2024-09-19T07:30:40.591 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T07:30:40.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:30:40.717 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911815' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRtvoCYtDDj8KEHFzMiLavIvWxUGRPHyLqumZtLhkYRzbmxHq0hLG+W6ZOWT9g+9kEZoym1dIMbKCA9paM5v8c= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNcTm093f+oS1hcqveC6LIFgFIei8SQYHKUzU/AvIGaCszN0409zUkeWq1828Ao+6SsUlFdPiAoEK2NJs3QTuw0= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnhd1ofbr7elYz7fZAt9BC3MrESizU2ocmOiY8F6El+7MvaBND7msN3OVzyyl3owNMhjlohgp6C5ceWlAjAoEw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T07:30:40.717 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T07:30:40.718 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T07:30:40.718 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T07:30:40.719 INFO:teuthology.task.internal:Checking packages... 2024-09-19T07:30:40.741 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T07:30:40.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T07:30:40.741 INFO:teuthology.packaging:ref: None 2024-09-19T07:30:40.741 INFO:teuthology.packaging:tag: None 2024-09-19T07:30:40.741 INFO:teuthology.packaging:branch: squid 2024-09-19T07:30:40.742 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:30:40.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T07:30:40.953 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T07:30:40.954 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T07:30:40.961 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T07:30:40.961 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T07:30:41.016 INFO:teuthology.task.internal:Saving configuration 2024-09-19T07:30:41.036 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T07:30:41.044 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T07:30:41.067 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 07:25:11.760213', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRtvoCYtDDj8KEHFzMiLavIvWxUGRPHyLqumZtLhkYRzbmxHq0hLG+W6ZOWT9g+9kEZoym1dIMbKCA9paM5v8c='} 2024-09-19T07:30:41.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 07:25:11.762042', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNcTm093f+oS1hcqveC6LIFgFIei8SQYHKUzU/AvIGaCszN0409zUkeWq1828Ao+6SsUlFdPiAoEK2NJs3QTuw0='} 2024-09-19T07:30:41.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 07:25:11.763646', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnhd1ofbr7elYz7fZAt9BC3MrESizU2ocmOiY8F6El+7MvaBND7msN3OVzyyl3owNMhjlohgp6C5ceWlAjAoEw='} 2024-09-19T07:30:41.114 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T07:30:41.121 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T07:30:41.121 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T07:30:41.121 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T07:30:41.121 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T07:30:41.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f55569bfbe0>, signals=[15]) 2024-09-19T07:30:41.231 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T07:30:41.238 INFO:teuthology.task.internal:Opening connections... 2024-09-19T07:30:41.238 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:30:41.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:30:41.323 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-19T07:30:41.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:30:41.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-19T07:30:41.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:30:41.477 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T07:30:41.485 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-09-19T07:30:41.502 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-09-19T07:30:41.503 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-09-19T07:30:41.560 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:30:41.561 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:30:41.562 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-09-19T07:30:41.584 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-19T07:30:41.603 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-19T07:30:41.603 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:30:41.662 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-09-19T07:30:41.663 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:30:41.663 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:30:41.663 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:30:41.663 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:30:41.663 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:30:41.663 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:30:41.664 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-19T07:30:41.693 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-19T07:30:41.712 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-19T07:30:41.712 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-19T07:30:41.771 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-19T07:30:41.771 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-19T07:30:41.771 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-19T07:30:41.771 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:30:41.771 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-19T07:30:41.771 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:30:41.772 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:30:41.772 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-19T07:30:41.793 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T07:30:41.803 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T07:30:41.844 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T07:30:41.844 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:30:41.847 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:30:41.850 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:30:41.866 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T07:30:41.889 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T07:30:41.889 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:30:41.904 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:30:41.907 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:30:41.929 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T07:30:42.009 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T07:30:42.024 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T07:30:42.024 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T07:30:42.024 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T07:30:42.024 DEBUG:teuthology.orchestra.run.smithi076:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:30:42.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:30:42.041 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-09-19T07:30:42.099 INFO:teuthology.orchestra.run.smithi076.stdout:5.14.0-503.el9.x86_64 2024-09-19T07:30:42.099 INFO:teuthology.task.kernel:Running kernel on smithi076: 5.14.0-503.el9.x86_64 2024-09-19T07:30:42.099 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum install -y kernel 2024-09-19T07:30:44.499 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T07:31:04.410 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-19T07:31:09.974 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-19T07:31:11.457 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-19T07:31:12.378 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T07:31:17.775 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-19T07:31:19.598 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T07:31:19.598 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T07:31:19.698 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:31:19.706 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-09-19T07:31:19.707 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-09-19T07:31:19.707 INFO:teuthology.orchestra.run.smithi076.stdout:Install 4 Packages 2024-09-19T07:31:19.707 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:31:19.707 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 79 M 2024-09-19T07:31:19.708 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 126 M 2024-09-19T07:31:19.708 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-09-19T07:31:20.094 INFO:teuthology.orchestra.run.smithi076.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 332 kB/s | 36 kB 00:00 2024-09-19T07:31:22.236 INFO:teuthology.orchestra.run.smithi076.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-09-19T07:31:24.235 INFO:teuthology.orchestra.run.smithi076.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 8.1 MB/s | 35 MB 00:04 2024-09-19T07:31:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.5 MB/s | 29 MB 00:04 2024-09-19T07:31:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:31:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:Total 16 MB/s | 79 MB 00:04 2024-09-19T07:31:25.188 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-09-19T07:31:25.554 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-09-19T07:31:25.554 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-09-19T07:31:26.517 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-09-19T07:31:26.517 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-09-19T07:31:28.980 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-09-19T07:31:29.602 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T07:31:29.693 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:31:32.458 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:31:32.593 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:31:37.420 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:31:37.543 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:31:42.361 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:32:20.489 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:32:20.529 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:32:20.918 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:32:20.918 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T07:32:20.918 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:32:20.918 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:32:21.759 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:32:21.760 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-09-19T07:32:22.108 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T07:32:22.203 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T07:32:22.203 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T07:32:22.203 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T07:32:22.204 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T07:32:22.204 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T07:32:22.204 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T07:32:22.204 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi076.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T07:32:22.204 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T07:32:22.263 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T07:32:22.264 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T07:32:22.264 DEBUG:teuthology.orchestra.run.smithi076:> sudo rpm -qi grub2-tools 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Name : grub2-tools 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Epoch : 1 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Version : 2.06 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Release : 82.el9 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Architecture: x86_64 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Group : Unspecified 2024-09-19T07:32:22.296 INFO:teuthology.orchestra.run.smithi076.stdout:Size : 8274670 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:License : GPLv3+ 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Packager : builder@centos.org 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Vendor : CentOS 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Summary : Support tools for GRUB. 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:Description : 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T07:32:22.297 INFO:teuthology.orchestra.run.smithi076.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T07:32:22.298 INFO:teuthology.orchestra.run.smithi076.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T07:32:22.298 INFO:teuthology.orchestra.run.smithi076.stdout:hardware devices. 2024-09-19T07:32:22.298 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:32:22.298 INFO:teuthology.orchestra.run.smithi076.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T07:32:22.299 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T07:32:22.299 INFO:teuthology.task.kernel:Updating grub on smithi076 to boot 5.14.0-508.el9.x86_64 2024-09-19T07:32:22.299 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T07:32:23.003 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2024-09-19T07:32:24.314 INFO:teuthology.orchestra.run.smithi076.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T07:32:24.345 INFO:teuthology.orchestra.run.smithi076.stderr:done 2024-09-19T07:32:24.348 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2024-09-19T07:32:24.364 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.rkPQAYGzYq 2024-09-19T07:32:24.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rkPQAYGzYq 2024-09-19T07:32:24.433 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.rkPQAYGzYq 2024-09-19T07:32:24.578 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.rkPQAYGzYq is 6KB 2024-09-19T07:32:24.627 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.rkPQAYGzYq 2024-09-19T07:32:24.642 DEBUG:teuthology.orchestra.run.smithi076:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T07:32:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T07:32:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T07:32:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T07:32:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T07:32:24.707 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T07:32:24.867 DEBUG:teuthology.orchestra.run.smithi076:> sudo shutdown -r now 2024-09-19T07:32:54.869 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T07:32:54.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-19T07:32:54.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:33:29.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-09-19T07:33:38.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-19T07:33:38.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:33:41.597 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-09-19T07:33:53.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-19T07:33:53.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:34:25.777 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-09-19T07:34:26.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-19T07:34:26.373 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T07:34:26.373 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-09-19T07:34:26.406 INFO:teuthology.orchestra.run.smithi076.stdout:5.14.0-508.el9.x86_64 2024-09-19T07:34:26.406 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T07:34:26.406 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T07:34:26.406 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T07:34:27.407 DEBUG:teuthology.parallel:result is None 2024-09-19T07:34:27.407 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T07:34:27.416 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T07:34:27.416 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:34:27.419 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:34:27.422 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:34:27.441 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T07:34:27.475 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T07:34:27.623 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T07:34:27.624 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:34:27.627 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:34:27.630 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:34:27.833 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T07:34:27.839 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T07:34:27.839 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:34:27.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:34:27.857 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:34:27.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:34:27.875 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:34:27.877 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:34:27.900 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:34:27.932 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:34:27.947 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:34:27.952 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:34:27.953 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:34:27.973 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:34:27.982 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:34:27.984 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T07:34:27.992 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T07:34:27.992 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:34:27.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:34:27.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:34:28.042 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T07:34:28.199 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T07:34:28.199 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:34:28.202 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:34:28.204 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:34:28.221 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:34:28.299 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:34:28.343 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:34:28.427 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:34:28.465 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:34:28.466 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:34:28.530 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:34:28.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:34:28.632 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:34:28.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:34:28.762 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:34:28.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:34:28.829 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:34:28.876 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:34:28.926 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:34:29.010 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:34:29.053 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:34:29.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:34:29.120 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2024-09-19T07:34:29.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-19T07:34:29.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-19T07:34:29.166 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:34:29.196 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:34:29.213 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:34:29.601 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T07:34:29.608 INFO:teuthology.task.internal:Starting timer... 2024-09-19T07:34:29.608 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T07:34:29.646 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T07:34:29.713 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T07:34:29.713 DEBUG:teuthology.orchestra.run.smithi076:> sudo service auditd rotate 2024-09-19T07:34:29.767 INFO:teuthology.orchestra.run.smithi076.stdout:Rotating logs: 2024-09-19T07:34:29.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-09-19T07:34:29.814 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-09-19T07:34:29.816 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-19T07:34:29.861 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-19T07:34:29.864 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T07:34:29.864 DEBUG:teuthology.orchestra.run.smithi076:> /usr/sbin/getenforce 2024-09-19T07:34:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Permissive 2024-09-19T07:34:29.889 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-09-19T07:34:29.915 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-09-19T07:34:29.915 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-19T07:34:29.940 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-19T07:34:29.940 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi076.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-09-19T07:34:29.940 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:34:29.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:34:29.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:34:30.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:34:30.001 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:34:30.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:34:30.029 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T07:34:30.029 DEBUG:teuthology.orchestra.run.smithi076:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:34:30.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:34:30.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:34:30.126 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T07:34:30.135 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T07:34:30.138 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T07:34:30.261 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T07:34:30.277 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T07:34:30.279 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi076.front.sepia.ceph.com,smithi137.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T07:38:30.409 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-09-19T07:38:30.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-19T07:38:30.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:38:30.494 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-09-19T07:38:30.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-19T07:38:30.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-19T07:38:30.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:38:30.655 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-19T07:38:30.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-19T07:38:30.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-19T07:38:30.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:38:30.812 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-19T07:38:30.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-19T07:38:30.893 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T07:38:30.904 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T07:38:30.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:38:30.905 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:38:30.908 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:38:30.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:38:30.910 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:38:30.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:38:30.938 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:38:30.939 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:38:30.954 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:38:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:38:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:38:30.980 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:38:30.980 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: ntpd: command not found 2024-09-19T07:38:30.980 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-09-19T07:38:30.991 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-09-19T07:38:30.991 INFO:teuthology.orchestra.run.smithi076.stdout:506 Cannot talk to daemon 2024-09-19T07:38:31.004 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-19T07:38:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:38:31.006 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:38:31.016 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-19T07:38:31.019 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:38:31.020 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:38:31.030 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:38:31.044 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:38:31.081 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:38:31.082 INFO:teuthology.orchestra.run.smithi076.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:38:31.086 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:38:31.086 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-09-19T07:38:31.086 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.086 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.086 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.086 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.087 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:38:31.087 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-19T07:38:31.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.100 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:38:31.103 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:38:31.104 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-19T07:38:31.104 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.104 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.104 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.104 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:38:31.104 INFO:teuthology.run_tasks:Running task install... 2024-09-19T07:38:31.112 DEBUG:teuthology.task.install:project ceph 2024-09-19T07:38:31.112 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T07:38:31.112 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T07:38:31.112 INFO:teuthology.task.install:Using flavor: default 2024-09-19T07:38:31.118 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T07:38:31.118 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T07:38:31.119 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:38:31.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:38:31.122 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:38:31.122 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:38:31.122 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:38:31.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:38:31.276 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:38:31.276 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:38:31.280 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:38:31.280 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:38:31.284 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:38:31.284 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:38:31.390 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:38:31.390 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:38:31.390 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:38:31.396 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:38:31.396 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:38:31.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:38:31.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:38:31.403 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:38:31.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:38:31.416 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:38:31.416 DEBUG:teuthology.orchestra.run.smithi076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:38:31.422 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:38:31.422 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:38:31.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:38:31.430 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:38:31.482 DEBUG:teuthology.orchestra.run.smithi076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:38:31.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:38:31.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:38:31.558 DEBUG:teuthology.orchestra.run.smithi076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:38:31.563 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:38:31.573 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:38:31.622 INFO:teuthology.orchestra.run.smithi076.stdout:check_obsoletes = 1 2024-09-19T07:38:31.624 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum clean all 2024-09-19T07:38:31.627 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-09-19T07:38:31.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-09-19T07:38:31.637 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-19T07:38:31.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-19T07:38:31.853 INFO:teuthology.orchestra.run.smithi137.stdout:45 files removed 2024-09-19T07:38:31.860 INFO:teuthology.orchestra.run.smithi076.stdout:45 files removed 2024-09-19T07:38:31.864 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-19T07:38:31.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:38:31.889 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:38:31.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:38:32.429 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T07:38:32.444 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-19T07:38:32.453 INFO:teuthology.orchestra.run.smithi076.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-19T07:38:32.697 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-19T07:38:32.721 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-19T07:38:32.737 INFO:teuthology.orchestra.run.smithi076.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T07:38:32.964 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T07:38:32.987 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T07:38:33.005 INFO:teuthology.orchestra.run.smithi076.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T07:38:34.772 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-19T07:38:35.054 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.3 MB 00:02 2024-09-19T07:38:35.455 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.3 MB 00:02 2024-09-19T07:38:38.340 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 20 MB 00:02 2024-09-19T07:38:40.614 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-19T07:38:42.465 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 20 MB 00:05 2024-09-19T07:38:42.674 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T07:38:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-19T07:38:45.204 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T07:38:46.381 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-19T07:38:46.998 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.5 MB 00:00 2024-09-19T07:38:47.848 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-19T07:38:48.382 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 19 kB 00:00 2024-09-19T07:38:48.836 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T07:38:49.453 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-19T07:38:50.593 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T07:38:52.770 INFO:teuthology.orchestra.run.smithi076.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:38:52.770 INFO:teuthology.orchestra.run.smithi076.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:38:52.782 INFO:teuthology.orchestra.run.smithi076.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:38:52.783 INFO:teuthology.orchestra.run.smithi076.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:38:52.784 INFO:teuthology.orchestra.run.smithi076.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:38:52.785 INFO:teuthology.orchestra.run.smithi076.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:38:52.787 INFO:teuthology.orchestra.run.smithi076.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:38:52.789 INFO:teuthology.orchestra.run.smithi076.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:38:52.790 INFO:teuthology.orchestra.run.smithi076.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:38:52.852 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-09-19T07:38:52.866 INFO:teuthology.orchestra.run.smithi076.stdout:====================================================================================== 2024-09-19T07:38:52.866 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-09-19T07:38:52.866 INFO:teuthology.orchestra.run.smithi076.stdout:====================================================================================== 2024-09-19T07:38:52.866 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-09-19T07:38:52.866 INFO:teuthology.orchestra.run.smithi076.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:38:52.866 INFO:teuthology.orchestra.run.smithi076.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:38:52.867 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:38:52.868 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:38:52.869 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:38:52.870 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrading: 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:38:52.871 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:38:52.872 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:38:52.873 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:38:52.874 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:38:52.875 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:38:52.876 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:38:52.877 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:38:52.878 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:38:52.879 INFO:teuthology.orchestra.run.smithi076.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:38:52.880 INFO:teuthology.orchestra.run.smithi076.stdout:Installing weak dependencies: 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout:====================================================================================== 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout:Install 148 Packages 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 8 Packages 2024-09-19T07:38:52.881 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:38:52.882 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 226 M 2024-09-19T07:38:52.882 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-09-19T07:38:53.603 INFO:teuthology.orchestra.run.smithi076.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T07:38:53.811 INFO:teuthology.orchestra.run.smithi076.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.2 MB/s | 896 kB 00:00 2024-09-19T07:38:53.886 INFO:teuthology.orchestra.run.smithi076.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T07:38:54.020 INFO:teuthology.orchestra.run.smithi076.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 9.8 MB/s | 5.4 MB 00:00 2024-09-19T07:38:54.141 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-19T07:38:54.145 INFO:teuthology.orchestra.run.smithi076.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-19T07:38:54.187 INFO:teuthology.orchestra.run.smithi076.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-19T07:38:54.546 INFO:teuthology.orchestra.run.smithi076.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 20 MB/s | 21 MB 00:01 2024-09-19T07:38:54.630 INFO:teuthology.orchestra.run.smithi076.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.7 MB/s | 4.7 MB 00:00 2024-09-19T07:38:54.697 INFO:teuthology.orchestra.run.smithi076.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 379 kB/s | 25 kB 00:00 2024-09-19T07:38:54.842 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T07:38:55.130 INFO:teuthology.orchestra.run.smithi076.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 18 MB/s | 11 MB 00:00 2024-09-19T07:38:55.305 INFO:teuthology.orchestra.run.smithi076.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 15 MB/s | 17 MB 00:01 2024-09-19T07:38:55.330 INFO:teuthology.orchestra.run.smithi076.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.1 MB/s | 228 kB 00:00 2024-09-19T07:38:55.356 INFO:teuthology.orchestra.run.smithi076.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 539 kB/s | 27 kB 00:00 2024-09-19T07:38:55.381 INFO:teuthology.orchestra.run.smithi076.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 630 kB/s | 32 kB 00:00 2024-09-19T07:38:55.431 INFO:teuthology.orchestra.run.smithi076.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T07:38:55.456 INFO:teuthology.orchestra.run.smithi076.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T07:38:55.482 INFO:teuthology.orchestra.run.smithi076.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T07:38:55.532 INFO:teuthology.orchestra.run.smithi076.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T07:38:55.591 INFO:teuthology.orchestra.run.smithi076.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 775 kB/s | 45 kB 00:00 2024-09-19T07:38:55.658 INFO:teuthology.orchestra.run.smithi076.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T07:38:55.742 INFO:teuthology.orchestra.run.smithi076.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-19T07:38:55.767 INFO:teuthology.orchestra.run.smithi076.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.5 MB/s | 161 kB 00:00 2024-09-19T07:38:55.792 INFO:teuthology.orchestra.run.smithi076.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T07:38:55.821 INFO:teuthology.orchestra.run.smithi076.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T07:38:55.843 INFO:teuthology.orchestra.run.smithi076.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T07:38:55.868 INFO:teuthology.orchestra.run.smithi076.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T07:38:55.927 INFO:teuthology.orchestra.run.smithi076.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T07:38:56.002 INFO:teuthology.orchestra.run.smithi076.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T07:38:56.027 INFO:teuthology.orchestra.run.smithi076.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 318 kB/s | 32 kB 00:00 2024-09-19T07:38:56.052 INFO:teuthology.orchestra.run.smithi076.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T07:38:56.337 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:38:56.337 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:38:56.351 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:38:56.352 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:38:56.353 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:38:56.354 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:38:56.355 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:38:56.358 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:38:56.359 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:38:56.378 INFO:teuthology.orchestra.run.smithi076.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 10 MB/s | 3.6 MB 00:00 2024-09-19T07:38:56.423 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-19T07:38:56.443 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-19T07:38:56.443 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-19T07:38:56.443 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-19T07:38:56.443 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-19T07:38:56.443 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:38:56.443 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:38:56.444 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:38:56.444 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:38:56.444 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:38:56.444 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:38:56.444 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:38:56.445 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:38:56.446 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:38:56.446 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:38:56.446 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:38:56.446 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:38:56.446 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:38:56.447 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:38:56.447 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:38:56.447 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:38:56.447 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:38:56.447 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:38:56.448 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:38:56.449 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:38:56.450 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:38:56.451 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:38:56.451 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:38:56.451 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:38:56.451 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:38:56.451 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:38:56.452 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:38:56.453 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:38:56.454 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:38:56.455 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:38:56.456 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:38:56.456 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:38:56.456 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:38:56.456 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:38:56.456 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:38:56.456 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:38:56.457 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:38:56.457 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:38:56.457 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:38:56.457 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:38:56.457 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:38:56.457 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:38:56.458 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:38:56.458 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:38:56.458 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:38:56.458 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:38:56.458 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:38:56.458 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:38:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:38:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:38:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:38:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:38:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:38:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:38:56.460 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:38:56.461 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:38:56.461 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:38:56.461 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:38:56.462 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:38:56.463 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:38:56.464 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout:Install 148 Packages 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 8 Packages 2024-09-19T07:38:56.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:38:56.466 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 226 M 2024-09-19T07:38:56.466 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-19T07:38:56.470 INFO:teuthology.orchestra.run.smithi076.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-19T07:38:56.495 INFO:teuthology.orchestra.run.smithi076.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.1 MB/s | 249 kB 00:00 2024-09-19T07:38:56.521 INFO:teuthology.orchestra.run.smithi076.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 983 kB/s | 49 kB 00:00 2024-09-19T07:38:56.546 INFO:teuthology.orchestra.run.smithi076.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 326 kB/s | 16 kB 00:00 2024-09-19T07:38:56.571 INFO:teuthology.orchestra.run.smithi076.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T07:38:56.613 INFO:teuthology.orchestra.run.smithi076.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 438 kB/s | 18 kB 00:00 2024-09-19T07:38:56.638 INFO:teuthology.orchestra.run.smithi076.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-19T07:38:56.722 INFO:teuthology.orchestra.run.smithi076.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-19T07:38:56.814 INFO:teuthology.orchestra.run.smithi076.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T07:38:56.847 INFO:teuthology.orchestra.run.smithi076.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-19T07:38:56.889 INFO:teuthology.orchestra.run.smithi076.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T07:38:56.940 INFO:teuthology.orchestra.run.smithi076.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-19T07:38:56.965 INFO:teuthology.orchestra.run.smithi076.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T07:38:56.986 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:38:56.987 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:38:56.998 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:38:56.998 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:38:56.999 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:38:57.000 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:38:57.002 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:38:57.004 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:38:57.005 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:38:57.007 INFO:teuthology.orchestra.run.smithi076.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T07:38:57.032 INFO:teuthology.orchestra.run.smithi076.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-19T07:38:57.067 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-19T07:38:57.079 INFO:teuthology.orchestra.run.smithi137.stdout:====================================================================================== 2024-09-19T07:38:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-19T07:38:57.080 INFO:teuthology.orchestra.run.smithi137.stdout:====================================================================================== 2024-09-19T07:38:57.080 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-19T07:38:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:38:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:38:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:38:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:38:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:38:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:38:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:38:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:38:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:38:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:38:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:38:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:38:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:38:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:38:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:38:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:38:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:38:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:38:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:38:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:38:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:38:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:38:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:38:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:38:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:38:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:38:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:38:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:38:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:38:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:38:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:38:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:38:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:38:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:38:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:38:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:38:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:38:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:38:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:38:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:38:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:38:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:38:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:38:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:38:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-19T07:38:57.103 INFO:teuthology.orchestra.run.smithi137.stdout:====================================================================================== 2024-09-19T07:38:57.104 INFO:teuthology.orchestra.run.smithi137.stdout:Install 148 Packages 2024-09-19T07:38:57.104 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 8 Packages 2024-09-19T07:38:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:38:57.105 INFO:teuthology.orchestra.run.smithi076.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T07:38:57.105 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 226 M 2024-09-19T07:38:57.106 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-19T07:38:57.576 INFO:teuthology.orchestra.run.smithi152.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T07:38:57.639 INFO:teuthology.orchestra.run.smithi076.stdout:(48/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 17 MB/s | 49 MB 00:02 2024-09-19T07:38:57.809 INFO:teuthology.orchestra.run.smithi152.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-19T07:38:57.902 INFO:teuthology.orchestra.run.smithi152.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T07:38:57.926 INFO:teuthology.orchestra.run.smithi152.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.2 MB/s | 145 kB 00:00 2024-09-19T07:38:57.987 INFO:teuthology.orchestra.run.smithi137.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 46 kB/s | 6.6 kB 00:00 2024-09-19T07:38:58.060 INFO:teuthology.orchestra.run.smithi152.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 2.4 MB 00:00 2024-09-19T07:38:58.194 INFO:teuthology.orchestra.run.smithi152.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.7 MB/s | 1.5 MB 00:00 2024-09-19T07:38:58.308 INFO:teuthology.orchestra.run.smithi076.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-19T07:38:58.327 INFO:teuthology.orchestra.run.smithi152.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-19T07:38:58.442 INFO:teuthology.orchestra.run.smithi076.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 489 kB/s | 689 kB 00:01 2024-09-19T07:38:58.475 INFO:teuthology.orchestra.run.smithi076.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 685 kB/s | 943 kB 00:01 2024-09-19T07:38:58.544 INFO:teuthology.orchestra.run.smithi137.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.6 MB/s | 896 kB 00:00 2024-09-19T07:38:58.586 INFO:teuthology.orchestra.run.smithi137.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 3.4 MB/s | 145 kB 00:00 2024-09-19T07:38:58.594 INFO:teuthology.orchestra.run.smithi152.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T07:38:58.644 INFO:teuthology.orchestra.run.smithi152.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 506 kB/s | 25 kB 00:00 2024-09-19T07:38:58.834 INFO:teuthology.orchestra.run.smithi076.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-19T07:38:58.945 INFO:teuthology.orchestra.run.smithi152.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T07:38:59.003 INFO:teuthology.orchestra.run.smithi152.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T07:38:59.034 INFO:teuthology.orchestra.run.smithi076.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-19T07:38:59.061 INFO:teuthology.orchestra.run.smithi137.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.0 MB/s | 2.4 MB 00:00 2024-09-19T07:38:59.070 INFO:teuthology.orchestra.run.smithi152.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 406 kB/s | 27 kB 00:00 2024-09-19T07:38:59.144 INFO:teuthology.orchestra.run.smithi152.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 432 kB/s | 32 kB 00:00 2024-09-19T07:38:59.236 INFO:teuthology.orchestra.run.smithi152.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T07:38:59.295 INFO:teuthology.orchestra.run.smithi137.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-09-19T07:38:59.301 INFO:teuthology.orchestra.run.smithi076.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 365 kB/s | 313 kB 00:00 2024-09-19T07:38:59.344 INFO:teuthology.orchestra.run.smithi152.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.5 MB/s | 163 kB 00:00 2024-09-19T07:38:59.345 INFO:teuthology.orchestra.run.smithi137.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.4 MB/s | 1.5 MB 00:00 2024-09-19T07:38:59.403 INFO:teuthology.orchestra.run.smithi152.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T07:38:59.503 INFO:teuthology.orchestra.run.smithi152.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.0 MB/s | 506 kB 00:00 2024-09-19T07:38:59.543 INFO:teuthology.orchestra.run.smithi076.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-19T07:38:59.768 INFO:teuthology.orchestra.run.smithi076.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-19T07:38:59.860 INFO:teuthology.orchestra.run.smithi076.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-19T07:39:00.037 INFO:teuthology.orchestra.run.smithi152.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 9.1 MB/s | 17 MB 00:01 2024-09-19T07:39:00.137 INFO:teuthology.orchestra.run.smithi152.stdout:(19/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 8.4 MB/s | 5.3 MB 00:00 2024-09-19T07:39:00.162 INFO:teuthology.orchestra.run.smithi152.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 361 kB/s | 45 kB 00:00 2024-09-19T07:39:00.187 INFO:teuthology.orchestra.run.smithi152.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T07:39:00.213 INFO:teuthology.orchestra.run.smithi152.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T07:39:00.238 INFO:teuthology.orchestra.run.smithi152.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T07:39:00.245 INFO:teuthology.orchestra.run.smithi137.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.0 MB/s | 4.7 MB 00:00 2024-09-19T07:39:00.271 INFO:teuthology.orchestra.run.smithi152.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T07:39:00.277 INFO:teuthology.orchestra.run.smithi076.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 218 kB/s | 160 kB 00:00 2024-09-19T07:39:00.297 INFO:teuthology.orchestra.run.smithi152.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T07:39:00.331 INFO:teuthology.orchestra.run.smithi152.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T07:39:00.377 INFO:teuthology.orchestra.run.smithi076.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-19T07:39:00.423 INFO:teuthology.orchestra.run.smithi152.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-19T07:39:00.506 INFO:teuthology.orchestra.run.smithi152.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 383 kB/s | 32 kB 00:00 2024-09-19T07:39:00.573 INFO:teuthology.orchestra.run.smithi152.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-19T07:39:00.607 INFO:teuthology.orchestra.run.smithi152.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.4 MB/s | 146 kB 00:00 2024-09-19T07:39:00.612 INFO:teuthology.orchestra.run.smithi137.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 17 MB 00:01 2024-09-19T07:39:00.687 INFO:teuthology.orchestra.run.smithi137.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 337 kB/s | 25 kB 00:00 2024-09-19T07:39:00.760 INFO:teuthology.orchestra.run.smithi076.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 738 kB/s | 662 kB 00:00 2024-09-19T07:39:00.928 INFO:teuthology.orchestra.run.smithi076.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-19T07:39:01.124 INFO:teuthology.orchestra.run.smithi152.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 20 MB/s | 49 MB 00:02 2024-09-19T07:39:01.191 INFO:teuthology.orchestra.run.smithi152.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.8 MB/s | 3.6 MB 00:00 2024-09-19T07:39:01.228 INFO:teuthology.orchestra.run.smithi076.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 611 kB/s | 581 kB 00:00 2024-09-19T07:39:01.241 INFO:teuthology.orchestra.run.smithi152.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.1 MB/s | 249 kB 00:00 2024-09-19T07:39:01.258 INFO:teuthology.orchestra.run.smithi152.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 738 kB/s | 49 kB 00:00 2024-09-19T07:39:01.317 INFO:teuthology.orchestra.run.smithi152.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 218 kB/s | 16 kB 00:00 2024-09-19T07:39:01.337 INFO:teuthology.orchestra.run.smithi076.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-19T07:39:01.344 INFO:teuthology.orchestra.run.smithi152.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.3 MB/s | 285 kB 00:00 2024-09-19T07:39:01.434 INFO:teuthology.orchestra.run.smithi152.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 199 kB/s | 18 kB 00:00 2024-09-19T07:39:01.534 INFO:teuthology.orchestra.run.smithi152.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-19T07:39:01.559 INFO:teuthology.orchestra.run.smithi152.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 3.1 MB/s | 765 kB 00:00 2024-09-19T07:39:01.618 INFO:teuthology.orchestra.run.smithi152.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 434 kB/s | 80 kB 00:00 2024-09-19T07:39:01.693 INFO:teuthology.orchestra.run.smithi152.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T07:39:01.704 INFO:teuthology.orchestra.run.smithi076.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 377 kB/s | 292 kB 00:00 2024-09-19T07:39:01.718 INFO:teuthology.orchestra.run.smithi152.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T07:39:01.761 INFO:teuthology.orchestra.run.smithi152.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-19T07:39:01.786 INFO:teuthology.orchestra.run.smithi152.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T07:39:01.828 INFO:teuthology.orchestra.run.smithi152.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T07:39:01.853 INFO:teuthology.orchestra.run.smithi152.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-19T07:39:01.904 INFO:teuthology.orchestra.run.smithi076.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-19T07:39:01.911 INFO:teuthology.orchestra.run.smithi152.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-19T07:39:01.971 INFO:teuthology.orchestra.run.smithi076.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-19T07:39:01.995 INFO:teuthology.orchestra.run.smithi152.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-09-19T07:39:02.112 INFO:teuthology.orchestra.run.smithi152.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-19T07:39:02.162 INFO:teuthology.orchestra.run.smithi152.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-19T07:39:02.187 INFO:teuthology.orchestra.run.smithi152.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-19T07:39:02.238 INFO:teuthology.orchestra.run.smithi152.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-19T07:39:02.271 INFO:teuthology.orchestra.run.smithi152.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-19T07:39:02.305 INFO:teuthology.orchestra.run.smithi152.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-19T07:39:02.322 INFO:teuthology.orchestra.run.smithi152.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-19T07:39:02.346 INFO:teuthology.orchestra.run.smithi137.stdout:(10/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 29 MB/s | 49 MB 00:01 2024-09-19T07:39:02.387 INFO:teuthology.orchestra.run.smithi152.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-19T07:39:02.389 INFO:teuthology.orchestra.run.smithi152.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-19T07:39:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T07:39:02.406 INFO:teuthology.orchestra.run.smithi152.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-09-19T07:39:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 543 kB/s | 27 kB 00:00 2024-09-19T07:39:02.532 INFO:teuthology.orchestra.run.smithi152.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-19T07:39:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:(13/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.6 MB/s | 11 MB 00:02 2024-09-19T07:39:02.573 INFO:teuthology.orchestra.run.smithi152.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-19T07:39:02.580 INFO:teuthology.orchestra.run.smithi137.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 237 kB/s | 32 kB 00:00 2024-09-19T07:39:02.590 INFO:teuthology.orchestra.run.smithi152.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T07:39:02.616 INFO:teuthology.orchestra.run.smithi152.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T07:39:02.630 INFO:teuthology.orchestra.run.smithi137.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T07:39:02.664 INFO:teuthology.orchestra.run.smithi137.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T07:39:02.674 INFO:teuthology.orchestra.run.smithi152.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T07:39:02.689 INFO:teuthology.orchestra.run.smithi137.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T07:39:02.699 INFO:teuthology.orchestra.run.smithi152.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T07:39:02.739 INFO:teuthology.orchestra.run.smithi137.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T07:39:02.758 INFO:teuthology.orchestra.run.smithi152.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2024-09-19T07:39:02.775 INFO:teuthology.orchestra.run.smithi152.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-19T07:39:02.806 INFO:teuthology.orchestra.run.smithi137.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 676 kB/s | 45 kB 00:00 2024-09-19T07:39:02.821 INFO:teuthology.orchestra.run.smithi076.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-19T07:39:02.906 INFO:teuthology.orchestra.run.smithi137.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 25 MB/s | 5.3 MB 00:00 2024-09-19T07:39:02.932 INFO:teuthology.orchestra.run.smithi137.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 1.1 MB/s | 136 kB 00:00 2024-09-19T07:39:02.957 INFO:teuthology.orchestra.run.smithi137.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T07:39:02.980 INFO:teuthology.orchestra.run.smithi076.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:01 2024-09-19T07:39:03.007 INFO:teuthology.orchestra.run.smithi137.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 4.2 MB/s | 320 kB 00:00 2024-09-19T07:39:03.033 INFO:teuthology.orchestra.run.smithi137.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T07:39:03.033 INFO:teuthology.orchestra.run.smithi152.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-19T07:39:03.055 INFO:teuthology.orchestra.run.smithi076.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-19T07:39:03.057 INFO:teuthology.orchestra.run.smithi137.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T07:39:03.075 INFO:teuthology.orchestra.run.smithi137.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 2.0 MB/s | 85 kB 00:00 2024-09-19T07:39:03.125 INFO:teuthology.orchestra.run.smithi137.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-19T07:39:03.175 INFO:teuthology.orchestra.run.smithi137.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 637 kB/s | 32 kB 00:00 2024-09-19T07:39:03.209 INFO:teuthology.orchestra.run.smithi152.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-19T07:39:03.225 INFO:teuthology.orchestra.run.smithi137.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T07:39:03.267 INFO:teuthology.orchestra.run.smithi152.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T07:39:03.401 INFO:teuthology.orchestra.run.smithi137.stdout:(30/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 20 MB/s | 3.6 MB 00:00 2024-09-19T07:39:03.434 INFO:teuthology.orchestra.run.smithi152.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-09-19T07:39:03.518 INFO:teuthology.orchestra.run.smithi137.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 6.7 MB/s | 3.1 MB 00:00 2024-09-19T07:39:03.568 INFO:teuthology.orchestra.run.smithi137.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T07:39:03.604 INFO:teuthology.orchestra.run.smithi152.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-19T07:39:03.651 INFO:teuthology.orchestra.run.smithi152.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T07:39:03.660 INFO:teuthology.orchestra.run.smithi137.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 29 MB/s | 7.4 MB 00:00 2024-09-19T07:39:03.677 INFO:teuthology.orchestra.run.smithi137.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 454 kB/s | 49 kB 00:00 2024-09-19T07:39:03.694 INFO:teuthology.orchestra.run.smithi137.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 493 kB/s | 16 kB 00:00 2024-09-19T07:39:03.753 INFO:teuthology.orchestra.run.smithi137.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T07:39:03.755 INFO:teuthology.orchestra.run.smithi076.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 975 kB/s | 910 kB 00:00 2024-09-19T07:39:03.778 INFO:teuthology.orchestra.run.smithi137.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-19T07:39:03.781 INFO:teuthology.orchestra.run.smithi076.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 172 kB/s | 137 kB 00:00 2024-09-19T07:39:03.785 INFO:teuthology.orchestra.run.smithi152.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.6 MB/s | 4.9 MB 00:01 2024-09-19T07:39:03.795 INFO:teuthology.orchestra.run.smithi137.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 438 kB/s | 18 kB 00:00 2024-09-19T07:39:03.836 INFO:teuthology.orchestra.run.smithi152.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T07:39:03.895 INFO:teuthology.orchestra.run.smithi137.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 682 kB/s | 80 kB 00:00 2024-09-19T07:39:03.927 INFO:teuthology.orchestra.run.smithi152.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-19T07:39:03.954 INFO:teuthology.orchestra.run.smithi137.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T07:39:03.988 INFO:teuthology.orchestra.run.smithi137.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-19T07:39:04.013 INFO:teuthology.orchestra.run.smithi152.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T07:39:04.029 INFO:teuthology.orchestra.run.smithi137.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T07:39:04.071 INFO:teuthology.orchestra.run.smithi137.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T07:39:04.086 INFO:teuthology.orchestra.run.smithi152.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 7.1 MB/s | 5.8 MB 00:00 2024-09-19T07:39:04.111 INFO:teuthology.orchestra.run.smithi152.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-09-19T07:39:04.113 INFO:teuthology.orchestra.run.smithi137.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T07:39:04.137 INFO:teuthology.orchestra.run.smithi152.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T07:39:04.155 INFO:teuthology.orchestra.run.smithi137.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T07:39:04.187 INFO:teuthology.orchestra.run.smithi152.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-19T07:39:04.197 INFO:teuthology.orchestra.run.smithi137.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-19T07:39:04.212 INFO:teuthology.orchestra.run.smithi152.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-19T07:39:04.281 INFO:teuthology.orchestra.run.smithi076.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-19T07:39:04.296 INFO:teuthology.orchestra.run.smithi152.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T07:39:04.323 INFO:teuthology.orchestra.run.smithi137.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-09-19T07:39:04.373 INFO:teuthology.orchestra.run.smithi137.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-09-19T07:39:04.379 INFO:teuthology.orchestra.run.smithi152.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T07:39:04.456 INFO:teuthology.orchestra.run.smithi076.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 129 kB/s | 87 kB 00:00 2024-09-19T07:39:04.463 INFO:teuthology.orchestra.run.smithi152.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 926 kB/s | 77 kB 00:00 2024-09-19T07:39:04.555 INFO:teuthology.orchestra.run.smithi152.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.6 MB/s | 6.0 MB 00:00 2024-09-19T07:39:04.580 INFO:teuthology.orchestra.run.smithi152.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-19T07:39:04.581 INFO:teuthology.orchestra.run.smithi137.stdout:(49/156): ceph-common-19.1.1-361.g2f599a46.el9. 3.1 MB/s | 21 MB 00:06 2024-09-19T07:39:04.614 INFO:teuthology.orchestra.run.smithi152.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T07:39:04.625 INFO:teuthology.orchestra.run.smithi137.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-19T07:39:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-19T07:39:04.674 INFO:teuthology.orchestra.run.smithi137.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 356 kB/s | 107 kB 00:00 2024-09-19T07:39:04.698 INFO:teuthology.orchestra.run.smithi152.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-19T07:39:04.699 INFO:teuthology.orchestra.run.smithi137.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 185 kB/s | 22 kB 00:00 2024-09-19T07:39:04.715 INFO:teuthology.orchestra.run.smithi152.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T07:39:04.725 INFO:teuthology.orchestra.run.smithi137.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-19T07:39:04.748 INFO:teuthology.orchestra.run.smithi152.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T07:39:04.749 INFO:teuthology.orchestra.run.smithi137.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-19T07:39:04.783 INFO:teuthology.orchestra.run.smithi137.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-19T07:39:04.789 INFO:teuthology.orchestra.run.smithi076.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-19T07:39:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-19T07:39:04.816 INFO:teuthology.orchestra.run.smithi137.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-19T07:39:04.849 INFO:teuthology.orchestra.run.smithi152.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-19T07:39:04.850 INFO:teuthology.orchestra.run.smithi137.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-19T07:39:04.875 INFO:teuthology.orchestra.run.smithi137.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-19T07:39:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T07:39:04.934 INFO:teuthology.orchestra.run.smithi137.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T07:39:04.958 INFO:teuthology.orchestra.run.smithi152.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-19T07:39:04.985 INFO:teuthology.orchestra.run.smithi137.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-19T07:39:05.002 INFO:teuthology.orchestra.run.smithi137.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 363 kB/s | 24 kB 00:00 2024-09-19T07:39:05.008 INFO:teuthology.orchestra.run.smithi152.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-19T07:39:05.052 INFO:teuthology.orchestra.run.smithi137.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-19T07:39:05.073 INFO:teuthology.orchestra.run.smithi076.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-19T07:39:05.077 INFO:teuthology.orchestra.run.smithi137.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-19T07:39:05.103 INFO:teuthology.orchestra.run.smithi137.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-19T07:39:05.128 INFO:teuthology.orchestra.run.smithi137.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T07:39:05.133 INFO:teuthology.orchestra.run.smithi152.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-09-19T07:39:05.145 INFO:teuthology.orchestra.run.smithi137.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 569 kB/s | 38 kB 00:00 2024-09-19T07:39:05.159 INFO:teuthology.orchestra.run.smithi152.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-19T07:39:05.175 INFO:teuthology.orchestra.run.smithi152.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-19T07:39:05.209 INFO:teuthology.orchestra.run.smithi152.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T07:39:05.226 INFO:teuthology.orchestra.run.smithi152.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T07:39:05.237 INFO:teuthology.orchestra.run.smithi137.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T07:39:05.251 INFO:teuthology.orchestra.run.smithi152.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T07:39:05.304 INFO:teuthology.orchestra.run.smithi137.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-19T07:39:05.327 INFO:teuthology.orchestra.run.smithi152.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-19T07:39:05.363 INFO:teuthology.orchestra.run.smithi137.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-19T07:39:05.377 INFO:teuthology.orchestra.run.smithi152.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T07:39:05.388 INFO:teuthology.orchestra.run.smithi137.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-19T07:39:05.411 INFO:teuthology.orchestra.run.smithi152.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T07:39:05.427 INFO:teuthology.orchestra.run.smithi152.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-19T07:39:05.430 INFO:teuthology.orchestra.run.smithi137.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-19T07:39:05.448 INFO:teuthology.orchestra.run.smithi076.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-19T07:39:05.463 INFO:teuthology.orchestra.run.smithi137.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T07:39:05.489 INFO:teuthology.orchestra.run.smithi137.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T07:39:05.544 INFO:teuthology.orchestra.run.smithi152.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-19T07:39:05.581 INFO:teuthology.orchestra.run.smithi137.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-19T07:39:05.586 INFO:teuthology.orchestra.run.smithi152.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-19T07:39:05.597 INFO:teuthology.orchestra.run.smithi137.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-19T07:39:05.611 INFO:teuthology.orchestra.run.smithi152.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T07:39:05.615 INFO:teuthology.orchestra.run.smithi076.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 297 kB/s | 245 kB 00:00 2024-09-19T07:39:05.648 INFO:teuthology.orchestra.run.smithi152.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T07:39:05.681 INFO:teuthology.orchestra.run.smithi137.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-09-19T07:39:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-19T07:39:05.706 INFO:teuthology.orchestra.run.smithi137.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-19T07:39:05.729 INFO:teuthology.orchestra.run.smithi152.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-19T07:39:05.731 INFO:teuthology.orchestra.run.smithi137.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-19T07:39:05.757 INFO:teuthology.orchestra.run.smithi137.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-19T07:39:05.771 INFO:teuthology.orchestra.run.smithi152.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-19T07:39:05.788 INFO:teuthology.orchestra.run.smithi152.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T07:39:05.790 INFO:teuthology.orchestra.run.smithi137.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-19T07:39:05.805 INFO:teuthology.orchestra.run.smithi152.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T07:39:05.815 INFO:teuthology.orchestra.run.smithi137.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-19T07:39:05.822 INFO:teuthology.orchestra.run.smithi152.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 849 kB/s | 14 kB 00:00 2024-09-19T07:39:05.841 INFO:teuthology.orchestra.run.smithi137.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-19T07:39:05.847 INFO:teuthology.orchestra.run.smithi152.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.5 MB/s | 548 kB 00:00 2024-09-19T07:39:05.865 INFO:teuthology.orchestra.run.smithi076.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 313 kB/s | 248 kB 00:00 2024-09-19T07:39:05.872 INFO:teuthology.orchestra.run.smithi152.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T07:39:05.874 INFO:teuthology.orchestra.run.smithi137.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-19T07:39:05.906 INFO:teuthology.orchestra.run.smithi152.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.9 MB/s | 358 kB 00:00 2024-09-19T07:39:05.908 INFO:teuthology.orchestra.run.smithi137.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-19T07:39:05.931 INFO:teuthology.orchestra.run.smithi152.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-19T07:39:05.933 INFO:teuthology.orchestra.run.smithi137.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T07:39:05.957 INFO:teuthology.orchestra.run.smithi152.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T07:39:05.990 INFO:teuthology.orchestra.run.smithi152.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T07:39:06.000 INFO:teuthology.orchestra.run.smithi137.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-19T07:39:06.015 INFO:teuthology.orchestra.run.smithi152.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T07:39:06.025 INFO:teuthology.orchestra.run.smithi137.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-19T07:39:06.041 INFO:teuthology.orchestra.run.smithi152.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T07:39:06.051 INFO:teuthology.orchestra.run.smithi137.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-19T07:39:06.066 INFO:teuthology.orchestra.run.smithi152.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-19T07:39:06.076 INFO:teuthology.orchestra.run.smithi137.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T07:39:06.091 INFO:teuthology.orchestra.run.smithi152.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-19T07:39:06.101 INFO:teuthology.orchestra.run.smithi137.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-19T07:39:06.117 INFO:teuthology.orchestra.run.smithi152.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-19T07:39:06.126 INFO:teuthology.orchestra.run.smithi137.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-19T07:39:06.149 INFO:teuthology.orchestra.run.smithi076.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-19T07:39:06.151 INFO:teuthology.orchestra.run.smithi137.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-19T07:39:06.158 INFO:teuthology.orchestra.run.smithi152.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-19T07:39:06.177 INFO:teuthology.orchestra.run.smithi137.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-19T07:39:06.184 INFO:teuthology.orchestra.run.smithi152.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T07:39:06.209 INFO:teuthology.orchestra.run.smithi152.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:39:06.219 INFO:teuthology.orchestra.run.smithi137.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-19T07:39:06.244 INFO:teuthology.orchestra.run.smithi137.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T07:39:06.251 INFO:teuthology.orchestra.run.smithi152.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-19T07:39:06.270 INFO:teuthology.orchestra.run.smithi137.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 711 kB/s | 36 kB 00:00 2024-09-19T07:39:06.276 INFO:teuthology.orchestra.run.smithi152.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 865 kB/s | 58 kB 00:00 2024-09-19T07:39:06.302 INFO:teuthology.orchestra.run.smithi152.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-19T07:39:06.303 INFO:teuthology.orchestra.run.smithi137.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-19T07:39:06.327 INFO:teuthology.orchestra.run.smithi152.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T07:39:06.352 INFO:teuthology.orchestra.run.smithi152.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T07:39:06.353 INFO:teuthology.orchestra.run.smithi137.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-19T07:39:06.369 INFO:teuthology.orchestra.run.smithi152.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-19T07:39:06.379 INFO:teuthology.orchestra.run.smithi137.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-09-19T07:39:06.386 INFO:teuthology.orchestra.run.smithi152.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 914 kB/s | 31 kB 00:00 2024-09-19T07:39:06.403 INFO:teuthology.orchestra.run.smithi152.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T07:39:06.412 INFO:teuthology.orchestra.run.smithi137.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T07:39:06.428 INFO:teuthology.orchestra.run.smithi152.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-19T07:39:06.438 INFO:teuthology.orchestra.run.smithi137.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T07:39:06.453 INFO:teuthology.orchestra.run.smithi152.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T07:39:06.479 INFO:teuthology.orchestra.run.smithi152.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T07:39:06.504 INFO:teuthology.orchestra.run.smithi152.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T07:39:06.529 INFO:teuthology.orchestra.run.smithi152.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T07:39:06.555 INFO:teuthology.orchestra.run.smithi152.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-19T07:39:06.588 INFO:teuthology.orchestra.run.smithi152.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-19T07:39:06.596 INFO:teuthology.orchestra.run.smithi137.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-19T07:39:06.599 INFO:teuthology.orchestra.run.smithi076.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 172 kB 00:00 2024-09-19T07:39:06.613 INFO:teuthology.orchestra.run.smithi152.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T07:39:06.621 INFO:teuthology.orchestra.run.smithi137.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 214 kB/s | 45 kB 00:00 2024-09-19T07:39:06.655 INFO:teuthology.orchestra.run.smithi137.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 103 kB/s | 22 kB 00:00 2024-09-19T07:39:06.673 INFO:teuthology.orchestra.run.smithi152.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T07:39:06.699 INFO:teuthology.orchestra.run.smithi076.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-19T07:39:06.714 INFO:teuthology.orchestra.run.smithi137.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-19T07:39:06.739 INFO:teuthology.orchestra.run.smithi137.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-19T07:39:06.764 INFO:teuthology.orchestra.run.smithi137.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T07:39:06.781 INFO:teuthology.orchestra.run.smithi137.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-19T07:39:06.815 INFO:teuthology.orchestra.run.smithi137.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-19T07:39:06.832 INFO:teuthology.orchestra.run.smithi137.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-19T07:39:06.865 INFO:teuthology.orchestra.run.smithi137.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.8 MB/s | 151 kB 00:00 2024-09-19T07:39:06.898 INFO:teuthology.orchestra.run.smithi152.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T07:39:06.899 INFO:teuthology.orchestra.run.smithi137.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-09-19T07:39:06.948 INFO:teuthology.orchestra.run.smithi152.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T07:39:06.974 INFO:teuthology.orchestra.run.smithi137.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 839 kB 00:00 2024-09-19T07:39:06.999 INFO:teuthology.orchestra.run.smithi137.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-19T07:39:07.025 INFO:teuthology.orchestra.run.smithi137.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-09-19T07:39:07.050 INFO:teuthology.orchestra.run.smithi137.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-19T07:39:07.075 INFO:teuthology.orchestra.run.smithi137.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T07:39:07.101 INFO:teuthology.orchestra.run.smithi137.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T07:39:07.126 INFO:teuthology.orchestra.run.smithi137.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T07:39:07.151 INFO:teuthology.orchestra.run.smithi137.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T07:39:07.176 INFO:teuthology.orchestra.run.smithi137.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T07:39:07.210 INFO:teuthology.orchestra.run.smithi137.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T07:39:07.269 INFO:teuthology.orchestra.run.smithi137.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-19T07:39:07.294 INFO:teuthology.orchestra.run.smithi137.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-09-19T07:39:07.319 INFO:teuthology.orchestra.run.smithi137.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T07:39:07.345 INFO:teuthology.orchestra.run.smithi137.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-19T07:39:07.370 INFO:teuthology.orchestra.run.smithi137.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-19T07:39:07.395 INFO:teuthology.orchestra.run.smithi137.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-19T07:39:07.415 INFO:teuthology.orchestra.run.smithi152.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2024-09-19T07:39:07.420 INFO:teuthology.orchestra.run.smithi137.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T07:39:07.450 INFO:teuthology.orchestra.run.smithi076.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 334 kB/s | 250 kB 00:00 2024-09-19T07:39:07.454 INFO:teuthology.orchestra.run.smithi137.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T07:39:07.456 INFO:teuthology.orchestra.run.smithi152.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 985 kB/s | 41 kB 00:00 2024-09-19T07:39:07.488 INFO:teuthology.orchestra.run.smithi137.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-19T07:39:07.513 INFO:teuthology.orchestra.run.smithi137.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-19T07:39:07.538 INFO:teuthology.orchestra.run.smithi137.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-19T07:39:07.557 INFO:teuthology.orchestra.run.smithi152.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.5 MB/s | 2.3 MB 00:00 2024-09-19T07:39:07.563 INFO:teuthology.orchestra.run.smithi137.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-19T07:39:07.582 INFO:teuthology.orchestra.run.smithi152.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T07:39:07.589 INFO:teuthology.orchestra.run.smithi137.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T07:39:07.614 INFO:teuthology.orchestra.run.smithi137.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-19T07:39:07.639 INFO:teuthology.orchestra.run.smithi137.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T07:39:07.681 INFO:teuthology.orchestra.run.smithi137.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-19T07:39:07.707 INFO:teuthology.orchestra.run.smithi137.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 882 kB/s | 59 kB 00:00 2024-09-19T07:39:07.708 INFO:teuthology.orchestra.run.smithi076.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-19T07:39:07.732 INFO:teuthology.orchestra.run.smithi137.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T07:39:07.757 INFO:teuthology.orchestra.run.smithi137.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T07:39:07.782 INFO:teuthology.orchestra.run.smithi137.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-19T07:39:07.808 INFO:teuthology.orchestra.run.smithi137.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T07:39:07.833 INFO:teuthology.orchestra.run.smithi137.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T07:39:07.858 INFO:teuthology.orchestra.run.smithi137.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T07:39:07.875 INFO:teuthology.orchestra.run.smithi137.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T07:39:07.909 INFO:teuthology.orchestra.run.smithi137.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T07:39:07.941 INFO:teuthology.orchestra.run.smithi152.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-19T07:39:07.959 INFO:teuthology.orchestra.run.smithi137.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T07:39:08.241 INFO:teuthology.orchestra.run.smithi152.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-19T07:39:08.242 INFO:teuthology.orchestra.run.smithi076.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 281 kB/s | 222 kB 00:00 2024-09-19T07:39:08.301 INFO:teuthology.orchestra.run.smithi137.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 3.4 MB 00:00 2024-09-19T07:39:08.367 INFO:teuthology.orchestra.run.smithi076.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-09-19T07:39:08.418 INFO:teuthology.orchestra.run.smithi137.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.2 MB/s | 3.2 MB 00:00 2024-09-19T07:39:08.507 INFO:teuthology.orchestra.run.smithi137.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2024-09-19T07:39:08.568 INFO:teuthology.orchestra.run.smithi137.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 273 kB/s | 41 kB 00:00 2024-09-19T07:39:08.593 INFO:teuthology.orchestra.run.smithi137.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.8 MB/s | 249 kB 00:00 2024-09-19T07:39:08.660 INFO:teuthology.orchestra.run.smithi137.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-09-19T07:39:08.801 INFO:teuthology.orchestra.run.smithi076.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 76 kB/s | 42 kB 00:00 2024-09-19T07:39:08.827 INFO:teuthology.orchestra.run.smithi137.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-19T07:39:09.134 INFO:teuthology.orchestra.run.smithi076.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 351 kB/s | 269 kB 00:00 2024-09-19T07:39:09.277 INFO:teuthology.orchestra.run.smithi137.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-19T07:39:09.283 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:39:09.284 INFO:teuthology.orchestra.run.smithi137.stdout:Total 19 MB/s | 226 MB 00:12 2024-09-19T07:39:09.366 INFO:teuthology.orchestra.run.smithi152.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-09-19T07:39:09.371 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:39:09.372 INFO:teuthology.orchestra.run.smithi152.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-19T07:39:09.510 INFO:teuthology.orchestra.run.smithi076.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-09-19T07:39:09.918 INFO:teuthology.orchestra.run.smithi076.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 356 kB/s | 279 kB 00:00 2024-09-19T07:39:10.110 INFO:teuthology.orchestra.run.smithi076.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 85 kB/s | 51 kB 00:00 2024-09-19T07:39:10.484 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-19T07:39:10.510 INFO:teuthology.orchestra.run.smithi076.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 91 kB/s | 54 kB 00:00 2024-09-19T07:39:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-19T07:39:10.634 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-19T07:39:10.635 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-19T07:39:10.756 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-19T07:39:10.757 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-19T07:39:11.069 INFO:teuthology.orchestra.run.smithi076.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-19T07:39:11.528 INFO:teuthology.orchestra.run.smithi076.stdout:(93/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T07:39:11.753 INFO:teuthology.orchestra.run.smithi076.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 65 kB/s | 44 kB 00:00 2024-09-19T07:39:12.153 INFO:teuthology.orchestra.run.smithi076.stdout:(95/156): python3-jsonpatch-1.21-16.el9.noarch. 3.8 kB/s | 26 kB 00:06 2024-09-19T07:39:12.287 INFO:teuthology.orchestra.run.smithi076.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 291 kB/s | 221 kB 00:00 2024-09-19T07:39:12.312 INFO:teuthology.orchestra.run.smithi076.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 65 kB/s | 36 kB 00:00 2024-09-19T07:39:12.431 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-19T07:39:12.432 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-19T07:39:12.568 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-19T07:39:12.568 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-19T07:39:12.754 INFO:teuthology.orchestra.run.smithi076.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-09-19T07:39:12.921 INFO:teuthology.orchestra.run.smithi076.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2024-09-19T07:39:13.071 INFO:teuthology.orchestra.run.smithi076.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-19T07:39:13.430 INFO:teuthology.orchestra.run.smithi076.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-09-19T07:39:13.505 INFO:teuthology.orchestra.run.smithi076.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 299 kB/s | 22 kB 00:00 2024-09-19T07:39:13.547 INFO:teuthology.orchestra.run.smithi076.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-19T07:39:13.605 INFO:teuthology.orchestra.run.smithi076.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-19T07:39:13.639 INFO:teuthology.orchestra.run.smithi076.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T07:39:13.672 INFO:teuthology.orchestra.run.smithi076.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-09-19T07:39:13.707 INFO:teuthology.orchestra.run.smithi076.stdout:(107/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-19T07:39:13.731 INFO:teuthology.orchestra.run.smithi076.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-19T07:39:13.757 INFO:teuthology.orchestra.run.smithi076.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 540 kB/s | 26 kB 00:00 2024-09-19T07:39:13.790 INFO:teuthology.orchestra.run.smithi076.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T07:39:13.824 INFO:teuthology.orchestra.run.smithi076.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-19T07:39:13.850 INFO:teuthology.orchestra.run.smithi076.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-09-19T07:39:13.916 INFO:teuthology.orchestra.run.smithi076.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-19T07:39:13.950 INFO:teuthology.orchestra.run.smithi076.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-19T07:39:13.975 INFO:teuthology.orchestra.run.smithi076.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-09-19T07:39:14.000 INFO:teuthology.orchestra.run.smithi076.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-19T07:39:14.025 INFO:teuthology.orchestra.run.smithi076.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T07:39:14.067 INFO:teuthology.orchestra.run.smithi076.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T07:39:14.101 INFO:teuthology.orchestra.run.smithi076.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-19T07:39:14.127 INFO:teuthology.orchestra.run.smithi076.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-19T07:39:14.152 INFO:teuthology.orchestra.run.smithi076.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T07:39:14.227 INFO:teuthology.orchestra.run.smithi076.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-19T07:39:14.244 INFO:teuthology.orchestra.run.smithi076.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-19T07:39:14.269 INFO:teuthology.orchestra.run.smithi076.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-19T07:39:14.295 INFO:teuthology.orchestra.run.smithi076.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T07:39:14.320 INFO:teuthology.orchestra.run.smithi076.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-19T07:39:14.345 INFO:teuthology.orchestra.run.smithi076.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T07:39:14.371 INFO:teuthology.orchestra.run.smithi076.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T07:39:14.404 INFO:teuthology.orchestra.run.smithi076.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T07:39:14.429 INFO:teuthology.orchestra.run.smithi076.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:39:14.455 INFO:teuthology.orchestra.run.smithi076.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T07:39:14.489 INFO:teuthology.orchestra.run.smithi076.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T07:39:14.514 INFO:teuthology.orchestra.run.smithi076.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-19T07:39:14.547 INFO:teuthology.orchestra.run.smithi076.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T07:39:14.564 INFO:teuthology.orchestra.run.smithi076.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T07:39:14.589 INFO:teuthology.orchestra.run.smithi076.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-19T07:39:14.615 INFO:teuthology.orchestra.run.smithi076.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T07:39:14.657 INFO:teuthology.orchestra.run.smithi076.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-19T07:39:14.699 INFO:teuthology.orchestra.run.smithi076.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-19T07:39:14.724 INFO:teuthology.orchestra.run.smithi076.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2024-09-19T07:39:14.749 INFO:teuthology.orchestra.run.smithi076.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T07:39:14.775 INFO:teuthology.orchestra.run.smithi076.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-19T07:39:14.800 INFO:teuthology.orchestra.run.smithi076.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T07:39:14.825 INFO:teuthology.orchestra.run.smithi076.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T07:39:14.850 INFO:teuthology.orchestra.run.smithi076.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T07:39:14.876 INFO:teuthology.orchestra.run.smithi076.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T07:39:14.901 INFO:teuthology.orchestra.run.smithi076.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T07:39:14.943 INFO:teuthology.orchestra.run.smithi076.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T07:39:15.093 INFO:teuthology.orchestra.run.smithi076.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-09-19T07:39:15.177 INFO:teuthology.orchestra.run.smithi076.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-09-19T07:39:15.235 INFO:teuthology.orchestra.run.smithi076.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 706 kB/s | 41 kB 00:00 2024-09-19T07:39:15.294 INFO:teuthology.orchestra.run.smithi076.stdout:(152/156): librados2-19.1.1-361.g2f599a46.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-19T07:39:15.319 INFO:teuthology.orchestra.run.smithi076.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-19T07:39:15.386 INFO:teuthology.orchestra.run.smithi076.stdout:(154/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.5 MB/s | 3.2 MB 00:00 2024-09-19T07:39:15.437 INFO:teuthology.orchestra.run.smithi076.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-19T07:39:15.489 INFO:teuthology.orchestra.run.smithi076.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-19T07:39:15.493 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:39:15.493 INFO:teuthology.orchestra.run.smithi076.stdout:Total 10 MB/s | 226 MB 00:22 2024-09-19T07:39:16.699 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-09-19T07:39:16.856 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-09-19T07:39:16.856 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-09-19T07:39:18.761 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-19T07:39:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:39:18.919 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:39:18.972 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:39:19.007 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:39:19.021 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-19T07:39:19.032 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:39:19.083 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:39:19.119 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-09-19T07:39:19.119 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-09-19T07:39:19.120 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:39:19.158 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:39:19.211 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:39:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:39:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:39:19.313 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:39:19.405 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:39:19.516 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:39:19.634 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:39:19.638 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:39:19.659 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:39:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:39:19.754 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:39:19.789 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:39:19.877 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:39:19.906 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:39:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:39:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:39:19.997 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:39:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:39:20.026 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:39:20.124 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:39:20.147 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:39:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:39:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:39:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:39:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:39:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:39:20.259 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:39:20.346 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:39:20.369 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:39:20.448 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:39:20.450 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:39:20.470 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:39:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:39:20.598 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:39:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:39:20.705 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:39:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:20.819 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:39:20.890 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:20.962 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:39:21.066 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:21.114 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:21.164 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:39:21.325 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:39:21.361 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:39:21.387 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:21.404 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:39:21.469 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:39:21.498 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:39:21.514 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:39:21.546 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:39:21.589 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:39:21.599 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:39:21.622 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:39:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:39:21.654 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:39:21.670 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:39:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:39:21.735 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:39:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:39:21.788 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:39:21.803 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:39:21.819 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:39:21.839 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:39:21.863 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:39:21.895 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:39:21.915 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:39:21.923 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:39:21.949 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:39:21.992 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:39:21.993 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:39:22.021 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:39:22.046 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:39:22.076 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:39:22.092 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:39:22.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:39:22.139 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:39:22.203 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:39:22.214 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:39:22.247 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:39:22.290 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:39:22.319 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:39:22.347 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:39:22.390 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:39:22.400 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:39:22.433 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:39:22.508 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:39:22.640 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:39:22.702 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:39:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:39:23.012 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:39:23.041 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:39:23.083 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:39:23.122 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:39:23.163 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:39:23.226 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:39:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:39:23.315 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:39:23.344 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:39:23.358 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:39:23.387 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:39:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:39:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:39:23.477 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:39:23.483 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:39:23.509 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:39:23.545 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:39:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:39:23.628 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:39:23.647 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:39:23.671 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:39:23.713 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:39:23.719 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:39:23.773 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:39:23.846 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:39:23.849 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:39:23.878 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:39:23.898 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:39:23.914 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:39:23.939 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:39:23.961 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:39:24.005 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:39:24.050 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:39:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:39:24.082 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:39:24.098 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:39:24.121 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:39:24.147 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:39:24.181 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:39:24.233 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:39:24.256 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:39:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:39:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:39:24.381 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:39:24.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:39:24.690 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:39:24.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:39:24.775 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:39:24.792 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:39:24.809 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:39:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:39:24.849 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:39:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:39:24.889 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:39:24.918 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:39:24.936 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:39:24.953 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:39:24.986 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:39:25.029 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:39:25.062 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:39:25.067 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:39:25.106 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:39:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:39:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:39:25.167 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:39:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:39:25.207 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:39:25.223 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:39:25.255 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:39:25.285 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:39:25.319 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:39:25.328 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:39:25.352 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:39:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-09-19T07:39:25.382 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:39:25.394 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:39:25.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:39:25.468 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:39:25.514 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:39:25.516 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:39:25.559 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:39:25.577 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:39:25.599 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:39:25.618 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:39:25.643 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:39:25.700 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:39:25.700 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:39:25.757 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:39:26.034 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:39:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:39:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:39:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:39:26.289 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:39:26.320 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:39:26.342 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:39:26.388 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:39:26.466 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:39:26.475 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:39:26.501 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:39:26.523 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:39:26.537 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:39:26.546 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:39:26.588 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:39:26.613 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:39:26.643 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:39:26.687 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:39:26.706 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:39:26.729 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:39:26.743 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:39:26.788 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:39:26.807 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:39:26.819 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:39:26.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:39:26.880 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:39:26.908 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:39:26.916 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:39:27.013 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:39:27.043 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:39:27.100 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:39:27.105 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:39:27.127 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:39:27.130 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:39:27.146 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:39:27.208 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:39:27.296 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:39:27.458 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:39:27.487 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:39:27.570 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:39:27.617 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:39:27.736 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:27.810 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:39:27.961 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:39:28.045 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:39:28.154 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:39:28.255 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:39:28.291 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:39:28.325 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:39:28.390 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:39:28.435 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:39:28.475 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:39:28.519 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:39:28.551 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:39:28.579 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:39:28.640 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:39:28.702 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:39:28.732 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:39:28.776 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:39:28.794 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:39:28.852 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:39:28.875 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:39:28.886 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:39:28.902 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:39:28.935 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:39:28.938 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:39:28.966 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:39:29.028 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:39:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:39:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:39:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:39:29.247 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:39:29.283 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:39:29.298 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:39:29.298 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:39:29.319 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:39:29.350 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:39:29.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:39:29.389 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:39:29.420 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:39:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:39:29.677 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:39:29.715 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:39:29.789 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:39:29.820 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:39:29.856 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:39:29.881 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:39:29.938 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:39:29.971 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:39:30.009 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:39:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:39:30.052 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:39:30.089 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:39:30.132 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:39:30.139 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:39:30.169 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:39:30.309 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:39:30.340 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:39:30.368 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:39:30.376 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:39:30.422 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:39:30.430 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:39:30.453 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:39:30.504 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:39:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:39:30.572 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:39:30.618 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:39:30.654 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:39:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:39:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:39:30.885 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:39:30.924 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:39:30.965 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:39:31.069 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:39:31.101 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:39:31.141 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:39:31.181 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:39:31.206 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:39:31.300 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:39:31.433 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:39:31.472 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:39:31.500 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:39:31.539 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:39:31.577 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:39:31.608 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:39:31.638 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:39:31.673 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:39:31.706 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:39:31.748 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:39:31.782 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:39:31.868 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:39:31.922 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:39:31.952 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:39:32.056 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:39:32.112 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:39:32.490 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:32.552 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:32.794 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:32.832 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:39:32.833 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:32.875 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:39:32.926 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:39:33.026 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:39:33.089 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:39:33.095 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:33.132 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:39:33.134 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:39:33.220 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:39:33.220 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:39:33.220 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:39:33.220 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:33.221 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:39:33.247 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:39:33.253 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:39:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:39:33.439 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:39:33.476 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:39:33.508 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:39:33.508 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:39:33.508 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:39:33.508 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:33.545 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:39:33.554 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:39:34.199 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:39:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:39:35.705 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:39:35.784 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:39:35.812 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:39:35.845 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:39:36.156 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:39:36.199 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:39:36.290 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:39:36.321 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:39:36.357 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:39:36.838 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:39:36.877 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:39:36.948 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:39:36.971 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:39:39.286 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:39.326 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:39.874 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:39:39.912 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:39:39.989 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:39:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:39:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:39:39.989 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:40.030 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:39:44.948 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:39:44.948 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-09-19T07:39:44.949 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:45.125 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:39:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:39:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:39:45.141 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:45.429 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:39:45.430 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-19T07:39:45.430 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-19T07:39:45.430 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-19T07:39:45.430 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-19T07:39:45.431 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-19T07:39:45.431 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-19T07:39:45.431 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-19T07:39:45.431 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:45.613 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:39:45.629 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:39:45.629 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:45.629 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:39:45.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:46.586 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:39:46.613 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:39:46.613 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:46.613 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:39:46.614 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:39:46.614 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:39:46.614 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:46.837 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:39:46.859 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:39:46.860 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:46.860 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:39:46.860 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:39:46.860 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:39:46.860 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:47.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:39:47.142 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:39:47.142 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:47.142 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:39:47.142 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:39:47.142 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:39:47.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:47.296 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:39:47.319 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:39:47.319 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:47.320 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:39:47.320 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:39:47.320 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:39:47.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:47.393 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:39:47.414 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:39:47.414 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:47.414 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:39:47.414 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:39:47.414 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:39:47.414 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:47.426 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:39:47.482 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:39:47.538 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:39:47.725 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:39:47.780 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:39:47.850 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:39:47.858 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:39:47.873 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:39:47.873 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:47.873 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:39:47.873 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:39:47.873 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:39:47.874 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:47.965 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:39:47.988 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:39:48.053 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:39:48.108 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:39:48.110 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:39:48.163 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:39:48.196 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:39:48.223 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:39:48.293 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:39:48.342 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:39:48.419 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:39:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:39:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:39:48.637 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:39:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:39:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:39:48.692 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:39:48.724 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:39:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:39:48.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:39:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:39:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:39:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:39:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:39:49.227 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:39:49.256 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:39:49.826 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:39:49.862 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:39:50.305 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:39:50.342 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:39:50.828 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:39:50.863 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:39:50.967 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:39:51.125 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:39:51.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:39:51.173 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:39:51.173 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:51.173 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:39:51.173 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:39:51.173 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:39:51.173 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:51.224 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:39:51.236 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:39:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:39:51.324 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:39:51.334 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:39:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:39:51.435 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:39:51.596 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:39:51.627 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:39:51.651 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:39:51.651 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:51.651 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:39:51.651 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:39:51.651 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:39:51.651 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:51.711 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:39:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:39:51.828 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:39:51.882 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:39:51.882 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /sys 2024-09-19T07:39:51.882 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /proc 2024-09-19T07:39:51.882 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /mnt 2024-09-19T07:39:51.883 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /var/tmp 2024-09-19T07:39:51.883 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /home 2024-09-19T07:39:51.883 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /root 2024-09-19T07:39:51.883 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /tmp 2024-09-19T07:39:51.883 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:51.884 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:39:52.060 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:39:52.076 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:39:52.076 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.076 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:39:52.076 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:52.292 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:39:52.318 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:39:52.342 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:39:52.342 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.342 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:39:52.343 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:39:52.343 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:39:52.343 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:39:52.409 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:39:52.409 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.409 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:39:52.409 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:52.453 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:39:52.476 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:39:52.476 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.476 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:39:52.476 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:39:52.476 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:39:52.476 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:52.778 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:39:52.802 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:39:52.802 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.802 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:39:52.802 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:39:52.802 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:39:52.803 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:39:52.809 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:39:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:39:52.870 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:39:52.870 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.871 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:39:52.871 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:39:52.871 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:39:52.871 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:52.914 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:39:52.937 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:39:52.937 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:52.937 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:39:52.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:52.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:39:53.004 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:39:53.004 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:53.005 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:39:53.005 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:39:53.005 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:39:53.005 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:39:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:39:53.331 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:53.331 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:39:53.331 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:39:53.331 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:39:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:39:53.554 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:39:53.581 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:39:53.582 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:53.582 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:39:53.582 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:39:53.582 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:39:53.582 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:53.813 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:39:53.837 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:39:53.837 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:53.837 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:39:53.837 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:39:53.837 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:39:53.837 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:54.272 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:39:54.296 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:39:54.296 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:54.296 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:39:54.296 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:39:54.296 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:39:54.296 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:54.411 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:39:54.484 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:39:54.539 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:39:54.732 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:39:54.781 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:39:54.859 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:39:54.947 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:39:55.077 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:39:55.141 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:39:55.172 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:39:55.199 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:39:55.696 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:39:55.723 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:39:55.755 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:39:55.818 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:39:55.846 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:39:56.904 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:39:56.932 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:39:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:39:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:39:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:39:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:39:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:39:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:39:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:39:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:39:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:39:57.784 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:39:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:39:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:39:57.895 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:39:57.932 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:39:57.942 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:39:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:39:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:39:58.034 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:39:58.190 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:39:58.193 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:39:58.218 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:39:58.231 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:39:58.241 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:39:58.241 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:58.241 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:39:58.241 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:39:58.241 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:39:58.241 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:58.262 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:39:58.285 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:39:58.291 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:39:58.296 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:39:58.337 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:39:58.380 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:39:58.404 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:39:58.415 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:39:58.436 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:39:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:39:58.911 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:39:58.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:39:58.971 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:39:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:39:59.353 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:39:59.382 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:39:59.394 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:39:59.412 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:39:59.437 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:39:59.437 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:59.437 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:39:59.437 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:39:59.437 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:39:59.437 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:59.478 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:39:59.479 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:39:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:39:59.502 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:59.503 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:39:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:59.515 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:39:59.540 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:39:59.547 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:39:59.567 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:39:59.567 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:39:59.570 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:39:59.570 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:59.570 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:39:59.570 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:39:59.571 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:39:59.571 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:59.659 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:39:59.659 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:39:59.743 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:39:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:39:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:39:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:39:59.801 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:39:59.880 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:39:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:39:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:39:59.904 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:39:59.904 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:39:59.905 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:39:59.905 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:39:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:39:59.921 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:39:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:39:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:40:00.005 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:40:00.037 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:40:00.042 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:40:00.067 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:40:00.093 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:40:00.093 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:40:00.099 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:00.169 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:40:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:40:00.261 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:40:00.286 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:40:00.291 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:40:00.291 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:40:00.471 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:40:00.471 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:40:00.555 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:40:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:04.477 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:40:04.518 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:40:04.558 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:40:04.591 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:40:04.618 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:40:04.815 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:40:04.858 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:40:04.887 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:40:04.917 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:40:04.955 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:40:05.604 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:40:05.644 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:40:05.665 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:40:05.666 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:40:05.667 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:40:05.668 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:40:05.669 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:40:05.670 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:40:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:40:05.672 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:40:05.673 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:40:05.674 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:40:05.675 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:40:05.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:40:05.677 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:40:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:40:05.679 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:40:06.425 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:40:06.426 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:40:06.427 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:40:06.439 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:40:06.439 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:40:06.439 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:40:06.439 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:40:06.439 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:40:06.440 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:40:06.441 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:40:06.442 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:40:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:40:06.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:40:06.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:40:06.446 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:40:06.447 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:40:06.448 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:40:06.448 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:40:06.448 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:40:06.448 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:40:06.449 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:40:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:40:06.451 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:40:06.452 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:40:06.453 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:40:06.454 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:40:06.454 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:40:06.454 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:40:06.454 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:40:06.565 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:40:06.649 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:40:06.701 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:40:06.803 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:40:06.835 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:40:06.862 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:40:06.887 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:40:06.887 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:40:06.979 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:40:06.979 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:40:07.063 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:40:07.088 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:40:07.093 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:40:07.093 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:40:07.273 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:40:07.274 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:40:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:40:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:08.151 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-19T07:40:08.152 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.153 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.154 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:40:08.155 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:40:08.156 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:40:08.157 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:40:08.157 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.158 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.158 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:40:08.158 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.160 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:40:08.160 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:40:08.160 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:40:08.160 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:40:08.161 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:40:08.162 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:40:08.163 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:40:08.164 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.165 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:40:08.166 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:40:08.167 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:40:08.168 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:40:08.168 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:40:08.168 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:40:08.168 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:40:08.168 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-19T07:40:08.580 DEBUG:teuthology.parallel:result is None 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.298 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.299 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.300 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:40:09.301 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:40:09.302 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:40:09.303 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:40:09.305 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:40:09.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:40:09.307 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:40:09.308 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.309 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:40:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:40:09.311 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-19T07:40:09.698 DEBUG:teuthology.parallel:result is None 2024-09-19T07:40:13.205 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:13.206 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:40:13.206 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:40:13.206 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:40:13.206 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:40:13.207 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:40:13.208 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:40:13.209 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:40:13.210 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:40:13.211 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:40:13.211 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:40:13.211 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:40:13.211 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:40:13.211 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:40:13.211 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:40:13.212 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:40:13.213 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:40:13.214 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:40:13.215 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:40:13.216 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:40:13.217 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:40:13.218 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:40:13.219 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:40:13.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:40:13.221 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:40:13.222 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:40:13.223 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:40:15.979 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:40:15.979 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:40:15.980 INFO:teuthology.orchestra.run.smithi076.stdout:Upgraded: 2024-09-19T07:40:15.980 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:15.980 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:15.981 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:15.981 INFO:teuthology.orchestra.run.smithi076.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:40:15.981 INFO:teuthology.orchestra.run.smithi076.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.981 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.982 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.983 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.984 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:40:15.985 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:40:15.986 INFO:teuthology.orchestra.run.smithi076.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:40:15.986 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:40:15.986 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:40:15.986 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:40:15.986 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.986 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:40:15.987 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:40:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.989 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:40:15.990 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:40:15.991 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:40:15.992 INFO:teuthology.orchestra.run.smithi076.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:40:15.993 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:40:15.994 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:40:15.995 INFO:teuthology.orchestra.run.smithi076.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:40:15.996 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:40:15.996 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:40:15.996 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:40:15.996 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:40:15.996 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-09-19T07:40:16.462 DEBUG:teuthology.parallel:result is None 2024-09-19T07:40:16.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:40:16.613 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:40:16.635 INFO:teuthology.orchestra.run.smithi076.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:40:16.636 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:40:16.636 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:40:16.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:40:16.777 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:40:16.803 INFO:teuthology.orchestra.run.smithi137.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:40:16.804 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:40:16.804 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:40:16.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:40:16.946 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:40:16.973 INFO:teuthology.orchestra.run.smithi152.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:40:16.973 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:40:16.974 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:40:16.975 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T07:40:16.975 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:40:16.976 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:40:17.003 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:40:17.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:40:17.036 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:40:17.036 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:40:17.069 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T07:40:17.069 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:40:17.069 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:40:17.095 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:40:17.161 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:40:17.161 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:40:17.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:40:17.260 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:40:17.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:40:17.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:40:17.360 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T07:40:17.360 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:40:17.360 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:40:17.386 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:40:17.452 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:40:17.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:40:17.481 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:40:17.549 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:40:17.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:40:17.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:40:17.646 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T07:40:17.647 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:40:17.647 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:40:17.672 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:40:17.739 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:40:17.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:40:17.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:40:17.835 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:40:17.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:40:17.865 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:40:17.935 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T07:40:18.065 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T07:40:18.066 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:40:18.066 INFO:tasks.cephadm:Cluster fsid is 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:40:18.066 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T07:40:18.067 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.76', 'mon.b': '172.21.15.137', 'mon.c': '172.21.15.152'} 2024-09-19T07:40:18.067 INFO:tasks.cephadm:First mon is mon.a on smithi076 2024-09-19T07:40:18.067 INFO:tasks.cephadm:First mgr is x 2024-09-19T07:40:18.067 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T07:40:18.067 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname $(hostname -s) 2024-09-19T07:40:18.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname $(hostname -s) 2024-09-19T07:40:18.124 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-09-19T07:40:18.155 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T07:40:18.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:40:18.307 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T07:40:18.450 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:40:18.451 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T07:40:18.452 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T07:40:18.452 DEBUG:teuthology.orchestra.run.smithi076:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:18.842 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:40 /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:18.842 DEBUG:teuthology.orchestra.run.smithi137:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.249 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:40 /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.249 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:40 /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.653 DEBUG:teuthology.orchestra.run.smithi076:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.673 DEBUG:teuthology.orchestra.run.smithi137:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.693 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:40:19.729 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T07:40:19.729 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:40:19.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:40:19.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:40:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:40:21.431 INFO:teuthology.orchestra.run.smithi076.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:40:49.127 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-19T07:40:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:40:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:40:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "repo_digests": [ 2024-09-19T07:40:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:40:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-19T07:40:49.128 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-19T07:41:16.310 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-19T07:41:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:41:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:41:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-09-19T07:41:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:41:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-19T07:41:16.311 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-19T07:41:29.239 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:41:29.239 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:41:29.239 INFO:teuthology.orchestra.run.smithi076.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:41:29.239 INFO:teuthology.orchestra.run.smithi076.stdout: "repo_digests": [ 2024-09-19T07:41:29.239 INFO:teuthology.orchestra.run.smithi076.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:41:29.240 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T07:41:29.240 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:41:29.265 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph 2024-09-19T07:41:29.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph 2024-09-19T07:41:29.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-09-19T07:41:29.389 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /etc/ceph 2024-09-19T07:41:29.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /etc/ceph 2024-09-19T07:41:29.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-09-19T07:41:29.474 INFO:tasks.cephadm:Writing seed config... 2024-09-19T07:41:29.477 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-19T07:41:29.477 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T07:41:29.477 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T07:41:29.477 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T07:41:29.478 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T07:41:29.478 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T07:41:29.478 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T07:41:29.478 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T07:41:29.478 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T07:41:29.478 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T07:41:29.479 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T07:41:29.479 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T07:41:29.479 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T07:41:29.479 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T07:41:29.479 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T07:41:29.480 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T07:41:29.480 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T07:41:29.480 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T07:41:29.480 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T07:41:29.480 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T07:41:29.480 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T07:41:29.481 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T07:41:29.482 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T07:41:29.482 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T07:41:29.482 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T07:41:29.482 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T07:41:29.482 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T07:41:29.483 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T07:41:29.484 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T07:41:29.485 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:41:29.485 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T07:41:29.501 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6aad871c-765a-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T07:41:29.501 DEBUG:teuthology.orchestra.run.smithi076:mon.a> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T07:41:29.544 DEBUG:teuthology.orchestra.run.smithi076:mgr.x> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T07:41:29.587 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T07:41:29.588 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.76 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:41:29.789 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:41:29.789 INFO:teuthology.orchestra.run.smithi076.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '6aad871c-765a-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.76', '--skip-admin-label'] 2024-09-19T07:41:29.790 INFO:teuthology.orchestra.run.smithi076.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T07:41:29.790 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying podman|docker is present... 2024-09-19T07:41:29.813 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout 5.2.2 2024-09-19T07:41:29.813 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying lvm2 is present... 2024-09-19T07:41:29.813 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying time synchronization is in place... 2024-09-19T07:41:29.821 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T07:41:29.821 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T07:41:29.827 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T07:41:29.827 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-09-19T07:41:29.833 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout enabled 2024-09-19T07:41:29.840 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout active 2024-09-19T07:41:29.840 INFO:teuthology.orchestra.run.smithi076.stdout:Unit chronyd.service is enabled and running 2024-09-19T07:41:29.840 INFO:teuthology.orchestra.run.smithi076.stdout:Repeating the final host check... 2024-09-19T07:41:29.862 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout 5.2.2 2024-09-19T07:41:29.862 INFO:teuthology.orchestra.run.smithi076.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T07:41:29.862 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl is present 2024-09-19T07:41:29.862 INFO:teuthology.orchestra.run.smithi076.stdout:lvcreate is present 2024-09-19T07:41:29.869 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T07:41:29.869 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T07:41:29.875 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T07:41:29.875 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-09-19T07:41:29.881 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout enabled 2024-09-19T07:41:29.888 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout active 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Unit chronyd.service is enabled and running 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Host looks OK 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Cluster fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Acquiring lock 140636206806016 on /run/cephadm/6aad871c-765a-11ef-bceb-c7b262605968.lock 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Lock 140636206806016 acquired on /run/cephadm/6aad871c-765a-11ef-bceb-c7b262605968.lock 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying IP 172.21.15.76 port 3300 ... 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying IP 172.21.15.76 port 6789 ... 2024-09-19T07:41:29.889 INFO:teuthology.orchestra.run.smithi076.stdout:Base mon IP(s) is [172.21.15.76:3300, 172.21.15.76:6789], mon addrv is [v2:172.21.15.76:3300,v1:172.21.15.76:6789] 2024-09-19T07:41:29.892 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.76 metric 100 2024-09-19T07:41:29.892 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.76 metric 100 2024-09-19T07:41:29.895 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T07:41:29.895 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T07:41:29.895 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T07:41:29.897 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T07:41:29.897 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T07:41:29.897 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T07:41:29.897 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T07:41:29.897 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:47e1/64 scope link noprefixroute 2024-09-19T07:41:29.897 INFO:teuthology.orchestra.run.smithi076.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T07:41:29.898 INFO:teuthology.orchestra.run.smithi076.stdout:Mon IP `172.21.15.76` is in CIDR network `172.21.0.0/20` 2024-09-19T07:41:29.898 INFO:teuthology.orchestra.run.smithi076.stdout:Mon IP `172.21.15.76` is in CIDR network `172.21.0.0/20` 2024-09-19T07:41:29.898 INFO:teuthology.orchestra.run.smithi076.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T07:41:29.898 INFO:teuthology.orchestra.run.smithi076.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T07:41:29.899 INFO:teuthology.orchestra.run.smithi076.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T07:41:30.318 INFO:teuthology.orchestra.run.smithi076.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T07:41:31.146 INFO:teuthology.orchestra.run.smithi076.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T07:41:31.146 INFO:teuthology.orchestra.run.smithi076.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T07:41:31.146 INFO:teuthology.orchestra.run.smithi076.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T07:41:32.168 INFO:teuthology.orchestra.run.smithi076.stdout:stat: stdout 167 167 2024-09-19T07:41:32.168 INFO:teuthology.orchestra.run.smithi076.stdout:Creating initial keys... 2024-09-19T07:41:33.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph-authtool: stdout AQCs1etmLUxhGhAAz3DCe57h7GTH+PyIOUVgkQ== 2024-09-19T07:41:33.829 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph-authtool: stdout AQCt1etmTzQ5ERAA/gfyylu5m5gxhS8fJqZzow== 2024-09-19T07:41:34.693 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph-authtool: stdout AQCu1etmIAQkBxAAl+G1Cb1dKKty+qTUa1aVrA== 2024-09-19T07:41:34.694 INFO:teuthology.orchestra.run.smithi076.stdout:Creating initial monmap... 2024-09-19T07:41:35.549 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T07:41:35.549 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T07:41:35.549 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:35.549 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T07:41:35.549 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool for a [v2:172.21.15.76:3300,v1:172.21.15.76:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T07:41:35.549 INFO:teuthology.orchestra.run.smithi076.stdout:setting min_mon_release = quincy 2024-09-19T07:41:35.550 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: set fsid to 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:35.550 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T07:41:35.550 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:41:35.550 INFO:teuthology.orchestra.run.smithi076.stdout:Creating mon... 2024-09-19T07:41:36.472 INFO:teuthology.orchestra.run.smithi076.stdout:create mon.a on 2024-09-19T07:41:36.681 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T07:41:36.828 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T07:41:37.003 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6aad871c-765a-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-6aad871c-765a-11ef-bceb-c7b262605968.target. 2024-09-19T07:41:37.004 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6aad871c-765a-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-6aad871c-765a-11ef-bceb-c7b262605968.target. 2024-09-19T07:41:37.260 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a 2024-09-19T07:41:37.260 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T07:41:37.425 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6aad871c-765a-11ef-bceb-c7b262605968.target.wants/ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-6aad871c-765a-11ef-bceb-c7b262605968@.service. 2024-09-19T07:41:37.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:37 smithi076 podman[30540]: 2024-09-19 07:41:37.885210839 +0000 UTC m=+0.336281004 container start 786c1da41bf6c0466e6eec08b84a5a5c11380e06578ab92cff64ac279cb5b5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T07:41:37.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:37 smithi076 ceph-mon[30561]: mkfs 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:37.979 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:41:37.979 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-09-19T07:41:37.987 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:41:37.987 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-09-19T07:41:37.987 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-09-19T07:41:37.987 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T07:41:37.987 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mon to start... 2024-09-19T07:41:37.987 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mon... 2024-09-19T07:41:38.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:37 smithi076 ceph-mon[30561]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:41:38.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:37 smithi076 bash[30540]: 786c1da41bf6c0466e6eec08b84a5a5c11380e06578ab92cff64ac279cb5b5b4 2024-09-19T07:41:38.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:37 smithi076 systemd[1]: Started Ceph mon.a for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:41:39.032 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T07:41:39.038 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout id: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:39.038 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T07:41:39.038 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:39.038 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout services: 2024-09-19T07:41:39.038 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.568264s) 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout data: 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.420+0000 7fb093cce640 1 Processor -- start 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.420+0000 7fb093cce640 1 -- start start 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.421+0000 7fb093cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c10a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:39.039 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.421+0000 7fb093cce640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c07be10 con 0x7fb08c108350 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.421+0000 7fb091a6a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c10a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.421+0000 7fb091a6a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c10a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32972/0 (socket says 172.21.15.76:32972) 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.421+0000 7fb091a6a640 1 -- 172.21.15.76:0/1297815694 learned_addr learned my addr 172.21.15.76:0/1297815694 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.421+0000 7fb091a6a640 1 -- 172.21.15.76:0/1297815694 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c10ac80 con 0x7fb08c108350 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.423+0000 7fb091a6a640 1 --2- 172.21.15.76:0/1297815694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c10a740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb084009820 tx=0x7fb08402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212119d583ca5d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.423+0000 7fb090a68640 1 -- 172.21.15.76:0/1297815694 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084037070 con 0x7fb08c108350 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.423+0000 7fb090a68640 1 -- 172.21.15.76:0/1297815694 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb084032440 con 0x7fb08c108350 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.423+0000 7fb090a68640 1 -- 172.21.15.76:0/1297815694 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084032740 con 0x7fb08c108350 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 -- 172.21.15.76:0/1297815694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 msgr2=0x7fb08c10a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 --2- 172.21.15.76:0/1297815694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c10a740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb084009820 tx=0x7fb08402a270 comp rx=0 tx=0).stop 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 -- 172.21.15.76:0/1297815694 shutdown_connections 2024-09-19T07:41:39.040 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 --2- 172.21.15.76:0/1297815694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c10a740 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 -- 172.21.15.76:0/1297815694 >> 172.21.15.76:0/1297815694 conn(0x7fb08c101f30 msgr2=0x7fb08c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 -- 172.21.15.76:0/1297815694 shutdown_connections 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.424+0000 7fb093cce640 1 -- 172.21.15.76:0/1297815694 wait complete. 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb093cce640 1 Processor -- start 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb093cce640 1 -- start start 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb093cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb093cce640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c10b0f0 con 0x7fb08c108350 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb091a6a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:39.041 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb091a6a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c19b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32978/0 (socket says 172.21.15.76:32978) 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb091a6a640 1 -- 172.21.15.76:0/222114262 learned_addr learned my addr 172.21.15.76:0/222114262 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb091a6a640 1 -- 172.21.15.76:0/222114262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c19b590 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.425+0000 7fb091a6a640 1 --2- 172.21.15.76:0/222114262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c19b050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb0840090b0 tx=0x7fb0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084041070 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08403c7a0 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c19b820 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084037040 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c19e510 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb084044070 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.426+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb08403d730 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.427+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08c1087b0 con 0x7fb08c108350 2024-09-19T07:41:39.042 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.429+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb08403cbe0 con 0x7fb08c108350 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.488+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb08c02d910 con 0x7fb08c108350 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.488+0000 7fb08affd640 1 -- 172.21.15.76:0/222114262 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fb08403cdc0 con 0x7fb08c108350 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 msgr2=0x7fb08c19b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 --2- 172.21.15.76:0/222114262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c19b050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb0840090b0 tx=0x7fb0840046c0 comp rx=0 tx=0).stop 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 shutdown_connections 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 --2- 172.21.15.76:0/222114262 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08c108350 0x7fb08c19b050 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 >> 172.21.15.76:0/222114262 conn(0x7fb08c101f30 msgr2=0x7fb08c1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 shutdown_connections 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:38.489+0000 7fb093cce640 1 -- 172.21.15.76:0/222114262 wait complete. 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:mon is available 2024-09-19T07:41:39.043 INFO:teuthology.orchestra.run.smithi076.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T07:41:39.161 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: monmap epoch 1 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: last_changed 2024-09-19T07:41:35.031505+0000 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: min_mon_release 19 (squid) 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: election_strategy: 1 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: fsmap 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: mgrmap e1: no daemons active 2024-09-19T07:41:39.162 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:38 smithi076 ceph-mon[30561]: from='client.? 172.21.15.76:0/222114262' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T07:41:40.069 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:39 smithi076 ceph-mon[30561]: from='client.? 172.21.15.76:0/2591725877' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T07:41:40.070 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:39 smithi076 ceph-mon[30561]: from='client.? 172.21.15.76:0/2591725877' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T07:41:40.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:40.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T07:41:40.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout fsid = 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:40.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.76:3300,v1:172.21.15.76:6789] 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T07:41:40.078 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166b8f1640 1 Processor -- start 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166b8f1640 1 -- start start 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166b8f1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166b8f1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f166407c850 con 0x7f166407de20 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166968d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166968d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32988/0 (socket says 172.21.15.76:32988) 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166968d640 1 -- 172.21.15.76:0/260094057 learned_addr learned my addr 172.21.15.76:0/260094057 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.460+0000 7f166968d640 1 -- 172.21.15.76:0/260094057 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166407c9d0 con 0x7f166407de20 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.461+0000 7f166968d640 1 --2- 172.21.15.76:0/260094057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166407c280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1658009820 tx=0x7f165802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a7aec2a4e9bb11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.461+0000 7f1657fff640 1 -- 172.21.15.76:0/260094057 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1658037070 con 0x7f166407de20 2024-09-19T07:41:40.079 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.461+0000 7f1657fff640 1 -- 172.21.15.76:0/260094057 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658032440 con 0x7f166407de20 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.461+0000 7f1657fff640 1 -- 172.21.15.76:0/260094057 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1658032740 con 0x7f166407de20 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 -- 172.21.15.76:0/260094057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 msgr2=0x7f166407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 --2- 172.21.15.76:0/260094057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166407c280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1658009820 tx=0x7f165802a270 comp rx=0 tx=0).stop 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 -- 172.21.15.76:0/260094057 shutdown_connections 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 --2- 172.21.15.76:0/260094057 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166407c280 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 -- 172.21.15.76:0/260094057 >> 172.21.15.76:0/260094057 conn(0x7f1664103020 msgr2=0x7f1664105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 -- 172.21.15.76:0/260094057 shutdown_connections 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.462+0000 7f166b8f1640 1 -- 172.21.15.76:0/260094057 wait complete. 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166b8f1640 1 Processor -- start 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166b8f1640 1 -- start start 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166b8f1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:40.080 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166b8f1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f166407cf00 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166968d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166968d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166419d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32994/0 (socket says 172.21.15.76:32994) 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166968d640 1 -- 172.21.15.76:0/2591725877 learned_addr learned my addr 172.21.15.76:0/2591725877 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166968d640 1 -- 172.21.15.76:0/2591725877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166419d770 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166968d640 1 --2- 172.21.15.76:0/2591725877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166419d230 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f16580090b0 tx=0x7f16580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1658041070 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165803c7a0 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166419da00 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.463+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1658037040 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.464+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16641a06f0 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.464+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1658044070 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.464+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f165803d730 con 0x7f166407de20 2024-09-19T07:41:40.081 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.465+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166407c300 con 0x7f166407de20 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.467+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f165803cbe0 con 0x7f166407de20 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.523+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f166402d940 con 0x7f166407de20 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.526+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f165803cdc0 con 0x7f166407de20 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.527+0000 7f16567fc640 1 -- 172.21.15.76:0/2591725877 <== mon.0 v2:172.21.15.76:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1658056070 con 0x7f166407de20 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 msgr2=0x7f166419d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 --2- 172.21.15.76:0/2591725877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166419d230 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f16580090b0 tx=0x7f16580046c0 comp rx=0 tx=0).stop 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 shutdown_connections 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 --2- 172.21.15.76:0/2591725877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f166407de20 0x7f166419d230 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 >> 172.21.15.76:0/2591725877 conn(0x7f1664103020 msgr2=0x7f16641040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 shutdown_connections 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:39.528+0000 7f166b8f1640 1 -- 172.21.15.76:0/2591725877 wait complete. 2024-09-19T07:41:40.082 INFO:teuthology.orchestra.run.smithi076.stdout:Generating new minimal ceph.conf... 2024-09-19T07:41:41.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:40 smithi076 ceph-mon[30561]: from='client.? 172.21.15.76:0/3484941393' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:41:44.257 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb6e57640 1 Processor -- start 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb6e57640 1 -- start start 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb6e57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb0107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb6e57640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb0108220 con 0x7f4bb0107850 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb4bf3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb0107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb4bf3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb0107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33010/0 (socket says 172.21.15.76:33010) 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.507+0000 7f4bb4bf3640 1 -- 172.21.15.76:0/2197186301 learned_addr learned my addr 172.21.15.76:0/2197186301 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.508+0000 7f4bb4bf3640 1 -- 172.21.15.76:0/2197186301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0108a50 con 0x7f4bb0107850 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.508+0000 7f4bb4bf3640 1 --2- 172.21.15.76:0/2197186301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb0107c50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009820 tx=0x7f4ba402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf54d4f717d549 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.508+0000 7f4baf7fe640 1 -- 172.21.15.76:0/2197186301 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba4037070 con 0x7f4bb0107850 2024-09-19T07:41:44.258 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.508+0000 7f4baf7fe640 1 -- 172.21.15.76:0/2197186301 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4ba4032920 con 0x7f4bb0107850 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.508+0000 7f4baf7fe640 1 -- 172.21.15.76:0/2197186301 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba4030950 con 0x7f4bb0107850 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 -- 172.21.15.76:0/2197186301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 msgr2=0x7f4bb0107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 --2- 172.21.15.76:0/2197186301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb0107c50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009820 tx=0x7f4ba402a270 comp rx=0 tx=0).stop 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 -- 172.21.15.76:0/2197186301 shutdown_connections 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 --2- 172.21.15.76:0/2197186301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb0107c50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 -- 172.21.15.76:0/2197186301 >> 172.21.15.76:0/2197186301 conn(0x7f4bb0103020 msgr2=0x7f4bb0105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 -- 172.21.15.76:0/2197186301 shutdown_connections 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.509+0000 7f4bb6e57640 1 -- 172.21.15.76:0/2197186301 wait complete. 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb6e57640 1 Processor -- start 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb6e57640 1 -- start start 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb6e57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb007db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb6e57640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010be00 con 0x7f4bb0107850 2024-09-19T07:41:44.259 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb4bf3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb007db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb4bf3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb007db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33016/0 (socket says 172.21.15.76:33016) 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb4bf3640 1 -- 172.21.15.76:0/3484941393 learned_addr learned my addr 172.21.15.76:0/3484941393 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb4bf3640 1 -- 172.21.15.76:0/3484941393 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb007e050 con 0x7f4bb0107850 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb4bf3640 1 --2- 172.21.15.76:0/3484941393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb007db10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009940 tx=0x7f4ba4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba4042070 con 0x7f4bb0107850 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4ba40326b0 con 0x7f4bb0107850 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb007c240 con 0x7f4bb0107850 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.510+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba4037040 con 0x7f4bb0107850 2024-09-19T07:41:44.260 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.511+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb007c780 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.511+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ba4045070 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.511+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ba4047bc0 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.512+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb010bf80 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.514+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4ba4032860 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.570+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f4bb007ceb0 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.571+0000 7f4badffb640 1 -- 172.21.15.76:0/3484941393 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f4ba403dbf0 con 0x7f4bb0107850 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 msgr2=0x7f4bb007db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 --2- 172.21.15.76:0/3484941393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb007db10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009940 tx=0x7f4ba4032e40 comp rx=0 tx=0).stop 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 shutdown_connections 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 --2- 172.21.15.76:0/3484941393 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4bb0107850 0x7f4bb007db10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 >> 172.21.15.76:0/3484941393 conn(0x7f4bb0103020 msgr2=0x7f4bb0103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 shutdown_connections 2024-09-19T07:41:44.261 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:40.572+0000 7f4bb6e57640 1 -- 172.21.15.76:0/3484941393 wait complete. 2024-09-19T07:41:44.262 INFO:teuthology.orchestra.run.smithi076.stdout:Restarting the monitor... 2024-09-19T07:41:44.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:44 smithi076 systemd[1]: Stopping Ceph mon.a for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:41:45.797 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:45 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a[30557]: 2024-09-19T07:41:45.543+0000 7fa1165d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:41:45.798 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:45 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a[30557]: 2024-09-19T07:41:45.543+0000 7fa1165d9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T07:41:46.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:45 smithi076 podman[30805]: 2024-09-19 07:41:45.798097492 +0000 UTC m=+1.365855224 container died 786c1da41bf6c0466e6eec08b84a5a5c11380e06578ab92cff64ac279cb5b5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:41:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:49 smithi076 podman[30805]: 2024-09-19 07:41:49.574260153 +0000 UTC m=+5.142017885 container cleanup 786c1da41bf6c0466e6eec08b84a5a5c11380e06578ab92cff64ac279cb5b5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T07:41:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:49 smithi076 bash[30805]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a 2024-09-19T07:41:51.421 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 podman[30817]: 2024-09-19 07:41:51.103983707 +0000 UTC m=+5.300623748 container remove 786c1da41bf6c0466e6eec08b84a5a5c11380e06578ab92cff64ac279cb5b5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T07:41:51.421 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T07:41:51.421 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 systemd[1]: Stopped Ceph mon.a for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:41:51.421 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 systemd[1]: Starting Ceph mon.a for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:41:51.673 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 podman[30911]: 2024-09-19 07:41:51.421690232 +0000 UTC m=+0.096751084 container create b15b079e9d65889fb05dfdbb6992f2caff8f41b8b9e40d8a9d19a36139576515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 podman[30911]: 2024-09-19 07:41:51.34054636 +0000 UTC m=+0.015607173 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 podman[30911]: 2024-09-19 07:41:51.623846456 +0000 UTC m=+0.298907267 container init b15b079e9d65889fb05dfdbb6992f2caff8f41b8b9e40d8a9d19a36139576515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 podman[30911]: 2024-09-19 07:41:51.626978529 +0000 UTC m=+0.302039335 container start b15b079e9d65889fb05dfdbb6992f2caff8f41b8b9e40d8a9d19a36139576515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: pidfile_write: ignore empty --pid-file 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: load: jerasure load: lrc 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: RocksDB version: 7.9.2 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Git sha 0 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: DB SUMMARY 2024-09-19T07:41:51.674 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: DB Session ID: EOW2Z95LXVQ3PXU3SF9Y 2024-09-19T07:41:51.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: CURRENT file: CURRENT 2024-09-19T07:41:51.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T07:41:51.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T07:41:51.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T07:41:51.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106336 ; 2024-09-19T07:41:51.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.error_if_exists: 0 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.create_if_missing: 0 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.paranoid_checks: 1 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.env: 0x55607c0b1940 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T07:41:51.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.info_log: 0x55607d98b6e0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.statistics: (nil) 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.use_fsync: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_log_file_size: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.allow_fallocate: 1 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.use_direct_reads: 0 2024-09-19T07:41:51.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.db_log_dir: 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.wal_dir: 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T07:41:51.678 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.write_buffer_manager: 0x55607d99adc0 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.unordered_write: 0 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T07:41:51.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.row_cache: None 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.wal_filter: None 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.two_write_queues: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.wal_compression: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.atomic_flush: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.log_readahead_size: 0 2024-09-19T07:41:51.680 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_background_jobs: 2 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_background_compactions: -1 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_subcompactions: 1 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T07:41:51.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_open_files: -1 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Compression algorithms supported: 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kZSTD supported: 0 2024-09-19T07:41:51.682 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.merge_operator: 2024-09-19T07:41:51.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_filter: None 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55607d98b320) 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: index_type: 0 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: data_block_index_type: 0 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: index_shortening: 1 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:41:51.684 INFO:journalctl@ceph.mon.a.smithi076.stdout: checksum: 4 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: no_block_cache: 0 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache: 0x55607d97f1f0 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache_options: 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: capacity : 536870912 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: num_shard_bits : 4 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: strict_capacity_limit : 0 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_cache_compressed: (nil) 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: persistent_cache: (nil) 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_size: 4096 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_size_deviation: 10 2024-09-19T07:41:51.685 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_restart_interval: 16 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: index_block_restart_interval: 1 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: metadata_block_size: 4096 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: partition_filters: 0 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: use_delta_encoding: 1 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: filter_policy: bloomfilter 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: whole_key_filtering: 1 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: verify_compression: 0 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: format_version: 5 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: enable_index_compression: 1 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: block_align: 0 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: max_auto_readahead_size: 262144 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: prepopulate_block_cache: 0 2024-09-19T07:41:51.686 INFO:journalctl@ceph.mon.a.smithi076.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression: NoCompression 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.num_levels: 7 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:41:51.687 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:41:51.688 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:41:51.689 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:41:51.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:41:51.691 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:41:51.692 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:41:51.692 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:41:51.692 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:41:51.692 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.ttl: 2592000 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:41:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 314494b3-e441-4cb8-9a9d-b93308ac96f8 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726731711652630, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726731711653567, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101355, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 99231, "index_size": 316, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14550, "raw_average_key_size": 50, "raw_value_size": 91321, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726731711, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "314494b3-e441-4cb8-9a9d-b93308ac96f8", "db_session_id": "EOW2Z95LXVQ3PXU3SF9Y", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726731711653662, "job": 1, "event": "recovery_finished"} 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T07:41:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55607d9ace00 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: DB pointer 0x55607daa8000 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** DB Stats ** 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:41:51.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** Compaction Stats [default] ** 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: L0 2/0 100.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: Sum 2/0 100.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 170.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** Compaction Stats [default] ** 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 170.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-09-19T07:41:51.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Cumulative compaction: 0.00 GB write, 31.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Interval compaction: 0.00 GB write, 31.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Block cache BinnedLRUCache@0x55607d97f1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T07:41:51.697 INFO:journalctl@ceph.mon.a.smithi076.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: starting mon.a rank 0 at public addrs [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] at bind addrs [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???) e1 preinit fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).mds e1 new map 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).mds e1 print_map 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: e1 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: btime 2024-09-19T07:41:37:923548+0000 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: legacy client fscid: -1 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: 2024-09-19T07:41:51.698 INFO:journalctl@ceph.mon.a.smithi076.stdout: No filesystems configured 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 bash[30911]: b15b079e9d65889fb05dfdbb6992f2caff8f41b8b9e40d8a9d19a36139576515 2024-09-19T07:41:51.699 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 systemd[1]: Started Ceph mon.a for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:41:51.699 INFO:teuthology.orchestra.run.smithi076.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T07:41:51.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: monmap epoch 1 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: last_changed 2024-09-19T07:41:35.031505+0000 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: min_mon_release 19 (squid) 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: election_strategy: 1 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: fsmap 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T07:41:51.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:51 smithi076 ceph-mon[30930]: mgrmap e1: no daemons active 2024-09-19T07:41:52.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.105+0000 7fb23fb0c640 1 Processor -- start 2024-09-19T07:41:52.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23fb0c640 1 -- start start 2024-09-19T07:41:52.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23fb0c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238105f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:52.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23fb0c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381064d0 con 0x7fb238105b00 2024-09-19T07:41:52.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23d8a8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:52.730 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23d8a8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47130/0 (socket says 172.21.15.76:47130) 2024-09-19T07:41:52.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23d8a8640 1 -- 172.21.15.76:0/1848797313 learned_addr learned my addr 172.21.15.76:0/1848797313 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:52.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.106+0000 7fb23d8a8640 1 -- 172.21.15.76:0/1848797313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238108ae0 con 0x7fb238105b00 2024-09-19T07:41:52.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.109+0000 7fb23d8a8640 1 --2- 172.21.15.76:0/1848797313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238105f00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb234009820 tx=0x7fb23402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773380d0cfcff1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:52.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.109+0000 7fb23c8a6640 1 -- 172.21.15.76:0/1848797313 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234037070 con 0x7fb238105b00 2024-09-19T07:41:52.731 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.109+0000 7fb23c8a6640 1 -- 172.21.15.76:0/1848797313 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb234032920 con 0x7fb238105b00 2024-09-19T07:41:52.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.109+0000 7fb23c8a6640 1 -- 172.21.15.76:0/1848797313 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234030950 con 0x7fb238105b00 2024-09-19T07:41:52.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 -- 172.21.15.76:0/1848797313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 msgr2=0x7fb238105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:52.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 --2- 172.21.15.76:0/1848797313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238105f00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb234009820 tx=0x7fb23402a270 comp rx=0 tx=0).stop 2024-09-19T07:41:52.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 -- 172.21.15.76:0/1848797313 shutdown_connections 2024-09-19T07:41:52.732 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 --2- 172.21.15.76:0/1848797313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238105f00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:52.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 -- 172.21.15.76:0/1848797313 >> 172.21.15.76:0/1848797313 conn(0x7fb2381016b0 msgr2=0x7fb238103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:52.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 -- 172.21.15.76:0/1848797313 shutdown_connections 2024-09-19T07:41:52.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 -- 172.21.15.76:0/1848797313 wait complete. 2024-09-19T07:41:52.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 Processor -- start 2024-09-19T07:41:52.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.110+0000 7fb23fb0c640 1 -- start start 2024-09-19T07:41:52.733 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23fb0c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238108360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23fb0c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb23810bd10 con 0x7fb238105b00 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23d8a8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238108360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23d8a8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238108360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47146/0 (socket says 172.21.15.76:47146) 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23d8a8640 1 -- 172.21.15.76:0/3975993069 learned_addr learned my addr 172.21.15.76:0/3975993069 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23d8a8640 1 -- 172.21.15.76:0/3975993069 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2381088a0 con 0x7fb238105b00 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23d8a8640 1 --2- 172.21.15.76:0/3975993069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238108360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb234009940 tx=0x7fb234032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234042070 con 0x7fb238105b00 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb2340326b0 con 0x7fb238105b00 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234037040 con 0x7fb238105b00 2024-09-19T07:41:52.734 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb238106a90 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.111+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb238106fd0 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.112+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb234045070 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.112+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb234047bc0 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.112+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb238105f80 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.115+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb23403dbf0 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.170+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fb2381072d0 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.175+0000 7fb22affd640 1 -- 172.21.15.76:0/3975993069 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fb23403d430 con 0x7fb238105b00 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 msgr2=0x7fb238108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:52.735 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 --2- 172.21.15.76:0/3975993069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238108360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb234009940 tx=0x7fb234032e40 comp rx=0 tx=0).stop 2024-09-19T07:41:52.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 shutdown_connections 2024-09-19T07:41:52.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 --2- 172.21.15.76:0/3975993069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb238105b00 0x7fb238108360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:52.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 >> 172.21.15.76:0/3975993069 conn(0x7fb2381016b0 msgr2=0x7fb238102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:52.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 shutdown_connections 2024-09-19T07:41:52.736 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:52.176+0000 7fb23fb0c640 1 -- 172.21.15.76:0/3975993069 wait complete. 2024-09-19T07:41:52.736 INFO:teuthology.orchestra.run.smithi076.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T07:41:52.754 INFO:teuthology.orchestra.run.smithi076.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:41:52.755 INFO:teuthology.orchestra.run.smithi076.stdout:Creating mgr... 2024-09-19T07:41:52.755 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T07:41:52.756 INFO:teuthology.orchestra.run.smithi076.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T07:41:53.006 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x 2024-09-19T07:41:53.006 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T07:41:53.157 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6aad871c-765a-11ef-bceb-c7b262605968.target.wants/ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-6aad871c-765a-11ef-bceb-c7b262605968@.service. 2024-09-19T07:41:53.374 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:53 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3975993069' entity='client.admin' 2024-09-19T07:41:53.643 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 podman[31142]: 2024-09-19 07:41:53.545274581 +0000 UTC m=+0.273239890 container start 908fb35e2429bd190e9d54643230c8dd46a0cbf6c327d709d27c20f1e756669c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:41:53.643 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 bash[31142]: 908fb35e2429bd190e9d54643230c8dd46a0cbf6c327d709d27c20f1e756669c 2024-09-19T07:41:53.656 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:41:53.656 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-09-19T07:41:53.664 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:41:53.664 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-09-19T07:41:53.664 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-09-19T07:41:53.664 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T07:41:53.673 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:41:53.673 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-09-19T07:41:53.680 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:41:53.680 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-09-19T07:41:53.680 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-09-19T07:41:53.680 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T07:41:53.680 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr to start... 2024-09-19T07:41:53.681 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr... 2024-09-19T07:41:53.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 systemd[1]: Started Ceph mgr.x for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:41:53.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:53.665+0000 7fdee2682040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:41:53.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:53.727+0000 7fdee2682040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:41:53.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:53.876+0000 7fdee2682040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:41:54.217 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:53 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:53.944+0000 7fdee2682040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:41:54.217 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:54.096+0000 7fdee2682040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:41:54.557 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:54 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1249591471' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:41:54.557 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:54.250+0000 7fdee2682040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:41:54.809 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:54.572+0000 7fdee2682040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:41:54.809 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:54.633+0000 7fdee2682040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:41:54.812 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:41:54.813 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:41:54.821 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:41:37:923548+0000", 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:41:54.822 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:41:37.924227+0000", 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:41:54.823 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.148+0000 7fcf9b904640 1 Processor -- start 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.148+0000 7fcf9b904640 1 -- start start 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.148+0000 7fcf9b904640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94106b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.148+0000 7fcf9b904640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94107140 con 0x7fcf94106770 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.149+0000 7fcf996a0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.149+0000 7fcf996a0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51376/0 (socket says 172.21.15.76:51376) 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.149+0000 7fcf996a0640 1 -- 172.21.15.76:0/2210997509 learned_addr learned my addr 172.21.15.76:0/2210997509 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.149+0000 7fcf996a0640 1 -- 172.21.15.76:0/2210997509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf94107970 con 0x7fcf94106770 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.150+0000 7fcf996a0640 1 --2- 172.21.15.76:0/2210997509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94106b70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009820 tx=0x7fcf9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93322539b58dd34c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.150+0000 7fcf8bfff640 1 -- 172.21.15.76:0/2210997509 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90037070 con 0x7fcf94106770 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.150+0000 7fcf8bfff640 1 -- 172.21.15.76:0/2210997509 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fcf90032920 con 0x7fcf94106770 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.150+0000 7fcf8bfff640 1 -- 172.21.15.76:0/2210997509 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90030950 con 0x7fcf94106770 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 -- 172.21.15.76:0/2210997509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 msgr2=0x7fcf94106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:54.824 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 --2- 172.21.15.76:0/2210997509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94106b70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009820 tx=0x7fcf9002a270 comp rx=0 tx=0).stop 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 -- 172.21.15.76:0/2210997509 shutdown_connections 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 --2- 172.21.15.76:0/2210997509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94106b70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 -- 172.21.15.76:0/2210997509 >> 172.21.15.76:0/2210997509 conn(0x7fcf94101f40 msgr2=0x7fcf94104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 -- 172.21.15.76:0/2210997509 shutdown_connections 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.151+0000 7fcf9b904640 1 -- 172.21.15.76:0/2210997509 wait complete. 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.152+0000 7fcf9b904640 1 Processor -- start 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.152+0000 7fcf9b904640 1 -- start start 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.152+0000 7fcf9b904640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.152+0000 7fcf9b904640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9407b0f0 con 0x7fcf94106770 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf996a0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf996a0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51386/0 (socket says 172.21.15.76:51386) 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf996a0640 1 -- 172.21.15.76:0/1249591471 learned_addr learned my addr 172.21.15.76:0/1249591471 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:54.825 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf996a0640 1 -- 172.21.15.76:0/1249591471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf94199b80 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf996a0640 1 --2- 172.21.15.76:0/1249591471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94199640 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009940 tx=0x7fcf90032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90042070 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fcf900326b0 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf94199e10 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90037040 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.153+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9419cb00 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.154+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcf90045070 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.154+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcf90047bc0 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.154+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf94106b70 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.156+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcf9003dbf0 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.216+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcf94192b00 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.217+0000 7fcf8a7fc640 1 -- 172.21.15.76:0/1249591471 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fcf9003d430 con 0x7fcf94106770 2024-09-19T07:41:54.826 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 msgr2=0x7fcf94199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 --2- 172.21.15.76:0/1249591471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94199640 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009940 tx=0x7fcf90032e40 comp rx=0 tx=0).stop 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 shutdown_connections 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 --2- 172.21.15.76:0/1249591471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf94106770 0x7fcf94199640 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 >> 172.21.15.76:0/1249591471 conn(0x7fcf94101f40 msgr2=0x7fcf9418fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 shutdown_connections 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:54.218+0000 7fcf9b904640 1 -- 172.21.15.76:0/1249591471 wait complete. 2024-09-19T07:41:54.827 INFO:teuthology.orchestra.run.smithi076.stdout:mgr not available, waiting (1/15)... 2024-09-19T07:41:55.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:54.818+0000 7fdee2682040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:41:56.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:55 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:55.694+0000 7fdee2682040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:41:56.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:55 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:55.761+0000 7fdee2682040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:41:56.745 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:56.483+0000 7fdee2682040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:41:56.745 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:56.599+0000 7fdee2682040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:41:56.745 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:56.744+0000 7fdee2682040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:41:57.032 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:56.806+0000 7fdee2682040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:41:57.032 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:56.963+0000 7fdee2682040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:41:57.032 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.032+0000 7fdee2682040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:41:57.285 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.092+0000 7fdee2682040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:41:57.285 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.251+0000 7fdee2682040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:41:57.590 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.317+0000 7fdee2682040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:41:57.591 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.384+0000 7fdee2682040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:41:57.591 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.468+0000 7fdee2682040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:41:57.591 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.529+0000 7fdee2682040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:41:57.591 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:57.589+0000 7fdee2682040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:41:58.424 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:58 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2631120659' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:41:58.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:41:58 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:41:58.422+0000 7fdee2682040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.868 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:41:58.869 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:41:58.870 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:41:58.871 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:41:58.871 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:41:58.871 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:41:37:923548+0000", 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:41:58.872 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:41:37.924227+0000", 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:41:58.873 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.158+0000 7f4a9ab18640 1 Processor -- start 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.158+0000 7f4a9ab18640 1 -- start start 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.158+0000 7f4a9ab18640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9410a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.158+0000 7f4a9ab18640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9407be30 con 0x7f4a94108330 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.159+0000 7f4a988b4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.159+0000 7f4a988b4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9410a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51394/0 (socket says 172.21.15.76:51394) 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.159+0000 7f4a988b4640 1 -- 172.21.15.76:0/3084198675 learned_addr learned my addr 172.21.15.76:0/3084198675 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.159+0000 7f4a988b4640 1 -- 172.21.15.76:0/3084198675 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9410ac60 con 0x7f4a94108330 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.160+0000 7f4a988b4640 1 --2- 172.21.15.76:0/3084198675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9410a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009820 tx=0x7f4a8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a28bad8a764d347 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:58.874 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.160+0000 7f4a937fe640 1 -- 172.21.15.76:0/3084198675 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a88037070 con 0x7f4a94108330 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.160+0000 7f4a937fe640 1 -- 172.21.15.76:0/3084198675 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4a88032920 con 0x7f4a94108330 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.160+0000 7f4a937fe640 1 -- 172.21.15.76:0/3084198675 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a88030950 con 0x7f4a94108330 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 -- 172.21.15.76:0/3084198675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 msgr2=0x7f4a9410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 --2- 172.21.15.76:0/3084198675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9410a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009820 tx=0x7f4a8802a270 comp rx=0 tx=0).stop 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 -- 172.21.15.76:0/3084198675 shutdown_connections 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 --2- 172.21.15.76:0/3084198675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9410a720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 -- 172.21.15.76:0/3084198675 >> 172.21.15.76:0/3084198675 conn(0x7f4a94101f30 msgr2=0x7f4a94104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 -- 172.21.15.76:0/3084198675 shutdown_connections 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.161+0000 7f4a9ab18640 1 -- 172.21.15.76:0/3084198675 wait complete. 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a9ab18640 1 Processor -- start 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a9ab18640 1 -- start start 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a9ab18640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:41:58.875 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a9ab18640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9410bc20 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a988b4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a988b4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51400/0 (socket says 172.21.15.76:51400) 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a988b4640 1 -- 172.21.15.76:0/2631120659 learned_addr learned my addr 172.21.15.76:0/2631120659 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.162+0000 7f4a988b4640 1 -- 172.21.15.76:0/2631120659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9419bd70 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a988b4640 1 --2- 172.21.15.76:0/2631120659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9419b830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006f10 tx=0x7f4a880327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a88037040 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4a88040070 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8803a630 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9419c000 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9419ecf0 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a8803a820 con 0x7f4a94108330 2024-09-19T07:41:58.876 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.163+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4a88045af0 con 0x7f4a94108330 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.164+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a94108790 con 0x7f4a94108330 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.168+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4a880328e0 con 0x7f4a94108330 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.230+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4a9419f290 con 0x7f4a94108330 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.230+0000 7f4a91ffb640 1 -- 172.21.15.76:0/2631120659 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4a88032d00 con 0x7f4a94108330 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.231+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 msgr2=0x7f4a9419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.231+0000 7f4a9ab18640 1 --2- 172.21.15.76:0/2631120659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9419b830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006f10 tx=0x7f4a880327d0 comp rx=0 tx=0).stop 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.231+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 shutdown_connections 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.231+0000 7f4a9ab18640 1 --2- 172.21.15.76:0/2631120659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a94108330 0x7f4a9419b830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.231+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 >> 172.21.15.76:0/2631120659 conn(0x7f4a94101f30 msgr2=0x7f4a94102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.231+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 shutdown_connections 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:41:58.232+0000 7f4a9ab18640 1 -- 172.21.15.76:0/2631120659 wait complete. 2024-09-19T07:41:58.877 INFO:teuthology.orchestra.run.smithi076.stdout:mgr not available, waiting (2/15)... 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: Activating manager daemon x 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: mgrmap e2: x(active, starting, since 0.00409667s) 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: Manager daemon x is now available 2024-09-19T07:41:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:41:59.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:41:59.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' 2024-09-19T07:41:59.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' 2024-09-19T07:41:59.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:41:59 smithi076 ceph-mon[30930]: from='mgr.14100 172.21.15.76:0/3220536604' entity='mgr.x' 2024-09-19T07:42:00.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:00 smithi076 ceph-mon[30930]: mgrmap e3: x(active, since 1.00649s) 2024-09-19T07:42:01.540 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:01 smithi076 ceph-mon[30930]: mgrmap e4: x(active, since 2s) 2024-09-19T07:42:02.329 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:42:02.330 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:42:02.331 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:42:02.340 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:41:37:923548+0000", 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:42:02.341 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:41:37.924227+0000", 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:42:02.342 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.298+0000 7f9158c15640 1 Processor -- start 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.298+0000 7f9158c15640 1 -- start start 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.299+0000 7f9158c15640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f9154106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.299+0000 7f9158c15640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9154107170 con 0x7f91541067a0 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.299+0000 7f915259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f9154106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.299+0000 7f915259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f9154106ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51484/0 (socket says 172.21.15.76:51484) 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.299+0000 7f915259c640 1 -- 172.21.15.76:0/3073043983 learned_addr learned my addr 172.21.15.76:0/3073043983 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.299+0000 7f915259c640 1 -- 172.21.15.76:0/3073043983 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91541079a0 con 0x7f91541067a0 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.300+0000 7f915259c640 1 --2- 172.21.15.76:0/3073043983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f9154106ba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f914c009820 tx=0x7f914c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e56beb668e80e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.300+0000 7f915159a640 1 -- 172.21.15.76:0/3073043983 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c037070 con 0x7f91541067a0 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.300+0000 7f915159a640 1 -- 172.21.15.76:0/3073043983 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f914c032920 con 0x7f91541067a0 2024-09-19T07:42:02.343 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.300+0000 7f915159a640 1 -- 172.21.15.76:0/3073043983 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c030950 con 0x7f91541067a0 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 -- 172.21.15.76:0/3073043983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 msgr2=0x7f9154106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 --2- 172.21.15.76:0/3073043983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f9154106ba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f914c009820 tx=0x7f914c02a270 comp rx=0 tx=0).stop 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 -- 172.21.15.76:0/3073043983 shutdown_connections 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 --2- 172.21.15.76:0/3073043983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f9154106ba0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 -- 172.21.15.76:0/3073043983 >> 172.21.15.76:0/3073043983 conn(0x7f9154101f30 msgr2=0x7f9154104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 -- 172.21.15.76:0/3073043983 shutdown_connections 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.301+0000 7f9158c15640 1 -- 172.21.15.76:0/3073043983 wait complete. 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f9158c15640 1 Processor -- start 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f9158c15640 1 -- start start 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f9158c15640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f915419db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f9158c15640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f915410ad50 con 0x7f91541067a0 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f915259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f915419db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:02.344 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f915259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f915419db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51496/0 (socket says 172.21.15.76:51496) 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f915259c640 1 -- 172.21.15.76:0/1872180383 learned_addr learned my addr 172.21.15.76:0/1872180383 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f915259c640 1 -- 172.21.15.76:0/1872180383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915419e040 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.302+0000 7f915259c640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f915419db00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f914c009940 tx=0x7f914c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.303+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c042070 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.303+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f914c0326b0 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.303+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915419e2d0 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.303+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c037040 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.303+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91541a0fc0 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.303+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f914c045070 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.304+0000 7f91437fe640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f913c039160 0x7f913c03b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.304+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f914c06c530 con 0x7f91541067a0 2024-09-19T07:42:02.345 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.304+0000 7f9151d9b640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f913c039160 0x7f913c03b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.304+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915410aed0 con 0x7f91541067a0 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.304+0000 7f9151d9b640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f913c039160 0x7f913c03b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f914800ad30 tx=0x7f91480093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.309+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f914c06bfb0 con 0x7f91541067a0 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.539+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f915402d910 con 0x7f91541067a0 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.539+0000 7f91437fe640 1 -- 172.21.15.76:0/1872180383 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f914c03cd20 con 0x7f91541067a0 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f913c039160 msgr2=0x7f913c03b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f913c039160 0x7f913c03b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f914800ad30 tx=0x7f91480093f0 comp rx=0 tx=0).stop 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 msgr2=0x7f915419db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f915419db00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f914c009940 tx=0x7f914c032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 shutdown_connections 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f913c039160 0x7f913c03b620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 --2- 172.21.15.76:0/1872180383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91541067a0 0x7f915419db00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 >> 172.21.15.76:0/1872180383 conn(0x7f9154101f30 msgr2=0x7f9154102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:02.346 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 shutdown_connections 2024-09-19T07:42:02.347 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:01.541+0000 7f9158c15640 1 -- 172.21.15.76:0/1872180383 wait complete. 2024-09-19T07:42:02.347 INFO:teuthology.orchestra.run.smithi076.stdout:mgr is available 2024-09-19T07:42:02.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:02 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1872180383' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:42:03.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:03 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1451568998' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout fsid = 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.76:3300,v1:172.21.15.76:6789] 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T07:42:03.456 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f015aca4640 1 Processor -- start 2024-09-19T07:42:03.457 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f015aca4640 1 -- start start 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f015aca4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f0154107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f015aca4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0154108220 con 0x7f0154107850 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f0158a40640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f0154107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f0158a40640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f0154107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51502/0 (socket says 172.21.15.76:51502) 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.719+0000 7f0158a40640 1 -- 172.21.15.76:0/3393311267 learned_addr learned my addr 172.21.15.76:0/3393311267 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.720+0000 7f0158a40640 1 -- 172.21.15.76:0/3393311267 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0154108a50 con 0x7f0154107850 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.720+0000 7f0158a40640 1 --2- 172.21.15.76:0/3393311267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f0154107c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0148009820 tx=0x7f014802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe9de4ebe6021e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.720+0000 7f01537fe640 1 -- 172.21.15.76:0/3393311267 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0148037070 con 0x7f0154107850 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.720+0000 7f01537fe640 1 -- 172.21.15.76:0/3393311267 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0148032920 con 0x7f0154107850 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.720+0000 7f01537fe640 1 -- 172.21.15.76:0/3393311267 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0148030950 con 0x7f0154107850 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 -- 172.21.15.76:0/3393311267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 msgr2=0x7f0154107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:03.458 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 --2- 172.21.15.76:0/3393311267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f0154107c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0148009820 tx=0x7f014802a270 comp rx=0 tx=0).stop 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 -- 172.21.15.76:0/3393311267 shutdown_connections 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 --2- 172.21.15.76:0/3393311267 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f0154107c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 -- 172.21.15.76:0/3393311267 >> 172.21.15.76:0/3393311267 conn(0x7f0154103020 msgr2=0x7f0154105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 -- 172.21.15.76:0/3393311267 shutdown_connections 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.721+0000 7f015aca4640 1 -- 172.21.15.76:0/3393311267 wait complete. 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f015aca4640 1 Processor -- start 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f015aca4640 1 -- start start 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f015aca4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f015419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f015aca4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f015410be00 con 0x7f0154107850 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0158a40640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f015419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0158a40640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f015419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51512/0 (socket says 172.21.15.76:51512) 2024-09-19T07:42:03.459 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0158a40640 1 -- 172.21.15.76:0/1451568998 learned_addr learned my addr 172.21.15.76:0/1451568998 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0158a40640 1 -- 172.21.15.76:0/1451568998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015419bdb0 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0158a40640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f015419b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0148009940 tx=0x7f0148032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0148042070 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f01480326b0 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015419c040 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.722+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0148037040 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.723+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015419ed30 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.724+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f0148045070 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.724+0000 7f0151ffb640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f0144039160 0x7f014403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.724+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f014806c240 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.724+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015410bf80 con 0x7f0154107850 2024-09-19T07:42:03.460 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.724+0000 7f0153fff640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f0144039160 0x7f014403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.724+0000 7f0153fff640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f0144039160 0x7f014403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01400098c0 tx=0x7f0140006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.729+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f014803bdf0 con 0x7f0154107850 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.895+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0154107cd0 con 0x7f0154107850 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.896+0000 7f0151ffb640 1 -- 172.21.15.76:0/1451568998 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f0148050020 con 0x7f0154107850 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f0144039160 msgr2=0x7f014403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f0144039160 0x7f014403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01400098c0 tx=0x7f0140006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 msgr2=0x7f015419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f015419b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0148009940 tx=0x7f0148032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 shutdown_connections 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f0144039160 0x7f014403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 --2- 172.21.15.76:0/1451568998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0154107850 0x7f015419b870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 >> 172.21.15.76:0/1451568998 conn(0x7f0154103020 msgr2=0x7f0154103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:03.461 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 shutdown_connections 2024-09-19T07:42:03.462 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:02.898+0000 7f015aca4640 1 -- 172.21.15.76:0/1451568998 wait complete. 2024-09-19T07:42:03.462 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling cephadm module... 2024-09-19T07:42:04.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3564354015' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T07:42:04.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ignoring --setuser ceph since I am not root 2024-09-19T07:42:04.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ignoring --setgroup ceph since I am not root 2024-09-19T07:42:04.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:04.573+0000 7f7b8ebee040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:42:04.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:04.629+0000 7f7b8ebee040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:42:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.852+0000 7f75aaf32640 1 Processor -- start 2024-09-19T07:42:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.852+0000 7f75aaf32640 1 -- start start 2024-09-19T07:42:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.852+0000 7f75aaf32640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a4107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.852+0000 7f75aaf32640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4108220 con 0x7f75a4107850 2024-09-19T07:42:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.853+0000 7f75a8cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a4107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.853+0000 7f75a8cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a4107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50026/0 (socket says 172.21.15.76:50026) 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.853+0000 7f75a8cce640 1 -- 172.21.15.76:0/2635667760 learned_addr learned my addr 172.21.15.76:0/2635667760 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.853+0000 7f75a8cce640 1 -- 172.21.15.76:0/2635667760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a4108a50 con 0x7f75a4107850 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.853+0000 7f75a8cce640 1 --2- 172.21.15.76:0/2635667760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a4107c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7598009820 tx=0x7f759802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ce744c1333393c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75a37fe640 1 -- 172.21.15.76:0/2635667760 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598037070 con 0x7f75a4107850 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75a37fe640 1 -- 172.21.15.76:0/2635667760 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7598032920 con 0x7f75a4107850 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75a37fe640 1 -- 172.21.15.76:0/2635667760 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598030950 con 0x7f75a4107850 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 -- 172.21.15.76:0/2635667760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 msgr2=0x7f75a4107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 --2- 172.21.15.76:0/2635667760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a4107c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7598009820 tx=0x7f759802a270 comp rx=0 tx=0).stop 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 -- 172.21.15.76:0/2635667760 shutdown_connections 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 --2- 172.21.15.76:0/2635667760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a4107c50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 -- 172.21.15.76:0/2635667760 >> 172.21.15.76:0/2635667760 conn(0x7f75a4103020 msgr2=0x7f75a4105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 -- 172.21.15.76:0/2635667760 shutdown_connections 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.854+0000 7f75aaf32640 1 -- 172.21.15.76:0/2635667760 wait complete. 2024-09-19T07:42:05.011 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75aaf32640 1 Processor -- start 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75aaf32640 1 -- start start 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75aaf32640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75aaf32640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f75a410be00 con 0x7f75a4107850 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75a8cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75a8cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50030/0 (socket says 172.21.15.76:50030) 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75a8cce640 1 -- 172.21.15.76:0/3564354015 learned_addr learned my addr 172.21.15.76:0/3564354015 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75a8cce640 1 -- 172.21.15.76:0/3564354015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a419bdd0 con 0x7f75a4107850 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.855+0000 7f75a8cce640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a419b890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7598009940 tx=0x7f7598032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.856+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598042070 con 0x7f75a4107850 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.856+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f75980326b0 con 0x7f75a4107850 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.856+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a419c060 con 0x7f75a4107850 2024-09-19T07:42:05.012 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.856+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598037040 con 0x7f75a4107850 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.856+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a419ed50 con 0x7f75a4107850 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.857+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f7598045070 con 0x7f75a4107850 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.857+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a410bf80 con 0x7f75a4107850 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.857+0000 7f75a1ffb640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f7594039160 0x7f759403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.857+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f759806c130 con 0x7f75a4107850 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.857+0000 7f75a3fff640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f7594039160 0x7f759403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.857+0000 7f75a3fff640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f7594039160 0x7f759403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f75900098c0 tx=0x7f7590006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:03.862+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7598045360 con 0x7f75a4107850 2024-09-19T07:42:05.013 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.072+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f75a419f3c0 con 0x7f75a4107850 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.436+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f7598043260 con 0x7f75a4107850 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.437+0000 7f75a1ffb640 1 -- 172.21.15.76:0/3564354015 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f759803dbf0 con 0x7f75a4107850 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f7594039160 msgr2=0x7f759403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f7594039160 0x7f759403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f75900098c0 tx=0x7f7590006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 msgr2=0x7f75a419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a419b890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7598009940 tx=0x7f7598032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 shutdown_connections 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f7594039160 0x7f759403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 --2- 172.21.15.76:0/3564354015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75a4107850 0x7f75a419b890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 >> 172.21.15.76:0/3564354015 conn(0x7f75a4103020 msgr2=0x7f75a4103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:05.014 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 shutdown_connections 2024-09-19T07:42:05.015 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:04.439+0000 7f75aaf32640 1 -- 172.21.15.76:0/3564354015 wait complete. 2024-09-19T07:42:05.127 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:04.776+0000 7f7b8ebee040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:42:05.128 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:04.842+0000 7f7b8ebee040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:42:05.128 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:04.989+0000 7f7b8ebee040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:42:05.389 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:05.133+0000 7f7b8ebee040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:42:05.647 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:05 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3564354015' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T07:42:05.648 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:05 smithi076 ceph-mon[30930]: mgrmap e5: x(active, since 6s) 2024-09-19T07:42:05.648 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:05.461+0000 7f7b8ebee040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:42:05.648 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:05.522+0000 7f7b8ebee040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:42:05.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:05.717+0000 7f7b8ebee040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:42:06.267 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:42:06.267 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T07:42:06.267 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:42:06.267 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T07:42:06.267 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.406+0000 7fb44bc33640 1 Processor -- start 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.406+0000 7fb44bc33640 1 -- start start 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.406+0000 7fb44bc33640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb444106b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.406+0000 7fb44bc33640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb444107140 con 0x7fb444106770 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.407+0000 7fb4499cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb444106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.407+0000 7fb4499cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb444106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50068/0 (socket says 172.21.15.76:50068) 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.407+0000 7fb4499cf640 1 -- 172.21.15.76:0/3176292195 learned_addr learned my addr 172.21.15.76:0/3176292195 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.407+0000 7fb4499cf640 1 -- 172.21.15.76:0/3176292195 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb444107970 con 0x7fb444106770 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.408+0000 7fb4499cf640 1 --2- 172.21.15.76:0/3176292195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb444106b70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb434009820 tx=0x7fb43402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de69737a40ac51b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.408+0000 7fb4489cd640 1 -- 172.21.15.76:0/3176292195 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb434037070 con 0x7fb444106770 2024-09-19T07:42:06.268 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.408+0000 7fb4489cd640 1 -- 172.21.15.76:0/3176292195 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb434032920 con 0x7fb444106770 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.408+0000 7fb4489cd640 1 -- 172.21.15.76:0/3176292195 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb434030950 con 0x7fb444106770 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 -- 172.21.15.76:0/3176292195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 msgr2=0x7fb444106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 --2- 172.21.15.76:0/3176292195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb444106b70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb434009820 tx=0x7fb43402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 -- 172.21.15.76:0/3176292195 shutdown_connections 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 --2- 172.21.15.76:0/3176292195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb444106b70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 -- 172.21.15.76:0/3176292195 >> 172.21.15.76:0/3176292195 conn(0x7fb444101f40 msgr2=0x7fb444104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 -- 172.21.15.76:0/3176292195 shutdown_connections 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 -- 172.21.15.76:0/3176292195 wait complete. 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 Processor -- start 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.409+0000 7fb44bc33640 1 -- start start 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb44bc33640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb44419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:06.269 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb44bc33640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb44410ad20 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb4499cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb44419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb4499cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb44419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50082/0 (socket says 172.21.15.76:50082) 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb4499cf640 1 -- 172.21.15.76:0/786243201 learned_addr learned my addr 172.21.15.76:0/786243201 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb4499cf640 1 -- 172.21.15.76:0/786243201 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44419be20 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb4499cf640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb44419b8e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb434006f10 tx=0x7fb4340327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb434037040 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb434040070 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44419c0b0 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.410+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43403a610 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.411+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44419eda0 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.411+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fb43403a850 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.412+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44410aea0 con 0x7fb444106770 2024-09-19T07:42:06.270 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.412+0000 7fb43affd640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 0x7fb43003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.412+0000 7fb4491ce640 1 -- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 msgr2=0x7fb43003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2265753650 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.412+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb43406c460 con 0x7fb444106770 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.412+0000 7fb4491ce640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 0x7fb43003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.417+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb434043c10 con 0x7fb444106770 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.613+0000 7fb4491ce640 1 -- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 msgr2=0x7fb43003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2265753650 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.613+0000 7fb4491ce640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 0x7fb43003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.631+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb44402d9c0 con 0x7fb444106770 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.631+0000 7fb43affd640 1 -- 172.21.15.76:0/786243201 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fb4340439b0 con 0x7fb444106770 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 msgr2=0x7fb43003b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 0x7fb43003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 msgr2=0x7fb44419b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb44419b8e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb434006f10 tx=0x7fb4340327d0 comp rx=0 tx=0).stop 2024-09-19T07:42:06.271 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 shutdown_connections 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7fb4300391b0 0x7fb43003b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.634+0000 7fb44bc33640 1 --2- 172.21.15.76:0/786243201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb444106770 0x7fb44419b8e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.635+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 >> 172.21.15.76:0/786243201 conn(0x7fb444101f40 msgr2=0x7fb444102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.635+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 shutdown_connections 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:05.635+0000 7fb44bc33640 1 -- 172.21.15.76:0/786243201 wait complete. 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for the mgr to restart... 2024-09-19T07:42:06.272 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr epoch 5... 2024-09-19T07:42:06.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:06 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/786243201' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T07:42:06.691 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:06 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:06.612+0000 7f7b8ebee040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:42:06.691 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:06 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:06.683+0000 7f7b8ebee040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:42:07.652 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.390+0000 7f7b8ebee040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:42:07.652 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.505+0000 7f7b8ebee040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:42:07.923 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.647+0000 7f7b8ebee040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:42:07.923 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.708+0000 7f7b8ebee040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:42:07.923 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.855+0000 7f7b8ebee040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:42:07.923 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.922+0000 7f7b8ebee040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:42:08.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:07.981+0000 7f7b8ebee040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:42:08.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:08.139+0000 7f7b8ebee040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:42:08.471 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:08.204+0000 7f7b8ebee040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:42:08.471 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:08.270+0000 7f7b8ebee040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:42:08.471 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:08.352+0000 7f7b8ebee040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:42:08.471 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:08.412+0000 7f7b8ebee040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:42:08.471 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:08.470+0000 7f7b8ebee040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:09.271+0000 7f7b8ebee040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: Active manager daemon x restarted 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: Activating manager daemon x 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: mgrmap e6: x(active, starting, since 0.00351044s) 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:42:09.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: Manager daemon x is now available 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:42:09.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:09 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:42:10.573 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-mon[30930]: Found migration_current of "None". Setting to last migration. 2024-09-19T07:42:10.573 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:10.573 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:10.573 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-mon[30930]: mgrmap e7: x(active, since 1.00535s) 2024-09-19T07:42:10.899 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:42:10.899 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T07:42:10.899 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T07:42:10.899 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622ee89640 1 Processor -- start 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622ee89640 1 -- start start 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622ee89640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622ee89640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f622807c7e0 con 0x7f622807ddf0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622cc25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622cc25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50094/0 (socket says 172.21.15.76:50094) 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622cc25640 1 -- 172.21.15.76:0/3361695566 learned_addr learned my addr 172.21.15.76:0/3361695566 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.690+0000 7f622cc25640 1 -- 172.21.15.76:0/3361695566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622807c960 con 0x7f622807ddf0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.691+0000 7f622cc25640 1 --2- 172.21.15.76:0/3361695566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622807c2a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f621c009820 tx=0x7f621c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feda598266ef7ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.691+0000 7f62277fe640 1 -- 172.21.15.76:0/3361695566 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c037070 con 0x7f622807ddf0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.691+0000 7f62277fe640 1 -- 172.21.15.76:0/3361695566 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f621c032920 con 0x7f622807ddf0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.691+0000 7f62277fe640 1 -- 172.21.15.76:0/3361695566 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c0309e0 con 0x7f622807ddf0 2024-09-19T07:42:10.900 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 -- 172.21.15.76:0/3361695566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 msgr2=0x7f622807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 --2- 172.21.15.76:0/3361695566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622807c2a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f621c009820 tx=0x7f621c02a300 comp rx=0 tx=0).stop 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 -- 172.21.15.76:0/3361695566 shutdown_connections 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 --2- 172.21.15.76:0/3361695566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622807c2a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 -- 172.21.15.76:0/3361695566 >> 172.21.15.76:0/3361695566 conn(0x7f6228103090 msgr2=0x7f62281054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 -- 172.21.15.76:0/3361695566 shutdown_connections 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.692+0000 7f622ee89640 1 -- 172.21.15.76:0/3361695566 wait complete. 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622ee89640 1 Processor -- start 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622ee89640 1 -- start start 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622ee89640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622ee89640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f622810ded0 con 0x7f622807ddf0 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622cc25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622cc25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622819dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50100/0 (socket says 172.21.15.76:50100) 2024-09-19T07:42:10.901 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622cc25640 1 -- 172.21.15.76:0/980155966 learned_addr learned my addr 172.21.15.76:0/980155966 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.693+0000 7f622cc25640 1 -- 172.21.15.76:0/980155966 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622819e010 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.694+0000 7f622cc25640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622819dad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f621c0306f0 tx=0x7f621c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.694+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c037040 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.694+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f621c040070 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.694+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622819e2a0 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.694+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c03a390 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.694+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62281a0f90 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.695+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f621c03a690 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.695+0000 7f6225ffb640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.695+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 --> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f621803bd80 con 0x7f62180391b0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.695+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f621c06c100 con 0x7f622807ddf0 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.695+0000 7f6227fff640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 msgr2=0x7f621803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2265753650 2024-09-19T07:42:10.902 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.695+0000 7f6227fff640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.896+0000 7f6227fff640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 msgr2=0x7f621803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2265753650 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:06.896+0000 7f6227fff640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:07.297+0000 7f6227fff640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 msgr2=0x7f621803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2265753650 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:07.297+0000 7f6227fff640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:08.098+0000 7f6227fff640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 msgr2=0x7f621803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/2265753650 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:08.098+0000 7f6227fff640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:09.274+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f621c06ae80 con 0x7f622807ddf0 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:09.275+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 msgr2=0x7f621803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:09.275+0000 7f6225ffb640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.275+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f621c03ad50 con 0x7f622807ddf0 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.275+0000 7f6225ffb640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f621803cae0 0x7f621803eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.275+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f621c00af30 con 0x7f621803cae0 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.276+0000 7f6227fff640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f621803cae0 0x7f621803eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:10.903 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.276+0000 7f6227fff640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f621803cae0 0x7f621803eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6214003980 tx=0x7f6214006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.277+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f621c00af30 con 0x7f621803cae0 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f622807c320 con 0x7f621803cae0 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f6225ffb640 1 -- 172.21.15.76:0/980155966 <== mgr.14118 v2:172.21.15.76:6800/1863850030 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f622807c320 con 0x7f621803cae0 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f621803cae0 msgr2=0x7f621803eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f621803cae0 0x7f621803eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6214003980 tx=0x7f6214006e10 comp rx=0 tx=0).stop 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 msgr2=0x7f622819dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622819dad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f621c0306f0 tx=0x7f621c0327b0 comp rx=0 tx=0).stop 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 shutdown_connections 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f621803cae0 0x7f621803eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:6800/2265753650,v1:172.21.15.76:6801/2265753650] conn(0x7f62180391b0 0x7f621803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 --2- 172.21.15.76:0/980155966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f622807ddf0 0x7f622819dad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.284+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 >> 172.21.15.76:0/980155966 conn(0x7f6228103090 msgr2=0x7f6228103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:10.904 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.285+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 shutdown_connections 2024-09-19T07:42:10.905 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:10.285+0000 7f622ee89640 1 -- 172.21.15.76:0/980155966 wait complete. 2024-09-19T07:42:10.905 INFO:teuthology.orchestra.run.smithi076.stdout:mgr epoch 5 is available 2024-09-19T07:42:10.905 INFO:teuthology.orchestra.run.smithi076.stdout:Setting orchestrator backend to cephadm... 2024-09-19T07:42:11.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:10.902+0000 7f7af5f48640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:42:10] ENGINE Error in HTTPServer.serve 2024-09-19T07:42:11.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: Traceback (most recent call last): 2024-09-19T07:42:11.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:42:11.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._connections.run(self.expiration_interval) 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._run(expiration_interval) 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: s = self.context.wrap_socket( 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: return self.sslsocket_class._create( 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self.do_handshake() 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:42:11.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._sslobj.do_handshake() 2024-09-19T07:42:11.196 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:42:11.196 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:11.494 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:11 smithi076 ceph-mon[30930]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T07:42:11.494 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:11 smithi076 ceph-mon[30930]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T07:42:11.495 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:11 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:12.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.304+0000 7ff881d17640 1 Processor -- start 2024-09-19T07:42:12.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff881d17640 1 -- start start 2024-09-19T07:42:12.097 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff881d17640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c10a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff881d17640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c07bd90 con 0x7ff87c1083d0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff87b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c10a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff87b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c10a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50170/0 (socket says 172.21.15.76:50170) 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff87b7fe640 1 -- 172.21.15.76:0/3354037225 learned_addr learned my addr 172.21.15.76:0/3354037225 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.305+0000 7ff87b7fe640 1 -- 172.21.15.76:0/3354037225 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c10ad00 con 0x7ff87c1083d0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.306+0000 7ff87b7fe640 1 --2- 172.21.15.76:0/3354037225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c10a7c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009820 tx=0x7ff86c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ca50ef91e9522e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.306+0000 7ff87affd640 1 -- 172.21.15.76:0/3354037225 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c037070 con 0x7ff87c1083d0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.306+0000 7ff87affd640 1 -- 172.21.15.76:0/3354037225 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff86c032920 con 0x7ff87c1083d0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.306+0000 7ff87affd640 1 -- 172.21.15.76:0/3354037225 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c030950 con 0x7ff87c1083d0 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 -- 172.21.15.76:0/3354037225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 msgr2=0x7ff87c10a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 --2- 172.21.15.76:0/3354037225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c10a7c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009820 tx=0x7ff86c02a270 comp rx=0 tx=0).stop 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 -- 172.21.15.76:0/3354037225 shutdown_connections 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 --2- 172.21.15.76:0/3354037225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c10a7c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 -- 172.21.15.76:0/3354037225 >> 172.21.15.76:0/3354037225 conn(0x7ff87c101f30 msgr2=0x7ff87c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:12.098 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 -- 172.21.15.76:0/3354037225 shutdown_connections 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 -- 172.21.15.76:0/3354037225 wait complete. 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 Processor -- start 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.307+0000 7ff881d17640 1 -- start start 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff881d17640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff881d17640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c10bcd0 con 0x7ff87c1083d0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff87b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff87b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50172/0 (socket says 172.21.15.76:50172) 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff87b7fe640 1 -- 172.21.15.76:0/1179655025 learned_addr learned my addr 172.21.15.76:0/1179655025 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff87b7fe640 1 -- 172.21.15.76:0/1179655025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c19bdd0 con 0x7ff87c1083d0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff87b7fe640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c19b890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff86c031000 tx=0x7ff86c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c042070 con 0x7ff87c1083d0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c19c060 con 0x7ff87c1083d0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff86c0326b0 con 0x7ff87c1083d0 2024-09-19T07:42:12.099 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c037040 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.308+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c19ed50 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.309+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7ff86c045070 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.309+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c108830 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.309+0000 7ff8797fa640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff8680390a0 0x7ff86803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.309+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff86c06c0d0 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.309+0000 7ff873fff640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff8680390a0 0x7ff86803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.310+0000 7ff873fff640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff8680390a0 0x7ff86803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8640098c0 tx=0x7ff864006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.314+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff86c04b170 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.327+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff86c03dbf0 con 0x7ff87c1083d0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.494+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff87c103230 con 0x7ff8680390a0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.499+0000 7ff8797fa640 1 -- 172.21.15.76:0/1179655025 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff87c103230 con 0x7ff8680390a0 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff8680390a0 msgr2=0x7ff86803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:12.100 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff8680390a0 0x7ff86803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8640098c0 tx=0x7ff864006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 msgr2=0x7ff87c19b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c19b890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff86c031000 tx=0x7ff86c032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 shutdown_connections 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff8680390a0 0x7ff86803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 --2- 172.21.15.76:0/1179655025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff87c1083d0 0x7ff87c19b890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 >> 172.21.15.76:0/1179655025 conn(0x7ff87c101f30 msgr2=0x7ff87c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 shutdown_connections 2024-09-19T07:42:12.101 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:11.501+0000 7ff881d17640 1 -- 172.21.15.76:0/1179655025 wait complete. 2024-09-19T07:42:12.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:10] ENGINE Bus STARTING 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:10] ENGINE Serving on http://172.21.15.76:8765 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:10] ENGINE Serving on https://172.21.15.76:7150 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:10] ENGINE Bus STARTED 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:10] ENGINE Error in HTTPServer.serve 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: Traceback (most recent call last): 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._run(expiration_interval) 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:42:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: s = self.context.wrap_socket( 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: return self.sslsocket_class._create( 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: self.do_handshake() 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._sslobj.do_handshake() 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: mgrmap e8: x(active, since 2s) 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:12.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:12 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:13.322 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T07:42:13.322 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.519+0000 7f9552a0d640 1 Processor -- start 2024-09-19T07:42:13.322 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f9552a0d640 1 -- start start 2024-09-19T07:42:13.322 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f9552a0d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c07cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f9552a0d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f954c07d100 con 0x7f954c07e6d0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f954bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c07cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f954bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c07cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50188/0 (socket says 172.21.15.76:50188) 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f954bfff640 1 -- 172.21.15.76:0/3671034294 learned_addr learned my addr 172.21.15.76:0/3671034294 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.520+0000 7f954bfff640 1 -- 172.21.15.76:0/3671034294 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c07d280 con 0x7f954c07e6d0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.521+0000 7f954bfff640 1 --2- 172.21.15.76:0/3671034294 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c07cb30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f953c009820 tx=0x7f953c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3079075bf1d2de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.521+0000 7f954affd640 1 -- 172.21.15.76:0/3671034294 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c037070 con 0x7f954c07e6d0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.521+0000 7f954affd640 1 -- 172.21.15.76:0/3671034294 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f953c032920 con 0x7f954c07e6d0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.521+0000 7f954affd640 1 -- 172.21.15.76:0/3671034294 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c030950 con 0x7f954c07e6d0 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 -- 172.21.15.76:0/3671034294 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 msgr2=0x7f954c07cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 --2- 172.21.15.76:0/3671034294 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c07cb30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f953c009820 tx=0x7f953c02a270 comp rx=0 tx=0).stop 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 -- 172.21.15.76:0/3671034294 shutdown_connections 2024-09-19T07:42:13.323 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 --2- 172.21.15.76:0/3671034294 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c07cb30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 -- 172.21.15.76:0/3671034294 >> 172.21.15.76:0/3671034294 conn(0x7f954c103070 msgr2=0x7f954c105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 -- 172.21.15.76:0/3671034294 shutdown_connections 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 -- 172.21.15.76:0/3671034294 wait complete. 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 Processor -- start 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.522+0000 7f9552a0d640 1 -- start start 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f9552a0d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f9552a0d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f954c10def0 con 0x7f954c07e6d0 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f954bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f954bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c19dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50196/0 (socket says 172.21.15.76:50196) 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f954bfff640 1 -- 172.21.15.76:0/3286385204 learned_addr learned my addr 172.21.15.76:0/3286385204 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f954bfff640 1 -- 172.21.15.76:0/3286385204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c19e000 con 0x7f954c07e6d0 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f954bfff640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c19dac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f953c031000 tx=0x7f953c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:13.324 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c042070 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f953c0325f0 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c19e290 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c037040 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.523+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c1a0f80 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.524+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f953c045070 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.524+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c07cbb0 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.524+0000 7f95497fa640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f95340391b0 0x7f953403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.525+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f953c06c520 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.525+0000 7f954b7fe640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f95340391b0 0x7f953403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.525+0000 7f954b7fe640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f95340391b0 0x7f953403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95400098c0 tx=0x7f9540006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.529+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f953c047440 con 0x7f954c07e6d0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.697+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f954c1043b0 con 0x7f95340391b0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.698+0000 7f95497fa640 1 -- 172.21.15.76:0/3286385204 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f954c1043b0 con 0x7f95340391b0 2024-09-19T07:42:13.325 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f95340391b0 msgr2=0x7f953403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f95340391b0 0x7f953403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95400098c0 tx=0x7f9540006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 msgr2=0x7f954c19dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c19dac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f953c031000 tx=0x7f953c032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 shutdown_connections 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f95340391b0 0x7f953403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 --2- 172.21.15.76:0/3286385204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f954c07e6d0 0x7f954c19dac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 >> 172.21.15.76:0/3286385204 conn(0x7f954c103070 msgr2=0x7f954c103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 shutdown_connections 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:12.700+0000 7f9552a0d640 1 -- 172.21.15.76:0/3286385204 wait complete. 2024-09-19T07:42:13.326 INFO:teuthology.orchestra.run.smithi076.stdout:Generating ssh key... 2024-09-19T07:42:13.601 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-mon[30930]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:14.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: Generating public/private rsa key pair. 2024-09-19T07:42:14.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: Your identification has been saved in /tmp/tmp_5caetco/key 2024-09-19T07:42:14.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: Your public key has been saved in /tmp/tmp_5caetco/key.pub 2024-09-19T07:42:14.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: The key fingerprint is: 2024-09-19T07:42:14.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: SHA256:bhQDn7PG1wZB4SzwIyIKvbLfcon2aSxaFaqPK14VpjY ceph-6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: The key's randomart image is: 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: +---[RSA 3072]----+ 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: | o .+. | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: | . = + . | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: |. o oo. X + | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: |.. +oo.o B o | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: |o oE.. S . o | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: | +..o + . . | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: |o .+ . o | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: |.=*.=. . | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: |*=o*+ | 2024-09-19T07:42:14.195 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: +----[SHA256]-----+ 2024-09-19T07:42:14.556 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:14 smithi076 ceph-mon[30930]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:14.556 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:14 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:14.556 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:14 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:14.564 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181f7b3640 1 Processor -- start 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181f7b3640 1 -- start start 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181f7b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f1818107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181f7b3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1818108220 con 0x7f1818107850 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181d54f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f1818107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181d54f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f1818107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34380/0 (socket says 172.21.15.76:34380) 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.678+0000 7f181d54f640 1 -- 172.21.15.76:0/1449114905 learned_addr learned my addr 172.21.15.76:0/1449114905 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.679+0000 7f181d54f640 1 -- 172.21.15.76:0/1449114905 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1818108a50 con 0x7f1818107850 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.679+0000 7f181d54f640 1 --2- 172.21.15.76:0/1449114905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f1818107c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1814009820 tx=0x7f181402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637499216a1423b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.679+0000 7f180ffff640 1 -- 172.21.15.76:0/1449114905 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814037070 con 0x7f1818107850 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.679+0000 7f180ffff640 1 -- 172.21.15.76:0/1449114905 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1814032920 con 0x7f1818107850 2024-09-19T07:42:14.565 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.679+0000 7f180ffff640 1 -- 172.21.15.76:0/1449114905 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814030950 con 0x7f1818107850 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 -- 172.21.15.76:0/1449114905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 msgr2=0x7f1818107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 --2- 172.21.15.76:0/1449114905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f1818107c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1814009820 tx=0x7f181402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 -- 172.21.15.76:0/1449114905 shutdown_connections 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 --2- 172.21.15.76:0/1449114905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f1818107c50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 -- 172.21.15.76:0/1449114905 >> 172.21.15.76:0/1449114905 conn(0x7f1818103020 msgr2=0x7f1818105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 -- 172.21.15.76:0/1449114905 shutdown_connections 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.680+0000 7f181f7b3640 1 -- 172.21.15.76:0/1449114905 wait complete. 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181f7b3640 1 Processor -- start 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181f7b3640 1 -- start start 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181f7b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f181819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181f7b3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f181810be00 con 0x7f1818107850 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181d54f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f181819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:14.566 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181d54f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f181819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34392/0 (socket says 172.21.15.76:34392) 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181d54f640 1 -- 172.21.15.76:0/4221548831 learned_addr learned my addr 172.21.15.76:0/4221548831 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181d54f640 1 -- 172.21.15.76:0/4221548831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181819bdd0 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f181d54f640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f181819b890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1814009940 tx=0x7f1814032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814042070 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.681+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f18140326b0 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.682+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181819c060 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.682+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814037040 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.682+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181819ed50 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.682+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1814045070 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.682+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181810bf80 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.683+0000 7f180e7fc640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f18040391b0 0x7f180403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.683+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f181406c230 con 0x7f1818107850 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.683+0000 7f181cd4e640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f18040391b0 0x7f180403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:14.567 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.683+0000 7f181cd4e640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f18040391b0 0x7f180403b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18080098c0 tx=0x7f1808006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.687+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1814045360 con 0x7f1818107850 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.853+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f1818104350 con 0x7f18040391b0 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.982+0000 7f180e7fc640 1 -- 172.21.15.76:0/4221548831 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1818104350 con 0x7f18040391b0 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.984+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f18040391b0 msgr2=0x7f180403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.984+0000 7f181f7b3640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f18040391b0 0x7f180403b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18080098c0 tx=0x7f1808006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.984+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 msgr2=0x7f181819b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.984+0000 7f181f7b3640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f181819b890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1814009940 tx=0x7f1814032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.985+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 shutdown_connections 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.985+0000 7f181f7b3640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f18040391b0 0x7f180403b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.985+0000 7f181f7b3640 1 --2- 172.21.15.76:0/4221548831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1818107850 0x7f181819b890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.985+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 >> 172.21.15.76:0/4221548831 conn(0x7f1818103020 msgr2=0x7f1818103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.985+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 shutdown_connections 2024-09-19T07:42:14.568 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:13.985+0000 7f181f7b3640 1 -- 172.21.15.76:0/4221548831 wait complete. 2024-09-19T07:42:15.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:15 smithi076 ceph-mon[30930]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:15.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:15 smithi076 ceph-mon[30930]: Generating ssh key... 2024-09-19T07:42:15.616 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:42:15.617 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c26036640 1 Processor -- start 2024-09-19T07:42:15.617 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c26036640 1 -- start start 2024-09-19T07:42:15.617 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c26036640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c20106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:15.617 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c26036640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20107120 con 0x7f8c20106750 2024-09-19T07:42:15.618 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c1f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c20106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:15.618 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c1f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c20106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34406/0 (socket says 172.21.15.76:34406) 2024-09-19T07:42:15.618 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c1f7fe640 1 -- 172.21.15.76:0/2557737317 learned_addr learned my addr 172.21.15.76:0/2557737317 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:15.618 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.976+0000 7f8c1f7fe640 1 -- 172.21.15.76:0/2557737317 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c20107950 con 0x7f8c20106750 2024-09-19T07:42:15.618 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.977+0000 7f8c1f7fe640 1 --2- 172.21.15.76:0/2557737317 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c20106b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009820 tx=0x7f8c1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb0c1abbe335ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.977+0000 7f8c1e7fc640 1 -- 172.21.15.76:0/2557737317 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10037070 con 0x7f8c20106750 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.977+0000 7f8c1e7fc640 1 -- 172.21.15.76:0/2557737317 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8c10032920 con 0x7f8c20106750 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.977+0000 7f8c1e7fc640 1 -- 172.21.15.76:0/2557737317 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10030950 con 0x7f8c20106750 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 -- 172.21.15.76:0/2557737317 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 msgr2=0x7f8c20106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 --2- 172.21.15.76:0/2557737317 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c20106b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009820 tx=0x7f8c1002a270 comp rx=0 tx=0).stop 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 -- 172.21.15.76:0/2557737317 shutdown_connections 2024-09-19T07:42:15.619 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 --2- 172.21.15.76:0/2557737317 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c20106b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 -- 172.21.15.76:0/2557737317 >> 172.21.15.76:0/2557737317 conn(0x7f8c20101f20 msgr2=0x7f8c20104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 -- 172.21.15.76:0/2557737317 shutdown_connections 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.978+0000 7f8c26036640 1 -- 172.21.15.76:0/2557737317 wait complete. 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c26036640 1 Processor -- start 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c26036640 1 -- start start 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c26036640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c2019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c26036640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2010ad00 con 0x7f8c20106750 2024-09-19T07:42:15.620 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c1f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c2019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c1f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c2019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34408/0 (socket says 172.21.15.76:34408) 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c1f7fe640 1 -- 172.21.15.76:0/4275283888 learned_addr learned my addr 172.21.15.76:0/4275283888 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c1f7fe640 1 -- 172.21.15.76:0/4275283888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2019acd0 con 0x7f8c20106750 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.979+0000 7f8c1f7fe640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c2019a790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c10006f10 tx=0x7f8c100327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.980+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10037040 con 0x7f8c20106750 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.980+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8c10040070 con 0x7f8c20106750 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.980+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1003a610 con 0x7f8c20106750 2024-09-19T07:42:15.621 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.980+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2019af60 con 0x7f8c20106750 2024-09-19T07:42:15.622 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.980+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2019dc50 con 0x7f8c20106750 2024-09-19T07:42:15.622 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.980+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8c1003a800 con 0x7f8c20106750 2024-09-19T07:42:15.622 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.981+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2010ae80 con 0x7f8c20106750 2024-09-19T07:42:15.622 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.981+0000 7f8c1cff9640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f8c08039200 0x7f8c0803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:15.623 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.981+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8c1006c5f0 con 0x7f8c20106750 2024-09-19T07:42:15.623 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.981+0000 7f8c1effd640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f8c08039200 0x7f8c0803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:15.623 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.981+0000 7f8c1effd640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f8c08039200 0x7f8c0803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c140098c0 tx=0x7f8c14006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:15.623 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:14.986+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c10041270 con 0x7f8c20106750 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.151+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f8c20103250 con 0x7f8c08039200 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.152+0000 7f8c1cff9640 1 -- 172.21.15.76:0/4275283888 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f8c20103250 con 0x7f8c08039200 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f8c08039200 msgr2=0x7f8c0803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f8c08039200 0x7f8c0803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c140098c0 tx=0x7f8c14006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 msgr2=0x7f8c2019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c2019a790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c10006f10 tx=0x7f8c100327d0 comp rx=0 tx=0).stop 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 shutdown_connections 2024-09-19T07:42:15.624 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f8c08039200 0x7f8c0803b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:15.625 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 --2- 172.21.15.76:0/4275283888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8c20106750 0x7f8c2019a790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:15.625 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 >> 172.21.15.76:0/4275283888 conn(0x7f8c20101f20 msgr2=0x7f8c20102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:15.625 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 shutdown_connections 2024-09-19T07:42:15.625 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:15.154+0000 7f8c26036640 1 -- 172.21.15.76:0/4275283888 wait complete. 2024-09-19T07:42:15.625 INFO:teuthology.orchestra.run.smithi076.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:42:15.625 INFO:teuthology.orchestra.run.smithi076.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T07:42:15.626 INFO:teuthology.orchestra.run.smithi076.stdout:Adding host smithi076... 2024-09-19T07:42:16.459 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:16 smithi076 ceph-mon[30930]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:17.495 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:17 smithi076 ceph-mon[30930]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi076", "addr": "172.21.15.76", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:18.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:18 smithi076 ceph-mon[30930]: Deploying cephadm binary to smithi076 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Added host 'smithi076' with addr '172.21.15.76' 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0df5fca640 1 Processor -- start 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0df5fca640 1 -- start start 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0df5fca640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df010a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0df5fca640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0df007be10 con 0x7f0df0108350 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0def7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df010a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0def7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df010a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34420/0 (socket says 172.21.15.76:34420) 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0def7fe640 1 -- 172.21.15.76:0/3263556645 learned_addr learned my addr 172.21.15.76:0/3263556645 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.028+0000 7f0def7fe640 1 -- 172.21.15.76:0/3263556645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df010ac80 con 0x7f0df0108350 2024-09-19T07:42:20.006 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.029+0000 7f0def7fe640 1 --2- 172.21.15.76:0/3263556645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df010a740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009820 tx=0x7f0de002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea37a6522e5d085 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.029+0000 7f0dee7fc640 1 -- 172.21.15.76:0/3263556645 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0037070 con 0x7f0df0108350 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.029+0000 7f0dee7fc640 1 -- 172.21.15.76:0/3263556645 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0de0032920 con 0x7f0df0108350 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.029+0000 7f0dee7fc640 1 -- 172.21.15.76:0/3263556645 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0030950 con 0x7f0df0108350 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 -- 172.21.15.76:0/3263556645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 msgr2=0x7f0df010a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 --2- 172.21.15.76:0/3263556645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df010a740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009820 tx=0x7f0de002a270 comp rx=0 tx=0).stop 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 -- 172.21.15.76:0/3263556645 shutdown_connections 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 --2- 172.21.15.76:0/3263556645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df010a740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 -- 172.21.15.76:0/3263556645 >> 172.21.15.76:0/3263556645 conn(0x7f0df0101f30 msgr2=0x7f0df0104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 -- 172.21.15.76:0/3263556645 shutdown_connections 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 -- 172.21.15.76:0/3263556645 wait complete. 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.030+0000 7f0df5fca640 1 Processor -- start 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0df5fca640 1 -- start start 2024-09-19T07:42:20.007 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0df5fca640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0df5fca640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0df010bcb0 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0def7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0def7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34434/0 (socket says 172.21.15.76:34434) 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0def7fe640 1 -- 172.21.15.76:0/4087238854 learned_addr learned my addr 172.21.15.76:0/4087238854 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0def7fe640 1 -- 172.21.15.76:0/4087238854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df019bdd0 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0def7fe640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df019b890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0de0006f10 tx=0x7f0de00327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0037040 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0de0040070 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df019c060 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de003a630 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.031+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df019ed50 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.032+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0de003ba70 con 0x7f0df0108350 2024-09-19T07:42:20.008 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.032+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df01087b0 con 0x7f0df0108350 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.032+0000 7f0decff9640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0dd80391b0 0x7f0dd803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.032+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0de006c6d0 con 0x7f0df0108350 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.033+0000 7f0deeffd640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0dd80391b0 0x7f0dd803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.033+0000 7f0deeffd640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0dd80391b0 0x7f0dd803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0de40098c0 tx=0x7f0de4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.037+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0de0043360 con 0x7f0df0108350 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:16.205+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi076", "addr": "172.21.15.76", "target": ["mon-mgr", ""]}) -- 0x7f0df01031f0 con 0x7f0dd80391b0 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.388+0000 7f0decff9640 1 -- 172.21.15.76:0/4087238854 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0df01031f0 con 0x7f0dd80391b0 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0dd80391b0 msgr2=0x7f0dd803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0dd80391b0 0x7f0dd803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0de40098c0 tx=0x7f0de4006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 msgr2=0x7f0df019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df019b890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0de0006f10 tx=0x7f0de00327d0 comp rx=0 tx=0).stop 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 shutdown_connections 2024-09-19T07:42:20.009 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0dd80391b0 0x7f0dd803b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:20.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 --2- 172.21.15.76:0/4087238854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0df0108350 0x7f0df019b890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:20.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 >> 172.21.15.76:0/4087238854 conn(0x7f0df0101f30 msgr2=0x7f0df0102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:20.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 shutdown_connections 2024-09-19T07:42:20.010 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:19.391+0000 7f0df5fca640 1 -- 172.21.15.76:0/4087238854 wait complete. 2024-09-19T07:42:20.010 INFO:teuthology.orchestra.run.smithi076.stdout:Deploying unmanaged mon service... 2024-09-19T07:42:20.600 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:20 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:20.601 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:20 smithi076 ceph-mon[30930]: Added host smithi076 2024-09-19T07:42:20.601 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:20 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:21.402 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T07:42:21.402 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f3770639640 1 Processor -- start 2024-09-19T07:42:21.402 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f3770639640 1 -- start start 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f3770639640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376810a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f3770639640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f376807be50 con 0x7f37681082c0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f376e3d5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376810a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f376e3d5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376810a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34450/0 (socket says 172.21.15.76:34450) 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.399+0000 7f376e3d5640 1 -- 172.21.15.76:0/550737588 learned_addr learned my addr 172.21.15.76:0/550737588 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.400+0000 7f376e3d5640 1 -- 172.21.15.76:0/550737588 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376810abf0 con 0x7f37681082c0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.400+0000 7f376e3d5640 1 --2- 172.21.15.76:0/550737588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376810a6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3764009820 tx=0x7f376402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df2c1464119697 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.400+0000 7f376d3d3640 1 -- 172.21.15.76:0/550737588 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764037070 con 0x7f37681082c0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f376d3d3640 1 -- 172.21.15.76:0/550737588 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3764032920 con 0x7f37681082c0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f376d3d3640 1 -- 172.21.15.76:0/550737588 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764030950 con 0x7f37681082c0 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 -- 172.21.15.76:0/550737588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 msgr2=0x7f376810a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:21.403 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 --2- 172.21.15.76:0/550737588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376810a6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3764009820 tx=0x7f376402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 -- 172.21.15.76:0/550737588 shutdown_connections 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 --2- 172.21.15.76:0/550737588 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376810a6b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 -- 172.21.15.76:0/550737588 >> 172.21.15.76:0/550737588 conn(0x7f3768101f20 msgr2=0x7f3768104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 -- 172.21.15.76:0/550737588 shutdown_connections 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.401+0000 7f3770639640 1 -- 172.21.15.76:0/550737588 wait complete. 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f3770639640 1 Processor -- start 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f3770639640 1 -- start start 2024-09-19T07:42:21.404 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f3770639640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f3770639640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f376810bc80 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f376e3d5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f376e3d5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376819b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34460/0 (socket says 172.21.15.76:34460) 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f376e3d5640 1 -- 172.21.15.76:0/2918085616 learned_addr learned my addr 172.21.15.76:0/2918085616 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f376e3d5640 1 -- 172.21.15.76:0/2918085616 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376819bd80 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.402+0000 7f376e3d5640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376819b840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3764031000 tx=0x7f3764032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.403+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764042070 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.403+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f37640326b0 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.403+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376819c010 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.403+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764037040 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.403+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376819ed00 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.403+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3764045070 con 0x7f37681082c0 2024-09-19T07:42:21.405 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.404+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3768108720 con 0x7f37681082c0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.404+0000 7f375f7fe640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f37540391b0 0x7f375403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.404+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f376406c3b0 con 0x7f37681082c0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.404+0000 7f376dbd4640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f37540391b0 0x7f375403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.404+0000 7f376dbd4640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f37540391b0 0x7f375403b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f37580098c0 tx=0x7f3758006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.408+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f376403c800 con 0x7f37681082c0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.600+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f37681031d0 con 0x7f37540391b0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.604+0000 7f375f7fe640 1 -- 172.21.15.76:0/2918085616 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f37681031d0 con 0x7f37540391b0 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f37540391b0 msgr2=0x7f375403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f37540391b0 0x7f375403b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f37580098c0 tx=0x7f3758006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 msgr2=0x7f376819b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376819b840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3764031000 tx=0x7f3764032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 shutdown_connections 2024-09-19T07:42:21.406 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f37540391b0 0x7f375403b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:21.407 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 --2- 172.21.15.76:0/2918085616 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37681082c0 0x7f376819b840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:21.407 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.606+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 >> 172.21.15.76:0/2918085616 conn(0x7f3768101f20 msgr2=0x7f3768102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:21.407 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.607+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 shutdown_connections 2024-09-19T07:42:21.407 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:20.607+0000 7f3770639640 1 -- 172.21.15.76:0/2918085616 wait complete. 2024-09-19T07:42:21.407 INFO:teuthology.orchestra.run.smithi076.stdout:Deploying unmanaged mgr service... 2024-09-19T07:42:21.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:21 smithi076 ceph-mon[30930]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:21.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:21 smithi076 ceph-mon[30930]: Saving service mon spec with placement count:5 2024-09-19T07:42:21.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:21 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:22.967 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T07:42:22.968 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93f0d6640 1 Processor -- start 2024-09-19T07:42:22.968 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93f0d6640 1 -- start start 2024-09-19T07:42:22.968 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93f0d6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa93810a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:22.968 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93f0d6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa93807be50 con 0x7fa938108310 2024-09-19T07:42:22.968 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93ce72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa93810a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:22.968 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93ce72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa93810a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34470/0 (socket says 172.21.15.76:34470) 2024-09-19T07:42:22.969 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.759+0000 7fa93ce72640 1 -- 172.21.15.76:0/3073732663 learned_addr learned my addr 172.21.15.76:0/3073732663 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:22.969 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.760+0000 7fa93ce72640 1 -- 172.21.15.76:0/3073732663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93810ac40 con 0x7fa938108310 2024-09-19T07:42:22.969 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.760+0000 7fa93ce72640 1 --2- 172.21.15.76:0/3073732663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa93810a700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa928009820 tx=0x7fa92802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe2d7366bb3cdac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:22.978 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.760+0000 7fa9377fe640 1 -- 172.21.15.76:0/3073732663 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928037070 con 0x7fa938108310 2024-09-19T07:42:22.979 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.760+0000 7fa9377fe640 1 -- 172.21.15.76:0/3073732663 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa928032920 con 0x7fa938108310 2024-09-19T07:42:22.979 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.760+0000 7fa9377fe640 1 -- 172.21.15.76:0/3073732663 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928030950 con 0x7fa938108310 2024-09-19T07:42:22.979 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3073732663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 msgr2=0x7fa93810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:22.979 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 --2- 172.21.15.76:0/3073732663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa93810a700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa928009820 tx=0x7fa92802a270 comp rx=0 tx=0).stop 2024-09-19T07:42:22.980 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3073732663 shutdown_connections 2024-09-19T07:42:22.980 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 --2- 172.21.15.76:0/3073732663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa93810a700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:22.980 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3073732663 >> 172.21.15.76:0/3073732663 conn(0x7fa938101f30 msgr2=0x7fa938104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:22.980 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3073732663 shutdown_connections 2024-09-19T07:42:22.980 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.761+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3073732663 wait complete. 2024-09-19T07:42:22.980 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93f0d6640 1 Processor -- start 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93f0d6640 1 -- start start 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93f0d6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa938107b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93f0d6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa93810bcd0 con 0x7fa938108310 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93ce72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa938107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93ce72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa938107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34478/0 (socket says 172.21.15.76:34478) 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93ce72640 1 -- 172.21.15.76:0/3412433075 learned_addr learned my addr 172.21.15.76:0/3412433075 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:22.981 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93ce72640 1 -- 172.21.15.76:0/3412433075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9381080d0 con 0x7fa938108310 2024-09-19T07:42:22.982 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93ce72640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa938107b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa928031000 tx=0x7fa928032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:22.982 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928042070 con 0x7fa938108310 2024-09-19T07:42:22.982 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa9280326b0 con 0x7fa938108310 2024-09-19T07:42:22.982 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9381062c0 con 0x7fa938108310 2024-09-19T07:42:22.982 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.762+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa928037040 con 0x7fa938108310 2024-09-19T07:42:22.982 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.763+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa938106800 con 0x7fa938108310 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.763+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa928045070 con 0x7fa938108310 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.764+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa938108770 con 0x7fa938108310 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.764+0000 7fa935ffb640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7fa924039200 0x7fa92403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.764+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa92806c2d0 con 0x7fa938108310 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.764+0000 7fa937fff640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7fa924039200 0x7fa92403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.764+0000 7fa937fff640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7fa924039200 0x7fa92403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa9200098c0 tx=0x7fa920006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:22.983 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.768+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa92806bc60 con 0x7fa938108310 2024-09-19T07:42:22.984 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.948+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa9381070b0 con 0x7fa924039200 2024-09-19T07:42:22.984 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.955+0000 7fa935ffb640 1 -- 172.21.15.76:0/3412433075 <== mgr.14118 v2:172.21.15.76:6800/1863850030 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa9381070b0 con 0x7fa924039200 2024-09-19T07:42:22.984 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7fa924039200 msgr2=0x7fa92403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:22.984 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7fa924039200 0x7fa92403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa9200098c0 tx=0x7fa920006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:22.984 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 msgr2=0x7fa938107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:22.984 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa938107b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa928031000 tx=0x7fa928032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:22.985 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 shutdown_connections 2024-09-19T07:42:22.985 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7fa924039200 0x7fa92403b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:22.985 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 --2- 172.21.15.76:0/3412433075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa938108310 0x7fa938107b90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:22.985 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 >> 172.21.15.76:0/3412433075 conn(0x7fa938101f30 msgr2=0x7fa938102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:22.985 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 shutdown_connections 2024-09-19T07:42:22.985 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:21.957+0000 7fa93f0d6640 1 -- 172.21.15.76:0/3412433075 wait complete. 2024-09-19T07:42:23.081 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:22 smithi076 ceph-mon[30930]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:23.081 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:22 smithi076 ceph-mon[30930]: Saving service mgr spec with placement count:2 2024-09-19T07:42:23.081 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:22 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:24.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d150c1640 1 Processor -- start 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d150c1640 1 -- start start 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d150c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d10106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d150c1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10107120 con 0x7f1d10106750 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d0ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d10106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d0ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d10106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49054/0 (socket says 172.21.15.76:49054) 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d0ed9d640 1 -- 172.21.15.76:0/2526662735 learned_addr learned my addr 172.21.15.76:0/2526662735 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:24.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.356+0000 7f1d0ed9d640 1 -- 172.21.15.76:0/2526662735 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d10107950 con 0x7f1d10106750 2024-09-19T07:42:24.509 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.357+0000 7f1d0ed9d640 1 --2- 172.21.15.76:0/2526662735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d10106b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009820 tx=0x7f1d0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b295c4ebc3127498 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:24.509 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.357+0000 7f1d0dd9b640 1 -- 172.21.15.76:0/2526662735 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d00037070 con 0x7f1d10106750 2024-09-19T07:42:24.509 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.357+0000 7f1d0dd9b640 1 -- 172.21.15.76:0/2526662735 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1d00032920 con 0x7f1d10106750 2024-09-19T07:42:24.509 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.357+0000 7f1d0dd9b640 1 -- 172.21.15.76:0/2526662735 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d00030950 con 0x7f1d10106750 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 -- 172.21.15.76:0/2526662735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 msgr2=0x7f1d10106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 --2- 172.21.15.76:0/2526662735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d10106b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009820 tx=0x7f1d0002a270 comp rx=0 tx=0).stop 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 -- 172.21.15.76:0/2526662735 shutdown_connections 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 --2- 172.21.15.76:0/2526662735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d10106b50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 -- 172.21.15.76:0/2526662735 >> 172.21.15.76:0/2526662735 conn(0x7f1d10101f20 msgr2=0x7f1d10104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 -- 172.21.15.76:0/2526662735 shutdown_connections 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 -- 172.21.15.76:0/2526662735 wait complete. 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.358+0000 7f1d150c1640 1 Processor -- start 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d150c1640 1 -- start start 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d150c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d1019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d150c1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1010ad00 con 0x7f1d10106750 2024-09-19T07:42:24.510 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d0ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d1019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d0ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d1019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49058/0 (socket says 172.21.15.76:49058) 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d0ed9d640 1 -- 172.21.15.76:0/2010233481 learned_addr learned my addr 172.21.15.76:0/2010233481 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d0ed9d640 1 -- 172.21.15.76:0/2010233481 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1019be50 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1d0ed9d640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d1019b910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009940 tx=0x7f1d00032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.359+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d00042070 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.360+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1d000326b0 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.360+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1019c0e0 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.360+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d00037040 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.360+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1019edd0 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.360+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1d00045070 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.360+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1010ae80 con 0x7f1d10106750 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.361+0000 7f1cf7fff640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1cf80391b0 0x7f1cf803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:24.511 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.361+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1d0006c260 con 0x7f1d10106750 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.361+0000 7f1d0e59c640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1cf80391b0 0x7f1cf803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.361+0000 7f1d0e59c640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1cf80391b0 0x7f1cf803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d040098c0 tx=0x7f1d04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.365+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d0003c800 con 0x7f1d10106750 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.539+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f1d10106bd0 con 0x7f1d10106750 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.541+0000 7f1cf7fff640 1 -- 172.21.15.76:0/2010233481 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f1d0003ccd0 con 0x7f1d10106750 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.543+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1cf80391b0 msgr2=0x7f1cf803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.543+0000 7f1d150c1640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1cf80391b0 0x7f1cf803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d040098c0 tx=0x7f1d04006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.543+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 msgr2=0x7f1d1019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.543+0000 7f1d150c1640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d1019b910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009940 tx=0x7f1d00032e40 comp rx=0 tx=0).stop 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.544+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 shutdown_connections 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.544+0000 7f1d150c1640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1cf80391b0 0x7f1cf803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.544+0000 7f1d150c1640 1 --2- 172.21.15.76:0/2010233481 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d10106750 0x7f1d1019b910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:24.512 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.544+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 >> 172.21.15.76:0/2010233481 conn(0x7f1d10101f20 msgr2=0x7f1d10102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:24.513 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.544+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 shutdown_connections 2024-09-19T07:42:24.513 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:23.544+0000 7f1d150c1640 1 -- 172.21.15.76:0/2010233481 wait complete. 2024-09-19T07:42:24.750 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:24 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2010233481' entity='client.admin' 2024-09-19T07:42:24.751 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:24 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:24.751 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:24 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:26.071 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.931+0000 7f0e89350640 1 Processor -- start 2024-09-19T07:42:26.071 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e89350640 1 -- start start 2024-09-19T07:42:26.071 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e89350640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8410a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:26.072 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e89350640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8407be30 con 0x7f0e841082e0 2024-09-19T07:42:26.072 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e82ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8410a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:26.072 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e82ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8410a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49062/0 (socket says 172.21.15.76:49062) 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e82ffd640 1 -- 172.21.15.76:0/2626875915 learned_addr learned my addr 172.21.15.76:0/2626875915 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.932+0000 7f0e82ffd640 1 -- 172.21.15.76:0/2626875915 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8410ac10 con 0x7f0e841082e0 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.933+0000 7f0e82ffd640 1 --2- 172.21.15.76:0/2626875915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8410a6d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009820 tx=0x7f0e7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35bc5ce4ec5b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.933+0000 7f0e81ffb640 1 -- 172.21.15.76:0/2626875915 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e74037070 con 0x7f0e841082e0 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.933+0000 7f0e81ffb640 1 -- 172.21.15.76:0/2626875915 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e74032940 con 0x7f0e841082e0 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.933+0000 7f0e81ffb640 1 -- 172.21.15.76:0/2626875915 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e740308b0 con 0x7f0e841082e0 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 -- 172.21.15.76:0/2626875915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 msgr2=0x7f0e8410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 --2- 172.21.15.76:0/2626875915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8410a6d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009820 tx=0x7f0e7402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 -- 172.21.15.76:0/2626875915 shutdown_connections 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 --2- 172.21.15.76:0/2626875915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8410a6d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:26.073 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 -- 172.21.15.76:0/2626875915 >> 172.21.15.76:0/2626875915 conn(0x7f0e84101f20 msgr2=0x7f0e84104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 -- 172.21.15.76:0/2626875915 shutdown_connections 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.934+0000 7f0e89350640 1 -- 172.21.15.76:0/2626875915 wait complete. 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e89350640 1 Processor -- start 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e89350640 1 -- start start 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e89350640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e89350640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8410bc20 con 0x7f0e841082e0 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e82ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e82ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49074/0 (socket says 172.21.15.76:49074) 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e82ffd640 1 -- 172.21.15.76:0/3883271436 learned_addr learned my addr 172.21.15.76:0/3883271436 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.935+0000 7f0e82ffd640 1 -- 172.21.15.76:0/3883271436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8419bd70 con 0x7f0e841082e0 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.936+0000 7f0e82ffd640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8419b830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e740097f0 tx=0x7f0e74032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.936+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e74042070 con 0x7f0e841082e0 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.936+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e7403d930 con 0x7f0e841082e0 2024-09-19T07:42:26.074 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.936+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8419c060 con 0x7f0e841082e0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.936+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e74037040 con 0x7f0e841082e0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.936+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e841060d0 con 0x7f0e841082e0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.937+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0e74045070 con 0x7f0e841082e0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.937+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e84108740 con 0x7f0e841082e0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.937+0000 7f0e6bfff640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0e6c03d5c0 0x7f0e6c03fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.937+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e7406c370 con 0x7f0e841082e0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.937+0000 7f0e827fc640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0e6c03d5c0 0x7f0e6c03fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:26.075 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.938+0000 7f0e827fc640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0e6c03d5c0 0x7f0e6c03fa80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098c0 tx=0x7f0e78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:24.943+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e7404b170 con 0x7f0e841082e0 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.116+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f0e84106810 con 0x7f0e841082e0 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.118+0000 7f0e6bfff640 1 -- 172.21.15.76:0/3883271436 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f0e74042d00 con 0x7f0e841082e0 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0e6c03d5c0 msgr2=0x7f0e6c03fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0e6c03d5c0 0x7f0e6c03fa80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098c0 tx=0x7f0e78006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 msgr2=0x7f0e8419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8419b830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e740097f0 tx=0x7f0e74032670 comp rx=0 tx=0).stop 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 shutdown_connections 2024-09-19T07:42:26.076 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f0e6c03d5c0 0x7f0e6c03fa80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:26.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 --2- 172.21.15.76:0/3883271436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0e841082e0 0x7f0e8419b830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:26.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.120+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 >> 172.21.15.76:0/3883271436 conn(0x7f0e84101f20 msgr2=0x7f0e84102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:26.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.121+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 shutdown_connections 2024-09-19T07:42:26.077 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:25.121+0000 7f0e89350640 1 -- 172.21.15.76:0/3883271436 wait complete. 2024-09-19T07:42:26.077 INFO:teuthology.orchestra.run.smithi076.stdout:Enabling the dashboard module... 2024-09-19T07:42:26.397 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:26 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3883271436' entity='client.admin' 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/34881358' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-mon[30930]: from='mgr.14118 172.21.15.76:0/3948104424' entity='mgr.x' 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ignoring --setuser ceph since I am not root 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ignoring --setgroup ceph since I am not root 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:27.707+0000 7fa0fe6c9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:42:27.908 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:27.763+0000 7fa0fe6c9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:42:28.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:27.917+0000 7fa0fe6c9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:42:28.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:27.983+0000 7fa0fe6c9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:42:28.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:28.136+0000 7fa0fe6c9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:42:28.559 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:28.278+0000 7fa0fe6c9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:42:28.724 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77f9ba640 1 Processor -- start 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77f9ba640 1 -- start start 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77f9ba640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff778107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77f9ba640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff778108220 con 0x7ff778107850 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77d756640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff778107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77d756640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff778107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49090/0 (socket says 172.21.15.76:49090) 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77d756640 1 -- 172.21.15.76:0/2982118962 learned_addr learned my addr 172.21.15.76:0/2982118962 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.475+0000 7ff77d756640 1 -- 172.21.15.76:0/2982118962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff778108a50 con 0x7ff778107850 2024-09-19T07:42:28.725 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.476+0000 7ff77d756640 1 --2- 172.21.15.76:0/2982118962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff778107c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff774009820 tx=0x7ff77402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5647e01fb87b9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.476+0000 7ff76ffff640 1 -- 172.21.15.76:0/2982118962 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff774037070 con 0x7ff778107850 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.476+0000 7ff76ffff640 1 -- 172.21.15.76:0/2982118962 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff774032940 con 0x7ff778107850 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.476+0000 7ff76ffff640 1 -- 172.21.15.76:0/2982118962 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7740308b0 con 0x7ff778107850 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 -- 172.21.15.76:0/2982118962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 msgr2=0x7ff778107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 --2- 172.21.15.76:0/2982118962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff778107c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff774009820 tx=0x7ff77402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 -- 172.21.15.76:0/2982118962 shutdown_connections 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 --2- 172.21.15.76:0/2982118962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff778107c50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 -- 172.21.15.76:0/2982118962 >> 172.21.15.76:0/2982118962 conn(0x7ff778103020 msgr2=0x7ff778105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 -- 172.21.15.76:0/2982118962 shutdown_connections 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 -- 172.21.15.76:0/2982118962 wait complete. 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.477+0000 7ff77f9ba640 1 Processor -- start 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77f9ba640 1 -- start start 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77f9ba640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff77819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:28.726 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77f9ba640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff77810be00 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77d756640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff77819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77d756640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff77819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49100/0 (socket says 172.21.15.76:49100) 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77d756640 1 -- 172.21.15.76:0/34881358 learned_addr learned my addr 172.21.15.76:0/34881358 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77d756640 1 -- 172.21.15.76:0/34881358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77819bdd0 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77d756640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff77819b890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff774009940 tx=0x7ff774032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff774042070 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff77403d930 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77819c060 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff774037040 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.478+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77819ed50 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.479+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff774045070 con 0x7ff778107850 2024-09-19T07:42:28.727 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.479+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff778107c50 con 0x7ff778107850 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.479+0000 7ff76e7fc640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff7640391b0 0x7ff76403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.479+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff77406c4a0 con 0x7ff778107850 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.479+0000 7ff77cf55640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff7640391b0 0x7ff76403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.480+0000 7ff77cf55640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff7640391b0 0x7ff76403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7680098c0 tx=0x7ff768006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.484+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff77403cd70 con 0x7ff778107850 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:26.704+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff77819f340 con 0x7ff778107850 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.558+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff77403c880 con 0x7ff778107850 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.560+0000 7ff76e7fc640 1 -- 172.21.15.76:0/34881358 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ff77403dae0 con 0x7ff778107850 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff7640391b0 msgr2=0x7ff76403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff7640391b0 0x7ff76403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7680098c0 tx=0x7ff768006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 msgr2=0x7ff77819b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff77819b890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff774009940 tx=0x7ff774032670 comp rx=0 tx=0).stop 2024-09-19T07:42:28.728 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 shutdown_connections 2024-09-19T07:42:28.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7ff7640391b0 0x7ff76403b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:28.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 --2- 172.21.15.76:0/34881358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff778107850 0x7ff77819b890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:28.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 >> 172.21.15.76:0/34881358 conn(0x7ff778103020 msgr2=0x7ff778103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:28.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 shutdown_connections 2024-09-19T07:42:28.729 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:27.561+0000 7ff77f9ba640 1 -- 172.21.15.76:0/34881358 wait complete. 2024-09-19T07:42:28.842 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/34881358' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T07:42:28.842 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-mon[30930]: mgrmap e9: x(active, since 18s) 2024-09-19T07:42:28.842 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:28.594+0000 7fa0fe6c9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:42:28.842 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:28.656+0000 7fa0fe6c9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:42:29.149 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:28.848+0000 7fa0fe6c9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:42:29.834 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:29 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3814379087' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T07:42:29.834 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:29.766+0000 7fa0fe6c9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:42:29.834 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:29.833+0000 7fa0fe6c9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.148+0000 7f124011a640 1 Processor -- start 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.149+0000 7f124011a640 1 -- start start 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.149+0000 7f124011a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f1238107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.149+0000 7f124011a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1238108290 con 0x7f12381078c0 2024-09-19T07:42:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.149+0000 7f123deb6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f1238107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.149+0000 7f123deb6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f1238107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49114/0 (socket says 172.21.15.76:49114) 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.149+0000 7f123deb6640 1 -- 172.21.15.76:0/615976641 learned_addr learned my addr 172.21.15.76:0/615976641 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.150+0000 7f123deb6640 1 -- 172.21.15.76:0/615976641 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1238108a70 con 0x7f12381078c0 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.150+0000 7f123deb6640 1 --2- 172.21.15.76:0/615976641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f1238107cc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1234009820 tx=0x7f123402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64f05ce82d310f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f123ceb4640 1 -- 172.21.15.76:0/615976641 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1234037070 con 0x7f12381078c0 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f123ceb4640 1 -- 172.21.15.76:0/615976641 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1234032940 con 0x7f12381078c0 2024-09-19T07:42:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f123ceb4640 1 -- 172.21.15.76:0/615976641 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12340308b0 con 0x7f12381078c0 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 -- 172.21.15.76:0/615976641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 msgr2=0x7f1238107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 --2- 172.21.15.76:0/615976641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f1238107cc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1234009820 tx=0x7f123402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 -- 172.21.15.76:0/615976641 shutdown_connections 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 --2- 172.21.15.76:0/615976641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f1238107cc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 -- 172.21.15.76:0/615976641 >> 172.21.15.76:0/615976641 conn(0x7f1238103050 msgr2=0x7f1238105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 -- 172.21.15.76:0/615976641 shutdown_connections 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.151+0000 7f124011a640 1 -- 172.21.15.76:0/615976641 wait complete. 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f124011a640 1 Processor -- start 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f124011a640 1 -- start start 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f124011a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f123819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f124011a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f123810be20 con 0x7f12381078c0 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f123deb6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f123819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:30.189 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f123deb6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f123819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49124/0 (socket says 172.21.15.76:49124) 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.152+0000 7f123deb6640 1 -- 172.21.15.76:0/3814379087 learned_addr learned my addr 172.21.15.76:0/3814379087 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f123deb6640 1 -- 172.21.15.76:0/3814379087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123819be10 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f123deb6640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f123819b8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1234009940 tx=0x7f1234032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1234042070 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123819c0a0 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123819ed90 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f123403d930 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.153+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1234037040 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.154+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f1234045070 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.154+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1238107cc0 con 0x7f12381078c0 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.154+0000 7f122effd640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 0x7f122403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:30.190 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.154+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f123406c580 con 0x7f12381078c0 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.154+0000 7f123d6b5640 1 -- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 msgr2=0x7f122403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1863850030 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.154+0000 7f123d6b5640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 0x7f122403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.163+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f123403cdf0 con 0x7f12381078c0 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.355+0000 7f123d6b5640 1 -- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 msgr2=0x7f122403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1863850030 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.355+0000 7f123d6b5640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 0x7f122403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.379+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f123819ef60 con 0x7f12381078c0 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.379+0000 7f122effd640 1 -- 172.21.15.76:0/3814379087 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f123819ef60 con 0x7f12381078c0 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.381+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 msgr2=0x7f122403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 0x7f122403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 msgr2=0x7f123819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f123819b8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1234009940 tx=0x7f1234032670 comp rx=0 tx=0).stop 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 shutdown_connections 2024-09-19T07:42:30.191 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7f1224039260 0x7f122403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:30.192 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 --2- 172.21.15.76:0/3814379087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12381078c0 0x7f123819b8d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:30.192 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 >> 172.21.15.76:0/3814379087 conn(0x7f1238103050 msgr2=0x7f1238103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:30.192 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 shutdown_connections 2024-09-19T07:42:30.192 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:29.382+0000 7f124011a640 1 -- 172.21.15.76:0/3814379087 wait complete. 2024-09-19T07:42:30.192 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for the mgr to restart... 2024-09-19T07:42:30.192 INFO:teuthology.orchestra.run.smithi076.stdout:Waiting for mgr epoch 9... 2024-09-19T07:42:30.818 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:30.570+0000 7fa0fe6c9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:42:30.819 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:30.694+0000 7fa0fe6c9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:42:31.138 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:30.844+0000 7fa0fe6c9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:42:31.138 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:30.910+0000 7fa0fe6c9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:42:31.138 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.066+0000 7fa0fe6c9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:42:31.138 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.137+0000 7fa0fe6c9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:42:31.430 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.199+0000 7fa0fe6c9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:42:31.430 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.362+0000 7fa0fe6c9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:42:31.430 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.428+0000 7fa0fe6c9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:42:31.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.496+0000 7fa0fe6c9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:42:31.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.581+0000 7fa0fe6c9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:42:31.694 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.643+0000 7fa0fe6c9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:42:32.020 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:31.704+0000 7fa0fe6c9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:32.489+0000 7fa0fe6c9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: Active manager daemon x restarted 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: Activating manager daemon x 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: mgrmap e10: x(active, starting, since 0.0033302s) 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:42:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: Manager daemon x is now available 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:42:32.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:42:33.897 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:33.604+0000 7fa0699dd640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:42:33] ENGINE Error in HTTPServer.serve 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: Traceback (most recent call last): 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._connections.run(self.expiration_interval) 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._run(expiration_interval) 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:42:33.898 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: s = self.context.wrap_socket( 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: return self.sslsocket_class._create( 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self.do_handshake() 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._sslobj.do_handshake() 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:42:33.899 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:42:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:42:34.165 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:42:34.165 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T07:42:34.165 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T07:42:34.165 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efee206a640 1 Processor -- start 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efee206a640 1 -- start start 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efee206a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc107c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efee206a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efedc108250 con 0x7efedc107880 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efedb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efedb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49126/0 (socket says 172.21.15.76:49126) 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efedb7fe640 1 -- 172.21.15.76:0/1298624862 learned_addr learned my addr 172.21.15.76:0/1298624862 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.611+0000 7efedb7fe640 1 -- 172.21.15.76:0/1298624862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc108a80 con 0x7efedc107880 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.612+0000 7efedb7fe640 1 --2- 172.21.15.76:0/1298624862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc107c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efecc009820 tx=0x7efecc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba52cb7c3a3e2db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.612+0000 7efeda7fc640 1 -- 172.21.15.76:0/1298624862 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc037070 con 0x7efedc107880 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.612+0000 7efeda7fc640 1 -- 172.21.15.76:0/1298624862 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efecc032940 con 0x7efedc107880 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.612+0000 7efeda7fc640 1 -- 172.21.15.76:0/1298624862 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc0308b0 con 0x7efedc107880 2024-09-19T07:42:34.166 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 -- 172.21.15.76:0/1298624862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 msgr2=0x7efedc107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 --2- 172.21.15.76:0/1298624862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc107c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efecc009820 tx=0x7efecc02a270 comp rx=0 tx=0).stop 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 -- 172.21.15.76:0/1298624862 shutdown_connections 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 --2- 172.21.15.76:0/1298624862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc107c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 -- 172.21.15.76:0/1298624862 >> 172.21.15.76:0/1298624862 conn(0x7efedc103070 msgr2=0x7efedc105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 -- 172.21.15.76:0/1298624862 shutdown_connections 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.613+0000 7efee206a640 1 -- 172.21.15.76:0/1298624862 wait complete. 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efee206a640 1 Processor -- start 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efee206a640 1 -- start start 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efee206a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efee206a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efedc10be30 con 0x7efedc107880 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efedb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:34.167 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efedb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49142/0 (socket says 172.21.15.76:49142) 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.614+0000 7efedb7fe640 1 -- 172.21.15.76:0/4284604820 learned_addr learned my addr 172.21.15.76:0/4284604820 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efedb7fe640 1 -- 172.21.15.76:0/4284604820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19be80 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efedb7fe640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc19b940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efecc009940 tx=0x7efecc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc042070 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efecc03d930 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc19c110 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efecc037040 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.615+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc19ee00 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.616+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7efecc045070 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.616+0000 7efed8ff9640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.616+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 --> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efec403be30 con 0x7efec4039260 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.617+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efecc06c6f0 con 0x7efedc107880 2024-09-19T07:42:34.168 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.617+0000 7efedaffd640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 msgr2=0x7efec403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1863850030 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.617+0000 7efedaffd640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.818+0000 7efedaffd640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 msgr2=0x7efec403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1863850030 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:30.818+0000 7efedaffd640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:31.219+0000 7efedaffd640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 msgr2=0x7efec403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1863850030 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:31.219+0000 7efedaffd640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:32.019+0000 7efedaffd640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 msgr2=0x7efec403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1863850030 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:32.019+0000 7efedaffd640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:32.492+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7efecc06b1a0 con 0x7efedc107880 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:32.492+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 msgr2=0x7efec403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:32.492+0000 7efed8ff9640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.495+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7efecc06dd70 con 0x7efedc107880 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.495+0000 7efed8ff9640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efec403cd20 0x7efec403f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:34.169 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.495+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efec403be30 con 0x7efec403cd20 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.495+0000 7efedaffd640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efec403cd20 0x7efec403f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.496+0000 7efedaffd640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efec403cd20 0x7efec403f110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efed0003980 tx=0x7efed00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.496+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7efec403be30 con 0x7efec403cd20 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.504+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7efedc107c80 con 0x7efec403cd20 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efed8ff9640 1 -- 172.21.15.76:0/4284604820 <== mgr.14150 v2:172.21.15.76:6800/1377496784 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7efedc107c80 con 0x7efec403cd20 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efec403cd20 msgr2=0x7efec403f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efec403cd20 0x7efec403f110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efed0003980 tx=0x7efed00092b0 comp rx=0 tx=0).stop 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 msgr2=0x7efedc19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc19b940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efecc009940 tx=0x7efecc032670 comp rx=0 tx=0).stop 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 shutdown_connections 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efec403cd20 0x7efec403f110 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:6800/1863850030,v1:172.21.15.76:6801/1863850030] conn(0x7efec4039260 0x7efec403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 --2- 172.21.15.76:0/4284604820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efedc107880 0x7efedc19b940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:34.170 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 >> 172.21.15.76:0/4284604820 conn(0x7efedc103070 msgr2=0x7efedc103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:34.171 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 shutdown_connections 2024-09-19T07:42:34.171 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:33.505+0000 7efee206a640 1 -- 172.21.15.76:0/4284604820 wait complete. 2024-09-19T07:42:34.171 INFO:teuthology.orchestra.run.smithi076.stdout:mgr epoch 9 is available 2024-09-19T07:42:34.171 INFO:teuthology.orchestra.run.smithi076.stdout:Generating a dashboard self-signed certificate... 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:34 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:33] ENGINE Bus STARTING 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:34 smithi076 ceph-mon[30930]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:34 smithi076 ceph-mon[30930]: mgrmap e11: x(active, since 1.00645s) 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:34 smithi076 ceph-mon[30930]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:34 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:33] ENGINE Serving on https://172.21.15.76:7150 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:34 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:33] ENGINE Error in HTTPServer.serve 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout: Traceback (most recent call last): 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:42:34.694 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._run(expiration_interval) 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: s = self.context.wrap_socket( 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: return self.sslsocket_class._create( 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: self.do_handshake() 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:42:34.695 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._sslobj.do_handshake() 2024-09-19T07:42:34.696 INFO:journalctl@ceph.mon.a.smithi076.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:42:35.504 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd2a5f0c640 1 Processor -- start 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd2a5f0c640 1 -- start start 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd2a5f0c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a010a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd2a5f0c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a007be50 con 0x7fd2a01082c0 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a010a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a010a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38630/0 (socket says 172.21.15.76:38630) 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd29f7fe640 1 -- 172.21.15.76:0/2909860663 learned_addr learned my addr 172.21.15.76:0/2909860663 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.578+0000 7fd29f7fe640 1 -- 172.21.15.76:0/2909860663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a010abf0 con 0x7fd2a01082c0 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.579+0000 7fd29f7fe640 1 --2- 172.21.15.76:0/2909860663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a010a6b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd290009820 tx=0x7fd29002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af546096dbdca9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.579+0000 7fd29e7fc640 1 -- 172.21.15.76:0/2909860663 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290037070 con 0x7fd2a01082c0 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.579+0000 7fd29e7fc640 1 -- 172.21.15.76:0/2909860663 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd290032940 con 0x7fd2a01082c0 2024-09-19T07:42:35.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.579+0000 7fd29e7fc640 1 -- 172.21.15.76:0/2909860663 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2900308b0 con 0x7fd2a01082c0 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/2909860663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 msgr2=0x7fd2a010a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 --2- 172.21.15.76:0/2909860663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a010a6b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd290009820 tx=0x7fd29002a270 comp rx=0 tx=0).stop 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/2909860663 shutdown_connections 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 --2- 172.21.15.76:0/2909860663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a010a6b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/2909860663 >> 172.21.15.76:0/2909860663 conn(0x7fd2a0101f20 msgr2=0x7fd2a0104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/2909860663 shutdown_connections 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/2909860663 wait complete. 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 Processor -- start 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.580+0000 7fd2a5f0c640 1 -- start start 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd2a5f0c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd2a5f0c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a010bcc0 con 0x7fd2a01082c0 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:35.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38646/0 (socket says 172.21.15.76:38646) 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29f7fe640 1 -- 172.21.15.76:0/3215018093 learned_addr learned my addr 172.21.15.76:0/3215018093 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29f7fe640 1 -- 172.21.15.76:0/3215018093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a019bde0 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29f7fe640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a019b8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd290032670 tx=0x7fd2900326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290042070 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd29003d930 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a019c070 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290037040 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.581+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a019ed60 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.582+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd290045070 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.582+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a0108720 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.583+0000 7fd29cff9640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd28c039260 0x7fd28c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.583+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd29006c610 con 0x7fd2a01082c0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.583+0000 7fd29effd640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd28c039260 0x7fd28c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:35.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.583+0000 7fd29effd640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd28c039260 0x7fd28c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd2880098c0 tx=0x7fd288006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.587+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd29003db50 con 0x7fd2a01082c0 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.768+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fd2a0103230 con 0x7fd28c039260 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.856+0000 7fd29cff9640 1 -- 172.21.15.76:0/3215018093 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fd2a0103230 con 0x7fd28c039260 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd28c039260 msgr2=0x7fd28c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd28c039260 0x7fd28c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd2880098c0 tx=0x7fd288006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 msgr2=0x7fd2a019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a019b8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd290032670 tx=0x7fd2900326a0 comp rx=0 tx=0).stop 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 shutdown_connections 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd28c039260 0x7fd28c03b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 --2- 172.21.15.76:0/3215018093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2a01082c0 0x7fd2a019b8a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 >> 172.21.15.76:0/3215018093 conn(0x7fd2a0101f20 msgr2=0x7fd2a0102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 shutdown_connections 2024-09-19T07:42:35.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:34.858+0000 7fd2a5f0c640 1 -- 172.21.15.76:0/3215018093 wait complete. 2024-09-19T07:42:35.509 INFO:teuthology.orchestra.run.smithi076.stdout:Creating initial admin user... 2024-09-19T07:42:35.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:35 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:33] ENGINE Serving on http://172.21.15.76:8765 2024-09-19T07:42:35.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:35 smithi076 ceph-mon[30930]: [19/Sep/2024:07:42:33] ENGINE Bus STARTED 2024-09-19T07:42:35.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:35 smithi076 ceph-mon[30930]: mgrmap e12: x(active, since 2s) 2024-09-19T07:42:35.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:35.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:35.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:36.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:36 smithi076 ceph-mon[30930]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:36.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:36.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:37.504 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$IJW15hU0Clpvi9wNWp11v.akdAFAjuRRWPneGQYizCaMANX/BNP/S", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726731756, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T07:42:37.504 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f897d0fa640 1 Processor -- start 2024-09-19T07:42:37.504 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f897d0fa640 1 -- start start 2024-09-19T07:42:37.504 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f897d0fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f8978106270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:37.504 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f897d0fa640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f89781067b0 con 0x7f8978105e70 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f8976d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f8978106270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f8976d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f8978106270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38654/0 (socket says 172.21.15.76:38654) 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.957+0000 7f8976d9d640 1 -- 172.21.15.76:0/350441566 learned_addr learned my addr 172.21.15.76:0/350441566 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.958+0000 7f8976d9d640 1 -- 172.21.15.76:0/350441566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8978107060 con 0x7f8978105e70 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.958+0000 7f8976d9d640 1 --2- 172.21.15.76:0/350441566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f8978106270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8968009820 tx=0x7f896802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677c4349805bc224 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.958+0000 7f8975d9b640 1 -- 172.21.15.76:0/350441566 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8968037070 con 0x7f8978105e70 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.958+0000 7f8975d9b640 1 -- 172.21.15.76:0/350441566 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8968032940 con 0x7f8978105e70 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.958+0000 7f8975d9b640 1 -- 172.21.15.76:0/350441566 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89680308b0 con 0x7f8978105e70 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 -- 172.21.15.76:0/350441566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 msgr2=0x7f8978106270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 --2- 172.21.15.76:0/350441566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f8978106270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8968009820 tx=0x7f896802a270 comp rx=0 tx=0).stop 2024-09-19T07:42:37.505 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 -- 172.21.15.76:0/350441566 shutdown_connections 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 --2- 172.21.15.76:0/350441566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f8978106270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 -- 172.21.15.76:0/350441566 >> 172.21.15.76:0/350441566 conn(0x7f89781016b0 msgr2=0x7f8978103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 -- 172.21.15.76:0/350441566 shutdown_connections 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.959+0000 7f897d0fa640 1 -- 172.21.15.76:0/350441566 wait complete. 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f897d0fa640 1 Processor -- start 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f897d0fa640 1 -- start start 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f897d0fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f897819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f897d0fa640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f897810a320 con 0x7f8978105e70 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f8976d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f897819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f8976d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f897819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38664/0 (socket says 172.21.15.76:38664) 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.960+0000 7f8976d9d640 1 -- 172.21.15.76:0/1834659857 learned_addr learned my addr 172.21.15.76:0/1834659857 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:37.506 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f8976d9d640 1 -- 172.21.15.76:0/1834659857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897819be20 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f8976d9d640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f897819b8e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8968032670 tx=0x7f89680326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8968042070 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897819c0b0 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f896803d930 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8968037040 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.961+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897819eda0 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.962+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8968045070 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.962+0000 7f895ffff640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8960039200 0x7f896003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.962+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f896806c540 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.962+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89781062f0 con 0x7f8978105e70 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.962+0000 7f897659c640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8960039200 0x7f896003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:37.507 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.962+0000 7f897659c640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8960039200 0x7f896003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f896c0098c0 tx=0x7f896c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:35.967+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f896803c920 con 0x7f8978105e70 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.156+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f897802d8c0 con 0x7f8960039200 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.381+0000 7f895ffff640 1 -- 172.21.15.76:0/1834659857 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f897802d8c0 con 0x7f8960039200 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8960039200 msgr2=0x7f896003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8960039200 0x7f896003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f896c0098c0 tx=0x7f896c006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 msgr2=0x7f897819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f897819b8e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8968032670 tx=0x7f89680326a0 comp rx=0 tx=0).stop 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 shutdown_connections 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8960039200 0x7f896003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 --2- 172.21.15.76:0/1834659857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8978105e70 0x7f897819b8e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 >> 172.21.15.76:0/1834659857 conn(0x7f89781016b0 msgr2=0x7f8978103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 shutdown_connections 2024-09-19T07:42:37.508 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:36.383+0000 7f897d0fa640 1 -- 172.21.15.76:0/1834659857 wait complete. 2024-09-19T07:42:37.509 INFO:teuthology.orchestra.run.smithi076.stdout:Fetching dashboard port number... 2024-09-19T07:42:37.672 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:37 smithi076 ceph-mon[30930]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:38.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:38 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2824371477' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T07:42:38.703 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.962+0000 7f5638921640 1 Processor -- start 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.962+0000 7f5638921640 1 -- start start 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.963+0000 7f5638921640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f5634106580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.963+0000 7f5638921640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f563407bdd0 con 0x7f5634106180 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.963+0000 7f563259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f5634106580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.963+0000 7f563259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f5634106580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38674/0 (socket says 172.21.15.76:38674) 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.963+0000 7f563259c640 1 -- 172.21.15.76:0/855349194 learned_addr learned my addr 172.21.15.76:0/855349194 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.963+0000 7f563259c640 1 -- 172.21.15.76:0/855349194 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5634106ac0 con 0x7f5634106180 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.964+0000 7f563259c640 1 --2- 172.21.15.76:0/855349194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f5634106580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5624009820 tx=0x7f562402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f190c382e7e8153 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.964+0000 7f563159a640 1 -- 172.21.15.76:0/855349194 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5624037070 con 0x7f5634106180 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.964+0000 7f563159a640 1 -- 172.21.15.76:0/855349194 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5624032940 con 0x7f5634106180 2024-09-19T07:42:38.704 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.964+0000 7f563159a640 1 -- 172.21.15.76:0/855349194 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56240308b0 con 0x7f5634106180 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.964+0000 7f5638921640 1 -- 172.21.15.76:0/855349194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 msgr2=0x7f5634106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.964+0000 7f5638921640 1 --2- 172.21.15.76:0/855349194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f5634106580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5624009820 tx=0x7f562402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 -- 172.21.15.76:0/855349194 shutdown_connections 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 --2- 172.21.15.76:0/855349194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f5634106580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 -- 172.21.15.76:0/855349194 >> 172.21.15.76:0/855349194 conn(0x7f5634101f30 msgr2=0x7f5634104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 -- 172.21.15.76:0/855349194 shutdown_connections 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 -- 172.21.15.76:0/855349194 wait complete. 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 Processor -- start 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.965+0000 7f5638921640 1 -- start start 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f5638921640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f563419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f5638921640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5634107bf0 con 0x7f5634106180 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f563259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f563419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f563259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f563419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38684/0 (socket says 172.21.15.76:38684) 2024-09-19T07:42:38.705 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f563259c640 1 -- 172.21.15.76:0/2824371477 learned_addr learned my addr 172.21.15.76:0/2824371477 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f563259c640 1 -- 172.21.15.76:0/2824371477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563419df90 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f563259c640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f563419da50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5624032670 tx=0x7f56240326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5624042070 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f562403d930 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563419e220 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5624037040 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.966+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56341a0f10 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.967+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f5624045070 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.967+0000 7f56237fe640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f561c039200 0x7f561c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.967+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f562406d5d0 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.967+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5634106580 con 0x7f5634106180 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.967+0000 7f5631d9b640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f561c039200 0x7f561c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:38.706 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.968+0000 7f5631d9b640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f561c039200 0x7f561c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56280098c0 tx=0x7f5628006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:37.972+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f562403cdf0 con 0x7f5634106180 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.142+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f563402d9f0 con 0x7f5634106180 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.143+0000 7f56237fe640 1 -- 172.21.15.76:0/2824371477 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f562403dae0 con 0x7f5634106180 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f561c039200 msgr2=0x7f561c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f561c039200 0x7f561c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56280098c0 tx=0x7f5628006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 msgr2=0x7f563419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f563419da50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5624032670 tx=0x7f56240326a0 comp rx=0 tx=0).stop 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 shutdown_connections 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f561c039200 0x7f561c03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 --2- 172.21.15.76:0/2824371477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5634106180 0x7f563419da50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 >> 172.21.15.76:0/2824371477 conn(0x7f5634101f30 msgr2=0x7f5634194730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 shutdown_connections 2024-09-19T07:42:38.707 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:38.145+0000 7f5638921640 1 -- 172.21.15.76:0/2824371477 wait complete. 2024-09-19T07:42:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:42:38.710 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout disabled 2024-09-19T07:42:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:42:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:systemctl: stdout inactive 2024-09-19T07:42:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:firewalld.service is not enabled 2024-09-19T07:42:38.717 INFO:teuthology.orchestra.run.smithi076.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T07:42:38.719 INFO:teuthology.orchestra.run.smithi076.stdout:Ceph Dashboard is now available at: 2024-09-19T07:42:38.719 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:38.719 INFO:teuthology.orchestra.run.smithi076.stdout: URL: https://smithi076.front.sepia.ceph.com:8443/ 2024-09-19T07:42:38.719 INFO:teuthology.orchestra.run.smithi076.stdout: User: admin 2024-09-19T07:42:38.719 INFO:teuthology.orchestra.run.smithi076.stdout: Password: hrtrubq0kg 2024-09-19T07:42:38.719 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:38.720 INFO:teuthology.orchestra.run.smithi076.stdout:Saving cluster configuration to /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config directory 2024-09-19T07:42:39.653 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:39 smithi076 ceph-mon[30930]: mgrmap e13: x(active, since 6s) 2024-09-19T07:42:39.653 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:39 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3259652765' entity='client.admin' 2024-09-19T07:42:39.988 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.086+0000 7f8cea52e640 1 Processor -- start 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.086+0000 7f8cea52e640 1 -- start start 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.087+0000 7f8cea52e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce4106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.087+0000 7f8cea52e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4107170 con 0x7f8ce41067a0 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.087+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce4106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.087+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce4106ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38688/0 (socket says 172.21.15.76:38688) 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.087+0000 7f8ce3fff640 1 -- 172.21.15.76:0/1773468400 learned_addr learned my addr 172.21.15.76:0/1773468400 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.087+0000 7f8ce3fff640 1 -- 172.21.15.76:0/1773468400 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce41079a0 con 0x7f8ce41067a0 2024-09-19T07:42:39.989 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8ce3fff640 1 --2- 172.21.15.76:0/1773468400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce4106ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009820 tx=0x7f8cd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad1fc73d4e40b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8ce37fe640 1 -- 172.21.15.76:0/1773468400 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4037070 con 0x7f8ce41067a0 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8ce37fe640 1 -- 172.21.15.76:0/1773468400 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cd4032940 con 0x7f8ce41067a0 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8ce37fe640 1 -- 172.21.15.76:0/1773468400 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd40308b0 con 0x7f8ce41067a0 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8cea52e640 1 -- 172.21.15.76:0/1773468400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 msgr2=0x7f8ce4106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8cea52e640 1 --2- 172.21.15.76:0/1773468400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce4106ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009820 tx=0x7f8cd402a270 comp rx=0 tx=0).stop 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8cea52e640 1 -- 172.21.15.76:0/1773468400 shutdown_connections 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8cea52e640 1 --2- 172.21.15.76:0/1773468400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce4106ba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.088+0000 7f8cea52e640 1 -- 172.21.15.76:0/1773468400 >> 172.21.15.76:0/1773468400 conn(0x7f8ce4101f30 msgr2=0x7f8ce4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8cea52e640 1 -- 172.21.15.76:0/1773468400 shutdown_connections 2024-09-19T07:42:39.990 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8cea52e640 1 -- 172.21.15.76:0/1773468400 wait complete. 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8cea52e640 1 Processor -- start 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8cea52e640 1 -- start start 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8cea52e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce407b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8cea52e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce410ad50 con 0x7f8ce41067a0 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce407b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8ce3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce407b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38694/0 (socket says 172.21.15.76:38694) 2024-09-19T07:42:39.991 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.089+0000 7f8ce3fff640 1 -- 172.21.15.76:0/3259652765 learned_addr learned my addr 172.21.15.76:0/3259652765 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8ce3fff640 1 -- 172.21.15.76:0/3259652765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce419e620 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8ce3fff640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce407b9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009940 tx=0x7f8cd4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4042070 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cd403d930 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4037040 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce419e7f0 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.090+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce419eb90 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.091+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8cd4045070 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.091+0000 7f8ce1ffb640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8cd00392a0 0x7f8cd003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.091+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce4106ba0 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.091+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8cd406c750 con 0x7f8ce41067a0 2024-09-19T07:42:39.992 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.091+0000 7f8cdbfff640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8cd00392a0 0x7f8cd003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.092+0000 7f8cdbfff640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8cd00392a0 0x7f8cd003b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0098c0 tx=0x7f8ccc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.096+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8cd403be10 con 0x7f8ce41067a0 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.349+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f8ce419eeb0 con 0x7f8ce41067a0 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.352+0000 7f8ce1ffb640 1 -- 172.21.15.76:0/3259652765 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f8cd4050020 con 0x7f8ce41067a0 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8cd00392a0 msgr2=0x7f8cd003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8cd00392a0 0x7f8cd003b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0098c0 tx=0x7f8ccc006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 msgr2=0x7f8ce407b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce407b9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009940 tx=0x7f8cd4032670 comp rx=0 tx=0).stop 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 shutdown_connections 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8cd00392a0 0x7f8cd003b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:39.993 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 --2- 172.21.15.76:0/3259652765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ce41067a0 0x7f8ce407b9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 >> 172.21.15.76:0/3259652765 conn(0x7f8ce4101f30 msgr2=0x7f8ce4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 shutdown_connections 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/bin/ceph: stderr 2024-09-19T07:42:39.354+0000 7f8cea52e640 1 -- 172.21.15.76:0/3259652765 wait complete. 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.994 INFO:teuthology.orchestra.run.smithi076.stdout: ceph telemetry on 2024-09-19T07:42:39.995 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.995 INFO:teuthology.orchestra.run.smithi076.stdout:For more information see: 2024-09-19T07:42:39.995 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.995 INFO:teuthology.orchestra.run.smithi076.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T07:42:39.995 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:39.995 INFO:teuthology.orchestra.run.smithi076.stdout:Bootstrap complete. 2024-09-19T07:42:40.031 INFO:tasks.cephadm:Fetching config... 2024-09-19T07:42:40.031 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:42:40.031 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T07:42:40.049 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T07:42:40.049 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:42:40.049 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T07:42:40.105 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T07:42:40.106 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:42:40.106 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T07:42:40.171 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T07:42:40.171 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:42:40.171 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T07:42:40.227 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T07:42:40.227 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:42:40.303 INFO:teuthology.orchestra.run.smithi076.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:42:40.314 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:42:40.358 INFO:teuthology.orchestra.run.smithi137.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:42:40.371 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:42:40.413 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7BA7kJYQRLMxgoZEJtxhCE1gcFGKlHJGyfH0roZ6Wu0gSWNrkhINWANInllspYPEOVhuW5ubqO91ClOLblLTkrZbzwjscR7dqRRxPwXHGGZLzjXvrU590+YmiI9ep4FqrUIcDzAWUd9BXgChn1sh0Z1fMzcLf35FLx92Mt93+Mq1TjRPK1Vn3zI62wnIPq6f/49m2JFe2DXNY+5RsWmSGJ72wBcYaqtS4sgOJ77rRIF/28K49hRkKd276LPNuGo1Bof5GeSGLiO9OYXrDY707S2tOpJhF9Er7YsspN4m2wHqo8kp1peV85T1NzU911cCxyFwDMR32qrk6zmY/RaW0Fuw1GcECsTDMPVYkGQIQHWBklGgC/H2LMJwx+ALMlCU8XTCAi/EV82iKAxKA9dkuZX83w2PBQFRR7ycGE7ImvPJsUshuegijL2EpMcS4Ezh9ifrBlXFEdzQKK4geeXCO97Tve8PjnXHgjDhUbKpV8VFw6F/wEFu8d01WLB7Ew8= ceph-6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:42:40.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T07:42:40.678 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:41.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.121+0000 7f66f8aea640 1 -- 172.21.15.76:0/4255987273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 msgr2=0x7f66f4104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:41.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.121+0000 7f66f8aea640 1 --2- 172.21.15.76:0/4255987273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009880 tx=0x7f66e402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:42:41.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 -- 172.21.15.76:0/4255987273 shutdown_connections 2024-09-19T07:42:41.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 --2- 172.21.15.76:0/4255987273 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:41.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 -- 172.21.15.76:0/4255987273 >> 172.21.15.76:0/4255987273 conn(0x7f66f40fbc80 msgr2=0x7f66f40fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:41.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 -- 172.21.15.76:0/4255987273 shutdown_connections 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 -- 172.21.15.76:0/4255987273 wait complete. 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 Processor -- start 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.122+0000 7f66f8aea640 1 -- start start 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f8aea640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f8aea640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41077f0 con 0x7f66f41020a0 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4196dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38708/0 (socket says 172.21.15.76:38708) 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f259c640 1 -- 172.21.15.76:0/3400412977 learned_addr learned my addr 172.21.15.76:0/3400412977 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f259c640 1 -- 172.21.15.76:0/3400412977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f4197310 con 0x7f66f41020a0 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f259c640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4196dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009230 tx=0x7f66e4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e403f030 con 0x7f66f41020a0 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66e4003e30 con 0x7f66f41020a0 2024-09-19T07:42:41.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f41975a0 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4035070 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.123+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f419a290 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.124+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f66e4042030 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.124+0000 7f66e37fe640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66dc0392a0 0x7f66dc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.124+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f66e4040070 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.124+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f4107f70 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.124+0000 7f66f1d9b640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66dc0392a0 0x7f66dc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.125+0000 7f66f1d9b640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66dc0392a0 0x7f66dc03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098c0 tx=0x7f66e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.129+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66e403b7e0 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.300+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f66f402d7c0 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.302+0000 7f66e37fe640 1 -- 172.21.15.76:0/3400412977 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f66e404c350 con 0x7f66f41020a0 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.304+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66dc0392a0 msgr2=0x7f66dc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:41.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.304+0000 7f66f8aea640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66dc0392a0 0x7f66dc03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098c0 tx=0x7f66e8006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.304+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 msgr2=0x7f66f4196dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.304+0000 7f66f8aea640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4196dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009230 tx=0x7f66e4032d00 comp rx=0 tx=0).stop 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.305+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 shutdown_connections 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.305+0000 7f66f8aea640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66dc0392a0 0x7f66dc03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.305+0000 7f66f8aea640 1 --2- 172.21.15.76:0/3400412977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66f41020a0 0x7f66f4196dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.305+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 >> 172.21.15.76:0/3400412977 conn(0x7f66f40fbc80 msgr2=0x7f66f40fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.305+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 shutdown_connections 2024-09-19T07:42:41.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:41.305+0000 7f66f8aea640 1 -- 172.21.15.76:0/3400412977 wait complete. 2024-09-19T07:42:42.258 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T07:42:42.259 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T07:42:42.481 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:42 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3400412977' entity='client.admin' 2024-09-19T07:42:42.691 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 -- 172.21.15.76:0/151559299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 msgr2=0x7fb4d4104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 --2- 172.21.15.76:0/151559299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4104520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009880 tx=0x7fb4c402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 -- 172.21.15.76:0/151559299 shutdown_connections 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 --2- 172.21.15.76:0/151559299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4104520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 -- 172.21.15.76:0/151559299 >> 172.21.15.76:0/151559299 conn(0x7fb4d40fbcd0 msgr2=0x7fb4d40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 -- 172.21.15.76:0/151559299 shutdown_connections 2024-09-19T07:42:43.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.156+0000 7fb4d9779640 1 -- 172.21.15.76:0/151559299 wait complete. 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d9779640 1 Processor -- start 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d9779640 1 -- start start 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d9779640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d9779640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4107820 con 0x7fb4d4102130 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d2ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d2ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38736/0 (socket says 172.21.15.76:38736) 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.157+0000 7fb4d2ffd640 1 -- 172.21.15.76:0/803317520 learned_addr learned my addr 172.21.15.76:0/803317520 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d2ffd640 1 -- 172.21.15.76:0/803317520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d41973c0 con 0x7fb4d4102130 2024-09-19T07:42:43.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d2ffd640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4196e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009230 tx=0x7fb4c4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:43.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4c403f030 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4c4003e30 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d4197650 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4c4035070 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.158+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d419a340 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.159+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb4c4042030 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.159+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d4107fa0 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.159+0000 7fb4d0ff9640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb4c0039300 0x7fb4c003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.159+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb4c4040070 con 0x7fb4d4102130 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.159+0000 7fb4cbfff640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb4c0039300 0x7fb4c003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:43.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.160+0000 7fb4cbfff640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb4c0039300 0x7fb4c003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0098c0 tx=0x7fb4bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:43.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.167+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb4c4073020 con 0x7fb4d4102130 2024-09-19T07:42:43.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.344+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fb4d402d830 con 0x7fb4c0039300 2024-09-19T07:42:43.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.347+0000 7fb4d0ff9640 1 -- 172.21.15.76:0/803317520 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb4d402d830 con 0x7fb4c0039300 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb4c0039300 msgr2=0x7fb4c003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb4c0039300 0x7fb4c003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0098c0 tx=0x7fb4bc006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 msgr2=0x7fb4d4196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4196e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009230 tx=0x7fb4c4032d00 comp rx=0 tx=0).stop 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 shutdown_connections 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb4c0039300 0x7fb4c003b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 --2- 172.21.15.76:0/803317520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb4d4102130 0x7fb4d4196e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:43.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 >> 172.21.15.76:0/803317520 conn(0x7fb4d40fbcd0 msgr2=0x7fb4d40fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:43.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 shutdown_connections 2024-09-19T07:42:43.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:43.349+0000 7fb4d9779640 1 -- 172.21.15.76:0/803317520 wait complete. 2024-09-19T07:42:44.087 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi137 2024-09-19T07:42:44.088 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:42:44.088 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.conf 2024-09-19T07:42:44.106 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:42:44.107 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:42:44.165 INFO:tasks.cephadm:Adding host smithi137 to orchestrator... 2024-09-19T07:42:44.165 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch host add smithi137 2024-09-19T07:42:44.600 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:44.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:44 smithi076 ceph-mon[30930]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:44.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 -- 172.21.15.76:0/3656026847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 msgr2=0x7fc868100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 --2- 172.21.15.76:0/3656026847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868100c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc858009880 tx=0x7fc85802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 -- 172.21.15.76:0/3656026847 shutdown_connections 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 --2- 172.21.15.76:0/3656026847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868100c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 -- 172.21.15.76:0/3656026847 >> 172.21.15.76:0/3656026847 conn(0x7fc8680fb010 msgr2=0x7fc8680fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 -- 172.21.15.76:0/3656026847 shutdown_connections 2024-09-19T07:42:45.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.117+0000 7fc86cca3640 1 -- 172.21.15.76:0/3656026847 wait complete. 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86cca3640 1 Processor -- start 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86cca3640 1 -- start start 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86cca3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86cca3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc868109970 con 0x7fc868100840 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50396/0 (socket says 172.21.15.76:50396) 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86659c640 1 -- 172.21.15.76:0/1270110512 learned_addr learned my addr 172.21.15.76:0/1270110512 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.118+0000 7fc86659c640 1 -- 172.21.15.76:0/1270110512 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc868199580 con 0x7fc868100840 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.119+0000 7fc86659c640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868199040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8580099a0 tx=0x7fc858032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.119+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85803f030 con 0x7fc868100840 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.119+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc868199810 con 0x7fc868100840 2024-09-19T07:42:45.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.119+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc858003d00 con 0x7fc868100840 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.119+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc858035070 con 0x7fc868100840 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.119+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86819c500 con 0x7fc868100840 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.120+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc858042030 con 0x7fc868100840 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.120+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86810a0f0 con 0x7fc868100840 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.120+0000 7fc85f7fe640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc8540392a0 0x7fc85403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.120+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc858040070 con 0x7fc868100840 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.120+0000 7fc85ffff640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc8540392a0 0x7fc85403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.121+0000 7fc85ffff640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc8540392a0 0x7fc85403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8500098c0 tx=0x7fc850006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:45.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.125+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc85804c350 con 0x7fc868100840 2024-09-19T07:42:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:45.306+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi137", "target": ["mon-mgr", ""]}) -- 0x7fc86802d830 con 0x7fc8540392a0 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi076", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:45.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:45.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:45.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:42:45.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:42:45.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:46.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:46 smithi076 ceph-mon[30930]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:42:46.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:46 smithi076 ceph-mon[30930]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:42:46.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:46 smithi076 ceph-mon[30930]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:42:46.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:46 smithi076 ceph-mon[30930]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi137", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:47 smithi076 ceph-mon[30930]: Deploying cephadm binary to smithi137 2024-09-19T07:42:48.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.469+0000 7fc85f7fe640 1 -- 172.21.15.76:0/1270110512 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc86802d830 con 0x7fc8540392a0 2024-09-19T07:42:48.469 INFO:teuthology.orchestra.run.smithi076.stdout:Added host 'smithi137' with addr '172.21.15.137' 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc8540392a0 msgr2=0x7fc85403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc8540392a0 0x7fc85403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8500098c0 tx=0x7fc850006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 msgr2=0x7fc868199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868199040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8580099a0 tx=0x7fc858032d00 comp rx=0 tx=0).stop 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 shutdown_connections 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc8540392a0 0x7fc85403b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 --2- 172.21.15.76:0/1270110512 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc868100840 0x7fc868199040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 >> 172.21.15.76:0/1270110512 conn(0x7fc8680fb010 msgr2=0x7fc8680fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 shutdown_connections 2024-09-19T07:42:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:48.471+0000 7fc86cca3640 1 -- 172.21.15.76:0/1270110512 wait complete. 2024-09-19T07:42:49.057 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T07:42:49.297 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:49.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:49.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:49 smithi076 ceph-mon[30930]: Added host smithi137 2024-09-19T07:42:49.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:49.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:49.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:49.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 -- 172.21.15.76:0/1843406329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 msgr2=0x7fbf64107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:49.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 --2- 172.21.15.76:0/1843406329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009880 tx=0x7fbf4c02a5d0 comp rx=0 tx=0).stop 2024-09-19T07:42:49.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 -- 172.21.15.76:0/1843406329 shutdown_connections 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 --2- 172.21.15.76:0/1843406329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 -- 172.21.15.76:0/1843406329 >> 172.21.15.76:0/1843406329 conn(0x7fbf640fd290 msgr2=0x7fbf640ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 -- 172.21.15.76:0/1843406329 shutdown_connections 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 -- 172.21.15.76:0/1843406329 wait complete. 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 Processor -- start 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.735+0000 7fbf696fd640 1 -- start start 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf696fd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf696fd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6410bdd0 con 0x7fbf64107660 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf62ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf62ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50420/0 (socket says 172.21.15.76:50420) 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf62ffd640 1 -- 172.21.15.76:0/4018309488 learned_addr learned my addr 172.21.15.76:0/4018309488 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:49.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf62ffd640 1 -- 172.21.15.76:0/4018309488 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf64197740 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf62ffd640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64197200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c006010 tx=0x7fbf4c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf4c03f070 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf641979d0 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf4c031c20 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf4c035030 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.736+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6419bad0 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.737+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbf4c042070 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.737+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf64102cd0 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.737+0000 7fbf5bfff640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf500392a0 0x7fbf5003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.737+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbf4c06d0c0 con 0x7fbf64107660 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.738+0000 7fbf627fc640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf500392a0 0x7fbf5003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.738+0000 7fbf627fc640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf500392a0 0x7fbf5003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbf540098c0 tx=0x7fbf54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:49.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.742+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf4c0433b0 con 0x7fbf64107660 2024-09-19T07:42:49.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.917+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf64198560 con 0x7fbf500392a0 2024-09-19T07:42:49.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.918+0000 7fbf5bfff640 1 -- 172.21.15.76:0/4018309488 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fbf64198560 con 0x7fbf500392a0 2024-09-19T07:42:49.919 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:49.919 INFO:teuthology.orchestra.run.smithi076.stdout:[{"addr": "172.21.15.76", "hostname": "smithi076", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}] 2024-09-19T07:42:49.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf500392a0 msgr2=0x7fbf5003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:49.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf500392a0 0x7fbf5003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbf540098c0 tx=0x7fbf54006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:49.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 msgr2=0x7fbf64197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64197200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c006010 tx=0x7fbf4c003c00 comp rx=0 tx=0).stop 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 shutdown_connections 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf500392a0 0x7fbf5003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 --2- 172.21.15.76:0/4018309488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf64107660 0x7fbf64197200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 >> 172.21.15.76:0/4018309488 conn(0x7fbf640fd290 msgr2=0x7fbf640feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 shutdown_connections 2024-09-19T07:42:49.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:49.921+0000 7fbf696fd640 1 -- 172.21.15.76:0/4018309488 wait complete. 2024-09-19T07:42:50.495 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2024-09-19T07:42:50.495 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:42:50.495 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2024-09-19T07:42:50.515 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:42:50.516 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:42:50.574 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2024-09-19T07:42:50.574 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch host add smithi152 2024-09-19T07:42:50.814 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:51.083 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:51.083 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:50 smithi076 ceph-mon[30930]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:42:51.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.276+0000 7f0773353640 1 -- 172.21.15.76:0/3641045871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 msgr2=0x7f076c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:51.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.276+0000 7f0773353640 1 --2- 172.21.15.76:0/3641045871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f075c009880 tx=0x7f075c02a5d0 comp rx=0 tx=0).stop 2024-09-19T07:42:51.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.276+0000 7f0773353640 1 -- 172.21.15.76:0/3641045871 shutdown_connections 2024-09-19T07:42:51.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.276+0000 7f0773353640 1 --2- 172.21.15.76:0/3641045871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:51.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.276+0000 7f0773353640 1 -- 172.21.15.76:0/3641045871 >> 172.21.15.76:0/3641045871 conn(0x7f076c0fd290 msgr2=0x7f076c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:51.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f0773353640 1 -- 172.21.15.76:0/3641045871 shutdown_connections 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f0773353640 1 -- 172.21.15.76:0/3641045871 wait complete. 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f0773353640 1 Processor -- start 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f0773353640 1 -- start start 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f0773353640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f0773353640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f076c10bdd0 con 0x7f076c107660 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.277+0000 7f07710ef640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f07710ef640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50434/0 (socket says 172.21.15.76:50434) 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f07710ef640 1 -- 172.21.15.76:0/4139912905 learned_addr learned my addr 172.21.15.76:0/4139912905 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f07710ef640 1 -- 172.21.15.76:0/4139912905 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076c197720 con 0x7f076c107660 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f07710ef640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c1971e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f075c006010 tx=0x7f075c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f075c03f070 con 0x7f076c107660 2024-09-19T07:42:51.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f075c031c20 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076c1979b0 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f075c035030 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.278+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f076c19bab0 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.279+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f075c042070 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.279+0000 7f076a7fc640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f07540392a0 0x7f075403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.279+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f075c06d0a0 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.279+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076c102cd0 con 0x7f076c107660 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.279+0000 7f07708ee640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f07540392a0 0x7f075403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:51.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.280+0000 7f07708ee640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f07540392a0 0x7f075403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f076000ad30 tx=0x7f07600093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:51.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.284+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f075c031720 con 0x7f076c107660 2024-09-19T07:42:51.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:51.456+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) -- 0x7f076c107ac0 con 0x7f07540392a0 2024-09-19T07:42:52.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:51 smithi076 ceph-mon[30930]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: Deploying cephadm binary to smithi152 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:42:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:42:53.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:42:53.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:42:53.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:53.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:53.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:54.689 INFO:teuthology.orchestra.run.smithi076.stdout:Added host 'smithi152' with addr '172.21.15.152' 2024-09-19T07:42:54.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.688+0000 7f076a7fc640 1 -- 172.21.15.76:0/4139912905 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f076c107ac0 con 0x7f07540392a0 2024-09-19T07:42:54.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:54 smithi076 ceph-mon[30930]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:42:54.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:54 smithi076 ceph-mon[30930]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:42:54.690 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:54 smithi076 ceph-mon[30930]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f07540392a0 msgr2=0x7f075403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f07540392a0 0x7f075403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f076000ad30 tx=0x7f07600093f0 comp rx=0 tx=0).stop 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 msgr2=0x7f076c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c1971e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f075c006010 tx=0x7f075c003c00 comp rx=0 tx=0).stop 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 shutdown_connections 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f07540392a0 0x7f075403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:54.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 --2- 172.21.15.76:0/4139912905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f076c107660 0x7f076c1971e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:54.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.690+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 >> 172.21.15.76:0/4139912905 conn(0x7f076c0fd290 msgr2=0x7f076c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:54.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.691+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 shutdown_connections 2024-09-19T07:42:54.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:54.691+0000 7f0773353640 1 -- 172.21.15.76:0/4139912905 wait complete. 2024-09-19T07:42:55.278 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T07:42:55.519 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:55.634 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:55 smithi076 ceph-mon[30930]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:42:55.634 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:55.634 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:42:55.634 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:55.634 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:55.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 -- 172.21.15.76:0/3932587675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 msgr2=0x7f00fc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:55.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 --2- 172.21.15.76:0/3932587675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc102b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009880 tx=0x7f00ec02a670 comp rx=0 tx=0).stop 2024-09-19T07:42:55.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 -- 172.21.15.76:0/3932587675 shutdown_connections 2024-09-19T07:42:55.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 --2- 172.21.15.76:0/3932587675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc102b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 -- 172.21.15.76:0/3932587675 >> 172.21.15.76:0/3932587675 conn(0x7f00fc0fc1b0 msgr2=0x7f00fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 -- 172.21.15.76:0/3932587675 shutdown_connections 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 -- 172.21.15.76:0/3932587675 wait complete. 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 Processor -- start 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.983+0000 7f0102375640 1 -- start start 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f0102375640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f0102375640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc10be00 con 0x7f00fc102750 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00fbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00fbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc1972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51486/0 (socket says 172.21.15.76:51486) 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00fbfff640 1 -- 172.21.15.76:0/4068433080 learned_addr learned my addr 172.21.15.76:0/4068433080 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:55.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00fbfff640 1 -- 172.21.15.76:0/4068433080 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc197820 con 0x7f00fc102750 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00fbfff640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc1972e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ec03f070 con 0x7f00fc102750 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00ec031c20 con 0x7f00fc102750 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc197ab0 con 0x7f00fc102750 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.984+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ec035030 con 0x7f00fc102750 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.985+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc197f10 con 0x7f00fc102750 2024-09-19T07:42:55.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.986+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f00ec042070 con 0x7f00fc102750 2024-09-19T07:42:55.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.986+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc06a7b0 con 0x7f00fc102750 2024-09-19T07:42:55.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.986+0000 7f00f9ffb640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f00e8039300 0x7f00e803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:55.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.986+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f00ec06d050 con 0x7f00fc102750 2024-09-19T07:42:55.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.986+0000 7f00f3fff640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f00e8039300 0x7f00e803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:55.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.986+0000 7f00f3fff640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f00e8039300 0x7f00e803b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00e40098c0 tx=0x7f00e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:55.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:55.991+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00ec042dc0 con 0x7f00fc102750 2024-09-19T07:42:56.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.177+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00fc198640 con 0x7f00e8039300 2024-09-19T07:42:56.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.178+0000 7f00f9ffb640 1 -- 172.21.15.76:0/4068433080 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f00fc198640 con 0x7f00e8039300 2024-09-19T07:42:56.178 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:42:56.178 INFO:teuthology.orchestra.run.smithi076.stdout:[{"addr": "172.21.15.76", "hostname": "smithi076", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f00e8039300 msgr2=0x7f00e803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f00e8039300 0x7f00e803b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00e40098c0 tx=0x7f00e4006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 msgr2=0x7f00fc1972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc1972e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec003c00 comp rx=0 tx=0).stop 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 shutdown_connections 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f00e8039300 0x7f00e803b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:56.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 --2- 172.21.15.76:0/4068433080 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00fc102750 0x7f00fc1972e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:56.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 >> 172.21.15.76:0/4068433080 conn(0x7f00fc0fc1b0 msgr2=0x7f00fc1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:56.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 shutdown_connections 2024-09-19T07:42:56.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:56.180+0000 7f0102375640 1 -- 172.21.15.76:0/4068433080 wait complete. 2024-09-19T07:42:56.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:56 smithi076 ceph-mon[30930]: Added host smithi152 2024-09-19T07:42:56.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:56.841 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T07:42:56.842 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T07:42:57.083 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:42:57.471 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:57 smithi076 ceph-mon[30930]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:42:57.471 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:57 smithi076 ceph-mon[30930]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:42:57.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 -- 172.21.15.76:0/2342856415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 msgr2=0x7f8598102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:57.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 --2- 172.21.15.76:0/2342856415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f8598102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8588009880 tx=0x7f858802a670 comp rx=0 tx=0).stop 2024-09-19T07:42:57.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 -- 172.21.15.76:0/2342856415 shutdown_connections 2024-09-19T07:42:57.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 --2- 172.21.15.76:0/2342856415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f8598102b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:57.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 -- 172.21.15.76:0/2342856415 >> 172.21.15.76:0/2342856415 conn(0x7f85980fc1b0 msgr2=0x7f85980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:57.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 -- 172.21.15.76:0/2342856415 shutdown_connections 2024-09-19T07:42:57.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.484+0000 7f859cd6c640 1 -- 172.21.15.76:0/2342856415 wait complete. 2024-09-19T07:42:57.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859cd6c640 1 Processor -- start 2024-09-19T07:42:57.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859cd6c640 1 -- start start 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859cd6c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f85981972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859cd6c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f859810bdf0 con 0x7f85981027b0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f85981972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f85981972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51490/0 (socket says 172.21.15.76:51490) 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.485+0000 7f859659c640 1 -- 172.21.15.76:0/98697304 learned_addr learned my addr 172.21.15.76:0/98697304 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f859659c640 1 -- 172.21.15.76:0/98697304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598197810 con 0x7f85981027b0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f859659c640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f85981972d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8588006010 tx=0x7f8588003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858803f070 con 0x7f85981027b0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8588031c20 con 0x7f85981027b0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8598197aa0 con 0x7f85981027b0 2024-09-19T07:42:57.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588035030 con 0x7f85981027b0 2024-09-19T07:42:57.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.486+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8598197f00 con 0x7f85981027b0 2024-09-19T07:42:57.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.487+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8588042070 con 0x7f85981027b0 2024-09-19T07:42:57.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.487+0000 7f85877fe640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8580039300 0x7f858003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:57.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.487+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f858806cc80 con 0x7f85981027b0 2024-09-19T07:42:57.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.487+0000 7f8595d9b640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8580039300 0x7f858003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:57.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.487+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859806a750 con 0x7f85981027b0 2024-09-19T07:42:57.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.487+0000 7f8595d9b640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8580039300 0x7f858003b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f858c0098c0 tx=0x7f858c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:57.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.492+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8588042520 con 0x7f85981027b0 2024-09-19T07:42:57.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:57.660+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8598198690 con 0x7f85981027b0 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.430+0000 7f85877fe640 1 -- 172.21.15.76:0/98697304 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8588031dd0 con 0x7f85981027b0 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:adjusted tunables profile to default 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8580039300 msgr2=0x7f858003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8580039300 0x7f858003b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f858c0098c0 tx=0x7f858c006db0 comp rx=0 tx=0).stop 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 msgr2=0x7f85981972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f85981972d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8588006010 tx=0x7f8588003c00 comp rx=0 tx=0).stop 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 shutdown_connections 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8580039300 0x7f858003b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:58.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 --2- 172.21.15.76:0/98697304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85981027b0 0x7f85981972d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:58.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 >> 172.21.15.76:0/98697304 conn(0x7f85980fc1b0 msgr2=0x7f8598103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:58.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 shutdown_connections 2024-09-19T07:42:58.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:42:58.432+0000 7f859cd6c640 1 -- 172.21.15.76:0/98697304 wait complete. 2024-09-19T07:42:58.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:58 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/98697304' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:42:59.089 INFO:tasks.cephadm:Adding mon.a on smithi076 2024-09-19T07:42:59.090 INFO:tasks.cephadm:Adding mon.b on smithi137 2024-09-19T07:42:59.090 INFO:tasks.cephadm:Adding mon.c on smithi152 2024-09-19T07:42:59.090 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c' 2024-09-19T07:42:59.335 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/98697304' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:42:59.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:42:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 -- 172.21.15.152:0/4044877694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 msgr2=0x7f465c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 --2- 172.21.15.152:0/4044877694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c107a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4644009880 tx=0x7f464402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 -- 172.21.15.152:0/4044877694 shutdown_connections 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 --2- 172.21.15.152:0/4044877694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c107a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 -- 172.21.15.152:0/4044877694 >> 172.21.15.152:0/4044877694 conn(0x7f465c0fd290 msgr2=0x7f465c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 -- 172.21.15.152:0/4044877694 shutdown_connections 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.865+0000 7f4660be9640 1 -- 172.21.15.152:0/4044877694 wait complete. 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f4660be9640 1 Processor -- start 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f4660be9640 1 -- start start 2024-09-19T07:42:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f4660be9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f4660be9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f465c10bdd0 con 0x7f465c107660 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f465a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f465a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.152:50432/0 (socket says 172.21.15.152:50432) 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.866+0000 7f465a59c640 1 -- 172.21.15.152:0/4037898878 learned_addr learned my addr 172.21.15.152:0/4037898878 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f465a59c640 1 -- 172.21.15.152:0/4037898878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c197720 con 0x7f465c107660 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f465a59c640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c1971e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4644009230 tx=0x7f4644003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f464403f070 con 0x7f465c107660 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4644031d50 con 0x7f465c107660 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c1979b0 con 0x7f465c107660 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4644035030 con 0x7f465c107660 2024-09-19T07:42:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.867+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c19bab0 con 0x7f465c107660 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.868+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4644042070 con 0x7f465c107660 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.868+0000 7f46537fe640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f46480392a0 0x7f464803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.868+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c102cd0 con 0x7f465c107660 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.868+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f464406d230 con 0x7f465c107660 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.868+0000 7f4659d9b640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f46480392a0 0x7f464803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.869+0000 7f4659d9b640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f46480392a0 0x7f464803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f464c0098c0 tx=0x7f464c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:42:59.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:42:59.873+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4644039350 con 0x7f465c107660 2024-09-19T07:43:00.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.051+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}) -- 0x7f465c198540 con 0x7f46480392a0 2024-09-19T07:43:00.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.056+0000 7f46537fe640 1 -- 172.21.15.152:0/4037898878 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f465c198540 con 0x7f46480392a0 2024-09-19T07:43:00.057 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mon update... 2024-09-19T07:43:00.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f46480392a0 msgr2=0x7f464803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:00.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f46480392a0 0x7f464803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f464c0098c0 tx=0x7f464c006db0 comp rx=0 tx=0).stop 2024-09-19T07:43:00.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 msgr2=0x7f465c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:00.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c1971e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4644009230 tx=0x7f4644003cb0 comp rx=0 tx=0).stop 2024-09-19T07:43:00.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 shutdown_connections 2024-09-19T07:43:00.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f46480392a0 0x7f464803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:00.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 --2- 172.21.15.152:0/4037898878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f465c107660 0x7f465c1971e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:00.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 >> 172.21.15.152:0/4037898878 conn(0x7f465c0fd290 msgr2=0x7f465c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:00.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 shutdown_connections 2024-09-19T07:43:00.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:00.058+0000 7f4660be9640 1 -- 172.21.15.152:0/4037898878 wait complete. 2024-09-19T07:43:00.672 DEBUG:teuthology.orchestra.run.smithi137:mon.b> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T07:43:00.675 DEBUG:teuthology.orchestra.run.smithi152:mon.c> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T07:43:00.678 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:43:00.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:43:00.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:43:00.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:00.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:43:00.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:43:00.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:00.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:00.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:00.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:00.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:00.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:00.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:00.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:00.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:00.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:01 smithi076 ceph-mon[30930]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:01 smithi076 ceph-mon[30930]: Saving service mon spec with placement smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c;count:3 2024-09-19T07:43:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:01 smithi076 ceph-mon[30930]: Deploying daemon mon.c on smithi152 2024-09-19T07:43:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:01 smithi076 ceph-mon[30930]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:01.838 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 -- 172.21.15.152:0/3374016559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 msgr2=0x7f1b18107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 --2- 172.21.15.152:0/3374016559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b18107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009880 tx=0x7f1b0802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 -- 172.21.15.152:0/3374016559 shutdown_connections 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 --2- 172.21.15.152:0/3374016559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b18107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 -- 172.21.15.152:0/3374016559 >> 172.21.15.152:0/3374016559 conn(0x7f1b180fd290 msgr2=0x7f1b180ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 -- 172.21.15.152:0/3374016559 shutdown_connections 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.425+0000 7f1b1da85640 1 -- 172.21.15.152:0/3374016559 wait complete. 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.426+0000 7f1b1da85640 1 Processor -- start 2024-09-19T07:43:03.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.426+0000 7f1b1da85640 1 -- start start 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.426+0000 7f1b1da85640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.426+0000 7f1b1da85640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1810bdd0 con 0x7f1b18107660 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.427+0000 7f1b177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.427+0000 7f1b177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.152:50444/0 (socket says 172.21.15.152:50444) 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.427+0000 7f1b177fe640 1 -- 172.21.15.152:0/283792223 learned_addr learned my addr 172.21.15.152:0/283792223 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.427+0000 7f1b177fe640 1 -- 172.21.15.152:0/283792223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b180763e0 con 0x7f1b18107660 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.427+0000 7f1b177fe640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b180744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b08006010 tx=0x7f1b08003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.428+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b0803f070 con 0x7f1b18107660 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.428+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b08031c20 con 0x7f1b18107660 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.428+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b18074a30 con 0x7f1b18107660 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.428+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b08035030 con 0x7f1b18107660 2024-09-19T07:43:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.428+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b18074ef0 con 0x7f1b18107660 2024-09-19T07:43:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.429+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1b08042070 con 0x7f1b18107660 2024-09-19T07:43:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.429+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b18102cd0 con 0x7f1b18107660 2024-09-19T07:43:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.429+0000 7f1b14ff9640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1b000392a0 0x7f1b0003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:03.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.429+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1b0806d150 con 0x7f1b18107660 2024-09-19T07:43:03.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.429+0000 7f1b16ffd640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1b000392a0 0x7f1b0003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:03.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.429+0000 7f1b16ffd640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1b000392a0 0x7f1b0003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0098c0 tx=0x7f1b0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:03.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.434+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b0804c350 con 0x7f1b18107660 2024-09-19T07:43:03.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.682+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1b18075a20 con 0x7f1b18107660 2024-09-19T07:43:03.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.682+0000 7f1b14ff9640 1 -- 172.21.15.152:0/283792223 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f1b0803b5f0 con 0x7f1b18107660 2024-09-19T07:43:03.683 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:43:03.683 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","modified":"2024-09-19T07:41:35.031505Z","created":"2024-09-19T07:41:35.031505Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T07:43:03.683 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-19T07:43:03.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1b000392a0 msgr2=0x7f1b0003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:03.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1b000392a0 0x7f1b0003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0098c0 tx=0x7f1b0c006db0 comp rx=0 tx=0).stop 2024-09-19T07:43:03.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 msgr2=0x7f1b180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:03.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b180744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b08006010 tx=0x7f1b08003c00 comp rx=0 tx=0).stop 2024-09-19T07:43:03.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 shutdown_connections 2024-09-19T07:43:03.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1b000392a0 0x7f1b0003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:03.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 --2- 172.21.15.152:0/283792223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b18107660 0x7f1b180744f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:03.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 >> 172.21.15.152:0/283792223 conn(0x7f1b180fd290 msgr2=0x7f1b180feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:03.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 shutdown_connections 2024-09-19T07:43:03.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:03.685+0000 7f1b1da85640 1 -- 172.21.15.152:0/283792223 wait complete. 2024-09-19T07:43:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:03 smithi076 ceph-mon[30930]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:04.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 podman[35098]: 2024-09-19 07:43:04.422150626 +0000 UTC m=+0.015911679 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:43:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:04 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/283792223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:05.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 podman[35098]: 2024-09-19 07:43:04.70206776 +0000 UTC m=+0.295828806 container init f8f909920519e88eebbaed3422f0adfd7263d4a76966254ca8684b474c22619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 podman[35098]: 2024-09-19 07:43:04.706133925 +0000 UTC m=+0.299894971 container start f8f909920519e88eebbaed3422f0adfd7263d4a76966254ca8684b474c22619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: pidfile_write: ignore empty --pid-file 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: load: jerasure load: lrc 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: RocksDB version: 7.9.2 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Git sha 0 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: DB SUMMARY 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: DB Session ID: TGF3GXJ9WM710YQOJK7C 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: CURRENT file: CURRENT 2024-09-19T07:43:05.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.error_if_exists: 0 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.create_if_missing: 0 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.paranoid_checks: 1 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.env: 0x55df9ae0e940 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.info_log: 0x55df9bff96e0 2024-09-19T07:43:05.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T07:43:05.064 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.statistics: (nil) 2024-09-19T07:43:05.064 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.use_fsync: 0 2024-09-19T07:43:05.064 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_log_file_size: 0 2024-09-19T07:43:05.064 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.allow_fallocate: 1 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.use_direct_reads: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.db_log_dir: 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.wal_dir: 2024-09-19T07:43:05.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.write_buffer_manager: 0x55df9c008dc0 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T07:43:05.066 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.unordered_write: 0 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.row_cache: None 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.wal_filter: None 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T07:43:05.067 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.two_write_queues: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.wal_compression: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.atomic_flush: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.log_readahead_size: 0 2024-09-19T07:43:05.068 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_background_jobs: 2 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_background_compactions: -1 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_subcompactions: 1 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T07:43:05.069 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_open_files: -1 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:43:05.070 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:43:05.071 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:43:05.071 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:43:05.071 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Compression algorithms supported: 2024-09-19T07:43:05.071 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kZSTD supported: 0 2024-09-19T07:43:05.071 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:43:05.071 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:43:05.072 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.merge_operator: 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_filter: None 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55df9bff9320) 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:43:05.073 INFO:journalctl@ceph.mon.c.smithi152.stdout: index_type: 0 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: data_block_index_type: 0 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: index_shortening: 1 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: checksum: 4 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: no_block_cache: 0 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_cache: 0x55df9bfed1f0 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_cache_options: 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: capacity : 536870912 2024-09-19T07:43:05.074 INFO:journalctl@ceph.mon.c.smithi152.stdout: num_shard_bits : 4 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: strict_capacity_limit : 0 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_cache_compressed: (nil) 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: persistent_cache: (nil) 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_size: 4096 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_size_deviation: 10 2024-09-19T07:43:05.075 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_restart_interval: 16 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: index_block_restart_interval: 1 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: metadata_block_size: 4096 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: partition_filters: 0 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: use_delta_encoding: 1 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: filter_policy: bloomfilter 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: whole_key_filtering: 1 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: verify_compression: 0 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: format_version: 5 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: enable_index_compression: 1 2024-09-19T07:43:05.076 INFO:journalctl@ceph.mon.c.smithi152.stdout: block_align: 0 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout: max_auto_readahead_size: 262144 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout: prepopulate_block_cache: 0 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression: NoCompression 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.num_levels: 7 2024-09-19T07:43:05.077 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:43:05.078 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:43:05.079 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:43:05.080 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:43:05.081 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:43:05.081 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:43:05.081 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:43:05.081 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:43:05.081 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:43:05.082 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:43:05.083 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:43:05.084 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:43:05.085 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:43:05.086 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.ttl: 2592000 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:43:05.087 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e3fd8ca5-37b3-4f61-85b4-ff0e4ba29c29 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726731784733246, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726731784733660, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726731784, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e3fd8ca5-37b3-4f61-85b4-ff0e4ba29c29", "db_session_id": "TGF3GXJ9WM710YQOJK7C", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726731784733754, "job": 1, "event": "recovery_finished"} 2024-09-19T07:43:05.088 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55df9c01ae00 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: DB pointer 0x55df9c116000 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout: ** DB Stats ** 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:43:05.089 INFO:journalctl@ceph.mon.c.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:43:05.090 INFO:journalctl@ceph.mon.c.smithi152.stdout: 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:43:05.091 INFO:journalctl@ceph.mon.c.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: Block cache BinnedLRUCache@0x55df9bfed1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: using public_addr v2:172.21.15.152:0/0 -> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: starting mon.c rank -1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:05.092 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(???) e0 preinit fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: e1 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: btime 2024-09-19T07:41:37:923548+0000 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: legacy client fscid: -1 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout: No filesystems configured 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T07:43:05.093 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:43:05.094 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Added host smithi152 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/98697304' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/98697304' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:43:05.095 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:43:05.096 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:05.097 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Saving service mon spec with placement smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c;count:3 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: Deploying daemon mon.c on smithi152 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:05.098 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/283792223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:05.099 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 ceph-mon[35117]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T07:43:05.099 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 bash[35098]: f8f909920519e88eebbaed3422f0adfd7263d4a76966254ca8684b474c22619d 2024-09-19T07:43:05.099 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:04 smithi152 systemd[1]: Started Ceph mon.c for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:43:05.303 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:43:05.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:43:05.557 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:43:10.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:43:10.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: mon.a calling monitor election 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: mon.c calling monitor election 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: monmap epoch 2 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:10.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: last_changed 2024-09-19T07:43:04.759173+0000 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: min_mon_release 19 (squid) 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: election_strategy: 1 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: fsmap 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: mgrmap e13: x(active, since 37s) 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: overall HEALTH_OK 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:10.196 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:10.197 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:10.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:43:10.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: mon.a calling monitor election 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: mon.c calling monitor election 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: monmap epoch 2 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:10.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: last_changed 2024-09-19T07:43:04.759173+0000 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: min_mon_release 19 (squid) 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: election_strategy: 1 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: fsmap 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: mgrmap e13: x(active, since 37s) 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: overall HEALTH_OK 2024-09-19T07:43:10.313 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:10.314 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:10.314 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:10.314 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:10.314 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 -- 172.21.15.152:0/2583680766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3eac003530 msgr2=0x7f3eac0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/2583680766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3eac003530 0x7f3eac0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3ec41016a0 tx=0x7f3eb402c490 comp rx=0 tx=0).stop 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 -- 172.21.15.152:0/2583680766 shutdown_connections 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/2583680766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3eac003530 0x7f3eac0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 -- 172.21.15.152:0/2583680766 >> 172.21.15.152:0/2583680766 conn(0x7f3ec40fc220 msgr2=0x7f3ec40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 -- 172.21.15.152:0/2583680766 shutdown_connections 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.380+0000 7f3ec9db8640 1 -- 172.21.15.152:0/2583680766 wait complete. 2024-09-19T07:43:10.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.381+0000 7f3ec9db8640 1 Processor -- start 2024-09-19T07:43:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.381+0000 7f3ec9db8640 1 -- start start 2024-09-19T07:43:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec9db8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec9db8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ec4102730 0x7f3ec4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec9db8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec41087c0 con 0x7f3ec4102730 2024-09-19T07:43:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec9db8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec4108640 con 0x7f3eac003530 2024-09-19T07:43:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54730/0 (socket says 172.21.15.152:54730) 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 -- 172.21.15.152:0/662413703 learned_addr learned my addr 172.21.15.152:0/662413703 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec2ffd640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ec4102730 0x7f3ec4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 -- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 msgr2=0x7f3ec41021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 -- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 msgr2=0x7f3ec41021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec37fe640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec2ffd640 1 -- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 msgr2=0x7f3ec41021f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec2ffd640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.382+0000 7f3ec2ffd640 1 -- 172.21.15.152:0/662413703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec41040e0 con 0x7f3ec4102730 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.383+0000 7f3ec2ffd640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ec4102730 0x7f3ec4102b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800b400 tx=0x7f3eb800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.383+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3eb8011630 con 0x7f3ec4102730 2024-09-19T07:43:10.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.383+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3eb8011cd0 con 0x7f3ec4102730 2024-09-19T07:43:10.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.383+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec41a35d0 con 0x7f3ec4102730 2024-09-19T07:43:10.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.383+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3eb8010e40 con 0x7f3ec4102730 2024-09-19T07:43:10.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.383+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec41a3b60 con 0x7f3ec4102730 2024-09-19T07:43:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.384+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3eb8018020 con 0x7f3ec4102730 2024-09-19T07:43:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.384+0000 7f3ec0ff9640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3eb0039090 0x7f3eb003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.384+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec4101ca0 con 0x7f3ec4102730 2024-09-19T07:43:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.384+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3eb804bfc0 con 0x7f3ec4102730 2024-09-19T07:43:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.384+0000 7f3ec37fe640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3eb0039090 0x7f3eb003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.385+0000 7f3ec37fe640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3eb0039090 0x7f3eb003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3eb402ca00 tx=0x7f3eb402c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:10.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.390+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3eb801f020 con 0x7f3ec4102730 2024-09-19T07:43:10.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.624+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3ec41a3ea0 con 0x7f3ec4102730 2024-09-19T07:43:10.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.625+0000 7f3ec0ff9640 1 -- 172.21.15.152:0/662413703 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3eb8018310 con 0x7f3ec4102730 2024-09-19T07:43:10.626 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:43:10.626 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","modified":"2024-09-19T07:43:04.759173Z","created":"2024-09-19T07:41:35.031505Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:43:10.626 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 2 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3eb0039090 msgr2=0x7f3eb003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3eb0039090 0x7f3eb003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3eb402ca00 tx=0x7f3eb402c990 comp rx=0 tx=0).stop 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ec4102730 msgr2=0x7f3ec4102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ec4102730 0x7f3ec4102b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800b400 tx=0x7f3eb800b8c0 comp rx=0 tx=0).stop 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 shutdown_connections 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3eb0039090 0x7f3eb003b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ec4102730 0x7f3ec4102b90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 --2- 172.21.15.152:0/662413703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3eac003530 0x7f3ec41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:10.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 >> 172.21.15.152:0/662413703 conn(0x7f3ec40fc220 msgr2=0x7f3ec406a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:10.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 shutdown_connections 2024-09-19T07:43:10.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:10.627+0000 7f3ec9db8640 1 -- 172.21.15.152:0/662413703 wait complete. 2024-09-19T07:43:10.983 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:10 smithi152 ceph-mon[35117]: Deploying daemon mon.b on smithi137 2024-09-19T07:43:10.983 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:10 smithi152 ceph-mon[35117]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:10.983 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:10 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/662413703' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:10.983 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:11.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:10 smithi076 ceph-mon[30930]: Deploying daemon mon.b on smithi137 2024-09-19T07:43:11.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:10 smithi076 ceph-mon[30930]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:11.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:10 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/662413703' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:11.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:12.236 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:43:12.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:43:12.490 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 -- 172.21.15.152:0/3364427944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088107660 msgr2=0x7f6088107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 --2- 172.21.15.152:0/3364427944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088107660 0x7f6088107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6070009880 tx=0x7f607002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 -- 172.21.15.152:0/3364427944 shutdown_connections 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 --2- 172.21.15.152:0/3364427944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088107660 0x7f6088107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 -- 172.21.15.152:0/3364427944 >> 172.21.15.152:0/3364427944 conn(0x7f60880fd320 msgr2=0x7f60880ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 -- 172.21.15.152:0/3364427944 shutdown_connections 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.949+0000 7f608c958640 1 -- 172.21.15.152:0/3364427944 wait complete. 2024-09-19T07:43:12.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608c958640 1 Processor -- start 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608c958640 1 -- start start 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608c958640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608c958640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088197a80 0x7f608819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608c958640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f608810be60 con 0x7f6088197a80 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608c958640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f608810bce0 con 0x7f6088107660 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.950+0000 7f608659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f608659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54746/0 (socket says 172.21.15.152:54746) 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f608659c640 1 -- 172.21.15.152:0/1300670544 learned_addr learned my addr 172.21.15.152:0/1300670544 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f608659c640 1 -- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 msgr2=0x7f6088197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f608659c640 1 -- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 msgr2=0x7f6088197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f608659c640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f608659c640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f6085d9b640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088197a80 0x7f608819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:12.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f6085d9b640 1 -- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 msgr2=0x7f6088197540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f6085d9b640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f6085d9b640 1 -- 172.21.15.152:0/1300670544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60881980a0 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f6085d9b640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088197a80 0x7f608819be10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f607800b3d0 tx=0x7f607800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.951+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6078011630 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.952+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6078011cd0 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.952+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608819c350 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.952+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f607800f2e0 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.952+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608819c890 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.952+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6078018020 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.953+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6088102da0 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.953+0000 7f607f7fe640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6074039040 0x7f607403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.953+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f607804bff0 con 0x7f6088197a80 2024-09-19T07:43:12.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.953+0000 7f608659c640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6074039040 0x7f607403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.953+0000 7f608659c640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6074039040 0x7f607403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f60700096c0 tx=0x7f607002aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:12.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:12.958+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f607801f020 con 0x7f6088197a80 2024-09-19T07:43:13.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.186+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f608819cba0 con 0x7f6088197a80 2024-09-19T07:43:13.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.186+0000 7f607f7fe640 1 -- 172.21.15.152:0/1300670544 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f6078017500 con 0x7f6088197a80 2024-09-19T07:43:13.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:43:13.188 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","modified":"2024-09-19T07:43:04.759173Z","created":"2024-09-19T07:41:35.031505Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:43:13.188 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 2 2024-09-19T07:43:13.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6074039040 msgr2=0x7f607403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6074039040 0x7f607403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f60700096c0 tx=0x7f607002aad0 comp rx=0 tx=0).stop 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088197a80 msgr2=0x7f608819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088197a80 0x7f608819be10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f607800b3d0 tx=0x7f607800b890 comp rx=0 tx=0).stop 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 shutdown_connections 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6074039040 0x7f607403b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6088197a80 0x7f608819be10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 --2- 172.21.15.152:0/1300670544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6088107660 0x7f6088197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 >> 172.21.15.152:0/1300670544 conn(0x7f60880fd320 msgr2=0x7f60880fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 shutdown_connections 2024-09-19T07:43:13.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:13.189+0000 7f608c958640 1 -- 172.21.15.152:0/1300670544 wait complete. 2024-09-19T07:43:13.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:13 smithi137 systemd[1]: Started Ceph mon.b for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:43:14.743 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:43:14.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:43:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 -- 172.21.15.152:0/150325851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6134005740 msgr2=0x7f6134007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 --2- 172.21.15.152:0/150325851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6134005740 0x7f6134007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f614c1016a0 tx=0x7f613c02bd70 comp rx=0 tx=0).stop 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 -- 172.21.15.152:0/150325851 shutdown_connections 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 --2- 172.21.15.152:0/150325851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6134005740 0x7f6134007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 -- 172.21.15.152:0/150325851 >> 172.21.15.152:0/150325851 conn(0x7f614c0fc220 msgr2=0x7f614c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 -- 172.21.15.152:0/150325851 shutdown_connections 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.589+0000 7f61535fd640 1 -- 172.21.15.152:0/150325851 wait complete. 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 Processor -- start 2024-09-19T07:43:18.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 -- start start 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6134005740 0x7f614c195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f614c19a020 0x7f614c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f614c107710 con 0x7f614c19a020 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f614c107590 con 0x7f6134005740 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.590+0000 7f61535fd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f614c107890 con 0x7f614c195750 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54758/0 (socket says 172.21.15.152:54758) 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 -- 172.21.15.152:0/550246242 learned_addr learned my addr 172.21.15.152:0/550246242 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f614c19a020 0x7f614c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:18.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 -- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 msgr2=0x7f614c199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 -- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 msgr2=0x7f614c199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6150b98640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151399640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6134005740 0x7f614c195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 -- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 msgr2=0x7f614c199ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 -- 172.21.15.152:0/550246242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6134005740 msgr2=0x7f614c195210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6134005740 0x7f614c195210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 -- 172.21.15.152:0/550246242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c1a1d90 con 0x7f614c19a020 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f6151b9a640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f614c19a020 0x7f614c19a4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6144009fd0 tx=0x7f614400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144015020 con 0x7f614c19a020 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6144011d30 con 0x7f614c19a020 2024-09-19T07:43:18.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c1a1fc0 con 0x7f614c19a020 2024-09-19T07:43:18.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614400f2e0 con 0x7f614c19a020 2024-09-19T07:43:18.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.591+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c1a24f0 con 0x7f614c19a020 2024-09-19T07:43:18.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.592+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6144018020 con 0x7f614c19a020 2024-09-19T07:43:18.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.593+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c1088b0 con 0x7f614c19a020 2024-09-19T07:43:18.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.593+0000 7f614a7fc640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6138039730 0x7f613803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:18.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.593+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f614404c040 con 0x7f614c19a020 2024-09-19T07:43:18.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.593+0000 7f6151399640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6138039730 0x7f613803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:18.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.593+0000 7f6151399640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6138039730 0x7f613803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f613c011010 tx=0x7f613c011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:18.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.598+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f614401f020 con 0x7f614c19a020 2024-09-19T07:43:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:43:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: mon.a calling monitor election 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: mon.c calling monitor election 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: monmap epoch 3 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: last_changed 2024-09-19T07:43:13.438798+0000 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: min_mon_release 19 (squid) 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: election_strategy: 1 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-19T07:43:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: fsmap 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: mgrmap e13: x(active, since 45s) 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: overall HEALTH_OK 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.841+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f614c02d7c0 con 0x7f614c19a020 2024-09-19T07:43:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.841+0000 7f614a7fc640 1 -- 172.21.15.152:0/550246242 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f6144018310 con 0x7f614c19a020 2024-09-19T07:43:18.842 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:43:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","modified":"2024-09-19T07:43:13.438798Z","created":"2024-09-19T07:41:35.031505Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:3300","nonce":0},{"type":"v1","addr":"172.21.15.76:6789","nonce":0}]},"addr":"172.21.15.76:6789/0","public_addr":"172.21.15.76:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:43:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 3 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.843+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6138039730 msgr2=0x7f613803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.843+0000 7f61535fd640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6138039730 0x7f613803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f613c011010 tx=0x7f613c011040 comp rx=0 tx=0).stop 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.843+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f614c19a020 msgr2=0x7f614c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.843+0000 7f61535fd640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f614c19a020 0x7f614c19a4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6144009fd0 tx=0x7f614400b870 comp rx=0 tx=0).stop 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 shutdown_connections 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f614c19a020 0x7f614c19a4d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f614c195750 0x7f614c199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6138039730 0x7f613803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 --2- 172.21.15.152:0/550246242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6134005740 0x7f614c195210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 >> 172.21.15.152:0/550246242 conn(0x7f614c0fc220 msgr2=0x7f614c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 shutdown_connections 2024-09-19T07:43:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:18.844+0000 7f61535fd640 1 -- 172.21.15.152:0/550246242 wait complete. 2024-09-19T07:43:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:43:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: mon.a calling monitor election 2024-09-19T07:43:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: mon.c calling monitor election 2024-09-19T07:43:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: monmap epoch 3 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: last_changed 2024-09-19T07:43:13.438798+0000 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: min_mon_release 19 (squid) 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: election_strategy: 1 2024-09-19T07:43:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: fsmap 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: mgrmap e13: x(active, since 45s) 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: overall HEALTH_OK 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:18.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:19.424 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T07:43:19.425 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T07:43:19.685 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:43:19.769 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:19 smithi152 ceph-mon[35117]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:19.769 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:19.769 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:19 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/550246242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:19.769 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:19.783 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:19 smithi076 ceph-mon[30930]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:19.784 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:19.784 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:19 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/550246242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:19.784 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.110+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2188171937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c41076c0 msgr2=0x7f68c4107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:20.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.110+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2188171937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c41076c0 0x7f68c4107aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009880 tx=0x7f68b402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.110+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2188171937 shutdown_connections 2024-09-19T07:43:20.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.110+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2188171937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c41076c0 0x7f68c4107aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.111+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2188171937 >> 172.21.15.76:0/2188171937 conn(0x7f68c40fb8c0 msgr2=0x7f68c40fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:20.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.111+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2188171937 shutdown_connections 2024-09-19T07:43:20.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.111+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2188171937 wait complete. 2024-09-19T07:43:20.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.111+0000 7f68c9c4c640 1 Processor -- start 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 -- start start 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c41076c0 0x7f68c41973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 0x7f68c419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 0x7f68c419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f68c410bd90 con 0x7f68c4197920 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68c410bc10 con 0x7f68c419c1f0 2024-09-19T07:43:20.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c9c4c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68c410bf10 con 0x7f68c41076c0 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 0x7f68c419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 0x7f68c419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38994/0 (socket says 172.21.15.76:38994) 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 -- 172.21.15.76:0/2498288861 learned_addr learned my addr 172.21.15.76:0/2498288861 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c37fe640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c41076c0 0x7f68c41973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c3fff640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 0x7f68c419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 -- 172.21.15.76:0/2498288861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c41076c0 msgr2=0x7f68c41973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c41076c0 0x7f68c41973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c3fff640 1 -- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 msgr2=0x7f68c419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c3fff640 1 -- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 msgr2=0x7f68c419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 -- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 msgr2=0x7f68c419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c3fff640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 0x7f68c419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:43:20.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c3fff640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 0x7f68c419c6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 0x7f68c419c6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.112+0000 7f68c2ffd640 1 -- 172.21.15.76:0/2498288861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41a3f60 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.113+0000 7f68c2ffd640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 0x7f68c419bcb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b520 tx=0x7f68b800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.113+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8004230 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.113+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68b80043d0 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.113+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41a4190 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.113+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8003e00 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.113+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41a4720 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.114+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f68b800e070 con 0x7f68c4197920 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.114+0000 7f68c0ff9640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68ac039730 0x7f68ac03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:20.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.114+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f68b804be20 con 0x7f68c4197920 2024-09-19T07:43:20.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.114+0000 7f68c37fe640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68ac039730 0x7f68ac03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:20.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.114+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c4107b20 con 0x7f68c4197920 2024-09-19T07:43:20.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.115+0000 7f68c37fe640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68ac039730 0x7f68ac03bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:20.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.119+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68b8014020 con 0x7f68c4197920 2024-09-19T07:43:20.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.304+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f68c41a4a00 con 0x7f68c4197920 2024-09-19T07:43:20.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.304+0000 7f68c0ff9640 1 -- 172.21.15.76:0/2498288861 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f68b804b6b0 con 0x7f68c4197920 2024-09-19T07:43:20.305 INFO:teuthology.orchestra.run.smithi076.stdout:# minimal ceph.conf for 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:20.305 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2024-09-19T07:43:20.305 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:20.305 INFO:teuthology.orchestra.run.smithi076.stdout: mon_host = [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68ac039730 msgr2=0x7f68ac03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68ac039730 0x7f68ac03bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b4005a20 comp rx=0 tx=0).stop 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 msgr2=0x7f68c419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 0x7f68c419bcb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b520 tx=0x7f68b800b9e0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 shutdown_connections 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68ac039730 0x7f68ac03bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68c419c1f0 0x7f68c419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f68c4197920 0x7f68c419bcb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 --2- 172.21.15.76:0/2498288861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c41076c0 0x7f68c41973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:20.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 >> 172.21.15.76:0/2498288861 conn(0x7f68c40fb8c0 msgr2=0x7f68c40fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:20.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 shutdown_connections 2024-09-19T07:43:20.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:20.306+0000 7f68c9c4c640 1 -- 172.21.15.76:0/2498288861 wait complete. 2024-09-19T07:43:20.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:43:20.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: mon.a calling monitor election 2024-09-19T07:43:20.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: mon.c calling monitor election 2024-09-19T07:43:20.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:43:20.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:43:20.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: monmap epoch 3 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: last_changed 2024-09-19T07:43:13.438798+0000 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: min_mon_release 19 (squid) 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: election_strategy: 1 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:20.907 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: fsmap 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: mgrmap e13: x(active, since 45s) 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: overall HEALTH_OK 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:20.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:20.909 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:20.909 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:20.909 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/550246242' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:43:20.909 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:21.000 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T07:43:21.001 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:43:21.001 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:43:21.031 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:43:21.031 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:43:21.098 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:43:21.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:43:21.127 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:43:21.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:43:21.193 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:43:21.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:43:21.222 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:43:21.222 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:43:21.287 INFO:tasks.cephadm:Adding mgr.x on smithi076 2024-09-19T07:43:21.287 INFO:tasks.cephadm:Adding mgr.y on smithi137 2024-09-19T07:43:21.287 INFO:tasks.cephadm:Adding mgr.z on smithi152 2024-09-19T07:43:21.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi076=x;smithi137=y;smithi152=z' 2024-09-19T07:43:21.349 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: mon.b calling monitor election 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: mon.b calling monitor election 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: mon.c calling monitor election 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: mon.a calling monitor election 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: monmap epoch 3 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:21.350 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: last_changed 2024-09-19T07:43:13.438798+0000 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: min_mon_release 19 (squid) 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: election_strategy: 1 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: fsmap 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: mgrmap e13: x(active, since 47s) 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: overall HEALTH_OK 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.351 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:21.352 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:21.390 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: mon.b calling monitor election 2024-09-19T07:43:21.390 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:43:21.390 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:43:21.390 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: mon.b calling monitor election 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: mon.c calling monitor election 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: mon.a calling monitor election 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: monmap epoch 3 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: last_changed 2024-09-19T07:43:13.438798+0000 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: min_mon_release 19 (squid) 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: election_strategy: 1 2024-09-19T07:43:21.391 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: fsmap 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: mgrmap e13: x(active, since 47s) 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: overall HEALTH_OK 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.392 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:21.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:21.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: mon.b calling monitor election 2024-09-19T07:43:21.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:43:21.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: mon.b calling monitor election 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: mon.c calling monitor election 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: mon.a calling monitor election 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: monmap epoch 3 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: last_changed 2024-09-19T07:43:13.438798+0000 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: created 2024-09-19T07:41:35.031505+0000 2024-09-19T07:43:21.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: min_mon_release 19 (squid) 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: election_strategy: 1 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: 0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.c 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: fsmap 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: mgrmap e13: x(active, since 47s) 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: overall HEALTH_OK 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:21.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:21.564 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:43:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 -- 172.21.15.152:0/2303789107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41016e0 msgr2=0x7f54d4101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 --2- 172.21.15.152:0/2303789107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41016e0 0x7f54d4101ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009880 tx=0x7f54d002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:43:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 -- 172.21.15.152:0/2303789107 shutdown_connections 2024-09-19T07:43:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 --2- 172.21.15.152:0/2303789107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41016e0 0x7f54d4101ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 -- 172.21.15.152:0/2303789107 >> 172.21.15.152:0/2303789107 conn(0x7f54d40fce90 msgr2=0x7f54d40ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 -- 172.21.15.152:0/2303789107 shutdown_connections 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.970+0000 7f54dc35d640 1 -- 172.21.15.152:0/2303789107 wait complete. 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 Processor -- start 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 -- start start 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54d41016e0 0x7f54d4197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 0x7f54d419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54d4197a30 0x7f54d419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4107930 con 0x7f54d41975b0 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41077b0 con 0x7f54d41016e0 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54dc35d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4107ab0 con 0x7f54d4197a30 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 0x7f54d419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54da8fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54d4197a30 0x7f54d419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 0x7f54d419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.152:45170/0 (socket says 172.21.15.152:45170) 2024-09-19T07:43:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 -- 172.21.15.152:0/1950107697 learned_addr learned my addr 172.21.15.152:0/1950107697 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54da0f9640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54d41016e0 0x7f54d4197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 -- 172.21.15.152:0/1950107697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54d4197a30 msgr2=0x7f54d419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54d4197a30 0x7f54d419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 -- 172.21.15.152:0/1950107697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54d41016e0 msgr2=0x7f54d4197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54d41016e0 0x7f54d4197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 -- 172.21.15.152:0/1950107697 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d419f470 con 0x7f54d41975b0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.971+0000 7f54d98f8640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 0x7f54d419c620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54c400b520 tx=0x7f54c400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.972+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4004230 con 0x7f54d41975b0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.972+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54c40043d0 con 0x7f54d41975b0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.972+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d419f760 con 0x7f54d41975b0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.972+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4003e00 con 0x7f54d41975b0 2024-09-19T07:43:21.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.972+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d419fd20 con 0x7f54d41975b0 2024-09-19T07:43:21.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.973+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f54c400e070 con 0x7f54d41975b0 2024-09-19T07:43:21.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.973+0000 7f54cb7fe640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f54c0039730 0x7f54c003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:21.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.973+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f54c404bde0 con 0x7f54d41975b0 2024-09-19T07:43:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.973+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d4101b60 con 0x7f54d41975b0 2024-09-19T07:43:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.973+0000 7f54da0f9640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f54c0039730 0x7f54c003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.973+0000 7f54da0f9640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f54c0039730 0x7f54c003bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54d002abc0 tx=0x7f54d0031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:21.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:21.978+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f54c4014020 con 0x7f54d41975b0 2024-09-19T07:43:22.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.156+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi137=y;smithi152=z", "target": ["mon-mgr", ""]}) -- 0x7f54d40626c0 con 0x7f54c0039730 2024-09-19T07:43:22.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.161+0000 7f54cb7fe640 1 -- 172.21.15.152:0/1950107697 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f54d40626c0 con 0x7f54c0039730 2024-09-19T07:43:22.162 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mgr update... 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f54c0039730 msgr2=0x7f54c003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f54c0039730 0x7f54c003bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54d002abc0 tx=0x7f54d0031640 comp rx=0 tx=0).stop 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 msgr2=0x7f54d419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 0x7f54d419c620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54c400b520 tx=0x7f54c400b9e0 comp rx=0 tx=0).stop 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 shutdown_connections 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54d4197a30 0x7f54d419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54d41975b0 0x7f54d419c620 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f54c0039730 0x7f54c003bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 --2- 172.21.15.152:0/1950107697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54d41016e0 0x7f54d4197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 >> 172.21.15.152:0/1950107697 conn(0x7f54d40fce90 msgr2=0x7f54d40fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:22.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 shutdown_connections 2024-09-19T07:43:22.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:43:22.163+0000 7f54dc35d640 1 -- 172.21.15.152:0/1950107697 wait complete. 2024-09-19T07:43:22.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:22 smithi076 ceph-mon[30930]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:43:22.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:22 smithi076 ceph-mon[30930]: Reconfiguring daemon mon.a on smithi076 2024-09-19T07:43:22.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:22 smithi152 ceph-mon[35117]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:43:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:22 smithi152 ceph-mon[35117]: Reconfiguring daemon mon.a on smithi076 2024-09-19T07:43:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:22 smithi137 ceph-mon[35309]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:43:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:22 smithi137 ceph-mon[35309]: Reconfiguring daemon mon.a on smithi076 2024-09-19T07:43:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:43:22.812 DEBUG:teuthology.orchestra.run.smithi137:mgr.y> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T07:43:22.815 DEBUG:teuthology.orchestra.run.smithi152:mgr.z> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T07:43:22.854 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T07:43:22.855 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:43:22.855 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:43:22.873 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:43:22.873 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_1 2024-09-19T07:43:22.930 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:43:22.930 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:22.930 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T07:43:22.931 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:22.931 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:22.931 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-19 07:42:43.006649409 +0000 2024-09-19T07:43:22.931 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-19 07:37:53.885274413 +0000 2024-09-19T07:43:22.931 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-19 07:37:53.885274413 +0000 2024-09-19T07:43:22.931 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-19 07:37:53.885274413 +0000 2024-09-19T07:43:22.931 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:43:22.997 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-19T07:43:22.997 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-19T07:43:22.997 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000203004 s, 2.5 MB/s 2024-09-19T07:43:22.998 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:43:23.055 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_2 2024-09-19T07:43:23.112 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-19 07:42:43.037648474 +0000 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-19 07:37:54.202264712 +0000 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-19 07:37:54.202264712 +0000 2024-09-19T07:43:23.113 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-19 07:37:54.202264712 +0000 2024-09-19T07:43:23.113 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:43:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-19T07:43:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-19T07:43:23.177 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000204515 s, 2.5 MB/s 2024-09-19T07:43:23.179 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:43:23.236 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_3 2024-09-19T07:43:23.293 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-19 07:42:43.066647598 +0000 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-19 07:37:54.542254307 +0000 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-19 07:37:54.542254307 +0000 2024-09-19T07:43:23.294 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-19 07:37:54.542254307 +0000 2024-09-19T07:43:23.294 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:43:23.355 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi137=y;smithi152=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: Reconfiguring daemon mon.b on smithi137 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: Saving service mgr spec with placement smithi076=x;smithi137=y;smithi152=z;count:3 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:23.356 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.358 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-19T07:43:23.358 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-19T07:43:23.358 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000173709 s, 2.9 MB/s 2024-09-19T07:43:23.359 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi137=y;smithi152=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: Reconfiguring daemon mon.b on smithi137 2024-09-19T07:43:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: Saving service mgr spec with placement smithi076=x;smithi137=y;smithi152=z;count:3 2024-09-19T07:43:23.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:23.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.415 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_4 2024-09-19T07:43:23.471 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:43:23.471 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:23.471 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T07:43:23.471 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:23.471 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:23.471 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-19 07:42:43.097646662 +0000 2024-09-19T07:43:23.472 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-19 07:37:54.844245065 +0000 2024-09-19T07:43:23.472 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-19 07:37:54.844245065 +0000 2024-09-19T07:43:23.472 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-19 07:37:54.844245065 +0000 2024-09-19T07:43:23.472 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:43:23.535 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-19T07:43:23.535 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-19T07:43:23.535 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000174744 s, 2.9 MB/s 2024-09-19T07:43:23.536 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi076=x;smithi137=y;smithi152=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: Reconfiguring daemon mon.b on smithi137 2024-09-19T07:43:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: Saving service mgr spec with placement smithi076=x;smithi137=y;smithi152=z;count:3 2024-09-19T07:43:23.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:23.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:23.592 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-19T07:43:23.592 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:43:23.608 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:43:23.609 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-19T07:43:23.665 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:43:23.665 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:23.665 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T07:43:23.665 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-19 07:43:12.785674219 +0000 2024-09-19T07:43:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-19 07:38:10.811410906 +0000 2024-09-19T07:43:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-19 07:38:10.811410906 +0000 2024-09-19T07:43:23.666 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-19 07:38:10.811410906 +0000 2024-09-19T07:43:23.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:43:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-19T07:43:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-19T07:43:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000242872 s, 2.1 MB/s 2024-09-19T07:43:23.730 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:43:23.788 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-19 07:43:12.785674219 +0000 2024-09-19T07:43:23.844 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-19 07:38:11.214403772 +0000 2024-09-19T07:43:23.845 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-19 07:38:11.214403772 +0000 2024-09-19T07:43:23.845 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-19 07:38:11.214403772 +0000 2024-09-19T07:43:23.845 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:43:23.907 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-19T07:43:23.908 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-19T07:43:23.908 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000218308 s, 2.3 MB/s 2024-09-19T07:43:23.909 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:43:23.965 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-19 07:43:12.785674219 +0000 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-19 07:38:11.523398302 +0000 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-19 07:38:11.523398302 +0000 2024-09-19T07:43:24.022 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-19 07:38:11.523398302 +0000 2024-09-19T07:43:24.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:43:24.085 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-19T07:43:24.085 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-19T07:43:24.085 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000210326 s, 2.4 MB/s 2024-09-19T07:43:24.086 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:43:24.143 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-19 07:43:12.786674201 +0000 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-19 07:38:11.832392832 +0000 2024-09-19T07:43:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-19 07:38:11.832392832 +0000 2024-09-19T07:43:24.200 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-19 07:38:11.832392832 +0000 2024-09-19T07:43:24.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:43:24.262 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-19T07:43:24.262 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-19T07:43:24.263 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000204271 s, 2.5 MB/s 2024-09-19T07:43:24.264 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:43:24.320 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-19T07:43:24.320 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:43:24.337 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:43:24.337 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-19T07:43:24.393 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-19 07:43:03.791047050 +0000 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-19 07:38:07.672786051 +0000 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-19 07:38:07.672786051 +0000 2024-09-19T07:43:24.394 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-19 07:38:07.672786051 +0000 2024-09-19T07:43:24.394 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:43:24.458 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-19T07:43:24.459 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-19T07:43:24.459 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000275415 s, 1.9 MB/s 2024-09-19T07:43:24.460 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:43:24.516 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-19T07:43:24.572 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:43:24.572 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:24.572 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T07:43:24.572 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:24.572 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:24.572 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-19 07:43:03.791047050 +0000 2024-09-19T07:43:24.573 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-19 07:38:07.999782303 +0000 2024-09-19T07:43:24.573 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-19 07:38:07.999782303 +0000 2024-09-19T07:43:24.573 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-19 07:38:07.999782303 +0000 2024-09-19T07:43:24.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:43:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-19T07:43:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-19T07:43:24.635 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000198424 s, 2.6 MB/s 2024-09-19T07:43:24.636 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:24 smithi137 ceph-mon[35309]: Reconfiguring daemon mon.c on smithi152 2024-09-19T07:43:24.693 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-19T07:43:24.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:24.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:24.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:43:24.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:24.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:24.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:24.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:24 smithi076 ceph-mon[30930]: Reconfiguring daemon mon.c on smithi152 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:24.726 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:24 smithi152 ceph-mon[35117]: Reconfiguring daemon mon.c on smithi152 2024-09-19T07:43:24.742 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-19 07:43:03.791047050 +0000 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-19 07:38:08.316778670 +0000 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-19 07:38:08.316778670 +0000 2024-09-19T07:43:24.828 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-19 07:38:08.316778670 +0000 2024-09-19T07:43:24.829 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:43:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-19T07:43:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-19T07:43:24.852 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000227621 s, 2.2 MB/s 2024-09-19T07:43:24.854 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:43:24.911 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-19T07:43:24.967 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-19 07:43:03.792047038 +0000 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-19 07:38:08.638774979 +0000 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-19 07:38:08.638774979 +0000 2024-09-19T07:43:24.968 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-19 07:38:08.638774979 +0000 2024-09-19T07:43:24.968 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:43:25.032 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-19T07:43:25.032 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-19T07:43:25.032 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000208979 s, 2.5 MB/s 2024-09-19T07:43:25.033 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:43:25.094 INFO:tasks.cephadm:Deploying osd.0 on smithi076 with /dev/vg_nvme/lv_4... 2024-09-19T07:43:25.094 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:43:25.342 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:43:25.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:25.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:25.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:25.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:25.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:25.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:43:25.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:25.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:25.764 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:25.764 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.764 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.764 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:25.764 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:25.764 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:25.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:25.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:43:25.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:25.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:25.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:25.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:26.561 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:26 smithi076 ceph-mon[30930]: Deploying daemon mgr.z on smithi152 2024-09-19T07:43:26.742 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:26 smithi152 ceph-mon[35117]: Deploying daemon mgr.z on smithi152 2024-09-19T07:43:26.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:26 smithi137 ceph-mon[35309]: Deploying daemon mgr.z on smithi152 2024-09-19T07:43:27.213 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.063+0000 7f99b24bf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:43:27.213 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.212+0000 7f99b24bf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:43:27.561 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.278+0000 7f99b24bf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:43:27.561 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.425+0000 7f99b24bf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:43:27.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:27.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:27.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:43:27.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:27.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:27.638 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:43:27.665 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_4 2024-09-19T07:43:27.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:27.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:27.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:43:27.763 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:27.763 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:27.881 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.566+0000 7f99b24bf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:43:27.881 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.879+0000 7f99b24bf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:43:27.907 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:28.311 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:27.940+0000 7f99b24bf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:43:28.311 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:28.121+0000 7f99b24bf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:43:28.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 -- 172.21.15.76:0/1040699783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 msgr2=0x7f9928103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 --2- 172.21.15.76:0/1040699783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928103610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9924009900 tx=0x7f992402a410 comp rx=0 tx=0).stop 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 -- 172.21.15.76:0/1040699783 shutdown_connections 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 --2- 172.21.15.76:0/1040699783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9928100350 0x7f992810a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 --2- 172.21.15.76:0/1040699783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9928103be0 0x7f99280ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 --2- 172.21.15.76:0/1040699783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928103610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 -- 172.21.15.76:0/1040699783 >> 172.21.15.76:0/1040699783 conn(0x7f99280fba40 msgr2=0x7f99280fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 -- 172.21.15.76:0/1040699783 shutdown_connections 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.371+0000 7f99307e1640 1 -- 172.21.15.76:0/1040699783 wait complete. 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 Processor -- start 2024-09-19T07:43:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 -- start start 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9928100350 0x7f99281980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9928103be0 0x7f992819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f992810dab0 con 0x7f9928103210 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f992810d930 con 0x7f9928100350 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f99307e1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f992810dc30 con 0x7f9928103be0 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f992dd7c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f992dd7c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42074/0 (socket says 172.21.15.76:42074) 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f992dd7c640 1 -- 172.21.15.76:0/3334567323 learned_addr learned my addr 172.21.15.76:0/3334567323 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f992ed7e640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9928103be0 0x7f992819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.372+0000 7f992e57d640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9928100350 0x7f99281980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f992dd7c640 1 -- 172.21.15.76:0/3334567323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9928103be0 msgr2=0x7f992819f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f992dd7c640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9928103be0 0x7f992819f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f992dd7c640 1 -- 172.21.15.76:0/3334567323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9928100350 msgr2=0x7f99281980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f992dd7c640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9928100350 0x7f99281980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f992dd7c640 1 -- 172.21.15.76:0/3334567323 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992819fd00 con 0x7f9928103210 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f992dd7c640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928198610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f991800d770 tx=0x7f991800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918017070 con 0x7f9928103210 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9918009c30 con 0x7f9928103210 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992819fff0 con 0x7f9928103210 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991800f6b0 con 0x7f9928103210 2024-09-19T07:43:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.373+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99281a0520 con 0x7f9928103210 2024-09-19T07:43:28.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.374+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f991801a070 con 0x7f9928103210 2024-09-19T07:43:28.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.374+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9928109100 con 0x7f9928103210 2024-09-19T07:43:28.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.374+0000 7f991f7fe640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9914039500 0x7f991403b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:28.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.374+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f991804c2c0 con 0x7f9928103210 2024-09-19T07:43:28.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.374+0000 7f992e57d640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9914039500 0x7f991403b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:28.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.375+0000 7f992e57d640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9914039500 0x7f991403b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9924006010 tx=0x7f9924031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:28.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.379+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f991800f850 con 0x7f9928103210 2024-09-19T07:43:28.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:28.554+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9928062630 con 0x7f9914039500 2024-09-19T07:43:28.556 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:28 smithi076 ceph-mon[30930]: Deploying daemon mgr.y on smithi137 2024-09-19T07:43:28.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:28 smithi137 ceph-mon[35309]: Deploying daemon mgr.y on smithi137 2024-09-19T07:43:28.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:28 smithi152 ceph-mon[35117]: Deploying daemon mgr.y on smithi137 2024-09-19T07:43:29.042 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:28 smithi137 systemd[1]: Starting Ceph mgr.y for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:43:29.303 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 podman[36661]: 2024-09-19 07:43:29.042658894 +0000 UTC m=+0.108106088 container create d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T07:43:29.303 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 podman[36661]: 2024-09-19 07:43:28.950461948 +0000 UTC m=+0.015909119 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:43:29.303 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 podman[36661]: 2024-09-19 07:43:29.303037726 +0000 UTC m=+0.368484880 container init d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T07:43:29.311 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:29.002+0000 7f99b24bf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:43:29.311 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:29.068+0000 7f99b24bf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:43:29.651 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 podman[36661]: 2024-09-19 07:43:29.305673468 +0000 UTC m=+0.371120620 container start d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mgr[36680]: -- 172.21.15.137:0/3966606111 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571018110e0 con 0x5571017ef400 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 bash[36661]: d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 systemd[1]: Started Ceph mgr.y for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:29.437+0000 7f9586056040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:29.496+0000 7f9586056040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:29.650+0000 7f9586056040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:29.652 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:43:29.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:43:29.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:29.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.801 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.882 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:29.882 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:29.882 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:43:29.883 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:43:29.883 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:29.883 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.883 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.883 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.883 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:29.904 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:29.718+0000 7f9586056040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:43:29.904 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:29.883+0000 7f9586056040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:43:30.061 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:29.798+0000 7f99b24bf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:43:30.061 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:29.935+0000 7f99b24bf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:43:30.347 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:30.031+0000 7f9586056040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:43:30.382 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.084+0000 7f99b24bf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:43:30.382 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.145+0000 7f99b24bf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:43:30.382 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.313+0000 7f99b24bf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:43:30.383 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.381+0000 7f99b24bf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:43:30.610 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:30 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:30.610 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:30.354+0000 7f9586056040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:43:30.610 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:30.416+0000 7f9586056040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:43:30.677 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:30.678 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.443+0000 7f99b24bf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:43:30.678 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.603+0000 7f99b24bf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:43:30.678 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.676+0000 7f99b24bf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:43:30.904 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:30.609+0000 7f9586056040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:43:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:30 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:30.950 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.743+0000 7f99b24bf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:43:30.950 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.830+0000 7f99b24bf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:43:30.950 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.890+0000 7f99b24bf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:43:30.951 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:30.949+0000 7f99b24bf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:43:31.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:31.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2571776055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbcd7216-2e99-403b-b350-f556959ce4af"}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2571776055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbcd7216-2e99-403b-b350-f556959ce4af"}]': finished 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:31.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:31 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2462125798' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:43:31.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2571776055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbcd7216-2e99-403b-b350-f556959ce4af"}]: dispatch 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2571776055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbcd7216-2e99-403b-b350-f556959ce4af"}]': finished 2024-09-19T07:43:31.740 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:43:31.741 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:31.741 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2462125798' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:43:31.904 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:31.491+0000 7f9586056040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:43:31.904 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:31.557+0000 7f9586056040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:43:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2571776055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbcd7216-2e99-403b-b350-f556959ce4af"}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2571776055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbcd7216-2e99-403b-b350-f556959ce4af"}]': finished 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:31 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2462125798' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:43:32.061 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:43:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:43:31.738+0000 7f99b24bf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:43:32.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:32.481+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f991801a400 con 0x7f9928103210 2024-09-19T07:43:32.518 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.262+0000 7f9586056040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:43:32.518 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.376+0000 7f9586056040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.517+0000 7f9586056040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: Reconfiguring daemon mgr.x on smithi076 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: Standby manager daemon z started 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:43:32.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:43:32.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.579+0000 7f9586056040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:43:32.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.725+0000 7f9586056040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:43:32.792 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.791+0000 7f9586056040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: Reconfiguring daemon mgr.x on smithi076 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: Standby manager daemon z started 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:43:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:32 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: Reconfiguring daemon mgr.x on smithi076 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: Standby manager daemon z started 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:43:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:32 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/62663757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:43:33.069 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:32.850+0000 7f9586056040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:43:33.070 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:33.005+0000 7f9586056040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:43:33.070 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:33.069+0000 7f9586056040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:43:33.330 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:33.134+0000 7f9586056040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:43:33.330 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:33.214+0000 7f9586056040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:43:33.330 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:33.272+0000 7f9586056040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:43:33.330 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:33.329+0000 7f9586056040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:43:33.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-mon[35309]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T07:43:33.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:43:33.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-mon[35309]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:33.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:33.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:33 smithi152 ceph-mon[35117]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T07:43:33.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:43:33.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:33 smithi152 ceph-mon[35117]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:33.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:33 smithi076 ceph-mon[30930]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T07:43:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:43:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:33 smithi076 ceph-mon[30930]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:34.404 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:43:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:43:34.106+0000 7f9586056040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:43:34.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:34.491+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f991801b3b0 con 0x7f9928103210 2024-09-19T07:43:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:34 smithi152 ceph-mon[35117]: Standby manager daemon y started 2024-09-19T07:43:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:34 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:43:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:34 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:43:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:34 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:43:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:34 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:43:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:34 smithi137 ceph-mon[35309]: Standby manager daemon y started 2024-09-19T07:43:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:34 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:43:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:34 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:43:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:34 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:43:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:34 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:43:34.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:34 smithi076 ceph-mon[30930]: Standby manager daemon y started 2024-09-19T07:43:34.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:34 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:43:34.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:34 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:43:34.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:34 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:43:34.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:34 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/405579991' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:43:35.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:35 smithi152 ceph-mon[35117]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T07:43:35.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:43:35.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:35 smithi152 ceph-mon[35117]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:35 smithi137 ceph-mon[35309]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T07:43:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:43:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:35 smithi137 ceph-mon[35309]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:35.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:35 smithi076 ceph-mon[30930]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T07:43:35.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:43:35.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:35 smithi076 ceph-mon[30930]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:37.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:37 smithi152 ceph-mon[35117]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:37.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:37.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:37.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:37.814 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:37 smithi076 ceph-mon[30930]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:37.814 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:37.814 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:37.814 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:37 smithi137 ceph-mon[35309]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:38.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:38.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:38.675 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:38.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:38.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:38.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:39.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:39 smithi076 ceph-mon[30930]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:39 smithi152 ceph-mon[35117]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:39 smithi137 ceph-mon[35309]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:40.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:40 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:43:40.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:40 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:40.824 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:40 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:43:40.825 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:40 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:40 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:43:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:40 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:41.652 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:41 smithi076 ceph-mon[30930]: Deploying daemon osd.0 on smithi076 2024-09-19T07:43:41.653 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:41 smithi076 ceph-mon[30930]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:41.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:41 smithi137 ceph-mon[35309]: Deploying daemon osd.0 on smithi076 2024-09-19T07:43:41.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:41 smithi137 ceph-mon[35309]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:41.985 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:41 smithi152 ceph-mon[35117]: Deploying daemon osd.0 on smithi076 2024-09-19T07:43:41.985 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:41 smithi152 ceph-mon[35117]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:43 smithi137 ceph-mon[35309]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:43 smithi076 ceph-mon[30930]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:43 smithi152 ceph-mon[35117]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:45.760 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:45 smithi076 ceph-mon[30930]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:45 smithi137 ceph-mon[35309]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:45 smithi152 ceph-mon[35117]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:46.791 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:46 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:46.792 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:46 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:46.792 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:46 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:46.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:46 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:46.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:46 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:46.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:46 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:46 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:46 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:46 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:47.824 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:47 smithi076 ceph-mon[30930]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:47.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:47 smithi137 ceph-mon[35309]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:47 smithi152 ceph-mon[35117]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:49 smithi137 ceph-mon[35309]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:49.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:49.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:49 smithi076 ceph-mon[30930]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:49 smithi152 ceph-mon[35117]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.258+0000 7f991f7fe640 1 -- 172.21.15.76:0/3334567323 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9928062630 con 0x7f9914039500 2024-09-19T07:43:50.259 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 0 on host 'smithi076' 2024-09-19T07:43:50.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9914039500 msgr2=0x7f991403b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9914039500 0x7f991403b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9924006010 tx=0x7f9924031640 comp rx=0 tx=0).stop 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 msgr2=0x7f9928198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928198610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f991800d770 tx=0x7f991800dc30 comp rx=0 tx=0).stop 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 shutdown_connections 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9928103be0 0x7f992819f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9928103210 0x7f9928198610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9914039500 0x7f991403b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 --2- 172.21.15.76:0/3334567323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9928100350 0x7f99281980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 >> 172.21.15.76:0/3334567323 conn(0x7f99280fba40 msgr2=0x7f99281062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 shutdown_connections 2024-09-19T07:43:50.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:43:50.260+0000 7f99307e1640 1 -- 172.21.15.76:0/3334567323 wait complete. 2024-09-19T07:43:50.879 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:50.879 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.879 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:50.906 DEBUG:teuthology.orchestra.run.smithi076:osd.0> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T07:43:50.909 INFO:tasks.cephadm:Deploying osd.1 on smithi137 with /dev/vg_nvme/lv_4... 2024-09-19T07:43:50.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:43:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:43:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:51.146 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:43:51.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:51 smithi137 ceph-mon[35309]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:51.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:51 smithi076 ceph-mon[30930]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:52.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:51 smithi152 ceph-mon[35117]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:52.587 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:43:52 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0[45091]: 2024-09-19T07:43:52.392+0000 7f323cd84640 -1 osd.0 0 log_to_monitors true 2024-09-19T07:43:52.614 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:52 smithi137 ceph-mon[35309]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:43:52.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:52 smithi152 ceph-mon[35117]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:43:52.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:52 smithi076 ceph-mon[30930]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:43:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:43:53.595 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_4 2024-09-19T07:43:53.846 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:43:53.870 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:53 smithi137 ceph-mon[35309]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:53.871 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:53 smithi137 ceph-mon[35309]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:43:53.871 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:53 smithi137 ceph-mon[35309]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:43:53.871 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:53 smithi137 ceph-mon[35309]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:43:53.871 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:53.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:53 smithi076 ceph-mon[30930]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:53.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:53 smithi076 ceph-mon[30930]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:43:53.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:53 smithi076 ceph-mon[30930]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:43:53.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:53 smithi076 ceph-mon[30930]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:43:53.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:53 smithi152 ceph-mon[35117]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:53 smithi152 ceph-mon[35117]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:43:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:53 smithi152 ceph-mon[35117]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:43:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:53 smithi152 ceph-mon[35117]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:43:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:54.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 -- 172.21.15.137:0/2397856249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1017a0 msgr2=0x7f404c109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 --2- 172.21.15.137:0/2397856249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1017a0 0x7f404c109040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4044009ca0 tx=0x7f404402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 -- 172.21.15.137:0/2397856249 shutdown_connections 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 --2- 172.21.15.137:0/2397856249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1017a0 0x7f404c109040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 --2- 172.21.15.137:0/2397856249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f404c100de0 0x7f404c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 --2- 172.21.15.137:0/2397856249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c1020a0 0x7f404c1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 -- 172.21.15.137:0/2397856249 >> 172.21.15.137:0/2397856249 conn(0x7f404c0fba40 msgr2=0x7f404c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 -- 172.21.15.137:0/2397856249 shutdown_connections 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.321+0000 7f40519e3640 1 -- 172.21.15.137:0/2397856249 wait complete. 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 Processor -- start 2024-09-19T07:43:54.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 -- start start 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 0x7f404c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f404c1017a0 0x7f404c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1020a0 0x7f404c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f404c10d9e0 con 0x7f404c100de0 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f404c10d860 con 0x7f404c1020a0 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f40519e3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f404c10db60 con 0x7f404c1017a0 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 0x7f404c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1020a0 0x7f404c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 0x7f404c19a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.137:51218/0 (socket says 172.21.15.137:51218) 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 -- 172.21.15.137:0/2773175078 learned_addr learned my addr 172.21.15.137:0/2773175078 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404a7fc640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f404c1017a0 0x7f404c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:54.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 -- 172.21.15.137:0/2773175078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f404c1017a0 msgr2=0x7f404c19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f404c1017a0 0x7f404c19a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 -- 172.21.15.137:0/2773175078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1020a0 msgr2=0x7f404c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1020a0 0x7f404c1a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404affd640 1 -- 172.21.15.137:0/2773175078 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404c1a1e20 con 0x7f404c100de0 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.322+0000 7f404b7fe640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1020a0 0x7f404c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.323+0000 7f404affd640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 0x7f404c19a1f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f403c00e9c0 tx=0x7f403c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.323+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c00cd80 con 0x7f404c100de0 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.323+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f403c0035f0 con 0x7f404c100de0 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.323+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404c1a2110 con 0x7f404c100de0 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.323+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c010690 con 0x7f404c100de0 2024-09-19T07:43:54.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.323+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404c1a26a0 con 0x7f404c100de0 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.324+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f404c1a2960 con 0x7f404c100de0 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.325+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f403c0037a0 con 0x7f404c100de0 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.325+0000 7f40509e1640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f40340a3260 0x7f40340a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.326+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f403c0ce0d0 con 0x7f404c100de0 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.326+0000 7f404a7fc640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f40340a3260 0x7f40340a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.326+0000 7f404a7fc640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f40340a3260 0x7f40340a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f404c19b710 tx=0x7f404000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:43:54.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.330+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f403c09c960 con 0x7f404c100de0 2024-09-19T07:43:54.410 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0[45091]: 2024-09-19T07:43:54.098+0000 7f323951b640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T07:43:54.410 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0[45091]: 2024-09-19T07:43:54.104+0000 7f3230b27640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:43:54.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:43:54.535+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f404c10b020 con 0x7f40340a3260 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:43:54.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:43:54.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:54.888 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:43:54.888 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:43:54.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:43:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:43:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020]' entity='osd.0' 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:43:55.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:43:55.784 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi076 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi076 to 17088M 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] boot 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:43:55.785 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:55 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi076 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi076 to 17088M 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] boot 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:43:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi076 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi076 to 17088M 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: osd.0 [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] boot 2024-09-19T07:43:56.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:43:56.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:55 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:43:57.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T07:43:57.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:43:57.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/2071526191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]: dispatch 2024-09-19T07:43:57.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]: dispatch 2024-09-19T07:43:57.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]': finished 2024-09-19T07:43:57.313 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:43:57.313 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:43:57.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T07:43:57.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:43:57.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/2071526191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]: dispatch 2024-09-19T07:43:57.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]: dispatch 2024-09-19T07:43:57.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]': finished 2024-09-19T07:43:57.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:43:57.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:43:57.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T07:43:57.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:43:57.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/2071526191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]: dispatch 2024-09-19T07:43:57.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]: dispatch 2024-09-19T07:43:57.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6e0be59-8380-49cd-a4af-bd63b01ea789"}]': finished 2024-09-19T07:43:57.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:43:57.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:43:58.367 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:58 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/940907793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:43:58.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:58 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/940907793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:43:58.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:58 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/940907793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:43:59.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:43:59 smithi137 ceph-mon[35309]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:43:59.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:43:59 smithi076 ceph-mon[30930]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:43:59.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:43:59 smithi152 ceph-mon[35117]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:01.650 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:01 smithi137 ceph-mon[35309]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:01.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:01 smithi076 ceph-mon[30930]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:01 smithi152 ceph-mon[35117]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:03.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:03 smithi137 ceph-mon[35309]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:03 smithi076 ceph-mon[30930]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:03 smithi152 ceph-mon[35117]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:05 smithi137 ceph-mon[35309]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:44:05.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:05.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:05 smithi076 ceph-mon[30930]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:44:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:05 smithi152 ceph-mon[35117]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:44:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:06.610 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:06 smithi137 ceph-mon[35309]: Deploying daemon osd.1 on smithi137 2024-09-19T07:44:06.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:06 smithi076 ceph-mon[30930]: Deploying daemon osd.1 on smithi137 2024-09-19T07:44:07.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:06 smithi152 ceph-mon[35117]: Deploying daemon osd.1 on smithi137 2024-09-19T07:44:07.902 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:07 smithi137 ceph-mon[35309]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:07.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:07 smithi076 ceph-mon[30930]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:08.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:07 smithi152 ceph-mon[35117]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:09.813 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:09 smithi137 ceph-mon[35309]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:09 smithi076 ceph-mon[30930]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:09 smithi152 ceph-mon[35117]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:11.863 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:11 smithi152 ceph-mon[35117]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:11.863 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:11 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:11.863 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:11 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:11.863 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:11 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:11 smithi137 ceph-mon[35309]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:11 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:11 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:11 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:11.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:11 smithi076 ceph-mon[30930]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:11.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:11 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:11.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:11 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:11.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:11 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:13 smithi137 ceph-mon[35309]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:13 smithi076 ceph-mon[30930]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:13 smithi152 ceph-mon[35117]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.013+0000 7f40509e1640 1 -- 172.21.15.137:0/2773175078 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f404c10b020 con 0x7f40340a3260 2024-09-19T07:44:15.014 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 1 on host 'smithi137' 2024-09-19T07:44:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f40340a3260 msgr2=0x7f40340a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f40340a3260 0x7f40340a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f404c19b710 tx=0x7f404000b390 comp rx=0 tx=0).stop 2024-09-19T07:44:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 msgr2=0x7f404c19a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 0x7f404c19a1f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f403c00e9c0 tx=0x7f403c00ee80 comp rx=0 tx=0).stop 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 shutdown_connections 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f40340a3260 0x7f40340a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f404c1020a0 0x7f404c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f404c1017a0 0x7f404c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 --2- 172.21.15.137:0/2773175078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c100de0 0x7f404c19a1f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 >> 172.21.15.137:0/2773175078 conn(0x7f404c0fba40 msgr2=0x7f404c109900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 shutdown_connections 2024-09-19T07:44:15.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:44:15.016+0000 7f40519e3640 1 -- 172.21.15.137:0/2773175078 wait complete. 2024-09-19T07:44:15.621 DEBUG:teuthology.orchestra.run.smithi137:osd.1> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T07:44:15.624 INFO:tasks.cephadm:Deploying osd.2 on smithi152 with /dev/vg_nvme/lv_4... 2024-09-19T07:44:15.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:44:15.846 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:15 smithi137 ceph-mon[35309]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:15.846 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:15.847 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:15.847 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:15.877 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:44:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:15 smithi076 ceph-mon[30930]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:15.998 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:15 smithi152 ceph-mon[35117]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:15.998 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:15.998 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:15.998 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:16.534 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:16 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1[39765]: 2024-09-19T07:44:16.276+0000 7f59d68d5640 -1 osd.1 0 log_to_monitors true 2024-09-19T07:44:16.802 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:16 smithi137 ceph-mon[35309]: from='osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:44:16.802 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:16 smithi137 ceph-mon[35309]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:44:16.938 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:16 smithi152 ceph-mon[35117]: from='osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:44:16.938 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:16 smithi152 ceph-mon[35117]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:44:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:16 smithi076 ceph-mon[30930]: from='osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:44:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:16 smithi076 ceph-mon[30930]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:44:17.890 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:17 smithi137 ceph-mon[35309]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:17.890 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:17 smithi137 ceph-mon[35309]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:44:17.890 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:17 smithi137 ceph-mon[35309]: from='osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:44:17.891 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:17 smithi137 ceph-mon[35309]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:44:17.891 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:17 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:17.891 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:17 smithi137 ceph-mon[35309]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:44:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:17 smithi076 ceph-mon[30930]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:17 smithi076 ceph-mon[30930]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:44:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:17 smithi076 ceph-mon[30930]: from='osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:44:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:17 smithi076 ceph-mon[30930]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:44:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:17 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:17 smithi076 ceph-mon[30930]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:44:18.053 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:17 smithi152 ceph-mon[35117]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:18.053 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:17 smithi152 ceph-mon[35117]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:44:18.053 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:17 smithi152 ceph-mon[35117]: from='osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:44:18.053 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:17 smithi152 ceph-mon[35117]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:44:18.053 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:17 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.054 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:17 smithi152 ceph-mon[35117]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:44:18.154 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1[39765]: 2024-09-19T07:44:18.027+0000 7f59d2858640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T07:44:18.154 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1[39765]: 2024-09-19T07:44:18.030+0000 7f59ca678640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:44:18.299 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:44:18.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-09-19T07:44:18.588 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='osd.1 ' entity='osd.1' 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:44:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='osd.1 ' entity='osd.1' 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:44:18.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:18.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.949 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='osd.1 ' entity='osd.1' 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:18.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:19.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 -- 172.21.15.152:0/1205131675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708101cd0 msgr2=0x7fc708102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:19.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 --2- 172.21.15.152:0/1205131675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708101cd0 0x7fc708102150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009900 tx=0x7fc6f002a410 comp rx=0 tx=0).stop 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 -- 172.21.15.152:0/1205131675 shutdown_connections 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 --2- 172.21.15.152:0/1205131675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc708102690 0x7fc708108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 --2- 172.21.15.152:0/1205131675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708101cd0 0x7fc708102150 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 --2- 172.21.15.152:0/1205131675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708100ad0 0x7fc708100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 -- 172.21.15.152:0/1205131675 >> 172.21.15.152:0/1205131675 conn(0x7fc7080fc280 msgr2=0x7fc7080fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 -- 172.21.15.152:0/1205131675 shutdown_connections 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.036+0000 7fc70e422640 1 -- 172.21.15.152:0/1205131675 wait complete. 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 Processor -- start 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 -- start start 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc708100ad0 0x7fc708104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:19.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708101cd0 0x7fc708103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 0x7fc7081036c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc70810c8e0 con 0x7fc708100ad0 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc70810c760 con 0x7fc708101cd0 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70e422640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc70810ca60 con 0x7fc708102690 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 0x7fc7081036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 0x7fc7081036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56188/0 (socket says 172.21.15.152:56188) 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc6fffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708101cd0 0x7fc708103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 -- 172.21.15.152:0/138736957 learned_addr learned my addr 172.21.15.152:0/138736957 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc707fff640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc708100ad0 0x7fc708104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 -- 172.21.15.152:0/138736957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708101cd0 msgr2=0x7fc708103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708101cd0 0x7fc708103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:19.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 -- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc708100ad0 msgr2=0x7fc708104b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc708100ad0 0x7fc708104b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 -- 172.21.15.152:0/138736957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc708103f80 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc6fffff640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708101cd0 0x7fc708103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.037+0000 7fc70c9bf640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 0x7fc7081036c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc700009fd0 tx=0x7fc70000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.038+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700017070 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.038+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc700004020 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.038+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7081a21b0 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.038+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7000106c0 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.038+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7081a2670 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.039+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7081a28a0 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.040+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fc7000041d0 con 0x7fc708102690 2024-09-19T07:44:19.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.041+0000 7fc705ffb640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6f40a31b0 0x7fc6f40a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:19.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.041+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7fc7000cdce0 con 0x7fc708102690 2024-09-19T07:44:19.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.041+0000 7fc707fff640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6f40a31b0 0x7fc6f40a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:19.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.042+0000 7fc707fff640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6f40a31b0 0x7fc6f40a5670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc708101b30 tx=0x7fc6f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:44:19.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.047+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc70009bc00 con 0x7fc708102690 2024-09-19T07:44:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:19.232+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc70806a680 con 0x7fc6f40a31b0 2024-09-19T07:44:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:44:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:44:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi137 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi137 to 17088M 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] boot 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:44:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi137 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi137 to 17088M 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] boot 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:44:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:19.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:44:19.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:44:19.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:19.985 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi137 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi137 to 17088M 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: osd.1 [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] boot 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:44:19.986 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:20 smithi152 ceph-mon[35117]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:44:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:20 smithi152 ceph-mon[35117]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T07:44:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:20 smithi137 ceph-mon[35309]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:44:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:20 smithi137 ceph-mon[35309]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T07:44:20.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:20 smithi076 ceph-mon[30930]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:44:20.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:20 smithi076 ceph-mon[30930]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T07:44:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:21 smithi137 ceph-mon[35309]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:21.906 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:21 smithi152 ceph-mon[35117]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:21.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:21 smithi076 ceph-mon[30930]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:22.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:22 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/138009217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]: dispatch 2024-09-19T07:44:22.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:22 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]: dispatch 2024-09-19T07:44:22.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:22 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]': finished 2024-09-19T07:44:22.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:22 smithi137 ceph-mon[35309]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:44:22.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:22.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:22 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/676703333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:44:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:22 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/138009217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]: dispatch 2024-09-19T07:44:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:22 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]: dispatch 2024-09-19T07:44:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:22 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]': finished 2024-09-19T07:44:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:22 smithi076 ceph-mon[30930]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:44:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:22 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/676703333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:44:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:22 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/138009217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]: dispatch 2024-09-19T07:44:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:22 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]: dispatch 2024-09-19T07:44:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:22 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9a747d3-c188-4867-979e-0bda4e6c30c9"}]': finished 2024-09-19T07:44:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:22 smithi152 ceph-mon[35117]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:44:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:22 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/676703333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:44:23.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:23 smithi137 ceph-mon[35309]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:23.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:23 smithi076 ceph-mon[30930]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:23 smithi152 ceph-mon[35117]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:25.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:25 smithi137 ceph-mon[35309]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:25.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:25 smithi076 ceph-mon[30930]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:26.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:25 smithi152 ceph-mon[35117]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:27.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:27 smithi152 ceph-mon[35117]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:27.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:27 smithi137 ceph-mon[35309]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:27.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:27 smithi076 ceph-mon[30930]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:29.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:29 smithi152 ceph-mon[35117]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:29 smithi137 ceph-mon[35309]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:29.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:29 smithi076 ceph-mon[30930]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:30.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:30 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:44:30.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:30 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:30 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:44:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:30 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:30 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:44:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:30 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:31.773 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:31 smithi152 ceph-mon[35117]: Deploying daemon osd.2 on smithi152 2024-09-19T07:44:31.773 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:31 smithi152 ceph-mon[35117]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:31 smithi137 ceph-mon[35309]: Deploying daemon osd.2 on smithi152 2024-09-19T07:44:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:31 smithi137 ceph-mon[35309]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:31.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:31 smithi076 ceph-mon[30930]: Deploying daemon osd.2 on smithi152 2024-09-19T07:44:31.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:31 smithi076 ceph-mon[30930]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:33.695 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:33 smithi152 ceph-mon[35117]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:33.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:33 smithi137 ceph-mon[35309]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:33 smithi076 ceph-mon[30930]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:35.869 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:35 smithi152 ceph-mon[35117]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:35 smithi137 ceph-mon[35309]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:35.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:35 smithi076 ceph-mon[30930]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:36.899 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:36.899 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:36.900 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:36.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:37.862 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:37 smithi152 ceph-mon[35117]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:37 smithi137 ceph-mon[35309]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:37.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:37 smithi076 ceph-mon[30930]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:39 smithi137 ceph-mon[35309]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:39 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:39 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:39 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:39 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:39.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:39 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:39 smithi076 ceph-mon[30930]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:39 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:39 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:39 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:39 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:39 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.977 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:39 smithi152 ceph-mon[35117]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:39.977 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:39 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.978 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:39 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:39.978 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:39 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:39.978 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:39 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:39.978 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:39 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:40.633 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 2 on host 'smithi152' 2024-09-19T07:44:40.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.632+0000 7fc705ffb640 1 -- 172.21.15.152:0/138736957 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc70806a680 con 0x7fc6f40a31b0 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.634+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6f40a31b0 msgr2=0x7fc6f40a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.634+0000 7fc70e422640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6f40a31b0 0x7fc6f40a5670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc708101b30 tx=0x7fc6f8005f90 comp rx=0 tx=0).stop 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 msgr2=0x7fc7081036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 0x7fc7081036c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc700009fd0 tx=0x7fc70000b260 comp rx=0 tx=0).stop 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 shutdown_connections 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc708102690 0x7fc7081036c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6f40a31b0 0x7fc6f40a5670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc708101cd0 0x7fc708103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 --2- 172.21.15.152:0/138736957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc708100ad0 0x7fc708104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:40.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 >> 172.21.15.152:0/138736957 conn(0x7fc7080fc280 msgr2=0x7fc708069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:44:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 shutdown_connections 2024-09-19T07:44:40.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:44:40.635+0000 7fc70e422640 1 -- 172.21.15.152:0/138736957 wait complete. 2024-09-19T07:44:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:40 smithi137 ceph-mon[35309]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:40 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:40 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:40 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:40.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:40 smithi076 ceph-mon[30930]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:40.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:40 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:40.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:40 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:40.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:40 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:41.013 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:40 smithi152 ceph-mon[35117]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:41.013 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:40 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:44:41.013 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:40 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:41.013 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:40 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:41.355 DEBUG:teuthology.orchestra.run.smithi152:osd.2> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T07:44:41.358 INFO:tasks.cephadm:Deploying osd.3 on smithi076 with /dev/vg_nvme/lv_3... 2024-09-19T07:44:41.358 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:44:41.600 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:44:42.679 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:42 smithi152 ceph-mon[35117]: from='osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:44:42.679 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:42 smithi152 ceph-mon[35117]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:44:42.679 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2[40101]: 2024-09-19T07:44:42.492+0000 7fa80588e640 -1 osd.2 0 log_to_monitors true 2024-09-19T07:44:42.813 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:42 smithi076 ceph-mon[30930]: from='osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:44:42.813 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:42 smithi076 ceph-mon[30930]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:44:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:42 smithi137 ceph-mon[35309]: from='osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:44:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:42 smithi137 ceph-mon[35309]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:44:43.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:43.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:44:43.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: from='osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:44:43.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:44:43.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:43.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:44:43.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:44:43.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T07:44:43.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:43.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:43.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:44:43.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: from='osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:44:43.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:44:43.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:43.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:44:43.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:44:43.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T07:44:43.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:44:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: from='osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:44:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:44:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:44:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:44:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T07:44:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:44.143 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2[40101]: 2024-09-19T07:44:43.980+0000 7fa801811640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T07:44:44.143 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2[40101]: 2024-09-19T07:44:43.984+0000 7fa7f9631640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:44:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:44:44.214 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_3 2024-09-19T07:44:44.456 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='osd.2 ' entity='osd.2' 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:44.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.824 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='osd.2 ' entity='osd.2' 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:44.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='osd.2 ' entity='osd.2' 2024-09-19T07:44:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:44:44.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:44.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:44:44.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:44.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/1580685099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc0101d10 msgr2=0x7f9fc0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/1580685099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc0101d10 0x7f9fc0102190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009900 tx=0x7f9fb402a410 comp rx=0 tx=0).stop 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/1580685099 shutdown_connections 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/1580685099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fc01026d0 0x7f9fc0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/1580685099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc0101d10 0x7f9fc0102190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/1580685099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc0100b10 0x7f9fc0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/1580685099 >> 172.21.15.76:0/1580685099 conn(0x7f9fc00fc2a0 msgr2=0x7f9fc00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/1580685099 shutdown_connections 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.907+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/1580685099 wait complete. 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 Processor -- start 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 -- start start 2024-09-19T07:44:44.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc0100b10 0x7f9fc0196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fc0101d10 0x7f9fc0197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 0x7f9fc019e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc010c8d0 con 0x7f9fc01026d0 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc010c750 con 0x7f9fc0100b10 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fc5bd5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc010ca50 con 0x7f9fc0101d10 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fbffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 0x7f9fc019e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fbffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 0x7f9fc019e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47636/0 (socket says 172.21.15.76:47636) 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fbffff640 1 -- 172.21.15.76:0/2115595796 learned_addr learned my addr 172.21.15.76:0/2115595796 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fbf7fe640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc0100b10 0x7f9fc0196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fbeffd640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fc0101d10 0x7f9fc0197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:44.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.908+0000 7f9fbffff640 1 -- 172.21.15.76:0/2115595796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fc0101d10 msgr2=0x7f9fc0197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbffff640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fc0101d10 0x7f9fc0197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbffff640 1 -- 172.21.15.76:0/2115595796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc0100b10 msgr2=0x7f9fc0196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbffff640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc0100b10 0x7f9fc0196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbffff640 1 -- 172.21.15.76:0/2115595796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc019ea40 con 0x7f9fc01026d0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbffff640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 0x7f9fc019e3d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800eaa0 tx=0x7f9fb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb800cdb0 con 0x7f9fc01026d0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fb8004b20 con 0x7f9fc01026d0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc019ed30 con 0x7f9fc01026d0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8011760 con 0x7f9fc01026d0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.909+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc019f1e0 con 0x7f9fc01026d0 2024-09-19T07:44:44.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.910+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc0107de0 con 0x7f9fc01026d0 2024-09-19T07:44:44.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.911+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f9fb8004cd0 con 0x7f9fc01026d0 2024-09-19T07:44:44.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.912+0000 7f9fbcff9640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9fa80a31e0 0x7f9fa80a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:44:44.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.912+0000 7f9fbf7fe640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9fa80a31e0 0x7f9fa80a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:44:44.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.912+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f9fb80ce300 con 0x7f9fc01026d0 2024-09-19T07:44:44.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.912+0000 7f9fbf7fe640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9fa80a31e0 0x7f9fa80a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0101b70 tx=0x7f9fb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:44:44.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:44.916+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fb8016030 con 0x7f9fc01026d0 2024-09-19T07:44:45.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:45.094+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9fc0062630 con 0x7f9fa80a31e0 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi152 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] boot 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:44:45.754 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:45.755 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:44:45.755 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:44:45.755 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:45 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:44:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:44:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi152 2024-09-19T07:44:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-19T07:44:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:45.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] boot 2024-09-19T07:44:45.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:44:45.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:45.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:44:45.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:44:45.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:45 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:44:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:44:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi152 2024-09-19T07:44:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: osd.2 [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] boot 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:44:45.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:45 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:46 smithi152 ceph-mon[35117]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:44:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:46 smithi152 ceph-mon[35117]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T07:44:47.150 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:46 smithi076 ceph-mon[30930]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:44:47.150 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:46 smithi076 ceph-mon[30930]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T07:44:47.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:46 smithi137 ceph-mon[35309]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:44:47.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:46 smithi137 ceph-mon[35309]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T07:44:48.053 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:47 smithi076 sudo[49950]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:44:48.053 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:47 smithi076 sudo[49950]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:48.053 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:47 smithi076 sudo[49950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:48.053 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:47 smithi076 sudo[49950]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:48.053 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: pgmap v76: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:48.053 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:44:48.053 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3842043546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6ebdf0e-f8b8-473b-919a-2f129822ad89"}]: dispatch 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3842043546' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6ebdf0e-f8b8-473b-919a-2f129822ad89"}]': finished 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:44:48.054 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: pgmap v76: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3842043546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6ebdf0e-f8b8-473b-919a-2f129822ad89"}]: dispatch 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:44:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3842043546' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6ebdf0e-f8b8-473b-919a-2f129822ad89"}]': finished 2024-09-19T07:44:48.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:44:48.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:44:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: pgmap v76: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:44:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:44:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T07:44:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:44:48.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3842043546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6ebdf0e-f8b8-473b-919a-2f129822ad89"}]: dispatch 2024-09-19T07:44:48.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:44:48.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3842043546' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6ebdf0e-f8b8-473b-919a-2f129822ad89"}]': finished 2024-09-19T07:44:48.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:44:48.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:44:48.444 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:48 smithi076 sudo[49956]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:44:48.444 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:48 smithi076 sudo[49956]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:48.444 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:48 smithi076 sudo[49956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:48.444 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 07:44:48 smithi076 sudo[49956]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:48.615 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43895]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:44:48.615 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43895]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:48.615 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:48.615 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43895]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:48 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2629247187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:44:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:48 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:48 smithi137 ceph-mon[35309]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:44:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:48 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:44:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:48 smithi137 ceph-mon[35309]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:48 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:48.905 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43898]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:44:48.905 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43898]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:48.905 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:48.905 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 07:44:48 smithi137 sudo[43898]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:49.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:48 smithi152 sudo[44034]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:44:49.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:48 smithi152 sudo[44034]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:49.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:48 smithi152 sudo[44034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:49.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:48 smithi152 sudo[44034]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:48 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2629247187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:44:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:48 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:48 smithi152 ceph-mon[35117]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:44:49.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:48 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:44:49.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:48 smithi152 ceph-mon[35117]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:49.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:48 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:49.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:48 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2629247187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:44:49.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:48 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:49.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:48 smithi076 ceph-mon[30930]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:44:49.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:48 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:44:49.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:48 smithi076 ceph-mon[30930]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:49.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:48 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:49.561 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44037]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:44:49.561 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44037]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:49.561 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:49.561 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44037]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:49.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50188]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:44:49.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50188]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:49.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:49.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50188]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:49.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:44:49.693+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9fb8098790 con 0x7f9fc01026d0 2024-09-19T07:44:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50374]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:44:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:49 smithi076 sudo[50374]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:50.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44040]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:44:50.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44040]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:50.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:50.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:49 smithi152 sudo[44040]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:50.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:50.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:50.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:50.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:50 smithi076 ceph-mon[30930]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 sudo[44043]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 sudo[44043]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 sudo[44043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 sudo[44043]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:50.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:50.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:50.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:50.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:50.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:50 smithi152 ceph-mon[35117]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:44:50.676 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43901]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:44:50.676 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43901]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:50.676 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:50.676 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43901]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43904]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:44:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43904]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:44:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:44:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 sudo[43904]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:44:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:51.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:50 smithi137 ceph-mon[35309]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:51.539 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:51 smithi137 ceph-mon[35309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:51.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:51 smithi152 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:51.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:51.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:51 smithi076 ceph-mon[30930]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:44:53.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:53 smithi152 ceph-mon[35117]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:53.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:53 smithi137 ceph-mon[35309]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:53.915 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:53 smithi076 ceph-mon[30930]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:55.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:55 smithi076 ceph-mon[30930]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:55.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:55 smithi137 ceph-mon[35309]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:55 smithi152 ceph-mon[35117]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:44:56.800 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:44:56.800 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:56.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:44:56.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:57.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:44:57.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:44:57.806 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:57 smithi076 ceph-mon[30930]: Deploying daemon osd.3 on smithi076 2024-09-19T07:44:57.806 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:57 smithi076 ceph-mon[30930]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T07:44:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:57 smithi137 ceph-mon[35309]: Deploying daemon osd.3 on smithi076 2024-09-19T07:44:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:57 smithi137 ceph-mon[35309]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T07:44:58.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:57 smithi152 ceph-mon[35117]: Deploying daemon osd.3 on smithi076 2024-09-19T07:44:58.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:57 smithi152 ceph-mon[35117]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T07:44:59.720 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:44:59 smithi076 ceph-mon[30930]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T07:44:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:44:59 smithi137 ceph-mon[35309]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T07:45:00.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:44:59 smithi152 ceph-mon[35117]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T07:45:01.766 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:01 smithi076 ceph-mon[30930]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T07:45:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:01 smithi137 ceph-mon[35309]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T07:45:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:01 smithi152 ceph-mon[35117]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T07:45:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:02.838 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:03.841 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:03 smithi076 ceph-mon[30930]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:03 smithi137 ceph-mon[35309]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:03 smithi152 ceph-mon[35117]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:05 smithi137 ceph-mon[35309]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:05.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:05 smithi076 ceph-mon[30930]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:05 smithi152 ceph-mon[35117]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.369+0000 7f9fbcff9640 1 -- 172.21.15.76:0/2115595796 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9fc0062630 con 0x7f9fa80a31e0 2024-09-19T07:45:06.370 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 3 on host 'smithi076' 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9fa80a31e0 msgr2=0x7f9fa80a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9fa80a31e0 0x7f9fa80a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0101b70 tx=0x7f9fb0005f90 comp rx=0 tx=0).stop 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 msgr2=0x7f9fc019e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 0x7f9fc019e3d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800eaa0 tx=0x7f9fb800ef60 comp rx=0 tx=0).stop 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 shutdown_connections 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9fc01026d0 0x7f9fc019e3d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fc0101d10 0x7f9fc0197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:06.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9fa80a31e0 0x7f9fa80a56a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:06.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 --2- 172.21.15.76:0/2115595796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc0100b10 0x7f9fc0196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:06.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 >> 172.21.15.76:0/2115595796 conn(0x7f9fc00fc2a0 msgr2=0x7f9fc0104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:45:06.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 shutdown_connections 2024-09-19T07:45:06.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:45:06.372+0000 7f9fc5bd5640 1 -- 172.21.15.76:0/2115595796 wait complete. 2024-09-19T07:45:06.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:06 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:06.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:06 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:06 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.939 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:06 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:06.939 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:06 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.939 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:06 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:06.966 DEBUG:teuthology.orchestra.run.smithi076:osd.3> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T07:45:06.968 INFO:tasks.cephadm:Deploying osd.4 on smithi137 with /dev/vg_nvme/lv_3... 2024-09-19T07:45:06.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:45:07.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:06 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:07.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:06 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:07.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:06 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:07.222 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:45:07.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:07 smithi137 ceph-mon[35309]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:07.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:07 smithi076 ceph-mon[30930]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:08.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:07 smithi152 ceph-mon[35117]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:45:08.510 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 07:45:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T07:45:08.198+0000 7f1ab848f640 -1 osd.3 0 log_to_monitors true 2024-09-19T07:45:08.722 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:08 smithi137 ceph-mon[35309]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:45:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:08 smithi076 ceph-mon[30930]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:45:09.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:08 smithi152 ceph-mon[35117]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:45:09.837 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:09 smithi137 ceph-mon[35309]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:45:09.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:09 smithi137 ceph-mon[35309]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:45:09.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:09 smithi137 ceph-mon[35309]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T07:45:09.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:09 smithi137 ceph-mon[35309]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:45:09.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:09.840 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:45:09.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_3 2024-09-19T07:45:09.874 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-mon[30930]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:45:09.874 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-mon[30930]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:45:09.874 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-mon[30930]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T07:45:09.874 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-mon[30930]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:45:09.874 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:09 smithi152 ceph-mon[35117]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:45:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:09 smithi152 ceph-mon[35117]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:45:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:09 smithi152 ceph-mon[35117]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T07:45:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:09 smithi152 ceph-mon[35117]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:45:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.118 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:45:10.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T07:45:09.990+0000 7f1ab4412640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T07:45:10.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 07:45:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T07:45:09.994+0000 7f1aac232640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:45:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 -- 172.21.15.137:0/4186004093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf981026d0 msgr2=0x7fbf98108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 --2- 172.21.15.137:0/4186004093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf981026d0 0x7fbf98108f60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009ca0 tx=0x7fbf9002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 -- 172.21.15.137:0/4186004093 shutdown_connections 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 --2- 172.21.15.137:0/4186004093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf981026d0 0x7fbf98108f60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 --2- 172.21.15.137:0/4186004093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98101d10 0x7fbf98102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 --2- 172.21.15.137:0/4186004093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf98100b10 0x7fbf98100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 -- 172.21.15.137:0/4186004093 >> 172.21.15.137:0/4186004093 conn(0x7fbf980fc2a0 msgr2=0x7fbf980fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 -- 172.21.15.137:0/4186004093 shutdown_connections 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.626+0000 7fbf9f526640 1 -- 172.21.15.137:0/4186004093 wait complete. 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 Processor -- start 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 -- start start 2024-09-19T07:45:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98100b10 0x7fbf9806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 0x7fbf9819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf981026d0 0x7fbf9819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810c8d0 con 0x7fbf981026d0 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810c750 con 0x7fbf98101d10 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9f526640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9810ca50 con 0x7fbf98100b10 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 0x7fbf9819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 0x7fbf9819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40076/0 (socket says 172.21.15.137:40076) 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 -- 172.21.15.137:0/2912310503 learned_addr learned my addr 172.21.15.137:0/2912310503 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9d2c2640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98100b10 0x7fbf9806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9dac3640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf981026d0 0x7fbf9819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 -- 172.21.15.137:0/2912310503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98100b10 msgr2=0x7fbf9806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:10.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98100b10 0x7fbf9806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 -- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf981026d0 msgr2=0x7fbf9819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf981026d0 0x7fbf9819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.627+0000 7fbf9cac1640 1 -- 172.21.15.137:0/2912310503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9819fc20 con 0x7fbf98101d10 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.628+0000 7fbf9cac1640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 0x7fbf9819ccf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400d770 tx=0x7fbf9400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.628+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94017070 con 0x7fbf98101d10 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.628+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf94005520 con 0x7fbf98101d10 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.628+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9819feb0 con 0x7fbf98101d10 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.628+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94010460 con 0x7fbf98101d10 2024-09-19T07:45:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.628+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a0310 con 0x7fbf98101d10 2024-09-19T07:45:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.629+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf98107e40 con 0x7fbf98101d10 2024-09-19T07:45:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.631+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbf94004ea0 con 0x7fbf98101d10 2024-09-19T07:45:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.631+0000 7fbf8e7fc640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf840a3240 0x7fbf840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.632+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7fbf940ce520 con 0x7fbf98101d10 2024-09-19T07:45:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.632+0000 7fbf9d2c2640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf840a3240 0x7fbf840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.632+0000 7fbf9d2c2640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf840a3240 0x7fbf840a5700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005fd0 tx=0x7fbf8800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:45:10.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.635+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf9409c440 con 0x7fbf98101d10 2024-09-19T07:45:10.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:10.809+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbf98062630 con 0x7fbf840a3240 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.810 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] boot 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:45:10.811 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] boot 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:45:10.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625]' entity='osd.3' 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: osd.3 [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] boot 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:45:11.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:45:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:45:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:45:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi076 2024-09-19T07:45:11.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi076 to 8544M 2024-09-19T07:45:11.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:45:11.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:45:11.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:45:11.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:11 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi076 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi076 to 8544M 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:45:11.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:11 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:11.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:45:11.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:45:11.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi076 2024-09-19T07:45:11.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi076 to 8544M 2024-09-19T07:45:11.963 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:45:11.963 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:45:11.963 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:45:11.963 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:11 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:12.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:12 smithi137 ceph-mon[35309]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:45:12.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:12 smithi137 ceph-mon[35309]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T07:45:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:12 smithi076 ceph-mon[30930]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:45:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:12 smithi076 ceph-mon[30930]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T07:45:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:12 smithi152 ceph-mon[35117]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:45:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:12 smithi152 ceph-mon[35117]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T07:45:13.818 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:13.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T07:45:13.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/2705394216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]: dispatch 2024-09-19T07:45:13.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]: dispatch 2024-09-19T07:45:13.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]': finished 2024-09-19T07:45:13.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:45:13.819 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/2705394216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]: dispatch 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]: dispatch 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]': finished 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:45:13.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/2705394216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]: dispatch 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]: dispatch 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3915b62-fdff-42fc-a586-f5ec5d2aba91"}]': finished 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:45:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:14.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:14 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/1816796084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:45:14.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:14 smithi137 ceph-mon[35309]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:45:14.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:14 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:14 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/1816796084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:45:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:14 smithi076 ceph-mon[30930]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:45:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:14 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:14 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/1816796084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:45:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:14 smithi152 ceph-mon[35117]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:45:15.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:14 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:15.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:15 smithi137 ceph-mon[35309]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:15.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:15 smithi137 ceph-mon[35309]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T07:45:15.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:15 smithi076 ceph-mon[30930]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:15 smithi076 ceph-mon[30930]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T07:45:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:15 smithi152 ceph-mon[35117]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:15 smithi152 ceph-mon[35117]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T07:45:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:17.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:17 smithi137 ceph-mon[35309]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:45:17.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:17 smithi076 ceph-mon[30930]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:45:18.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:17 smithi152 ceph-mon[35117]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:45:19.878 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:19 smithi137 ceph-mon[35309]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:45:19.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:19 smithi076 ceph-mon[30930]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:45:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:19 smithi152 ceph-mon[35117]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:45:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:21 smithi137 ceph-mon[35309]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T07:45:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:45:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:21.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:21 smithi076 ceph-mon[30930]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T07:45:21.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:45:21.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:21 smithi152 ceph-mon[35117]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T07:45:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:45:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:22.892 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:22 smithi137 ceph-mon[35309]: Deploying daemon osd.4 on smithi137 2024-09-19T07:45:22.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:22 smithi076 ceph-mon[30930]: Deploying daemon osd.4 on smithi137 2024-09-19T07:45:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:22 smithi152 ceph-mon[35117]: Deploying daemon osd.4 on smithi137 2024-09-19T07:45:23.781 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:23 smithi137 ceph-mon[35309]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T07:45:23.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:23 smithi076 ceph-mon[30930]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T07:45:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:23 smithi152 ceph-mon[35117]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T07:45:25.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:25 smithi137 ceph-mon[35309]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:45:25.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:25 smithi076 ceph-mon[30930]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:45:26.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:25 smithi152 ceph-mon[35117]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:45:27.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:27 smithi137 ceph-mon[35309]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:27.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:27 smithi076 ceph-mon[30930]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:28.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:27 smithi152 ceph-mon[35117]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:28.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:28 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:28.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:28 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:28.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:28 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:28.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:28 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:28.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:28 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:28.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:28 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:28 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:28 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:28 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:29.893 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:29 smithi137 ceph-mon[35309]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:29.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:29 smithi076 ceph-mon[30930]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:29 smithi152 ceph-mon[35117]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:31.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.656+0000 7fbf8e7fc640 1 -- 172.21.15.137:0/2912310503 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf98062630 con 0x7fbf840a3240 2024-09-19T07:45:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 4 on host 'smithi137' 2024-09-19T07:45:31.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.658+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf840a3240 msgr2=0x7fbf840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:31.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.658+0000 7fbf9f526640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf840a3240 0x7fbf840a5700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005fd0 tx=0x7fbf8800b410 comp rx=0 tx=0).stop 2024-09-19T07:45:31.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.658+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 msgr2=0x7fbf9819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.658+0000 7fbf9f526640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 0x7fbf9819ccf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400d770 tx=0x7fbf9400dc30 comp rx=0 tx=0).stop 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 shutdown_connections 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbf981026d0 0x7fbf9819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbf840a3240 0x7fbf840a5700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf98101d10 0x7fbf9819ccf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 --2- 172.21.15.137:0/2912310503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98100b10 0x7fbf9806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 >> 172.21.15.137:0/2912310503 conn(0x7fbf980fc2a0 msgr2=0x7fbf98105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 shutdown_connections 2024-09-19T07:45:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:45:31.659+0000 7fbf9f526640 1 -- 172.21.15.137:0/2912310503 wait complete. 2024-09-19T07:45:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:31.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:31.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:31.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:31.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:31.908 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:31.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:31.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:31.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:31.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:31.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:31.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:31.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:32.284 DEBUG:teuthology.orchestra.run.smithi137:osd.4> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T07:45:32.287 INFO:tasks.cephadm:Deploying osd.5 on smithi152 with /dev/vg_nvme/lv_3... 2024-09-19T07:45:32.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:45:32.542 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:45:32.835 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.835 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.835 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:32 smithi137 ceph-mon[35309]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:32 smithi076 ceph-mon[30930]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:32.951 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.951 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:32.951 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:32 smithi152 ceph-mon[35117]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:34.125 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 07:45:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T07:45:34.069+0000 7fcf8980a640 -1 osd.4 0 log_to_monitors true 2024-09-19T07:45:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:34 smithi137 ceph-mon[35309]: from='osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:45:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:34 smithi137 ceph-mon[35309]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:45:34.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:34 smithi076 ceph-mon[30930]: from='osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:45:34.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:34 smithi076 ceph-mon[30930]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:45:34.478 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:34 smithi152 ceph-mon[35117]: from='osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:45:34.478 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:34 smithi152 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:45:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-mon[35309]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:45:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-mon[35309]: from='osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:45:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-mon[35309]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T07:45:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-mon[35309]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:45:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-mon[35309]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:35.217 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:45:35.242 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-09-19T07:45:35.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:35 smithi076 ceph-mon[30930]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:45:35.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:35 smithi076 ceph-mon[30930]: from='osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:45:35.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:35 smithi076 ceph-mon[30930]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T07:45:35.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:35.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:35 smithi076 ceph-mon[30930]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:45:35.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:35 smithi076 ceph-mon[30930]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:35.501 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:45:35.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:35 smithi152 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:45:35.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:35 smithi152 ceph-mon[35117]: from='osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:45:35.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:35 smithi152 ceph-mon[35117]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T07:45:35.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:35.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:35 smithi152 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:45:35.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:35 smithi152 ceph-mon[35117]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:35.904 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T07:45:35.523+0000 7fcf8578d640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T07:45:35.904 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 07:45:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T07:45:35.529+0000 7fcf7d5ad640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:45:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 -- 172.21.15.152:0/3261855234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 msgr2=0x7f355c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 --2- 172.21.15.152:0/3261855234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c100f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3550009900 tx=0x7f355002a410 comp rx=0 tx=0).stop 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 -- 172.21.15.152:0/3261855234 shutdown_connections 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 --2- 172.21.15.152:0/3261855234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355c1026d0 0x7f355c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 --2- 172.21.15.152:0/3261855234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 0x7f355c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 --2- 172.21.15.152:0/3261855234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c100f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 -- 172.21.15.152:0/3261855234 >> 172.21.15.152:0/3261855234 conn(0x7f355c0fc2a0 msgr2=0x7f355c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 -- 172.21.15.152:0/3261855234 shutdown_connections 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 -- 172.21.15.152:0/3261855234 wait complete. 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 Processor -- start 2024-09-19T07:45:36.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.992+0000 7f356358d640 1 -- start start 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 0x7f355c1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355c1026d0 0x7f355c19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f355c10c8d0 con 0x7f355c1026d0 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f355c10c750 con 0x7f355c101d10 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f355c10ca50 con 0x7f355c100b10 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57086/0 (socket says 172.21.15.152:57086) 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 -- 172.21.15.152:0/3711854532 learned_addr learned my addr 172.21.15.152:0/3711854532 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3560b28640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 0x7f355c1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 -- 172.21.15.152:0/3711854532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 msgr2=0x7f355c1973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:36.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 0x7f355c1973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 -- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355c1026d0 msgr2=0x7f355c19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355c1026d0 0x7f355c19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 -- 172.21.15.152:0/3711854532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c06a890 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3560b28640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 0x7f355c1973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f3561329640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c196ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3550009230 tx=0x7f3550004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355003f030 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3550003d00 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550035070 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355c06ab20 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.993+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355c06b050 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.995+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355c107e40 con 0x7f355c100b10 2024-09-19T07:45:36.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.996+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3550042030 con 0x7f355c100b10 2024-09-19T07:45:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.996+0000 7f354e7fc640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35480a32f0 0x7f35480a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:45:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.996+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3821+0+0 (secure 0 0 0) 0x7f35500ef2b0 con 0x7f355c100b10 2024-09-19T07:45:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.997+0000 7f3560b28640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35480a32f0 0x7f35480a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:45:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:35.997+0000 7f3560b28640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35480a32f0 0x7f35480a57b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3558005fd0 tx=0x7f3558005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:45:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:36.000+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35500bd160 con 0x7f355c100b10 2024-09-19T07:45:36.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:36.177+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f355c06b320 con 0x7f35480a32f0 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi137 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:36.178 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi137 to 8544M 2024-09-19T07:45:36.179 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.179 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:36.179 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:36.179 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.179 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:36 smithi152 ceph-mon[35117]: from='osd.4 ' entity='osd.4' 2024-09-19T07:45:36.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:45:36.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi137 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi137 to 8544M 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.406 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:36 smithi137 ceph-mon[35309]: from='osd.4 ' entity='osd.4' 2024-09-19T07:45:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:45:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T07:45:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi137 2024-09-19T07:45:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi137 to 8544M 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:36.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:36 smithi076 ceph-mon[30930]: from='osd.4 ' entity='osd.4' 2024-09-19T07:45:37.232 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:45:37.232 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:45:37.232 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:37.232 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:45:37.232 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:45:37.233 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:45:37.233 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:37.233 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] boot 2024-09-19T07:45:37.233 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T07:45:37.233 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:37.233 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:37 smithi152 ceph-mon[35117]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:45:37.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:37.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] boot 2024-09-19T07:45:37.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T07:45:37.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:37.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:37 smithi137 ceph-mon[35309]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: osd.4 [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] boot 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T07:45:37.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:45:37.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:37 smithi076 ceph-mon[30930]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:45:38.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:38 smithi152 ceph-mon[35117]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T07:45:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:38 smithi137 ceph-mon[35309]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T07:45:38.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:38 smithi076 ceph-mon[30930]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/529829681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]: dispatch 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]: dispatch 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]': finished 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:45:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:39 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/3428529959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/529829681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]: dispatch 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]: dispatch 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]': finished 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:45:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:39 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/3428529959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/529829681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]: dispatch 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]: dispatch 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd332d73-a236-4f57-81a1-c971286b9034"}]': finished 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:45:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:39 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/3428529959' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:45:41.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:41 smithi076 ceph-mon[30930]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:41.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:41 smithi152 ceph-mon[35117]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:41.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:41 smithi137 ceph-mon[35309]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:43.755 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:43 smithi152 ceph-mon[35117]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:43 smithi137 ceph-mon[35309]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:43 smithi076 ceph-mon[30930]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:45.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:45 smithi152 ceph-mon[35117]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:45 smithi137 ceph-mon[35309]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:45.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:45 smithi076 ceph-mon[30930]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:47.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:47 smithi152 ceph-mon[35117]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:47.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:45:47.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:47.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:47 smithi137 ceph-mon[35309]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:47.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:45:47.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:47.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:47 smithi076 ceph-mon[30930]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:45:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:48.824 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:48 smithi152 ceph-mon[35117]: Deploying daemon osd.5 on smithi152 2024-09-19T07:45:48.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:48 smithi137 ceph-mon[35309]: Deploying daemon osd.5 on smithi152 2024-09-19T07:45:48.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:48 smithi076 ceph-mon[30930]: Deploying daemon osd.5 on smithi152 2024-09-19T07:45:49.889 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:49 smithi152 ceph-mon[35117]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:49 smithi137 ceph-mon[35309]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:49 smithi076 ceph-mon[30930]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:51.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:51 smithi137 ceph-mon[35309]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:51.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:51 smithi076 ceph-mon[30930]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:52.030 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:51 smithi152 ceph-mon[35117]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:53.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:53 smithi152 ceph-mon[35117]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:53.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:53 smithi137 ceph-mon[35309]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:53.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:53 smithi076 ceph-mon[30930]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:54.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:54.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:54.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:54.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:54.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:54.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:54.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:54.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:54.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:55.741 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:55 smithi152 ceph-mon[35117]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:55.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:55 smithi137 ceph-mon[35309]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:55 smithi076 ceph-mon[30930]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:57.447 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 5 on host 'smithi152' 2024-09-19T07:45:57.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.447+0000 7f354e7fc640 1 -- 172.21.15.152:0/3711854532 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f355c06b320 con 0x7f35480a32f0 2024-09-19T07:45:57.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35480a32f0 msgr2=0x7f35480a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:57.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35480a32f0 0x7f35480a57b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3558005fd0 tx=0x7f3558005ea0 comp rx=0 tx=0).stop 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 msgr2=0x7f355c196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c196ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3550009230 tx=0x7f3550004430 comp rx=0 tx=0).stop 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 shutdown_connections 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f355c1026d0 0x7f355c19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35480a32f0 0x7f35480a57b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f355c101d10 0x7f355c1973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 --2- 172.21.15.152:0/3711854532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f355c100b10 0x7f355c196ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 >> 172.21.15.152:0/3711854532 conn(0x7f355c0fc2a0 msgr2=0x7f355c105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.449+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 shutdown_connections 2024-09-19T07:45:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:45:57.450+0000 7f356358d640 1 -- 172.21.15.152:0/3711854532 wait complete. 2024-09-19T07:45:57.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:57.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:57.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:57.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:57.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:57 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:57.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:57.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:57 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:45:57.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:57.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:57 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:45:58.154 DEBUG:teuthology.orchestra.run.smithi152:osd.5> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T07:45:58.156 INFO:tasks.cephadm:Deploying osd.6 on smithi076 with /dev/vg_nvme/lv_2... 2024-09-19T07:45:58.157 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:45:58.409 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:45:59.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:45:59 smithi076 ceph-mon[30930]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:45:59 smithi137 ceph-mon[35309]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:59.904 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:45:59 smithi152 ceph-mon[35117]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:45:59.904 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 07:45:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T07:45:59.667+0000 7fb9eb49f640 -1 osd.5 0 log_to_monitors true 2024-09-19T07:46:00.733 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:00 smithi152 ceph-mon[35117]: from='osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:46:00.733 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:00 smithi152 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:46:00.782 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:00 smithi076 ceph-mon[30930]: from='osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:46:00.783 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:00 smithi076 ceph-mon[30930]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:46:00.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:00 smithi137 ceph-mon[35309]: from='osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:46:00.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:00 smithi137 ceph-mon[35309]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:46:01.087 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:46:01.114 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_2 2024-09-19T07:46:01.374 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:46:01.747 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:46:01.747 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:46:01.747 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:46:01.747 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:01.748 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3137392798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf481026c0 msgr2=0x7fcf48108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3137392798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf481026c0 0x7fcf48108f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009ca0 tx=0x7fcf4002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3137392798 shutdown_connections 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3137392798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf481026c0 0x7fcf48108f50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3137392798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf48101d00 0x7fcf48102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3137392798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf48100b00 0x7fcf48100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3137392798 >> 172.21.15.76:0/3137392798 conn(0x7fcf480fc290 msgr2=0x7fcf480fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3137392798 shutdown_connections 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.832+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3137392798 wait complete. 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 Processor -- start 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 -- start start 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 0x7fcf4806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf48101d00 0x7fcf4819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:01.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf481026c0 0x7fcf4819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810c9c0 con 0x7fcf48100b00 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810c840 con 0x7fcf481026c0 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf4dd78640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810cb40 con 0x7fcf48101d00 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 0x7fcf4806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 0x7fcf4806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50506/0 (socket says 172.21.15.76:50506) 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 -- 172.21.15.76:0/3598725854 learned_addr learned my addr 172.21.15.76:0/3598725854 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf46ffd640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf48101d00 0x7fcf4819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf47fff640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf481026c0 0x7fcf4819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 -- 172.21.15.76:0/3598725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf48101d00 msgr2=0x7fcf4819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf48101d00 0x7fcf4819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 -- 172.21.15.76:0/3598725854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf481026c0 msgr2=0x7fcf4819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:01.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf481026c0 0x7fcf4819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf477fe640 1 -- 172.21.15.76:0/3598725854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4819fda0 con 0x7fcf48100b00 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.833+0000 7fcf47fff640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf481026c0 0x7fcf4819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.834+0000 7fcf477fe640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 0x7fcf4806b2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800b450 tx=0x7fcf3800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.834+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38015020 con 0x7fcf48100b00 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.834+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcf38011d90 con 0x7fcf48100b00 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.834+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4819ffd0 con 0x7fcf48100b00 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.834+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800f340 con 0x7fcf48100b00 2024-09-19T07:46:01.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.834+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a0510 con 0x7fcf48100b00 2024-09-19T07:46:01.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.835+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf48107ef0 con 0x7fcf48100b00 2024-09-19T07:46:01.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.836+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcf38018020 con 0x7fcf48100b00 2024-09-19T07:46:01.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.837+0000 7fcf44ff9640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcf300a3240 0x7fcf300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:01.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.837+0000 7fcf46ffd640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcf300a3240 0x7fcf300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:01.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.837+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4566+0+0 (secure 0 0 0) 0x7fcf380ce9d0 con 0x7fcf48100b00 2024-09-19T07:46:01.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.837+0000 7fcf46ffd640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcf300a3240 0x7fcf300a5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf4806b870 tx=0x7fcf3c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:46:01.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:01.840+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf3801f020 con 0x7fcf48100b00 2024-09-19T07:46:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:46:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:46:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:46:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:02.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:02.013+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcf48062630 con 0x7fcf300a3240 2024-09-19T07:46:02.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T07:46:01.618+0000 7fb9e7422640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T07:46:02.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T07:46:01.625+0000 7fb9e324a640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:46:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:46:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:46:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:46:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T07:46:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:02.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:02.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi152 2024-09-19T07:46:02.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-19T07:46:02.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:46:02.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T07:46:02.676 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] boot 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:02.677 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi152 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] boot 2024-09-19T07:46:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T07:46:02.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:02.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:02.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:02.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi152 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: osd.5 [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] boot 2024-09-19T07:46:03.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T07:46:03.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:46:03.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:03.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:03.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:03.750 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:03 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:46:03.750 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:03 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:46:03.750 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:03 smithi076 ceph-mon[30930]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:03.750 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:03 smithi076 ceph-mon[30930]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:46:03.750 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:03 smithi076 ceph-mon[30930]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T07:46:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:03 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:46:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:03 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:46:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:03 smithi137 ceph-mon[35309]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:03 smithi137 ceph-mon[35309]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:46:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:03 smithi137 ceph-mon[35309]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T07:46:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:03 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:46:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:03 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:46:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:03 smithi152 ceph-mon[35117]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:03 smithi152 ceph-mon[35117]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:46:04.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:03 smithi152 ceph-mon[35117]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T07:46:05.025 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:04 smithi076 ceph-mon[30930]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T07:46:05.026 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:04 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3432596148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a799bfc9-78c1-4d99-b9f5-4a80371e957e"}]: dispatch 2024-09-19T07:46:05.026 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:04 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3432596148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a799bfc9-78c1-4d99-b9f5-4a80371e957e"}]': finished 2024-09-19T07:46:05.026 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:04 smithi076 ceph-mon[30930]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T07:46:05.026 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:05.026 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:04 smithi076 ceph-mon[30930]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:04 smithi137 ceph-mon[35309]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T07:46:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:04 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3432596148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a799bfc9-78c1-4d99-b9f5-4a80371e957e"}]: dispatch 2024-09-19T07:46:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:04 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3432596148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a799bfc9-78c1-4d99-b9f5-4a80371e957e"}]': finished 2024-09-19T07:46:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:04 smithi137 ceph-mon[35309]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T07:46:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:04 smithi137 ceph-mon[35309]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:04 smithi152 ceph-mon[35117]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T07:46:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3432596148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a799bfc9-78c1-4d99-b9f5-4a80371e957e"}]: dispatch 2024-09-19T07:46:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3432596148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a799bfc9-78c1-4d99-b9f5-4a80371e957e"}]': finished 2024-09-19T07:46:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:04 smithi152 ceph-mon[35117]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T07:46:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:04 smithi152 ceph-mon[35117]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:06.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:05 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2042985757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:06.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:05 smithi137 ceph-mon[35309]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T07:46:06.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:05 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:06.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:05 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2042985757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:06.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:05 smithi076 ceph-mon[30930]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T07:46:06.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:05 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:06.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:05 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2042985757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:06.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:05 smithi152 ceph-mon[35117]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T07:46:06.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:05 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:07.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:06 smithi137 ceph-mon[35309]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:46:07.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:06 smithi076 ceph-mon[30930]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:46:07.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:06 smithi152 ceph-mon[35117]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:46:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:09 smithi137 ceph-mon[35309]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-19T07:46:09.938 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:09 smithi076 ceph-mon[30930]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-19T07:46:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:09 smithi152 ceph-mon[35117]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-19T07:46:11.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:11 smithi076 ceph-mon[30930]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T07:46:11.863 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:11 smithi152 ceph-mon[35117]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T07:46:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:11 smithi137 ceph-mon[35309]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T07:46:13.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:13 smithi076 ceph-mon[30930]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T07:46:13.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:46:13.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:13 smithi137 ceph-mon[35309]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T07:46:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:46:13.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:13 smithi152 ceph-mon[35117]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T07:46:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:46:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:14.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:14 smithi076 ceph-mon[30930]: Deploying daemon osd.6 on smithi076 2024-09-19T07:46:14.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:14 smithi137 ceph-mon[35309]: Deploying daemon osd.6 on smithi076 2024-09-19T07:46:15.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:14 smithi152 ceph-mon[35117]: Deploying daemon osd.6 on smithi076 2024-09-19T07:46:15.684 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:15 smithi076 ceph-mon[30930]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:46:15.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:15 smithi137 ceph-mon[35309]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:46:16.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:15 smithi152 ceph-mon[35117]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:46:17.801 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:17 smithi076 ceph-mon[30930]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:17.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:17 smithi137 ceph-mon[35309]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:18.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:17 smithi152 ceph-mon[35117]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:19.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:19 smithi076 ceph-mon[30930]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:19.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:19.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:19.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:19 smithi137 ceph-mon[35309]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:19 smithi152 ceph-mon[35117]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:21.668 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:21 smithi076 ceph-mon[30930]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:21 smithi137 ceph-mon[35309]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:21 smithi152 ceph-mon[35117]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:22.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.913+0000 7fcf44ff9640 1 -- 172.21.15.76:0/3598725854 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf48062630 con 0x7fcf300a3240 2024-09-19T07:46:22.914 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 6 on host 'smithi076' 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcf300a3240 msgr2=0x7fcf300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcf300a3240 0x7fcf300a5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf4806b870 tx=0x7fcf3c008040 comp rx=0 tx=0).stop 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 msgr2=0x7fcf4806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 0x7fcf4806b2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800b450 tx=0x7fcf3800b910 comp rx=0 tx=0).stop 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 shutdown_connections 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcf300a3240 0x7fcf300a5700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf481026c0 0x7fcf4819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf48101d00 0x7fcf4819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:22.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 --2- 172.21.15.76:0/3598725854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf48100b00 0x7fcf4806b2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:22.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.915+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 >> 172.21.15.76:0/3598725854 conn(0x7fcf480fc290 msgr2=0x7fcf481050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:46:22.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.916+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 shutdown_connections 2024-09-19T07:46:22.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:46:22.916+0000 7fcf4dd78640 1 -- 172.21.15.76:0/3598725854 wait complete. 2024-09-19T07:46:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:22 smithi137 ceph-mon[35309]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:23.170 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.171 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.171 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:23.171 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:23.171 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.171 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:22 smithi152 ceph-mon[35117]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:23.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:23.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:23.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:22 smithi076 ceph-mon[30930]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:23.622 DEBUG:teuthology.orchestra.run.smithi076:osd.6> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T07:46:23.624 INFO:tasks.cephadm:Deploying osd.7 on smithi137 with /dev/vg_nvme/lv_2... 2024-09-19T07:46:23.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:46:23.878 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:46:23.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:23.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:23.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:24.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:24.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:24.393 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:24.394 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:24.394 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:24.394 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:25.007 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:24 smithi076 ceph-mon[30930]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:25.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:24 smithi137 ceph-mon[35309]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:25.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:24 smithi152 ceph-mon[35117]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:25.444 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 07:46:25 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T07:46:25.107+0000 7fc8a5749640 -1 osd.6 0 log_to_monitors true 2024-09-19T07:46:26.149 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:25 smithi137 ceph-mon[35309]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:46:26.150 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:25 smithi076 ceph-mon[30930]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:46:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:25 smithi152 ceph-mon[35117]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:46:26.469 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:46:26.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_2 2024-09-19T07:46:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:46:27.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:46:27.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T07:46:27.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:46:27.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:27.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi076 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi076 to 5696M 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.029 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:26 smithi137 ceph-mon[35309]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi076 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi076 to 5696M 2024-09-19T07:46:27.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:27.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:27.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:26 smithi076 ceph-mon[30930]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.189+0000 7fa6b8769640 1 -- 172.21.15.137:0/2813154945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b0102df0 msgr2=0x7fa6b0103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.189+0000 7fa6b8769640 1 --2- 172.21.15.137:0/2813154945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b0102df0 0x7fa6b0103270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009900 tx=0x7fa6a002a410 comp rx=0 tx=0).stop 2024-09-19T07:46:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- 172.21.15.137:0/2813154945 shutdown_connections 2024-09-19T07:46:27.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 --2- 172.21.15.137:0/2813154945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b01037b0 0x7fa6b010a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 --2- 172.21.15.137:0/2813154945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b0102df0 0x7fa6b0103270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 --2- 172.21.15.137:0/2813154945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0101bf0 0x7fa6b0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- 172.21.15.137:0/2813154945 >> 172.21.15.137:0/2813154945 conn(0x7fa6b00fd3c0 msgr2=0x7fa6b00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- 172.21.15.137:0/2813154945 shutdown_connections 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- 172.21.15.137:0/2813154945 wait complete. 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 Processor -- start 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- start start 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b0101bf0 0x7fa6b0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 0x7fa6b00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 0x7fa6b0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b010d9b0 con 0x7fa6b0102df0 2024-09-19T07:46:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b010d830 con 0x7fa6b01037b0 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.190+0000 7fa6b8769640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b010db30 con 0x7fa6b0101bf0 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 0x7fa6b0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b5d04640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 0x7fa6b00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 0x7fa6b0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33864/0 (socket says 172.21.15.137:33864) 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b5d04640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 0x7fa6b00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.137:52480/0 (socket says 172.21.15.137:52480) 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 -- 172.21.15.137:0/1243080984 learned_addr learned my addr 172.21.15.137:0/1243080984 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6505640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b0101bf0 0x7fa6b0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 -- 172.21.15.137:0/1243080984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b0101bf0 msgr2=0x7fa6b0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b0101bf0 0x7fa6b0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 -- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 msgr2=0x7fa6b00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 0x7fa6b00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 -- 172.21.15.137:0/1243080984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b00753e0 con 0x7fa6b01037b0 2024-09-19T07:46:27.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b5d04640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 0x7fa6b00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b6d06640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 0x7fa6b0074b20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800eaa0 tx=0x7fa6a800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800cdb0 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa6a8004b20 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8011760 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b01a2100 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.191+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b01a2610 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.192+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b0108fa0 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.194+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa6a8011900 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.194+0000 7fa6a77fe640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa69c0a3240 0x7fa69c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.194+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7fa6a80cf030 con 0x7fa6b01037b0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.194+0000 7fa6b6505640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa69c0a3240 0x7fa69c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.195+0000 7fa6b6505640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa69c0a3240 0x7fa69c0a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0102c50 tx=0x7fa6ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:46:27.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.202+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6a8016030 con 0x7fa6b01037b0 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi076 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi076 to 5696M 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:27.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:26 smithi152 ceph-mon[35117]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:27.382+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa6b0062630 con 0x7fa69c0a3240 2024-09-19T07:46:27.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T07:46:27.294+0000 7fc8a16cc640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T07:46:27.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T07:46:27.303+0000 7fc8994ec640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:46:28.123 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:46:28.123 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T07:46:28.123 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:28.123 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:28.124 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' 2024-09-19T07:46:28.124 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:28.124 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:28.124 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:28.124 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:28.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917]' entity='osd.6' 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:28.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] boot 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:29.114 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:28 smithi137 ceph-mon[35309]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:29.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:46:29.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:46:29.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:29.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] boot 2024-09-19T07:46:29.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T07:46:29.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:29.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:28 smithi076 ceph-mon[30930]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: osd.6 [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] boot 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:46:29.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:28 smithi152 ceph-mon[35117]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:46:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:30 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/3507853958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]: dispatch 2024-09-19T07:46:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:30 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]: dispatch 2024-09-19T07:46:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:30 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]': finished 2024-09-19T07:46:30.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:30 smithi137 ceph-mon[35309]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T07:46:30.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:30 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:30.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:30 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/3507853958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]: dispatch 2024-09-19T07:46:30.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:30 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]: dispatch 2024-09-19T07:46:30.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:30 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]': finished 2024-09-19T07:46:30.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:30 smithi152 ceph-mon[35117]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T07:46:30.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:30 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:30 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/3507853958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]: dispatch 2024-09-19T07:46:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:30 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]: dispatch 2024-09-19T07:46:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:30 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f89e262-1002-4e2c-b312-aead48b74d7e"}]': finished 2024-09-19T07:46:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:30 smithi076 ceph-mon[30930]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T07:46:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:30 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:31.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:31 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/1884714035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:31.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:31 smithi152 ceph-mon[35117]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:31 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/1884714035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:31 smithi137 ceph-mon[35309]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:31.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:31 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/1884714035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:31.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:31 smithi076 ceph-mon[30930]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:33.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:33 smithi137 ceph-mon[35309]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:33 smithi076 ceph-mon[30930]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:33 smithi152 ceph-mon[35117]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:35.897 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:35 smithi137 ceph-mon[35309]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:35.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:35 smithi076 ceph-mon[30930]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:35 smithi152 ceph-mon[35117]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:37.845 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:37 smithi137 ceph-mon[35309]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:37.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:37 smithi076 ceph-mon[30930]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:37 smithi152 ceph-mon[35117]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:46:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:38.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:46:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:46:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:39 smithi137 ceph-mon[35309]: Deploying daemon osd.7 on smithi137 2024-09-19T07:46:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:39 smithi137 ceph-mon[35309]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:39.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:39 smithi076 ceph-mon[30930]: Deploying daemon osd.7 on smithi137 2024-09-19T07:46:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:39 smithi076 ceph-mon[30930]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:40.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:39 smithi152 ceph-mon[35117]: Deploying daemon osd.7 on smithi137 2024-09-19T07:46:40.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:39 smithi152 ceph-mon[35117]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:41.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:41 smithi137 ceph-mon[35309]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:41.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:41 smithi076 ceph-mon[30930]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:42.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:41 smithi152 ceph-mon[35117]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:43.759 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:43 smithi137 ceph-mon[35309]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:43.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:43 smithi076 ceph-mon[30930]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:43 smithi152 ceph-mon[35117]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:44.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:44.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:44.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:45 smithi137 ceph-mon[35309]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:45.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:45 smithi076 ceph-mon[30930]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:46.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:45 smithi152 ceph-mon[35117]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:47.806 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:47 smithi137 ceph-mon[35309]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:47.806 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:47.806 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:47.806 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:47.806 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:47.806 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:47 smithi076 ceph-mon[30930]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:47 smithi152 ceph-mon[35117]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.153+0000 7fa6a77fe640 1 -- 172.21.15.137:0/1243080984 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa6b0062630 con 0x7fa69c0a3240 2024-09-19T07:46:48.155 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 7 on host 'smithi137' 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa69c0a3240 msgr2=0x7fa69c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa69c0a3240 0x7fa69c0a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0102c50 tx=0x7fa6ac005f90 comp rx=0 tx=0).stop 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 msgr2=0x7fa6b0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 0x7fa6b0074b20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800eaa0 tx=0x7fa6a800ef60 comp rx=0 tx=0).stop 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 shutdown_connections 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa69c0a3240 0x7fa69c0a5700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b01037b0 0x7fa6b0074b20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6b0102df0 0x7fa6b00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:48.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 --2- 172.21.15.137:0/1243080984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b0101bf0 0x7fa6b0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:48.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.155+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 >> 172.21.15.137:0/1243080984 conn(0x7fa6b00fd3c0 msgr2=0x7fa6b0106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:46:48.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.156+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 shutdown_connections 2024-09-19T07:46:48.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:46:48.156+0000 7fa6b8769640 1 -- 172.21.15.137:0/1243080984 wait complete. 2024-09-19T07:46:48.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:48 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:48.777 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:48 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.778 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:48 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.805 DEBUG:teuthology.orchestra.run.smithi137:osd.7> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T07:46:48.807 INFO:tasks.cephadm:Deploying osd.8 on smithi152 with /dev/vg_nvme/lv_2... 2024-09-19T07:46:48.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:46:48.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:48 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:48.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:48 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:48.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:48 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:49.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:48 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:46:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:48 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:48 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:46:49.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:49 smithi152 ceph-mon[35117]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:49 smithi076 ceph-mon[30930]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:50.025 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:49 smithi137 ceph-mon[35309]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:50.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 07:46:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T07:46:50.486+0000 7f00e4311640 -1 osd.7 0 log_to_monitors true 2024-09-19T07:46:50.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:50 smithi152 ceph-mon[35117]: from='osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:46:50.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:50 smithi152 ceph-mon[35117]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:46:50.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:50 smithi076 ceph-mon[30930]: from='osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:46:50.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:50 smithi076 ceph-mon[30930]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:46:51.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:50 smithi137 ceph-mon[35309]: from='osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:46:51.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:50 smithi137 ceph-mon[35309]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:46:51.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:51 smithi152 ceph-mon[35117]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:51.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:51 smithi152 ceph-mon[35117]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:46:51.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:51 smithi152 ceph-mon[35117]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T07:46:51.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:51 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:51.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:51 smithi152 ceph-mon[35117]: from='osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:46:51.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:51 smithi152 ceph-mon[35117]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:46:51.825 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T07:46:51.672+0000 7f00e0294640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T07:46:51.825 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T07:46:51.679+0000 7f00dc0bc640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:46:51.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-mon[35309]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:51.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-mon[35309]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:46:51.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-mon[35309]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T07:46:51.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:51.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-mon[35309]: from='osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:46:51.826 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:51 smithi137 ceph-mon[35309]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:46:51.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:46:51.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-09-19T07:46:51.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:51 smithi076 ceph-mon[30930]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:51.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:51 smithi076 ceph-mon[30930]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:46:51.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:51 smithi076 ceph-mon[30930]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T07:46:51.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:51 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:51.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:51 smithi076 ceph-mon[30930]: from='osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:46:51.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:51 smithi076 ceph-mon[30930]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:46:52.118 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:46:52.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 -- 172.21.15.152:0/2037936649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 msgr2=0x7f5240102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 --2- 172.21.15.152:0/2037936649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f5240102180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f523c009900 tx=0x7f523c02a410 comp rx=0 tx=0).stop 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 -- 172.21.15.152:0/2037936649 shutdown_connections 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 --2- 172.21.15.152:0/2037936649 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52401026c0 0x7f5240108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 --2- 172.21.15.152:0/2037936649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f5240102180 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 --2- 172.21.15.152:0/2037936649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5240100b00 0x7f5240100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 -- 172.21.15.152:0/2037936649 >> 172.21.15.152:0/2037936649 conn(0x7f52400fc290 msgr2=0x7f52400fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 -- 172.21.15.152:0/2037936649 shutdown_connections 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.632+0000 7f524813a640 1 -- 172.21.15.152:0/2037936649 wait complete. 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 Processor -- start 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 -- start start 2024-09-19T07:46:52.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240100b00 0x7f524019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f524019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52401026c0 0x7f52401a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f524010c920 con 0x7f5240100b00 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f524010c7a0 con 0x7f52401026c0 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f524813a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f524010caa0 con 0x7f5240101d00 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f524019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f524019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58124/0 (socket says 172.21.15.152:58124) 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 -- 172.21.15.152:0/2081025044 learned_addr learned my addr 172.21.15.152:0/2081025044 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52466d7640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52401026c0 0x7f52401a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f5245ed6640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240100b00 0x7f524019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:52.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 -- 172.21.15.152:0/2081025044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52401026c0 msgr2=0x7f52401a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52401026c0 0x7f52401a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 -- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240100b00 msgr2=0x7f524019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240100b00 0x7f524019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 -- 172.21.15.152:0/2081025044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52401a1db0 con 0x7f5240101d00 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f5245ed6640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240100b00 0x7f524019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.633+0000 7f52456d5640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f524019a6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f523c009a20 tx=0x7f523c004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.634+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c03f030 con 0x7f5240101d00 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.634+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52401a2040 con 0x7f5240101d00 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.634+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f523c003dc0 con 0x7f5240101d00 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.634+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c035070 con 0x7f5240101d00 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.634+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52401a25a0 con 0x7f5240101d00 2024-09-19T07:46:52.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.635+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52401a2800 con 0x7f5240101d00 2024-09-19T07:46:52.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.637+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f523c042030 con 0x7f5240101d00 2024-09-19T07:46:52.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.637+0000 7f5232ffd640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f522c0a3270 0x7f522c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:46:52.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.637+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5430+0+0 (secure 0 0 0) 0x7f523c0ef930 con 0x7f5240101d00 2024-09-19T07:46:52.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.637+0000 7f5245ed6640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f522c0a3270 0x7f522c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:46:52.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.638+0000 7f5245ed6640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f522c0a3270 0x7f522c0a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5240101b60 tx=0x7f523400a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:46:52.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.640+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f523c0bd190 con 0x7f5240101d00 2024-09-19T07:46:52.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:46:52.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T07:46:52.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:52.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:52.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] boot 2024-09-19T07:46:52.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi137 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi137 to 5696M 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:52.815 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:52.816 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.816 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:52 smithi152 ceph-mon[35117]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:52.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:46:52.823+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f52400fe440 con 0x7f522c0a3270 2024-09-19T07:46:52.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:46:52.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T07:46:52.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:52.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:52.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] boot 2024-09-19T07:46:52.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T07:46:52.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:52.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi137 2024-09-19T07:46:52.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:52.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:52.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:52.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi137 to 5696M 2024-09-19T07:46:52.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.947 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:52.947 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:52.947 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:52.947 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:52 smithi076 ceph-mon[30930]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: osd.7 [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] boot 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T07:46:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi137 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi137 to 5696M 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:46:53.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:52 smithi137 ceph-mon[35309]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:54.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:46:54.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:46:54.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T07:46:54.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:54.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:54.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:54.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:46:54.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:46:55.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:54 smithi137 ceph-mon[35309]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T07:46:55.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:54 smithi137 ceph-mon[35309]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:55.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:54 smithi076 ceph-mon[30930]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T07:46:55.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:54 smithi076 ceph-mon[30930]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:55.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:54 smithi152 ceph-mon[35117]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T07:46:55.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:54 smithi152 ceph-mon[35117]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:55.836 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:55 smithi152 ceph-mon[35117]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T07:46:55.836 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:55 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/3082241023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]: dispatch 2024-09-19T07:46:55.836 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:55 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]: dispatch 2024-09-19T07:46:55.836 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:55 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]': finished 2024-09-19T07:46:55.836 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:55 smithi152 ceph-mon[35117]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T07:46:55.836 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:55 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:46:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:55 smithi137 ceph-mon[35309]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T07:46:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:55 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/3082241023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]: dispatch 2024-09-19T07:46:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:55 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]: dispatch 2024-09-19T07:46:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:55 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]': finished 2024-09-19T07:46:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:55 smithi137 ceph-mon[35309]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T07:46:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:55 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:46:56.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:55 smithi076 ceph-mon[30930]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T07:46:56.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:55 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/3082241023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]: dispatch 2024-09-19T07:46:56.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:55 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]: dispatch 2024-09-19T07:46:56.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:55 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "799b54bb-4284-41b5-8cc1-d139b9dae6d2"}]': finished 2024-09-19T07:46:56.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:55 smithi076 ceph-mon[30930]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T07:46:56.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:55 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:46:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:56 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/4234077727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:56 smithi137 ceph-mon[35309]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:57.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:56 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/4234077727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:57.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:56 smithi076 ceph-mon[30930]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:57.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:56 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/4234077727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:46:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:56 smithi152 ceph-mon[35117]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:59.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:46:59 smithi076 ceph-mon[30930]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:59.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:46:59 smithi152 ceph-mon[35117]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:46:59.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:46:59 smithi137 ceph-mon[35309]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:01.736 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:01 smithi152 ceph-mon[35117]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:01 smithi137 ceph-mon[35309]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:01.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:01 smithi076 ceph-mon[30930]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:03.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:03 smithi152 ceph-mon[35117]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:03 smithi137 ceph-mon[35309]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:03 smithi076 ceph-mon[30930]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:47:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:47:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:05.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:47:05.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:05 smithi137 ceph-mon[35309]: Deploying daemon osd.8 on smithi152 2024-09-19T07:47:05.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:05 smithi137 ceph-mon[35309]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:05.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:05 smithi152 ceph-mon[35117]: Deploying daemon osd.8 on smithi152 2024-09-19T07:47:05.929 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:05 smithi152 ceph-mon[35117]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:05.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:05 smithi076 ceph-mon[30930]: Deploying daemon osd.8 on smithi152 2024-09-19T07:47:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:05 smithi076 ceph-mon[30930]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:07.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:07 smithi152 ceph-mon[35117]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:07.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:07 smithi137 ceph-mon[35309]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:07.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:07 smithi076 ceph-mon[30930]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:09 smithi152 ceph-mon[35117]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:09 smithi137 ceph-mon[35309]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:09 smithi076 ceph-mon[30930]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:10.918 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:10.918 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:10.918 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:10.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:11.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:11 smithi076 ceph-mon[30930]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:11.944 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:11 smithi152 ceph-mon[35117]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:12.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:11 smithi137 ceph-mon[35309]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:13.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.671+0000 7f5232ffd640 1 -- 172.21.15.152:0/2081025044 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f52400fe440 con 0x7f522c0a3270 2024-09-19T07:47:13.671 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 8 on host 'smithi152' 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f522c0a3270 msgr2=0x7f522c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f522c0a3270 0x7f522c0a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5240101b60 tx=0x7f523400a5e0 comp rx=0 tx=0).stop 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 msgr2=0x7f524019a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f524019a6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f523c009a20 tx=0x7f523c004430 comp rx=0 tx=0).stop 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 shutdown_connections 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f522c0a3270 0x7f522c0a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52401026c0 0x7f52401a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5240101d00 0x7f524019a6c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:13.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 --2- 172.21.15.152:0/2081025044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240100b00 0x7f524019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:13.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 >> 172.21.15.152:0/2081025044 conn(0x7f52400fc290 msgr2=0x7f52400fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:47:13.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 shutdown_connections 2024-09-19T07:47:13.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:47:13.674+0000 7f524813a640 1 -- 172.21.15.152:0/2081025044 wait complete. 2024-09-19T07:47:13.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:13 smithi076 ceph-mon[30930]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:13.981 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:13 smithi152 ceph-mon[35117]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:14.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:13 smithi137 ceph-mon[35309]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:14.317 DEBUG:teuthology.orchestra.run.smithi152:osd.8> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T07:47:14.319 INFO:tasks.cephadm:Deploying osd.9 on smithi076 with /dev/vg_nvme/lv_1... 2024-09-19T07:47:14.320 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:47:14.588 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:47:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:14 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:14 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:14 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:14 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:14 smithi076 ceph-mon[30930]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:15.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:14 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:14 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:14 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:14 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.027 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:14 smithi152 ceph-mon[35117]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:14 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:14 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:14 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:14 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:14 smithi137 ceph-mon[35309]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:16.252 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 07:47:16 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T07:47:16.000+0000 7ff968b85640 -1 osd.8 0 log_to_monitors true 2024-09-19T07:47:16.503 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:16 smithi152 ceph-mon[35117]: from='osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:47:16.504 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:16 smithi152 ceph-mon[35117]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:47:16.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:16 smithi137 ceph-mon[35309]: from='osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:47:16.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:16 smithi137 ceph-mon[35309]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:47:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:16 smithi076 ceph-mon[30930]: from='osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:47:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:16 smithi076 ceph-mon[30930]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:47:17.242 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:47:17.269 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi076:vg_nvme/lv_1 2024-09-19T07:47:17.527 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:47:17.548 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:17 smithi076 ceph-mon[30930]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:47:17.548 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:17 smithi076 ceph-mon[30930]: from='osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:47:17.548 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:17 smithi076 ceph-mon[30930]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T07:47:17.548 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:17 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:17.548 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:17 smithi076 ceph-mon[30930]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:47:17.548 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:17 smithi076 ceph-mon[30930]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:17.651 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T07:47:17.466+0000 7ff964b08640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T07:47:17.651 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T07:47:17.475+0000 7ff960930640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:47:17.651 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-mon[35117]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:47:17.651 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-mon[35117]: from='osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:47:17.651 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-mon[35117]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T07:47:17.652 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:17.652 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-mon[35117]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:47:17.652 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:17 smithi152 ceph-mon[35117]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:17.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:17 smithi137 ceph-mon[35309]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:47:17.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:17 smithi137 ceph-mon[35309]: from='osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:47:17.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:17 smithi137 ceph-mon[35309]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T07:47:17.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:17 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:17.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:17 smithi137 ceph-mon[35309]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:47:17.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:17 smithi137 ceph-mon[35309]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:47:18.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 -- 172.21.15.76:0/376764468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 msgr2=0x7fd7e0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/376764468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0107380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009900 tx=0x7fd7dc02a3f0 comp rx=0 tx=0).stop 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 -- 172.21.15.76:0/376764468 shutdown_connections 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/376764468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 0x7fd7e0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/376764468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0107380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/376764468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7e0102660 0x7fd7e0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 -- 172.21.15.76:0/376764468 >> 172.21.15.76:0/376764468 conn(0x7fd7e00fc280 msgr2=0x7fd7e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 -- 172.21.15.76:0/376764468 shutdown_connections 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.020+0000 7fd7e85d5640 1 -- 172.21.15.76:0/376764468 wait complete. 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 Processor -- start 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 -- start start 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7e0102660 0x7fd7e0101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:18.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 0x7fd7e0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e010d9e0 con 0x7fd7e0104f90 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e010d860 con 0x7fd7e01078c0 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e85d5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e010db60 con 0x7fd7e0102660 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e5b70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e5b70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34190/0 (socket says 172.21.15.76:34190) 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e5b70640 1 -- 172.21.15.76:0/671484446 learned_addr learned my addr 172.21.15.76:0/671484446 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e6371640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7e0102660 0x7fd7e0101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.021+0000 7fd7e6b72640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 0x7fd7e0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e5b70640 1 -- 172.21.15.76:0/671484446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7e0102660 msgr2=0x7fd7e0101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:18.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e5b70640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7e0102660 0x7fd7e0101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e5b70640 1 -- 172.21.15.76:0/671484446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 msgr2=0x7fd7e0100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e5b70640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 0x7fd7e0100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e5b70640 1 -- 172.21.15.76:0/671484446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e0101410 con 0x7fd7e0104f90 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e6b72640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 0x7fd7e0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e5b70640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0100610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0316a0 tx=0x7fd7dc032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc03f030 con 0x7fd7e0104f90 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e01a20b0 con 0x7fd7e0104f90 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7dc003d00 con 0x7fd7e0104f90 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc035070 con 0x7fd7e0104f90 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.022+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e01a2560 con 0x7fd7e0104f90 2024-09-19T07:47:18.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.023+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e00fdd70 con 0x7fd7e0104f90 2024-09-19T07:47:18.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.025+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd7dc042030 con 0x7fd7e0104f90 2024-09-19T07:47:18.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.025+0000 7fd7d77fe640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd7cc0a3240 0x7fd7cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:18.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.026+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7fd7dc0ef770 con 0x7fd7e0104f90 2024-09-19T07:47:18.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.026+0000 7fd7e6371640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd7cc0a3240 0x7fd7cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:18.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.026+0000 7fd7e6371640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd7cc0a3240 0x7fd7cc0a5700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000bbe0 tx=0x7fd7d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:47:18.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.028+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7dc0bcf60 con 0x7fd7e0104f90 2024-09-19T07:47:18.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:18.207+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd7e0062630 con 0x7fd7cc0a3240 2024-09-19T07:47:18.761 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:47:18.761 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T07:47:18.761 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:18.761 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:18.761 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.761 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.762 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.762 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.762 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.762 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.762 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.762 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:47:18.763 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:47:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:47:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:47:18.814 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:47:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T07:47:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:47:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:47:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi152 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] boot 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:19.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:19 smithi076 ceph-mon[30930]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:19.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:47:19.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:47:19.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi152 2024-09-19T07:47:19.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-19T07:47:19.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:47:19.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] boot 2024-09-19T07:47:19.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T07:47:19.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:19.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:19 smithi152 ceph-mon[35117]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi152 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi076:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: osd.8 [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] boot 2024-09-19T07:47:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T07:47:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:47:19.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:19 smithi137 ceph-mon[35309]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:20.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:20 smithi076 ceph-mon[30930]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T07:47:20.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:20 smithi152 ceph-mon[35117]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T07:47:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:20 smithi137 ceph-mon[35309]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T07:47:21.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T07:47:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2309070422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "156eab9f-4c2f-4ff4-b26b-f9100ca01236"}]: dispatch 2024-09-19T07:47:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2309070422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "156eab9f-4c2f-4ff4-b26b-f9100ca01236"}]': finished 2024-09-19T07:47:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:47:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3712569683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2309070422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "156eab9f-4c2f-4ff4-b26b-f9100ca01236"}]: dispatch 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2309070422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "156eab9f-4c2f-4ff4-b26b-f9100ca01236"}]': finished 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3712569683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2309070422' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "156eab9f-4c2f-4ff4-b26b-f9100ca01236"}]: dispatch 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2309070422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "156eab9f-4c2f-4ff4-b26b-f9100ca01236"}]': finished 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3712569683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:47:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:22 smithi152 ceph-mon[35117]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T07:47:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:22 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:22 smithi152 ceph-mon[35117]: pgmap v195: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:22 smithi137 ceph-mon[35309]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T07:47:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:22 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:22 smithi137 ceph-mon[35309]: pgmap v195: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:23.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:22 smithi076 ceph-mon[30930]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T07:47:23.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:22 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:23.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:22 smithi076 ceph-mon[30930]: pgmap v195: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:23 smithi152 ceph-mon[35117]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T07:47:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:24.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:23 smithi137 ceph-mon[35309]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T07:47:24.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:24.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:23 smithi076 ceph-mon[30930]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T07:47:24.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:24 smithi152 ceph-mon[35117]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T07:47:25.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:24 smithi137 ceph-mon[35309]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T07:47:25.172 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:24 smithi076 ceph-mon[30930]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T07:47:27.724 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:27 smithi076 ceph-mon[30930]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:47:27.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:27 smithi137 ceph-mon[35309]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:47:28.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:27 smithi152 ceph-mon[35117]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:47:29.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:29 smithi076 ceph-mon[30930]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T07:47:29.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:47:29.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:29 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:29 smithi137 ceph-mon[35309]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T07:47:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:47:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:29 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:29 smithi152 ceph-mon[35117]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T07:47:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:47:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:29 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:30.833 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:30 smithi076 ceph-mon[30930]: Deploying daemon osd.9 on smithi076 2024-09-19T07:47:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:30 smithi137 ceph-mon[35309]: Deploying daemon osd.9 on smithi076 2024-09-19T07:47:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:30 smithi152 ceph-mon[35117]: Deploying daemon osd.9 on smithi076 2024-09-19T07:47:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:31 smithi137 ceph-mon[35309]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:47:31.925 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:31 smithi076 ceph-mon[30930]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:47:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:31 smithi152 ceph-mon[35117]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:47:33.747 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:33 smithi076 ceph-mon[30930]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:47:33.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:33 smithi137 ceph-mon[35309]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:47:34.065 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:33 smithi152 ceph-mon[35117]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:47:35.741 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:35 smithi076 ceph-mon[30930]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:35.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:35.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:35.742 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:35 smithi137 ceph-mon[35309]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:35 smithi152 ceph-mon[35117]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:37.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:37 smithi076 ceph-mon[30930]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:37 smithi152 ceph-mon[35117]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:38.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:37 smithi137 ceph-mon[35309]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:38.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.724+0000 7fd7d77fe640 1 -- 172.21.15.76:0/671484446 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7e0062630 con 0x7fd7cc0a3240 2024-09-19T07:47:38.725 INFO:teuthology.orchestra.run.smithi076.stdout:Created osd(s) 9 on host 'smithi076' 2024-09-19T07:47:38.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd7cc0a3240 msgr2=0x7fd7cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:38.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd7cc0a3240 0x7fd7cc0a5700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000bbe0 tx=0x7fd7d000b390 comp rx=0 tx=0).stop 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 msgr2=0x7fd7e0100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0100610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0316a0 tx=0x7fd7dc032d70 comp rx=0 tx=0).stop 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 shutdown_connections 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd7cc0a3240 0x7fd7cc0a5700 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7e01078c0 0x7fd7e0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd7e0104f90 0x7fd7e0100610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 --2- 172.21.15.76:0/671484446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7e0102660 0x7fd7e0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.726+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 >> 172.21.15.76:0/671484446 conn(0x7fd7e00fc280 msgr2=0x7fd7e0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.727+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 shutdown_connections 2024-09-19T07:47:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:47:38.727+0000 7fd7e85d5640 1 -- 172.21.15.76:0/671484446 wait complete. 2024-09-19T07:47:39.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:39.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:39.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:39.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:39.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:38 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:38 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:38 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:39.528 DEBUG:teuthology.orchestra.run.smithi076:osd.9> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T07:47:39.531 INFO:tasks.cephadm:Deploying osd.10 on smithi137 with /dev/vg_nvme/lv_1... 2024-09-19T07:47:39.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:47:39.789 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:47:41.409 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 07:47:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T07:47:41.070+0000 7fab2d5f5640 -1 osd.9 0 log_to_monitors true 2024-09-19T07:47:41.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:41 smithi076 ceph-mon[30930]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:41.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:41 smithi076 ceph-mon[30930]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:47:41.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:41 smithi137 ceph-mon[35309]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:41.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:41 smithi137 ceph-mon[35309]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:47:42.014 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:41 smithi152 ceph-mon[35117]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:42.014 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:41 smithi152 ceph-mon[35117]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:47:42.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-19T07:47:42.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_1 2024-09-19T07:47:42.657 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:47:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:42 smithi137 ceph-mon[35309]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:47:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:42 smithi137 ceph-mon[35309]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T07:47:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:42 smithi137 ceph-mon[35309]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:47:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:42 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:42.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:42 smithi076 ceph-mon[30930]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:47:42.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:42 smithi076 ceph-mon[30930]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T07:47:42.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:42 smithi076 ceph-mon[30930]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:47:42.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:42 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:43.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:42 smithi152 ceph-mon[35117]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:47:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:42 smithi152 ceph-mon[35117]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T07:47:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:42 smithi152 ceph-mon[35117]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]: dispatch 2024-09-19T07:47:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:42 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 -- 172.21.15.137:0/617676594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd201026c0 msgr2=0x7efd20108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 --2- 172.21.15.137:0/617676594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd201026c0 0x7efd20108f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd18009be0 tx=0x7efd1802a6c0 comp rx=0 tx=0).stop 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 -- 172.21.15.137:0/617676594 shutdown_connections 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 --2- 172.21.15.137:0/617676594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd201026c0 0x7efd20108f50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 --2- 172.21.15.137:0/617676594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd20101d00 0x7efd20102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 --2- 172.21.15.137:0/617676594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 -- 172.21.15.137:0/617676594 >> 172.21.15.137:0/617676594 conn(0x7efd200fc290 msgr2=0x7efd200fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 -- 172.21.15.137:0/617676594 shutdown_connections 2024-09-19T07:47:43.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.135+0000 7efd27239640 1 -- 172.21.15.137:0/617676594 wait complete. 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 Processor -- start 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 -- start start 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd20101d00 0x7efd20198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd201026c0 0x7efd2019f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efd2010c8b0 con 0x7efd201026c0 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd2010c730 con 0x7efd20100b00 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd27239640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efd2010ca30 con 0x7efd20101d00 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd24fd5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd24fd5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39934/0 (socket says 172.21.15.137:39934) 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd1ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd20101d00 0x7efd20198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd24fd5640 1 -- 172.21.15.137:0/2241273101 learned_addr learned my addr 172.21.15.137:0/2241273101 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-19T07:47:43.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.136+0000 7efd257d6640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd201026c0 0x7efd2019f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1ffff640 1 -- 172.21.15.137:0/2241273101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 msgr2=0x7efd20198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1ffff640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1ffff640 1 -- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd201026c0 msgr2=0x7efd2019f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1ffff640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd201026c0 0x7efd2019f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1ffff640 1 -- 172.21.15.137:0/2241273101 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2019fbe0 con 0x7efd20101d00 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd24fd5640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1ffff640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd20101d00 0x7efd20198560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e9f0 tx=0x7efd0c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00ccc0 con 0x7efd20101d00 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd0c010930 con 0x7efd20101d00 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0189f0 con 0x7efd20101d00 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2019fed0 con 0x7efd20101d00 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.137+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd201a0330 con 0x7efd20101d00 2024-09-19T07:47:43.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.138+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd201a0560 con 0x7efd20101d00 2024-09-19T07:47:43.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.140+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efd0c010ae0 con 0x7efd20101d00 2024-09-19T07:47:43.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.141+0000 7efd1dffb640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efd100a3270 0x7efd100a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:47:43.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.141+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7efd0c0cf400 con 0x7efd20101d00 2024-09-19T07:47:43.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.141+0000 7efd24fd5640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efd100a3270 0x7efd100a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:47:43.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.142+0000 7efd24fd5640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efd100a3270 0x7efd100a5730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd140096c0 tx=0x7efd14009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:47:43.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.143+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd0c09c3f0 con 0x7efd20101d00 2024-09-19T07:47:43.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:47:43.323+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7efd201a07f0 con 0x7efd100a3270 2024-09-19T07:47:43.443 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T07:47:43.078+0000 7fab29578640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T07:47:43.443 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T07:47:43.088+0000 7fab21398640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:47:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:47:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi076 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi076 to 4272M 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:43.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:43.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' 2024-09-19T07:47:43.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:47:43.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:47:43.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:43 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi076 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:43.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi076 to 4272M 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' 2024-09-19T07:47:43.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:47:43.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:47:43.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:43 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi076", "root=default"]}]': finished 2024-09-19T07:47:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T07:47:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi076 2024-09-19T07:47:44.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi076 to 4272M 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316]' entity='osd.9' 2024-09-19T07:47:44.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:47:44.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:47:44.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:43 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] boot 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T07:47:44.783 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] boot 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T07:47:44.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: osd.9 [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] boot 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T07:47:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:47:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:45 smithi137 ceph-mon[35309]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:45.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:45 smithi076 ceph-mon[30930]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:45 smithi152 ceph-mon[35117]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:47:46.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T07:47:46.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/2595992582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]: dispatch 2024-09-19T07:47:46.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]: dispatch 2024-09-19T07:47:46.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]': finished 2024-09-19T07:47:46.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T07:47:46.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:47:46.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:46 smithi076 ceph-mon[30930]: from='client.? 172.21.15.137:0/380399393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/2595992582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]: dispatch 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]: dispatch 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]': finished 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:47:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:46 smithi152 ceph-mon[35117]: from='client.? 172.21.15.137:0/380399393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:47:47.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T07:47:47.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/2595992582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]: dispatch 2024-09-19T07:47:47.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]: dispatch 2024-09-19T07:47:47.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "167970e0-dbe5-4fed-91bd-df956725da30"}]': finished 2024-09-19T07:47:47.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T07:47:47.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:47:47.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:46 smithi137 ceph-mon[35309]: from='client.? 172.21.15.137:0/380399393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:47:47.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:47 smithi076 ceph-mon[30930]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:47 smithi152 ceph-mon[35117]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:47 smithi137 ceph-mon[35309]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:49 smithi076 ceph-mon[30930]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:50.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:49 smithi152 ceph-mon[35117]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:50.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:49 smithi137 ceph-mon[35309]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:51.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:51 smithi076 ceph-mon[30930]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:52.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:51 smithi152 ceph-mon[35117]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:52.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:51 smithi137 ceph-mon[35309]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:52.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:52 smithi137 ceph-mon[35309]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:52.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:52 smithi076 ceph-mon[30930]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:53.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:52 smithi152 ceph-mon[35117]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:54.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:47:54.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:54 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:54.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:47:54.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:54 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:55.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:47:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:54 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:47:55.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:55 smithi076 ceph-mon[30930]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:55.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:55 smithi076 ceph-mon[30930]: Deploying daemon osd.10 on smithi137 2024-09-19T07:47:56.035 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:55 smithi137 ceph-mon[35309]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:56.035 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:55 smithi137 ceph-mon[35309]: Deploying daemon osd.10 on smithi137 2024-09-19T07:47:56.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:55 smithi152 ceph-mon[35117]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:55 smithi152 ceph-mon[35117]: Deploying daemon osd.10 on smithi137 2024-09-19T07:47:57.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:57 smithi076 ceph-mon[30930]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:58.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:57 smithi152 ceph-mon[35117]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:58.071 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:57 smithi137 ceph-mon[35309]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:59.852 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:47:59 smithi137 ceph-mon[35309]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:47:59.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:47:59 smithi076 ceph-mon[30930]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:00.185 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:47:59 smithi152 ceph-mon[35117]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:00.924 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:00 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:00.924 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:00 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:00.924 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:00 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:00 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:01.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:00 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:01.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:00 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:01.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:00 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:01.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:01 smithi076 ceph-mon[30930]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:01.952 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:01 smithi137 ceph-mon[35309]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:01 smithi152 ceph-mon[35117]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:03 smithi137 ceph-mon[35309]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:03 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:03 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:03 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:03 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:03.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:03 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:03.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:03 smithi076 ceph-mon[30930]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:03 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:03 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:03 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:03 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:03.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:03 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:03 smithi152 ceph-mon[35117]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:03 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:03 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:03 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:03 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:04.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:03 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.249+0000 7efd1dffb640 1 -- 172.21.15.137:0/2241273101 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7efd201a07f0 con 0x7efd100a3270 2024-09-19T07:48:04.250 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 10 on host 'smithi137' 2024-09-19T07:48:04.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efd100a3270 msgr2=0x7efd100a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:04.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efd100a3270 0x7efd100a5730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd140096c0 tx=0x7efd14009260 comp rx=0 tx=0).stop 2024-09-19T07:48:04.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd20101d00 msgr2=0x7efd20198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd20101d00 0x7efd20198560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e9f0 tx=0x7efd0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 shutdown_connections 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efd201026c0 0x7efd2019f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd20101d00 0x7efd20198560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7efd100a3270 0x7efd100a5730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 --2- 172.21.15.137:0/2241273101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd20100b00 0x7efd20198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 >> 172.21.15.137:0/2241273101 conn(0x7efd200fc290 msgr2=0x7efd200fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 shutdown_connections 2024-09-19T07:48:04.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-19T07:48:04.252+0000 7efd27239640 1 -- 172.21.15.137:0/2241273101 wait complete. 2024-09-19T07:48:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:04 smithi137 ceph-mon[35309]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:04 smithi076 ceph-mon[30930]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:04.956 DEBUG:teuthology.orchestra.run.smithi137:osd.10> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T07:48:04.960 INFO:tasks.cephadm:Deploying osd.11 on smithi152 with /dev/vg_nvme/lv_1... 2024-09-19T07:48:04.960 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:48:04.988 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:04.989 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.989 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:04.989 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:04 smithi152 ceph-mon[35117]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:05.214 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:48:07.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 07:48:06 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T07:48:06.785+0000 7fac0abb2640 -1 osd.10 0 log_to_monitors true 2024-09-19T07:48:07.790 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:07 smithi137 ceph-mon[35309]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:07.790 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:07 smithi137 ceph-mon[35309]: from='osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:48:07.790 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:07 smithi137 ceph-mon[35309]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:48:07.941 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:07 smithi152 ceph-mon[35117]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:07.941 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:07 smithi152 ceph-mon[35117]: from='osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:48:07.942 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:07 smithi152 ceph-mon[35117]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:48:07.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:07 smithi076 ceph-mon[30930]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:07.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:07 smithi076 ceph-mon[30930]: from='osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:48:07.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:07 smithi076 ceph-mon[30930]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:48:08.246 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-19T07:48:08.273 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_1 2024-09-19T07:48:08.571 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:48:08.844 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:48:08.844 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T07:48:08.848 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:48:08.848 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:08.848 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:48:08.848 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.848 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:08.849 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:08 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:08.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:08.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:08.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:08 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:09.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/1730271450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 msgr2=0x7fa6f8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/1730271450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f8103280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009900 tx=0x7fa6ec02a410 comp rx=0 tx=0).stop 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/1730271450 shutdown_connections 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/1730271450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f81037c0 0x7fa6f810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/1730271450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f8103280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/1730271450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6f8101c00 0x7fa6f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/1730271450 >> 172.21.15.152:0/1730271450 conn(0x7fa6f80fd390 msgr2=0x7fa6f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/1730271450 shutdown_connections 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.054+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/1730271450 wait complete. 2024-09-19T07:48:09.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 Processor -- start 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 -- start start 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6f8101c00 0x7fa6f8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f81037c0 0x7fa6f8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f810d9c0 con 0x7fa6f8101c00 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f810d840 con 0x7fa6f81037c0 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6fdbcb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f810db40 con 0x7fa6f8102e00 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6f6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:09.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6f6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45696/0 (socket says 172.21.15.152:45696) 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6f6ffd640 1 -- 172.21.15.152:0/4141390849 learned_addr learned my addr 172.21.15.152:0/4141390849 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6f7fff640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f81037c0 0x7fa6f8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.055+0000 7fa6f77fe640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6f8101c00 0x7fa6f8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f6ffd640 1 -- 172.21.15.152:0/4141390849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f81037c0 msgr2=0x7fa6f8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f6ffd640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f81037c0 0x7fa6f8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f6ffd640 1 -- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6f8101c00 msgr2=0x7fa6f8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f6ffd640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6f8101c00 0x7fa6f8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f6ffd640 1 -- 172.21.15.152:0/4141390849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f80753e0 con 0x7fa6f8102e00 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f6ffd640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f80745e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009a20 tx=0x7fa6ec004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:09.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec03f030 con 0x7fa6f8102e00 2024-09-19T07:48:09.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa6ec003dc0 con 0x7fa6f8102e00 2024-09-19T07:48:09.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec035070 con 0x7fa6f8102e00 2024-09-19T07:48:09.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f81a2060 con 0x7fa6f8102e00 2024-09-19T07:48:09.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.056+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f81a2510 con 0x7fa6f8102e00 2024-09-19T07:48:09.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.057+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f8108f30 con 0x7fa6f8102e00 2024-09-19T07:48:09.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.058+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa6ec042030 con 0x7fa6f8102e00 2024-09-19T07:48:09.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.059+0000 7fa6f4ff9640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa6e00a3240 0x7fa6e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:09.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.059+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6414+0+0 (secure 0 0 0) 0x7fa6ec0ef850 con 0x7fa6f8102e00 2024-09-19T07:48:09.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.059+0000 7fa6f77fe640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa6e00a3240 0x7fa6e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:09.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.059+0000 7fa6f77fe640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa6e00a3240 0x7fa6e00a5700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8102c60 tx=0x7fa6e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:09.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.063+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6ec0bc690 con 0x7fa6f8102e00 2024-09-19T07:48:09.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T07:48:08.660+0000 7fac06b35640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T07:48:09.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T07:48:08.671+0000 7fac0295d640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:48:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:48:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T07:48:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:48:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:09.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:08 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:09.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:09.238+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa6f8062630 con 0x7fa6e00a3240 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi137 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi137 to 4272M 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:09.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:09.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:48:09.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:48:09.945 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:09.992 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi137 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi137 to 4272M 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:48:09.993 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:48:09.994 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi137 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi137 to 4272M 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:48:10.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:48:10.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:10.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:48:10.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:48:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:48:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] boot 2024-09-19T07:48:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T07:48:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:10.953 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:48:10.953 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:48:10.953 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:48:10.953 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:10.953 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] boot 2024-09-19T07:48:10.954 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T07:48:10.954 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:48:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:48:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:48:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: osd.10 [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] boot 2024-09-19T07:48:11.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T07:48:11.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:48:11.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:11 smithi152 ceph-mon[35117]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:11.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:11 smithi152 ceph-mon[35117]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T07:48:11.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:11 smithi076 ceph-mon[30930]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:11.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:11 smithi076 ceph-mon[30930]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T07:48:12.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:11 smithi137 ceph-mon[35309]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:48:12.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:11 smithi137 ceph-mon[35309]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/3614271946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]: dispatch 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]: dispatch 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]': finished 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.152:0/1320227604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:48:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:12 smithi152 ceph-mon[35117]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/3614271946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]: dispatch 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]: dispatch 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]': finished 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.152:0/1320227604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:48:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:12 smithi076 ceph-mon[30930]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/3614271946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]: dispatch 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]: dispatch 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09775c03-0d7f-4443-99af-1ccf1bb95342"}]': finished 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.152:0/1320227604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:48:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:12 smithi137 ceph-mon[35309]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:15.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:15 smithi137 ceph-mon[35309]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:48:15.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:15 smithi076 ceph-mon[30930]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:48:16.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:15 smithi152 ceph-mon[35117]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:48:17.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:17 smithi152 ceph-mon[35117]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:48:17.909 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:17 smithi137 ceph-mon[35309]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:48:17.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:17 smithi076 ceph-mon[30930]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:48:19.719 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:19 smithi152 ceph-mon[35117]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T07:48:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:19 smithi137 ceph-mon[35309]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T07:48:19.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:19 smithi076 ceph-mon[30930]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T07:48:21.808 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:21 smithi152 ceph-mon[35117]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:48:21.809 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:48:21.809 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:21 smithi137 ceph-mon[35309]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:48:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:48:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:21.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:21 smithi076 ceph-mon[30930]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:48:21.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:48:21.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:22.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:22 smithi152 ceph-mon[35117]: Deploying daemon osd.11 on smithi152 2024-09-19T07:48:22.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:22 smithi076 ceph-mon[30930]: Deploying daemon osd.11 on smithi152 2024-09-19T07:48:23.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:22 smithi137 ceph-mon[35309]: Deploying daemon osd.11 on smithi152 2024-09-19T07:48:23.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:23 smithi076 ceph-mon[30930]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T07:48:23.998 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:23 smithi152 ceph-mon[35117]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T07:48:24.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:23 smithi137 ceph-mon[35309]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T07:48:25.897 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:25 smithi152 ceph-mon[35117]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:48:25.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:25 smithi076 ceph-mon[30930]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:48:26.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:25 smithi137 ceph-mon[35309]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:48:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:27 smithi076 ceph-mon[30930]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:27.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:27 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:27.972 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:27 smithi152 ceph-mon[35117]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:27.972 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:27.972 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:27.972 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:27 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:28.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:27 smithi137 ceph-mon[35309]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:28.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:28.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:28.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:27 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:29.880 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:29 smithi152 ceph-mon[35117]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:29.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:29 smithi076 ceph-mon[30930]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:30.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:29 smithi137 ceph-mon[35309]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:31.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.049+0000 7fa6f4ff9640 1 -- 172.21.15.152:0/4141390849 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa6f8062630 con 0x7fa6e00a3240 2024-09-19T07:48:31.050 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 11 on host 'smithi152' 2024-09-19T07:48:31.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa6e00a3240 msgr2=0x7fa6e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:31.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa6e00a3240 0x7fa6e00a5700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8102c60 tx=0x7fa6e8005f90 comp rx=0 tx=0).stop 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 msgr2=0x7fa6f80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f80745e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009a20 tx=0x7fa6ec004430 comp rx=0 tx=0).stop 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 shutdown_connections 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa6e00a3240 0x7fa6e00a5700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f81037c0 0x7fa6f8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f8102e00 0x7fa6f80745e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 --2- 172.21.15.152:0/4141390849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6f8101c00 0x7fa6f8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 >> 172.21.15.152:0/4141390849 conn(0x7fa6f80fd390 msgr2=0x7fa6f8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:31.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 shutdown_connections 2024-09-19T07:48:31.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:31.052+0000 7fa6fdbcb640 1 -- 172.21.15.152:0/4141390849 wait complete. 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:31 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:31.501 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:31.502 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.502 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:31 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:31.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:31.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:31 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:31.744 DEBUG:teuthology.orchestra.run.smithi152:osd.11> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T07:48:31.746 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T07:48:31.747 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:48:31.993 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:32.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 -- 172.21.15.76:0/531938325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f74104f90 msgr2=0x7f4f74107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:32.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/531938325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f74104f90 0x7f4f74107380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009900 tx=0x7f4f5c02a410 comp rx=0 tx=0).stop 2024-09-19T07:48:32.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 -- 172.21.15.76:0/531938325 shutdown_connections 2024-09-19T07:48:32.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/531938325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f741078c0 0x7f4f74109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/531938325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f74104f90 0x7f4f74107380 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/531938325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f74102660 0x7f4f74104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 -- 172.21.15.76:0/531938325 >> 172.21.15.76:0/531938325 conn(0x7f4f740fc280 msgr2=0x7f4f740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:32.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 -- 172.21.15.76:0/531938325 shutdown_connections 2024-09-19T07:48:32.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.476+0000 7f4f7a97e640 1 -- 172.21.15.76:0/531938325 wait complete. 2024-09-19T07:48:32.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 Processor -- start 2024-09-19T07:48:32.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 -- start start 2024-09-19T07:48:32.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f74102660 0x7f4f74197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:32.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f74104f90 0x7f4f74198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:32.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 0x7f4f7419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7410d990 con 0x7f4f741078c0 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7410d810 con 0x7f4f74104f90 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f7a97e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7410db10 con 0x7f4f74102660 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 0x7f4f7419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 0x7f4f7419f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52390/0 (socket says 172.21.15.76:52390) 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 -- 172.21.15.76:0/1475972396 learned_addr learned my addr 172.21.15.76:0/1475972396 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:32.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f73fff640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f74102660 0x7f4f74197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 -- 172.21.15.76:0/1475972396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f74102660 msgr2=0x7f4f74197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f74102660 0x7f4f74197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 -- 172.21.15.76:0/1475972396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f74104f90 msgr2=0x7f4f74198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f74104f90 0x7f4f74198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.477+0000 7f4f78f1b640 1 -- 172.21.15.76:0/1475972396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7419fb00 con 0x7f4f741078c0 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.478+0000 7f4f78f1b640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 0x7f4f7419f490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00cce0 tx=0x7f4f6c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.478+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00f450 con 0x7f4f741078c0 2024-09-19T07:48:32.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.478+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f6c00faf0 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.478+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7419fdf0 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.478+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c018cc0 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.478+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f741a0300 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.479+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f740fdd70 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.480+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f6c00f5f0 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.481+0000 7f4f717fa640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4f600a32f0 0x7f4f600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.481+0000 7f4f73fff640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4f600a32f0 0x7f4f600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.481+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f4f6c0cf840 con 0x7f4f741078c0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.481+0000 7f4f73fff640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4f600a32f0 0x7f4f600a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f64005e10 tx=0x7f4f64005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:32.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.485+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f6c014030 con 0x7f4f741078c0 2024-09-19T07:48:32.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.657+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4f7402da10 con 0x7f4f741078c0 2024-09-19T07:48:32.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.658+0000 7f4f717fa640 1 -- 172.21.15.76:0/1475972396 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f4f6c09cb40 con 0x7f4f741078c0 2024-09-19T07:48:32.658 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:32.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4f600a32f0 msgr2=0x7f4f600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:32.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4f600a32f0 0x7f4f600a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f64005e10 tx=0x7f4f64005da0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 msgr2=0x7f4f7419f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:32.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 0x7f4f7419f490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00cce0 tx=0x7f4f6c00a620 comp rx=0 tx=0).stop 2024-09-19T07:48:32.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 shutdown_connections 2024-09-19T07:48:32.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4f741078c0 0x7f4f7419f490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4f600a32f0 0x7f4f600a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f74104f90 0x7f4f74198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 --2- 172.21.15.76:0/1475972396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f74102660 0x7f4f74197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:32.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 >> 172.21.15.76:0/1475972396 conn(0x7f4f740fc280 msgr2=0x7f4f74102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:32.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 shutdown_connections 2024-09-19T07:48:32.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:32.660+0000 7f4f7a97e640 1 -- 172.21.15.76:0/1475972396 wait complete. 2024-09-19T07:48:33.291 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 07:48:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T07:48:33.143+0000 7fd6c799b640 -1 osd.11 0 log_to_monitors true 2024-09-19T07:48:33.554 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726732089,"num_in_osds":12,"osd_in_since":1726732091,"num_remapped_pgs":0} 2024-09-19T07:48:33.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:33 smithi076 ceph-mon[30930]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:33 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1475972396' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:33 smithi076 ceph-mon[30930]: from='osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:48:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:33 smithi076 ceph-mon[30930]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:48:34.032 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:33 smithi152 ceph-mon[35117]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:34.032 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:33 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1475972396' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:34.032 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:33 smithi152 ceph-mon[35117]: from='osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:48:34.033 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:33 smithi152 ceph-mon[35117]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:48:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:33 smithi137 ceph-mon[35309]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:33 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1475972396' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:33 smithi137 ceph-mon[35309]: from='osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:48:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:33 smithi137 ceph-mon[35309]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:48:34.556 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:48:34.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:34 smithi152 ceph-mon[35117]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:48:34.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:34 smithi152 ceph-mon[35117]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T07:48:34.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:34 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:34.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:34 smithi152 ceph-mon[35117]: from='osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:48:34.739 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:34 smithi152 ceph-mon[35117]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:48:34.817 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:34.938 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:34 smithi076 ceph-mon[30930]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:48:34.938 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:34 smithi076 ceph-mon[30930]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T07:48:34.938 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:34 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:34.939 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:34 smithi076 ceph-mon[30930]: from='osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:48:34.939 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:34 smithi076 ceph-mon[30930]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:48:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:34 smithi137 ceph-mon[35309]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:48:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:34 smithi137 ceph-mon[35309]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T07:48:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:34 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:34 smithi137 ceph-mon[35309]: from='osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:48:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:34 smithi137 ceph-mon[35309]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-19T07:48:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 -- 172.21.15.76:0/1391505903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084101d90 msgr2=0x7f3084102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 --2- 172.21.15.76:0/1391505903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084101d90 0x7f3084102210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3078009900 tx=0x7f307802a410 comp rx=0 tx=0).stop 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 -- 172.21.15.76:0/1391505903 shutdown_connections 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 --2- 172.21.15.76:0/1391505903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084102750 0x7f3084108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 --2- 172.21.15.76:0/1391505903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084101d90 0x7f3084102210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 --2- 172.21.15.76:0/1391505903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3084101070 0x7f3084101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 -- 172.21.15.76:0/1391505903 >> 172.21.15.76:0/1391505903 conn(0x7f30840fba80 msgr2=0x7f30840fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 -- 172.21.15.76:0/1391505903 shutdown_connections 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.276+0000 7f3089b1f640 1 -- 172.21.15.76:0/1391505903 wait complete. 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 Processor -- start 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 -- start start 2024-09-19T07:48:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084101070 0x7f3084197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3084101d90 0x7f3084198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 0x7f308419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f308410c8d0 con 0x7f3084102750 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f308410c750 con 0x7f3084101070 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3089b1f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f308410ca50 con 0x7f3084101d90 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3083fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 0x7f308419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3083fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 0x7f308419f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60714/0 (socket says 172.21.15.76:60714) 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3083fff640 1 -- 172.21.15.76:0/3567818615 learned_addr learned my addr 172.21.15.76:0/3567818615 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.277+0000 7f3082ffd640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3084101d90 0x7f3084198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f30837fe640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084101070 0x7f3084197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3083fff640 1 -- 172.21.15.76:0/3567818615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3084101d90 msgr2=0x7f3084198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3083fff640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3084101d90 0x7f3084198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3083fff640 1 -- 172.21.15.76:0/3567818615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084101070 msgr2=0x7f3084197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3083fff640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084101070 0x7f3084197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3083fff640 1 -- 172.21.15.76:0/3567818615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308419fc10 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3083fff640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 0x7f308419f5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f307c00eaa0 tx=0x7f307c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c00cdb0 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f307c004b20 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308419ff00 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c011760 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.278+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30841a0360 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.279+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30841a05f0 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.280+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f307c011900 con 0x7f3084102750 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.281+0000 7f3080ff9640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f306c0a3270 0x7f306c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.281+0000 7f30837fe640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f306c0a3270 0x7f306c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.281+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f307c0cf870 con 0x7f3084102750 2024-09-19T07:48:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.281+0000 7f30837fe640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f306c0a3270 0x7f306c0a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3074005fd0 tx=0x7f307400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.284+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f307c016030 con 0x7f3084102750 2024-09-19T07:48:35.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.454+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f30841a07c0 con 0x7f3084102750 2024-09-19T07:48:35.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.454+0000 7f3080ff9640 1 -- 172.21.15.76:0/3567818615 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f307c09c500 con 0x7f3084102750 2024-09-19T07:48:35.455 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f306c0a3270 msgr2=0x7f306c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f306c0a3270 0x7f306c0a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3074005fd0 tx=0x7f307400b390 comp rx=0 tx=0).stop 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 msgr2=0x7f308419f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 0x7f308419f5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f307c00eaa0 tx=0x7f307c00ef60 comp rx=0 tx=0).stop 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 shutdown_connections 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3084102750 0x7f308419f5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3084101d90 0x7f3084198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f306c0a3270 0x7f306c0a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 --2- 172.21.15.76:0/3567818615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084101070 0x7f3084197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:35.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 >> 172.21.15.76:0/3567818615 conn(0x7f30840fba80 msgr2=0x7f30840fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:35.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 shutdown_connections 2024-09-19T07:48:35.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:35.457+0000 7f3089b1f640 1 -- 172.21.15.76:0/3567818615 wait complete. 2024-09-19T07:48:35.560 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T07:48:35.089+0000 7fd6c391e640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T07:48:35.561 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T07:48:35.100+0000 7fd6bb73e640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:48:35.826 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:35.826 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:48:35.826 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:35.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:35.828 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='osd.11 ' entity='osd.11' 2024-09-19T07:48:35.828 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3567818615' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:35.828 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:35 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='osd.11 ' entity='osd.11' 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3567818615' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:36.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:35 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='osd.11 ' entity='osd.11' 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3567818615' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:36.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:35 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:36.255 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726732089,"num_in_osds":12,"osd_in_since":1726732091,"num_remapped_pgs":0} 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: purged_snaps scrub starts 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: purged_snaps scrub ok 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: Detected new or changed devices on smithi152 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] boot 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:48:36.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:36 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: purged_snaps scrub starts 2024-09-19T07:48:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: purged_snaps scrub ok 2024-09-19T07:48:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: Detected new or changed devices on smithi152 2024-09-19T07:48:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-19T07:48:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] boot 2024-09-19T07:48:37.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:48:37.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:36 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: purged_snaps scrub starts 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: purged_snaps scrub ok 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: Detected new or changed devices on smithi152 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: osd.11 [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] boot 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:48:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:36 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:48:37.257 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:48:37.511 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:37.900 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:37 smithi076 ceph-mon[30930]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:37.900 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:37 smithi076 ceph-mon[30930]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:48:38.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 -- 172.21.15.76:0/2746312489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c100ad0 msgr2=0x7f8a1c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 --2- 172.21.15.76:0/2746312489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c100ed0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009900 tx=0x7f8a0c02a410 comp rx=0 tx=0).stop 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 -- 172.21.15.76:0/2746312489 shutdown_connections 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 --2- 172.21.15.76:0/2746312489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c102690 0x7f8a1c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 --2- 172.21.15.76:0/2746312489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 0x7f8a1c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 --2- 172.21.15.76:0/2746312489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c100ed0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 -- 172.21.15.76:0/2746312489 >> 172.21.15.76:0/2746312489 conn(0x7f8a1c0fc280 msgr2=0x7f8a1c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 -- 172.21.15.76:0/2746312489 shutdown_connections 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.977+0000 7f8a21d01640 1 -- 172.21.15.76:0/2746312489 wait complete. 2024-09-19T07:48:38.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 Processor -- start 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 -- start start 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 0x7f8a1c197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 0x7f8a1c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c10c910 con 0x7f8a1c102690 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c10c790 con 0x7f8a1c101cd0 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a21d01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c10ca90 con 0x7f8a1c100ad0 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 0x7f8a1c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.978+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 0x7f8a1c19e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60726/0 (socket says 172.21.15.76:60726) 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 -- 172.21.15.76:0/1642843930 learned_addr learned my addr 172.21.15.76:0/1642843930 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1b7fe640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:38.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 -- 172.21.15.76:0/1642843930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c100ad0 msgr2=0x7f8a1c196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 -- 172.21.15.76:0/1642843930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 msgr2=0x7f8a1c197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1affd640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 0x7f8a1c197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 0x7f8a1c197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 -- 172.21.15.76:0/1642843930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c19eb80 con 0x7f8a1c102690 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1b7fe640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1affd640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 0x7f8a1c197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a1bfff640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 0x7f8a1c19e510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400cad0 tx=0x7f8a1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400ae20 con 0x7f8a1c102690 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1c19ee70 con 0x7f8a1c102690 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a14004b20 con 0x7f8a1c102690 2024-09-19T07:48:38.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400f780 con 0x7f8a1c102690 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.979+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1c19f3a0 con 0x7f8a1c102690 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.980+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1c107e70 con 0x7f8a1c102690 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.981+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8a1400f920 con 0x7f8a1c102690 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.982+0000 7f8a18ff9640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8a040a3270 0x7f8a040a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.982+0000 7f8a1b7fe640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8a040a3270 0x7f8a040a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.982+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f8a140cf930 con 0x7f8a1c102690 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.983+0000 7f8a1b7fe640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8a040a3270 0x7f8a040a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c006010 tx=0x7f8a0c005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:38.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:37.986+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a14014030 con 0x7f8a1c102690 2024-09-19T07:48:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:37 smithi152 ceph-mon[35117]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:37 smithi152 ceph-mon[35117]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:48:38.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.152+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8a1c02da10 con 0x7f8a1c102690 2024-09-19T07:48:38.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.152+0000 7f8a18ff9640 1 -- 172.21.15.76:0/1642843930 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f8a1409ca50 con 0x7f8a1c102690 2024-09-19T07:48:38.153 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:38.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:37 smithi137 ceph-mon[35309]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:48:38.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:37 smithi137 ceph-mon[35309]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:48:38.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8a040a3270 msgr2=0x7f8a040a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:38.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8a040a3270 0x7f8a040a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c006010 tx=0x7f8a0c005be0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 msgr2=0x7f8a1c19e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:38.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 0x7f8a1c19e510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400cad0 tx=0x7f8a1400cf90 comp rx=0 tx=0).stop 2024-09-19T07:48:38.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 shutdown_connections 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8a1c102690 0x7f8a1c19e510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8a040a3270 0x7f8a040a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a1c101cd0 0x7f8a1c197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 --2- 172.21.15.76:0/1642843930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a1c100ad0 0x7f8a1c196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 >> 172.21.15.76:0/1642843930 conn(0x7f8a1c0fc280 msgr2=0x7f8a1c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 shutdown_connections 2024-09-19T07:48:38.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:38.154+0000 7f8a21d01640 1 -- 172.21.15.76:0/1642843930 wait complete. 2024-09-19T07:48:38.697 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:38 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1642843930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:38.880 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726732116,"num_in_osds":12,"osd_in_since":1726732091,"num_remapped_pgs":0} 2024-09-19T07:48:38.881 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:48:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:38 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1642843930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:39.122 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:39.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:38 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1642843930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:48:39.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 -- 172.21.15.76:0/213845727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58100e20 msgr2=0x7f5d58101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/213845727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58100e20 0x7f5d58101200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009900 tx=0x7f5d4802a480 comp rx=0 tx=0).stop 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 -- 172.21.15.76:0/213845727 shutdown_connections 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/213845727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d58102ef0 0x7f5d5810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/213845727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102570 0x7f5d581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/213845727 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58100e20 0x7f5d58101200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.604+0000 7f5d5ec90640 1 -- 172.21.15.76:0/213845727 >> 172.21.15.76:0/213845727 conn(0x7f5d580fc7d0 msgr2=0x7f5d580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 -- 172.21.15.76:0/213845727 shutdown_connections 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 -- 172.21.15.76:0/213845727 wait complete. 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 Processor -- start 2024-09-19T07:48:39.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 -- start start 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d58100e20 0x7f5d581985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 0x7f5d58198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102ef0 0x7f5d5819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581110e0 con 0x7f5d58102570 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58110f60 con 0x7f5d58100e20 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d5ec90640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58111260 con 0x7f5d58102ef0 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d57fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 0x7f5d58198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d57fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 0x7f5d58198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60752/0 (socket says 172.21.15.76:60752) 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.605+0000 7f5d57fff640 1 -- 172.21.15.76:0/296798516 learned_addr learned my addr 172.21.15.76:0/296798516 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d5d22d640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102ef0 0x7f5d5819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:39.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d57fff640 1 -- 172.21.15.76:0/296798516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102ef0 msgr2=0x7f5d5819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d57fff640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102ef0 0x7f5d5819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d57fff640 1 -- 172.21.15.76:0/296798516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d58100e20 msgr2=0x7f5d581985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d57fff640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d58100e20 0x7f5d581985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d57fff640 1 -- 172.21.15.76:0/296798516 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5819d5a0 con 0x7f5d58102570 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d5d22d640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102ef0 0x7f5d5819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d57fff640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 0x7f5d58198b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00d950 tx=0x7f5d4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c017070 con 0x7f5d58102570 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5819d890 con 0x7f5d58102570 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d4c009c30 con 0x7f5d58102570 2024-09-19T07:48:39.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00f740 con 0x7f5d58102570 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.606+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d581a5170 con 0x7f5d58102570 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.607+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d58101200 con 0x7f5d58102570 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.608+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5d4c010a80 con 0x7f5d58102570 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.609+0000 7f5d55ffb640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d400a3240 0x7f5d400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.609+0000 7f5d5ca2c640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d400a3240 0x7f5d400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.609+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5d4c0cf170 con 0x7f5d58102570 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.610+0000 7f5d5ca2c640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d400a3240 0x7f5d400a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d4802a9a0 tx=0x7f5d48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:39.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.613+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d4c009de0 con 0x7f5d58102570 2024-09-19T07:48:39.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.781+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d581a5370 con 0x7f5d58102570 2024-09-19T07:48:39.782 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:39 smithi076 ceph-mon[30930]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:39.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.782+0000 7f5d55ffb640 1 -- 172.21.15.76:0/296798516 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18493 (secure 0 0 0) 0x7f5d4c09c330 con 0x7f5d58102570 2024-09-19T07:48:39.783 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:39.783 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":77,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:48:37.093803+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:48:39.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d400a3240 msgr2=0x7f5d400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:39.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d400a3240 0x7f5d400a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d4802a9a0 tx=0x7f5d48000bc0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 msgr2=0x7f5d58198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 0x7f5d58198b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00d950 tx=0x7f5d4c00de10 comp rx=0 tx=0).stop 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 shutdown_connections 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58102ef0 0x7f5d5819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d58102570 0x7f5d58198b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d400a3240 0x7f5d400a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 --2- 172.21.15.76:0/296798516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d58100e20 0x7f5d581985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 >> 172.21.15.76:0/296798516 conn(0x7f5d580fc7d0 msgr2=0x7f5d58105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 shutdown_connections 2024-09-19T07:48:39.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:39.785+0000 7f5d5ec90640 1 -- 172.21.15.76:0/296798516 wait complete. 2024-09-19T07:48:40.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:39 smithi152 ceph-mon[35117]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:40.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:39 smithi137 ceph-mon[35309]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:40.588 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:44:46.792310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:48:40.589 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T07:48:40.834 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:40.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:40 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/296798516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:48:40.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:40 smithi076 ceph-mon[30930]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:40 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/296798516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:48:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:40 smithi152 ceph-mon[35117]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:41.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:40 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/296798516' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:48:41.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:40 smithi137 ceph-mon[35309]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:41.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 -- 172.21.15.76:0/3078995809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4100a80 msgr2=0x7fe4c4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:41.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3078995809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4100a80 0x7fe4c4100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009930 tx=0x7fe4b802a420 comp rx=0 tx=0).stop 2024-09-19T07:48:41.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 -- 172.21.15.76:0/3078995809 shutdown_connections 2024-09-19T07:48:41.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3078995809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4c4101420 0x7fe4c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3078995809 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4100a80 0x7fe4c4100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3078995809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4c4106a80 0x7fe4c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 -- 172.21.15.76:0/3078995809 >> 172.21.15.76:0/3078995809 conn(0x7fe4c40fc7a0 msgr2=0x7fe4c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 -- 172.21.15.76:0/3078995809 shutdown_connections 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.317+0000 7fe4ca514640 1 -- 172.21.15.76:0/3078995809 wait complete. 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 Processor -- start 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 -- start start 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4c4100a80 0x7fe4c4197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 0x7fe4c4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4c4106a80 0x7fe4c419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4110fa0 con 0x7fe4c4101420 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4110e20 con 0x7fe4c4106a80 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.318+0000 7fe4ca514640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4111120 con 0x7fe4c4100a80 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 0x7fe4c4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:41.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 0x7fe4c4197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60762/0 (socket says 172.21.15.76:60762) 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 -- 172.21.15.76:0/3363550655 learned_addr learned my addr 172.21.15.76:0/3363550655 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c8ab1640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4c4106a80 0x7fe4c419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c3fff640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4c4100a80 0x7fe4c4197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 -- 172.21.15.76:0/3363550655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4c4100a80 msgr2=0x7fe4c4197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4c4100a80 0x7fe4c4197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 -- 172.21.15.76:0/3363550655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4c4106a80 msgr2=0x7fe4c419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4c4106a80 0x7fe4c419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 -- 172.21.15.76:0/3363550655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c419c3f0 con 0x7fe4c4101420 2024-09-19T07:48:41.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c37fe640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 0x7fe4c4197980 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009230 tx=0x7fe4b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:41.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b803f030 con 0x7fe4c4101420 2024-09-19T07:48:41.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4b8003af0 con 0x7fe4c4101420 2024-09-19T07:48:41.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c419c680 con 0x7fe4c4101420 2024-09-19T07:48:41.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8035070 con 0x7fe4c4101420 2024-09-19T07:48:41.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.319+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c41a3fc0 con 0x7fe4c4101420 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.320+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c4100ee0 con 0x7fe4c4101420 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.321+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe4b8042030 con 0x7fe4c4101420 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.322+0000 7fe4c17fa640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe4ac0a3240 0x7fe4ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.322+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fe4b80efc80 con 0x7fe4c4101420 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.322+0000 7fe4c3fff640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe4ac0a3240 0x7fe4ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.323+0000 7fe4c3fff640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe4ac0a3240 0x7fe4ac0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40058c0 tx=0x7fe4b400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:41.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.326+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4b80f5020 con 0x7fe4c4101420 2024-09-19T07:48:41.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.492+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe4c41a4190 con 0x7fe4c4101420 2024-09-19T07:48:41.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.492+0000 7fe4c17fa640 1 -- 172.21.15.76:0/3363550655 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7fe4b80bc890 con 0x7fe4c4101420 2024-09-19T07:48:41.493 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-09-19T07:48:41.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe4ac0a3240 msgr2=0x7fe4ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:41.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe4ac0a3240 0x7fe4ac0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40058c0 tx=0x7fe4b400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 msgr2=0x7fe4c4197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 0x7fe4c4197980 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009230 tx=0x7fe4b8004270 comp rx=0 tx=0).stop 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 shutdown_connections 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe4ac0a3240 0x7fe4ac0a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4c4106a80 0x7fe4c419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe4c4101420 0x7fe4c4197980 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 --2- 172.21.15.76:0/3363550655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4c4100a80 0x7fe4c4197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 >> 172.21.15.76:0/3363550655 conn(0x7fe4c40fc7a0 msgr2=0x7fe4c40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 shutdown_connections 2024-09-19T07:48:41.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:41.494+0000 7fe4ca514640 1 -- 172.21.15.76:0/3363550655 wait complete. 2024-09-19T07:48:41.865 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:41 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3363550655' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:48:42.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:41 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3363550655' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:48:42.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:41 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3363550655' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:48:42.320 INFO:tasks.cephadm:Adding mds.a on smithi076 2024-09-19T07:48:42.320 INFO:tasks.cephadm:Adding mds.d on smithi076 2024-09-19T07:48:42.320 INFO:tasks.cephadm:Adding mds.g on smithi076 2024-09-19T07:48:42.320 INFO:tasks.cephadm:Adding mds.j on smithi076 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.b on smithi137 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.e on smithi137 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.h on smithi137 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.k on smithi137 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.c on smithi152 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.f on smithi152 2024-09-19T07:48:42.321 INFO:tasks.cephadm:Adding mds.i on smithi152 2024-09-19T07:48:42.322 INFO:tasks.cephadm:Adding mds.l on smithi152 2024-09-19T07:48:42.322 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l' 2024-09-19T07:48:42.583 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:48:42.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:42 smithi076 ceph-mon[30930]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:42.958 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:42 smithi152 ceph-mon[35117]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:43.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 -- 172.21.15.152:0/2501025913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704100ad0 msgr2=0x7fe704100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:43.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 --2- 172.21.15.152:0/2501025913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704100ad0 0x7fe704100ed0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe700009900 tx=0x7fe70002a410 comp rx=0 tx=0).stop 2024-09-19T07:48:43.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 -- 172.21.15.152:0/2501025913 shutdown_connections 2024-09-19T07:48:43.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 --2- 172.21.15.152:0/2501025913 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704102690 0x7fe704108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 --2- 172.21.15.152:0/2501025913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704101cd0 0x7fe704102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 --2- 172.21.15.152:0/2501025913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704100ad0 0x7fe704100ed0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 -- 172.21.15.152:0/2501025913 >> 172.21.15.152:0/2501025913 conn(0x7fe7040fc280 msgr2=0x7fe7040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 -- 172.21.15.152:0/2501025913 shutdown_connections 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.066+0000 7fe70c487640 1 -- 172.21.15.152:0/2501025913 wait complete. 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 Processor -- start 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 -- start start 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704100ad0 0x7fe704196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 0x7fe704197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704102690 0x7fe70419e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe70410c890 con 0x7fe704100ad0 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe70410c710 con 0x7fe704102690 2024-09-19T07:48:43.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.067+0000 7fe70c487640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe70410ca10 con 0x7fe704101cd0 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 0x7fe704197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 0x7fe704197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51290/0 (socket says 172.21.15.152:51290) 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 -- 172.21.15.152:0/3315019356 learned_addr learned my addr 172.21.15.152:0/3315019356 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe70a223640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704100ad0 0x7fe704196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe70aa24640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704102690 0x7fe70419e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 -- 172.21.15.152:0/3315019356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704102690 msgr2=0x7fe70419e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704102690 0x7fe70419e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 -- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704100ad0 msgr2=0x7fe704196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704100ad0 0x7fe704196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 -- 172.21.15.152:0/3315019356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70419eb30 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe70aa24640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704102690 0x7fe70419e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe70a223640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704100ad0 0x7fe704196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe709a22640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 0x7fe704197440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400d770 tx=0x7fe6f400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4017070 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6f4005520 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70419ee20 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4010460 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.068+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70419f2d0 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.069+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe704107ed0 con 0x7fe704101cd0 2024-09-19T07:48:43.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.071+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe6f4004ea0 con 0x7fe704101cd0 2024-09-19T07:48:43.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.071+0000 7fe6fb7fe640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:43.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.071+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fe6f40cef50 con 0x7fe704101cd0 2024-09-19T07:48:43.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.071+0000 7fe70a223640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:43.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.072+0000 7fe70a223640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe700006010 tx=0x7fe700031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:43.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.075+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6f409c110 con 0x7fe704101cd0 2024-09-19T07:48:43.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:42 smithi137 ceph-mon[35309]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:43.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.261+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}) -- 0x7fe7040627f0 con 0x7fe6f00a32f0 2024-09-19T07:48:43.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.269+0000 7fe6fb7fe640 1 -- 172.21.15.152:0/3315019356 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe7040627f0 con 0x7fe6f00a32f0 2024-09-19T07:48:43.269 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mds.all update... 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe6f00a32f0 msgr2=0x7fe6f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe700006010 tx=0x7fe700031640 comp rx=0 tx=0).stop 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 msgr2=0x7fe704197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 0x7fe704197440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400d770 tx=0x7fe6f400dc30 comp rx=0 tx=0).stop 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 shutdown_connections 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fe6f00a32f0 0x7fe6f00a57b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe704102690 0x7fe70419e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe704101cd0 0x7fe704197440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 --2- 172.21.15.152:0/3315019356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe704100ad0 0x7fe704196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 >> 172.21.15.152:0/3315019356 conn(0x7fe7040fc280 msgr2=0x7fe7041050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:43.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 shutdown_connections 2024-09-19T07:48:43.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-19T07:48:43.271+0000 7fe70c487640 1 -- 172.21.15.152:0/3315019356 wait complete. 2024-09-19T07:48:44.009 DEBUG:teuthology.orchestra.run.smithi076:mds.a> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T07:48:44.013 DEBUG:teuthology.orchestra.run.smithi076:mds.d> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T07:48:44.056 DEBUG:teuthology.orchestra.run.smithi076:mds.g> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T07:48:44.101 DEBUG:teuthology.orchestra.run.smithi076:mds.j> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T07:48:44.144 DEBUG:teuthology.orchestra.run.smithi137:mds.b> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T07:48:44.147 DEBUG:teuthology.orchestra.run.smithi137:mds.e> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T07:48:44.190 DEBUG:teuthology.orchestra.run.smithi137:mds.h> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T07:48:44.233 DEBUG:teuthology.orchestra.run.smithi137:mds.k> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T07:48:44.277 DEBUG:teuthology.orchestra.run.smithi152:mds.c> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T07:48:44.280 DEBUG:teuthology.orchestra.run.smithi152:mds.f> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T07:48:44.324 DEBUG:teuthology.orchestra.run.smithi152:mds.i> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T07:48:44.367 DEBUG:teuthology.orchestra.run.smithi152:mds.l> sudo journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T07:48:44.416 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T07:48:44.417 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:48:44.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: Saving service mds.all spec with placement smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:44.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:44 smithi076 ceph-mon[30930]: Deploying daemon mds.l on smithi152 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: Saving service mds.all spec with placement smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:44.453 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:44.454 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:44.454 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:44.454 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:44.454 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:44 smithi152 ceph-mon[35117]: Deploying daemon mds.l on smithi152 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: Saving service mds.all spec with placement smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:44.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:44.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:44.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:44.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:44 smithi137 ceph-mon[35309]: Deploying daemon mds.l on smithi152 2024-09-19T07:48:44.670 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 -- 172.21.15.76:0/2849268546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 msgr2=0x7f33e010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/2849268546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e010bbf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009900 tx=0x7f33d002a480 comp rx=0 tx=0).stop 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 -- 172.21.15.76:0/2849268546 shutdown_connections 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/2849268546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e010c180 0x7f33e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/2849268546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e010bbf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/2849268546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33e0102de0 0x7f33e01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 -- 172.21.15.76:0/2849268546 >> 172.21.15.76:0/2849268546 conn(0x7f33e00fc7a0 msgr2=0x7f33e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:45.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 -- 172.21.15.76:0/2849268546 shutdown_connections 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.141+0000 7f33e7ffd640 1 -- 172.21.15.76:0/2849268546 wait complete. 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 Processor -- start 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 -- start start 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33e0102de0 0x7f33e0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e0198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e010c180 0x7f33e019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0112090 con 0x7f33e0103700 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0111f10 con 0x7f33e010c180 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e7ffd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0112210 con 0x7f33e0102de0 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e0198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e0198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40972/0 (socket says 172.21.15.76:40972) 2024-09-19T07:48:45.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 -- 172.21.15.76:0/3121770968 learned_addr learned my addr 172.21.15.76:0/3121770968 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e659a640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e010c180 0x7f33e019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5d99640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33e0102de0 0x7f33e0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 -- 172.21.15.76:0/3121770968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33e0102de0 msgr2=0x7f33e0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33e0102de0 0x7f33e0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 -- 172.21.15.76:0/3121770968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e010c180 msgr2=0x7f33e019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e010c180 0x7f33e019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 -- 172.21.15.76:0/3121770968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e019d500 con 0x7f33e0103700 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.142+0000 7f33e5598640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e0198a90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f33d0006010 tx=0x7f33d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.143+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d003f030 con 0x7f33e0103700 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.143+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33d0003d00 con 0x7f33e0103700 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.143+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e019d790 con 0x7f33e0103700 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.143+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0035070 con 0x7f33e0103700 2024-09-19T07:48:45.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.143+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e01a50d0 con 0x7f33e0103700 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.144+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e006afd0 con 0x7f33e0103700 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.145+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f33d0042030 con 0x7f33e0103700 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.146+0000 7f33d6ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f33cc0a3240 0x7f33cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.146+0000 7f33e5d99640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f33cc0a3240 0x7f33cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.146+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f33d00ef9d0 con 0x7f33e0103700 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.146+0000 7f33e5d99640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f33cc0a3240 0x7f33cc0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005fd0 tx=0x7f33dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:45.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.150+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33d00bc600 con 0x7f33e0103700 2024-09-19T07:48:45.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.354+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33e0107200 con 0x7f33e0103700 2024-09-19T07:48:45.354 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:45 smithi076 ceph-mon[30930]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:45.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.354+0000 7f33d6ffd640 1 -- 172.21.15.76:0/3121770968 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f33d00c0900 con 0x7f33e0103700 2024-09-19T07:48:45.355 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:45.355 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":1,"btime":"2024-09-19T07:41:37:923548+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T07:48:45.355 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 1 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.357+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f33cc0a3240 msgr2=0x7f33cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.357+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f33cc0a3240 0x7f33cc0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005fd0 tx=0x7f33dc00b390 comp rx=0 tx=0).stop 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.357+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 msgr2=0x7f33e0198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.357+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e0198a90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f33d0006010 tx=0x7f33d00042f0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 shutdown_connections 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f33cc0a3240 0x7f33cc0a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e010c180 0x7f33e019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f33e0103700 0x7f33e0198a90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 --2- 172.21.15.76:0/3121770968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33e0102de0 0x7f33e0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 >> 172.21.15.76:0/3121770968 conn(0x7f33e00fc7a0 msgr2=0x7f33e00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:45.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 shutdown_connections 2024-09-19T07:48:45.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:45.358+0000 7f33e7ffd640 1 -- 172.21.15.76:0/3121770968 wait complete. 2024-09-19T07:48:45.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:45 smithi152 ceph-mon[35117]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:45.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:45 smithi137 ceph-mon[35309]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:46.031 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:45 smithi152 systemd[1]: Starting Ceph mds.l for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:48:46.298 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:46 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3121770968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:46.299 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 podman[64711]: 2024-09-19 07:48:45.933964026 +0000 UTC m=+0.015968701 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:48:46.299 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 podman[64711]: 2024-09-19 07:48:46.03676958 +0000 UTC m=+0.118774282 container create 8ce106d30132fbfd63c860c8dfd936c04d68081680711d91bcbc68bdcfb8c9b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T07:48:46.299 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 podman[64711]: 2024-09-19 07:48:46.273209722 +0000 UTC m=+0.355214380 container init 8ce106d30132fbfd63c860c8dfd936c04d68081680711d91bcbc68bdcfb8c9b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:48:46.299 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 podman[64711]: 2024-09-19 07:48:46.276042086 +0000 UTC m=+0.358046749 container start 8ce106d30132fbfd63c860c8dfd936c04d68081680711d91bcbc68bdcfb8c9b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T07:48:46.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:46 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3121770968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:46.561 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 ceph-mds[64730]: -- 172.21.15.152:0/3414983129 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556135d3b860 con 0x556135d19000 2024-09-19T07:48:46.561 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l[64726]: starting mds.l at 2024-09-19T07:48:46.561 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 bash[64711]: 8ce106d30132fbfd63c860c8dfd936c04d68081680711d91bcbc68bdcfb8c9b9 2024-09-19T07:48:46.561 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 07:48:46 smithi152 systemd[1]: Started Ceph mds.l for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:48:46.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:46 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3121770968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:47.545 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6832/4080590897,v1:172.21.15.152:6833/4080590897] up:boot 2024-09-19T07:48:47.545 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: fsmap 1 up:standby 2024-09-19T07:48:47.545 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:48:47.545 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.545 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.546 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.546 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:47.546 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:47.546 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:47.546 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: Deploying daemon mds.k on smithi137 2024-09-19T07:48:47.546 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:47 smithi137 ceph-mon[35309]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:47.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6832/4080590897,v1:172.21.15.152:6833/4080590897] up:boot 2024-09-19T07:48:47.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: fsmap 1 up:standby 2024-09-19T07:48:47.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:48:47.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:47.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:47.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:47.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: Deploying daemon mds.k on smithi137 2024-09-19T07:48:47.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:47 smithi152 ceph-mon[35117]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6832/4080590897,v1:172.21.15.152:6833/4080590897] up:boot 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: fsmap 1 up:standby 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:47.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:47.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: Deploying daemon mds.k on smithi137 2024-09-19T07:48:47.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:47 smithi076 ceph-mon[30930]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:48.133 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:48:48.397 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:48.610 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 systemd[1]: Starting Ceph mds.k for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:48:48.868 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 podman[64400]: 2024-09-19 07:48:48.513133688 +0000 UTC m=+0.016309834 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:48:48.868 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 podman[64400]: 2024-09-19 07:48:48.624110743 +0000 UTC m=+0.127286880 container create 2c6a50bb65eeb168b7c687f9a08ee9f368a6b90c2435213ccc0f08ececd1831a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T07:48:48.869 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 podman[64400]: 2024-09-19 07:48:48.868455218 +0000 UTC m=+0.371631356 container init 2c6a50bb65eeb168b7c687f9a08ee9f368a6b90c2435213ccc0f08ececd1831a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:48:48.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 -- 172.21.15.76:0/4288686326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c102790 msgr2=0x7f416c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 --2- 172.21.15.76:0/4288686326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c102790 0x7f416c1067e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4160009900 tx=0x7f416002a410 comp rx=0 tx=0).stop 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 -- 172.21.15.76:0/4288686326 shutdown_connections 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 --2- 172.21.15.76:0/4288686326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f416c106f10 0x7f416c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 --2- 172.21.15.76:0/4288686326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c102790 0x7f416c1067e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 --2- 172.21.15.76:0/4288686326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f416c101de0 0x7f416c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 -- 172.21.15.76:0/4288686326 >> 172.21.15.76:0/4288686326 conn(0x7f416c0fd8c0 msgr2=0x7f416c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 -- 172.21.15.76:0/4288686326 shutdown_connections 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 -- 172.21.15.76:0/4288686326 wait complete. 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 Processor -- start 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.944+0000 7f4174189640 1 -- start start 2024-09-19T07:48:48.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4174189640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 0x7f416c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4174189640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f416c102790 0x7f416c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4174189640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f416c106f10 0x7f416c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4174189640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f416c112090 con 0x7f416c101de0 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4174189640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f416c111f10 con 0x7f416c102790 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4174189640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f416c112210 con 0x7f416c106f10 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 0x7f416c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 0x7f416c1984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40982/0 (socket says 172.21.15.76:40982) 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 -- 172.21.15.76:0/1849898368 learned_addr learned my addr 172.21.15.76:0/1849898368 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4172726640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f416c106f10 0x7f416c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171724640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f416c102790 0x7f416c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 -- 172.21.15.76:0/1849898368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f416c106f10 msgr2=0x7f416c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:48.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f416c106f10 0x7f416c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 -- 172.21.15.76:0/1849898368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f416c102790 msgr2=0x7f416c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f416c102790 0x7f416c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 -- 172.21.15.76:0/1849898368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c19d480 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f4171f25640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 0x7f416c1984d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f416800e9f0 tx=0x7f416800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416800cd80 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.945+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4168010930 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.946+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c19d770 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.946+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168018b00 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.946+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a5050 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.947+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c1021c0 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.948+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4168018ca0 con 0x7f416c101de0 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.949+0000 7f415effd640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f41580a32c0 0x7f41580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:48.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.949+0000 7f4171724640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f41580a32c0 0x7f41580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:48.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.949+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f41680cf840 con 0x7f416c101de0 2024-09-19T07:48:48.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.949+0000 7f4171724640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f41580a32c0 0x7f41580a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f416c0fdce0 tx=0x7f4160005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:48.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:48.953+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f416809ca00 con 0x7f416c101de0 2024-09-19T07:48:49.154 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 podman[64400]: 2024-09-19 07:48:48.871523735 +0000 UTC m=+0.374699874 container start 2c6a50bb65eeb168b7c687f9a08ee9f368a6b90c2435213ccc0f08ececd1831a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T07:48:49.155 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 ceph-mds[64419]: -- 172.21.15.137:0/4101912230 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556504fd3860 con 0x556504fb1400 2024-09-19T07:48:49.155 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k[64415]: starting mds.k at 2024-09-19T07:48:49.155 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 bash[64400]: 2c6a50bb65eeb168b7c687f9a08ee9f368a6b90c2435213ccc0f08ececd1831a 2024-09-19T07:48:49.155 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 07:48:48 smithi137 systemd[1]: Started Ceph mds.k for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:48:49.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.167+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f416c10a0f0 con 0x7f416c101de0 2024-09-19T07:48:49.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.168+0000 7f415effd640 1 -- 172.21.15.76:0/1849898368 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f416809c300 con 0x7f416c101de0 2024-09-19T07:48:49.169 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:49.169 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":2,"btime":"2024-09-19T07:48:46:304255+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:48:49.169 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 2 2024-09-19T07:48:49.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f41580a32c0 msgr2=0x7f41580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:49.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f41580a32c0 0x7f41580a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f416c0fdce0 tx=0x7f4160005a20 comp rx=0 tx=0).stop 2024-09-19T07:48:49.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 msgr2=0x7f416c1984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 0x7f416c1984d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f416800e9f0 tx=0x7f416800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 shutdown_connections 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f416c106f10 0x7f416c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f41580a32c0 0x7f41580a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f416c102790 0x7f416c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 --2- 172.21.15.76:0/1849898368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f416c101de0 0x7f416c1984d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 >> 172.21.15.76:0/1849898368 conn(0x7f416c0fd8c0 msgr2=0x7f416c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 shutdown_connections 2024-09-19T07:48:49.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:49.171+0000 7f4174189640 1 -- 172.21.15.76:0/1849898368 wait complete. 2024-09-19T07:48:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:49.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:49.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:49 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1849898368' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:49.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:49.936 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:49.937 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:49.937 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:49.937 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:49.937 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:49.937 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:49.937 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:49 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1849898368' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:49 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1849898368' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:50 smithi137 ceph-mon[35309]: Deploying daemon mds.j on smithi076 2024-09-19T07:48:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:50 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6832/4027949156,v1:172.21.15.137:6833/4027949156] up:boot 2024-09-19T07:48:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:50 smithi137 ceph-mon[35309]: fsmap 2 up:standby 2024-09-19T07:48:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:50 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:48:50.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:50 smithi076 ceph-mon[30930]: Deploying daemon mds.j on smithi076 2024-09-19T07:48:50.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:50 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6832/4027949156,v1:172.21.15.137:6833/4027949156] up:boot 2024-09-19T07:48:50.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:50 smithi076 ceph-mon[30930]: fsmap 2 up:standby 2024-09-19T07:48:50.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:50 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:48:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:50 smithi152 ceph-mon[35117]: Deploying daemon mds.j on smithi076 2024-09-19T07:48:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:50 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6832/4027949156,v1:172.21.15.137:6833/4027949156] up:boot 2024-09-19T07:48:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:50 smithi152 ceph-mon[35117]: fsmap 2 up:standby 2024-09-19T07:48:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:50 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:48:51.860 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:51 smithi076 ceph-mon[30930]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:51.967 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:48:52.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:51 smithi152 ceph-mon[35117]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:52.111 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 07:48:52 smithi076 ceph-mds[70911]: -- 172.21.15.76:0/3644150274 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557162771860 con 0x55716274f400 2024-09-19T07:48:52.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:51 smithi137 ceph-mon[35309]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:52.253 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:52.376 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 07:48:52 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j[70903]: starting mds.j at 2024-09-19T07:48:52.377 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 07:48:52 smithi076 bash[70874]: fbf07994bb88e537c5caeee770e16f90141426b4d2e3554ccf6189e4662ef2d2 2024-09-19T07:48:52.377 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 07:48:52 smithi076 systemd[1]: Started Ceph mds.j for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:48:52.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 -- 172.21.15.76:0/3318566445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60101450 msgr2=0x7f8b60105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:52.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 --2- 172.21.15.76:0/3318566445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60101450 0x7f8b60105920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009900 tx=0x7f8b5002a470 comp rx=0 tx=0).stop 2024-09-19T07:48:52.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 -- 172.21.15.76:0/3318566445 shutdown_connections 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 --2- 172.21.15.76:0/3318566445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b60105f40 0x7f8b601063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 --2- 172.21.15.76:0/3318566445 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60101450 0x7f8b60105920 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 --2- 172.21.15.76:0/3318566445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b60100b30 0x7f8b60100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 -- 172.21.15.76:0/3318566445 >> 172.21.15.76:0/3318566445 conn(0x7f8b600fc7a0 msgr2=0x7f8b600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 -- 172.21.15.76:0/3318566445 shutdown_connections 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.746+0000 7f8b68218640 1 -- 172.21.15.76:0/3318566445 wait complete. 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 Processor -- start 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 -- start start 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b60100b30 0x7f8b601a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b60101450 0x7f8b601a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 0x7f8b6019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:52.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b601186a0 con 0x7f8b60105f40 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b60118520 con 0x7f8b60100b30 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b68218640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b60118820 con 0x7f8b60101450 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b667b5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 0x7f8b6019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b667b5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 0x7f8b6019e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41018/0 (socket says 172.21.15.76:41018) 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b667b5640 1 -- 172.21.15.76:0/2881928967 learned_addr learned my addr 172.21.15.76:0/2881928967 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b65fb4640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b60100b30 0x7f8b601a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.747+0000 7f8b657b3640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b60101450 0x7f8b601a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b667b5640 1 -- 172.21.15.76:0/2881928967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b60101450 msgr2=0x7f8b601a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b667b5640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b60101450 0x7f8b601a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b667b5640 1 -- 172.21.15.76:0/2881928967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b60100b30 msgr2=0x7f8b601a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b667b5640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b60100b30 0x7f8b601a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b667b5640 1 -- 172.21.15.76:0/2881928967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6019f0c0 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b667b5640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 0x7f8b6019e990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800eaa0 tx=0x7f8b5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800cdb0 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6019f3b0 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b58004b20 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58011760 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.748+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b601ab6a0 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.749+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b60105920 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.750+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8b58011900 con 0x7f8b60105f40 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.751+0000 7f8b56ffd640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.751+0000 7f8b65fb4640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:52.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.751+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f8b580cf960 con 0x7f8b60105f40 2024-09-19T07:48:52.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.751+0000 7f8b65fb4640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b6019fad0 tx=0x7f8b5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:52.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.754+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b58016030 con 0x7f8b60105f40 2024-09-19T07:48:52.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.967+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b6019fec0 con 0x7f8b60105f40 2024-09-19T07:48:52.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.967+0000 7f8b56ffd640 1 -- 172.21.15.76:0/2881928967 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f8b6019fec0 con 0x7f8b60105f40 2024-09-19T07:48:52.967 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:52.968 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":4,"btime":"2024-09-19T07:48:52:664379+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:48:52.968 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 4 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.969+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8b4c0a3240 msgr2=0x7f8b4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.969+0000 7f8b68218640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b6019fad0 tx=0x7f8b5c00b390 comp rx=0 tx=0).stop 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.969+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 msgr2=0x7f8b6019e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.969+0000 7f8b68218640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 0x7f8b6019e990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800eaa0 tx=0x7f8b5800ef60 comp rx=0 tx=0).stop 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 shutdown_connections 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b60105f40 0x7f8b6019e990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b60101450 0x7f8b601a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 --2- 172.21.15.76:0/2881928967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b60100b30 0x7f8b601a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 >> 172.21.15.76:0/2881928967 conn(0x7f8b600fc7a0 msgr2=0x7f8b601038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:52.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 shutdown_connections 2024-09-19T07:48:52.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:52.970+0000 7f8b68218640 1 -- 172.21.15.76:0/2881928967 wait complete. 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: Deploying daemon mds.d on smithi076 2024-09-19T07:48:53.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:53.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.76:6834/1242982400,v1:172.21.15.76:6835/1242982400] up:boot 2024-09-19T07:48:53.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: fsmap 3 up:standby 2024-09-19T07:48:53.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:48:53.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:53 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2881928967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: Deploying daemon mds.d on smithi076 2024-09-19T07:48:53.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:53.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.76:6834/1242982400,v1:172.21.15.76:6835/1242982400] up:boot 2024-09-19T07:48:53.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: fsmap 3 up:standby 2024-09-19T07:48:53.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:48:53.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:53 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2881928967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:53.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: Deploying daemon mds.d on smithi076 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.76:6834/1242982400,v1:172.21.15.76:6835/1242982400] up:boot 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: fsmap 3 up:standby 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:48:53.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:53 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2881928967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:55.444 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 systemd[1]: Starting Ceph mds.d for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:48:55.800 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:55 smithi076 ceph-mon[30930]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:55.801 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 podman[71285]: 2024-09-19 07:48:55.432250611 +0000 UTC m=+0.015920119 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:48:55.801 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 podman[71285]: 2024-09-19 07:48:55.540271257 +0000 UTC m=+0.123940793 container create 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:48:55.801 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 podman[71285]: 2024-09-19 07:48:55.801698077 +0000 UTC m=+0.385367578 container init 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:48:55.860 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:48:55.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:55 smithi137 ceph-mon[35309]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:55 smithi152 ceph-mon[35117]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:56.125 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:56.194 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 podman[71285]: 2024-09-19 07:48:55.80471346 +0000 UTC m=+0.388382964 container start 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:48:56.194 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 ceph-mds[71304]: -- 172.21.15.76:0/3790257807 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55558428b860 con 0x555584269000 2024-09-19T07:48:56.194 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d[71300]: starting mds.d at 2024-09-19T07:48:56.194 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 bash[71285]: 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 2024-09-19T07:48:56.194 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 07:48:55 smithi076 systemd[1]: Started Ceph mds.d for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 -- 172.21.15.76:0/2969628656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb58106f20 msgr2=0x7fbb5810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/2969628656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb58106f20 0x7fbb5810eaa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb5002a410 comp rx=0 tx=0).stop 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 -- 172.21.15.76:0/2969628656 shutdown_connections 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/2969628656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb58106f20 0x7fbb5810eaa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/2969628656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb581027a0 0x7fbb581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/2969628656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb58101df0 0x7fbb581021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 -- 172.21.15.76:0/2969628656 >> 172.21.15.76:0/2969628656 conn(0x7fbb580fd8f0 msgr2=0x7fbb580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 -- 172.21.15.76:0/2969628656 shutdown_connections 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 -- 172.21.15.76:0/2969628656 wait complete. 2024-09-19T07:48:56.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.644+0000 7fbb5eee8640 1 Processor -- start 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 -- start start 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb58101df0 0x7fbb58198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 0x7fbb58198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb58106f20 0x7fbb5819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581120e0 con 0x7fbb581027a0 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58111f60 con 0x7fbb58101df0 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5eee8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58112260 con 0x7fbb58106f20 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 0x7fbb58198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5cc84640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb58101df0 0x7fbb58198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 0x7fbb58198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44196/0 (socket says 172.21.15.76:44196) 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 -- 172.21.15.76:0/1847759938 learned_addr learned my addr 172.21.15.76:0/1847759938 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:48:56.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb5d485640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb58106f20 0x7fbb5819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 -- 172.21.15.76:0/1847759938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb58106f20 msgr2=0x7fbb5819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb58106f20 0x7fbb5819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 -- 172.21.15.76:0/1847759938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb58101df0 msgr2=0x7fbb58198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb58101df0 0x7fbb58198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 -- 172.21.15.76:0/1847759938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5819d4b0 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.645+0000 7fbb57fff640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 0x7fbb58198a40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000b4a0 tx=0x7fbb4000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.646+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40014070 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.646+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5819d7a0 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.646+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb40010b10 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.646+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40017d60 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.646+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb581a5080 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.647+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb581021d0 con 0x7fbb581027a0 2024-09-19T07:48:56.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.648+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb40017070 con 0x7fbb581027a0 2024-09-19T07:48:56.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.648+0000 7fbb55ffb640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbb440a3240 0x7fbb440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:48:56.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.649+0000 7fbb5cc84640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbb440a3240 0x7fbb440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:48:56.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.649+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fbb400ce880 con 0x7fbb581027a0 2024-09-19T07:48:56.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.649+0000 7fbb5cc84640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbb440a3240 0x7fbb440a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb48005fd0 tx=0x7fbb48009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:48:56.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.653+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb4009ba40 con 0x7fbb581027a0 2024-09-19T07:48:56.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.858+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb5810a160 con 0x7fbb581027a0 2024-09-19T07:48:56.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.858+0000 7fbb55ffb640 1 -- 172.21.15.76:0/1847759938 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fbb4009b340 con 0x7fbb581027a0 2024-09-19T07:48:56.859 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:48:56.859 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":5,"btime":"2024-09-19T07:48:56:654007+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:48:56.859 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 5 2024-09-19T07:48:56.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbb440a3240 msgr2=0x7fbb440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:56.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbb440a3240 0x7fbb440a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb48005fd0 tx=0x7fbb48009680 comp rx=0 tx=0).stop 2024-09-19T07:48:56.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 msgr2=0x7fbb58198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:48:56.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 0x7fbb58198a40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000b4a0 tx=0x7fbb4000b960 comp rx=0 tx=0).stop 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 shutdown_connections 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb58106f20 0x7fbb5819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb581027a0 0x7fbb58198a40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbb440a3240 0x7fbb440a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 --2- 172.21.15.76:0/1847759938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb58101df0 0x7fbb58198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 >> 172.21.15.76:0/1847759938 conn(0x7fbb580fd8f0 msgr2=0x7fbb580fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 shutdown_connections 2024-09-19T07:48:56.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:48:56.861+0000 7fbb5eee8640 1 -- 172.21.15.76:0/1847759938 wait complete. 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: Deploying daemon mds.e on smithi137 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.76:6836/3127929213,v1:172.21.15.76:6837/3127929213] up:boot 2024-09-19T07:48:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: fsmap 4 up:standby 2024-09-19T07:48:57.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:48:57.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:56 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1847759938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:57.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: Deploying daemon mds.e on smithi137 2024-09-19T07:48:57.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:57.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.76:6836/3127929213,v1:172.21.15.76:6837/3127929213] up:boot 2024-09-19T07:48:57.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: fsmap 4 up:standby 2024-09-19T07:48:57.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:48:57.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:56 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1847759938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: Deploying daemon mds.e on smithi137 2024-09-19T07:48:57.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:57.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.76:6836/3127929213,v1:172.21.15.76:6837/3127929213] up:boot 2024-09-19T07:48:57.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: fsmap 4 up:standby 2024-09-19T07:48:57.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:48:57.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:56 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1847759938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:48:58.154 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 systemd[1]: Starting Ceph mds.e for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:48:58.499 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 podman[64718]: 2024-09-19 07:48:58.128863519 +0000 UTC m=+0.016213670 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:48:58.499 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 podman[64718]: 2024-09-19 07:48:58.254728189 +0000 UTC m=+0.142078321 container create c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T07:48:58.499 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 podman[64718]: 2024-09-19 07:48:58.499360316 +0000 UTC m=+0.386710447 container init c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:48:58.904 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 podman[64718]: 2024-09-19 07:48:58.502900421 +0000 UTC m=+0.390250555 container start c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T07:48:58.904 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 ceph-mds[64737]: -- 172.21.15.137:0/3636240539 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b3b4e7860 con 0x559b3b4c4800 2024-09-19T07:48:58.904 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e[64733]: starting mds.e at 2024-09-19T07:48:58.904 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 bash[64718]: c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf 2024-09-19T07:48:58.904 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 07:48:58 smithi137 systemd[1]: Started Ceph mds.e for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:48:59.592 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:48:59.797 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6834/1108325659,v1:172.21.15.137:6835/1108325659] up:boot 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: fsmap 5 up:standby 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:59.798 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:48:59 smithi152 ceph-mon[35117]: Deploying daemon mds.f on smithi152 2024-09-19T07:48:59.862 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6834/1108325659,v1:172.21.15.137:6835/1108325659] up:boot 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: fsmap 5 up:standby 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:59.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:48:59 smithi137 ceph-mon[35309]: Deploying daemon mds.f on smithi152 2024-09-19T07:48:59.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6834/1108325659,v1:172.21.15.137:6835/1108325659] up:boot 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: fsmap 5 up:standby 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:48:59.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:48:59 smithi076 ceph-mon[30930]: Deploying daemon mds.f on smithi152 2024-09-19T07:49:00.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 -- 172.21.15.76:0/4079346090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c01002f0 msgr2=0x7f11c01006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:00.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 --2- 172.21.15.76:0/4079346090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c01002f0 0x7f11c01006d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009890 tx=0x7f11b402a380 comp rx=0 tx=0).stop 2024-09-19T07:49:00.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 -- 172.21.15.76:0/4079346090 shutdown_connections 2024-09-19T07:49:00.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 --2- 172.21.15.76:0/4079346090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 0x7f11c010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 --2- 172.21.15.76:0/4079346090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c0100ca0 0x7f11c0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 --2- 172.21.15.76:0/4079346090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c01002f0 0x7f11c01006d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 -- 172.21.15.76:0/4079346090 >> 172.21.15.76:0/4079346090 conn(0x7f11c0077210 msgr2=0x7f11c00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 -- 172.21.15.76:0/4079346090 shutdown_connections 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.330+0000 7f11c6c61640 1 -- 172.21.15.76:0/4079346090 wait complete. 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 Processor -- start 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 -- start start 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c01002f0 0x7f11c01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 0x7f11c0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 0x7f11c019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f11c01120c0 con 0x7f11c0100ca0 2024-09-19T07:49:00.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0111f40 con 0x7f11c0106f50 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c6c61640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0112240 con 0x7f11c01002f0 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 0x7f11c0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 0x7f11c0198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44218/0 (socket says 172.21.15.76:44218) 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11bffff640 1 -- 172.21.15.76:0/3621441863 learned_addr learned my addr 172.21.15.76:0/3621441863 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c49fd640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c01002f0 0x7f11c01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.331+0000 7f11c51fe640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 0x7f11c019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bffff640 1 -- 172.21.15.76:0/3621441863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c01002f0 msgr2=0x7f11c01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bffff640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c01002f0 0x7f11c01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bffff640 1 -- 172.21.15.76:0/3621441863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 msgr2=0x7f11c019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bffff640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 0x7f11c019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bffff640 1 -- 172.21.15.76:0/3621441863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c019d550 con 0x7f11c0100ca0 2024-09-19T07:49:00.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11c49fd640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c01002f0 0x7f11c01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11c51fe640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 0x7f11c019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bffff640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 0x7f11c0198ae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00e9a0 tx=0x7f11ac00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00cd80 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11ac0035f0 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c019d840 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac010700 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.332+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01a5120 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.333+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c01006d0 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.334+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f11ac0037a0 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.335+0000 7f11bdffb640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f11b00a3240 0x7f11b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.335+0000 7f11c49fd640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f11b00a3240 0x7f11b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.335+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f11ac0cf810 con 0x7f11c0100ca0 2024-09-19T07:49:00.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.335+0000 7f11c49fd640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f11b00a3240 0x7f11b00a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097b0 tx=0x7f11b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:00.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.339+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11ac09c9d0 con 0x7f11c0100ca0 2024-09-19T07:49:00.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.546+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c002d7c0 con 0x7f11c0100ca0 2024-09-19T07:49:00.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.547+0000 7f11bdffb640 1 -- 172.21.15.76:0/3621441863 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f11ac09c2d0 con 0x7f11c0100ca0 2024-09-19T07:49:00.548 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:00.548 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":6,"btime":"2024-09-19T07:48:58:581549+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:49:00.548 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 6 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.549+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f11b00a3240 msgr2=0x7f11b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.549+0000 7f11c6c61640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f11b00a3240 0x7f11b00a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f11b40097b0 tx=0x7f11b40058d0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.549+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 msgr2=0x7f11c0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.549+0000 7f11c6c61640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 0x7f11c0198ae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00e9a0 tx=0x7f11ac00ee60 comp rx=0 tx=0).stop 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.549+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 shutdown_connections 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f11b00a3240 0x7f11b00a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11c0106f50 0x7f11c019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11c0100ca0 0x7f11c0198ae0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 --2- 172.21.15.76:0/3621441863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11c01002f0 0x7f11c01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:00.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 >> 172.21.15.76:0/3621441863 conn(0x7f11c0077210 msgr2=0x7f11c0105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:00.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 shutdown_connections 2024-09-19T07:49:00.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:00.550+0000 7f11c6c61640 1 -- 172.21.15.76:0/3621441863 wait complete. 2024-09-19T07:49:00.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:00 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3621441863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:00.812 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:00 smithi152 systemd[1]: Starting Ceph mds.f for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:49:00.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:00 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3621441863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:00.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:00 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3621441863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:01.095 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:00 smithi152 podman[65013]: 2024-09-19 07:49:00.728341771 +0000 UTC m=+0.016120768 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:49:01.096 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:00 smithi152 podman[65013]: 2024-09-19 07:49:00.851676429 +0000 UTC m=+0.139455420 container create d14f998bad9fa215786ccfe8b81b146a40e5b839015fd34faca542f07338a2fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T07:49:01.096 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:01 smithi152 podman[65013]: 2024-09-19 07:49:01.096226014 +0000 UTC m=+0.384005002 container init d14f998bad9fa215786ccfe8b81b146a40e5b839015fd34faca542f07338a2fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T07:49:01.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:01 smithi152 podman[65013]: 2024-09-19 07:49:01.099126575 +0000 UTC m=+0.386905569 container start d14f998bad9fa215786ccfe8b81b146a40e5b839015fd34faca542f07338a2fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:49:01.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mds[65032]: -- 172.21.15.152:0/806382939 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560da0f49860 con 0x560da0f27000 2024-09-19T07:49:01.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f[65028]: starting mds.f at 2024-09-19T07:49:01.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:01 smithi152 bash[65013]: d14f998bad9fa215786ccfe8b81b146a40e5b839015fd34faca542f07338a2fc 2024-09-19T07:49:01.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 07:49:01 smithi152 systemd[1]: Started Ceph mds.f for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:01.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:01 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:01.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:01 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:01.949 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:01.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:01.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:01.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:01.950 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:01 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:02.746 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:02 smithi152 ceph-mon[35117]: Deploying daemon mds.c on smithi152 2024-09-19T07:49:02.746 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:02 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6834/266318645,v1:172.21.15.152:6835/266318645] up:boot 2024-09-19T07:49:02.747 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:02 smithi152 ceph-mon[35117]: fsmap 6 up:standby 2024-09-19T07:49:02.747 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:02 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:49:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:02 smithi137 ceph-mon[35309]: Deploying daemon mds.c on smithi152 2024-09-19T07:49:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:02 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6834/266318645,v1:172.21.15.152:6835/266318645] up:boot 2024-09-19T07:49:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:02 smithi137 ceph-mon[35309]: fsmap 6 up:standby 2024-09-19T07:49:02.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:02 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:49:02.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:02 smithi076 ceph-mon[30930]: Deploying daemon mds.c on smithi152 2024-09-19T07:49:02.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:02 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6834/266318645,v1:172.21.15.152:6835/266318645] up:boot 2024-09-19T07:49:02.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:02 smithi076 ceph-mon[30930]: fsmap 6 up:standby 2024-09-19T07:49:02.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:02 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:49:03.224 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:49:03.311 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 systemd[1]: Starting Ceph mds.c for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:49:03.495 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:03.702 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:03 smithi152 ceph-mon[35117]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:03.703 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 podman[65313]: 2024-09-19 07:49:03.309183845 +0000 UTC m=+0.016091484 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:49:03.703 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 podman[65313]: 2024-09-19 07:49:03.450061962 +0000 UTC m=+0.156969592 container create 650a4bf9e60307ad4bfd36c6c248929f095f1c3ebea20505ad4b6722d7f22e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T07:49:03.703 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 podman[65313]: 2024-09-19 07:49:03.703143832 +0000 UTC m=+0.410051461 container init 650a4bf9e60307ad4bfd36c6c248929f095f1c3ebea20505ad4b6722d7f22e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T07:49:03.866 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:03 smithi076 ceph-mon[30930]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:03.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:03 smithi137 ceph-mon[35309]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:03.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 -- 172.21.15.76:0/753019376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0101de0 msgr2=0x7fa3f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 --2- 172.21.15.76:0/753019376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0101de0 0x7fa3f01021c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009900 tx=0x7fa3e002a410 comp rx=0 tx=0).stop 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 -- 172.21.15.76:0/753019376 shutdown_connections 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 --2- 172.21.15.76:0/753019376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3f0106f10 0x7fa3f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 --2- 172.21.15.76:0/753019376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3f0102790 0x7fa3f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 --2- 172.21.15.76:0/753019376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0101de0 0x7fa3f01021c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 -- 172.21.15.76:0/753019376 >> 172.21.15.76:0/753019376 conn(0x7fa3f00fd8c0 msgr2=0x7fa3f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 -- 172.21.15.76:0/753019376 shutdown_connections 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.948+0000 7fa3f586b640 1 -- 172.21.15.76:0/753019376 wait complete. 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 Processor -- start 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 -- start start 2024-09-19T07:49:03.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3f0101de0 0x7fa3f0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3f0102790 0x7fa3f0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 0x7fa3f019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112050 con 0x7fa3f0106f10 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0111ed0 con 0x7fa3f0102790 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3f586b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f01121d0 con 0x7fa3f0101de0 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 0x7fa3f019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 0x7fa3f019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33430/0 (socket says 172.21.15.76:33430) 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 -- 172.21.15.76:0/856231118 learned_addr learned my addr 172.21.15.76:0/856231118 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3e7fff640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3f0102790 0x7fa3f0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3eeffd640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3f0101de0 0x7fa3f0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 -- 172.21.15.76:0/856231118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3f0101de0 msgr2=0x7fa3f0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3f0101de0 0x7fa3f0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:03.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 -- 172.21.15.76:0/856231118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3f0102790 msgr2=0x7fa3f0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3f0102790 0x7fa3f0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 -- 172.21.15.76:0/856231118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f019d540 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.949+0000 7fa3ef7fe640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 0x7fa3f019ce60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800cad0 tx=0x7fa3e800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.950+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800ae20 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.950+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f019d830 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.950+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa3e8004b20 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.950+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800f780 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.950+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f01a5110 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.951+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f01021c0 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.952+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa3e800f980 con 0x7fa3f0106f10 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.952+0000 7fa3f4869640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa3dc0a3240 0x7fa3dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:03.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.953+0000 7fa3eeffd640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa3dc0a3240 0x7fa3dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:03.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.953+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fa3e80cf820 con 0x7fa3f0106f10 2024-09-19T07:49:03.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.953+0000 7fa3eeffd640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa3dc0a3240 0x7fa3dc0a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0005ab0 tx=0x7fa3e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:03.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:03.956+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3e8014030 con 0x7fa3f0106f10 2024-09-19T07:49:04.061 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 podman[65313]: 2024-09-19 07:49:03.706352867 +0000 UTC m=+0.413260497 container start 650a4bf9e60307ad4bfd36c6c248929f095f1c3ebea20505ad4b6722d7f22e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T07:49:04.061 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 ceph-mds[65332]: -- 172.21.15.152:0/1827212762 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b6d77d1c20 con 0x55b6d77ae800 2024-09-19T07:49:04.061 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c[65328]: starting mds.c at 2024-09-19T07:49:04.061 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 bash[65313]: 650a4bf9e60307ad4bfd36c6c248929f095f1c3ebea20505ad4b6722d7f22e3e 2024-09-19T07:49:04.061 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 07:49:03 smithi152 systemd[1]: Started Ceph mds.c for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:04.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.155+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f010a150 con 0x7fa3f0106f10 2024-09-19T07:49:04.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.155+0000 7fa3f4869640 1 -- 172.21.15.76:0/856231118 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7fa3e809c9e0 con 0x7fa3f0106f10 2024-09-19T07:49:04.156 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:04.156 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":7,"btime":"2024-09-19T07:49:01:590355+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T07:49:04.156 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 7 2024-09-19T07:49:04.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa3dc0a3240 msgr2=0x7fa3dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa3dc0a3240 0x7fa3dc0a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0005ab0 tx=0x7fa3e0005a20 comp rx=0 tx=0).stop 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 msgr2=0x7fa3f019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 0x7fa3f019ce60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800cad0 tx=0x7fa3e800cf90 comp rx=0 tx=0).stop 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 shutdown_connections 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa3f0106f10 0x7fa3f019ce60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa3dc0a3240 0x7fa3dc0a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3f0102790 0x7fa3f0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 --2- 172.21.15.76:0/856231118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3f0101de0 0x7fa3f0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 >> 172.21.15.76:0/856231118 conn(0x7fa3f00fd8c0 msgr2=0x7fa3f00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 shutdown_connections 2024-09-19T07:49:04.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:04.157+0000 7fa3f586b640 1 -- 172.21.15.76:0/856231118 wait complete. 2024-09-19T07:49:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:04.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:04.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:04.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:04.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:04.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:04.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: Deploying daemon mds.h on smithi137 2024-09-19T07:49:04.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/856231118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:04.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:04.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] up:boot 2024-09-19T07:49:04.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: fsmap 7 up:standby 2024-09-19T07:49:04.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:04 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:49:04.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: Deploying daemon mds.h on smithi137 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/856231118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] up:boot 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: fsmap 7 up:standby 2024-09-19T07:49:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:04 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: Deploying daemon mds.h on smithi137 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/856231118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:05.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] up:boot 2024-09-19T07:49:05.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: fsmap 7 up:standby 2024-09-19T07:49:05.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:04 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:49:05.904 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:05 smithi137 systemd[1]: Starting Ceph mds.h for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:49:06.313 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 podman[65020]: 2024-09-19 07:49:05.93168991 +0000 UTC m=+0.015867795 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:49:06.313 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 podman[65020]: 2024-09-19 07:49:06.060605189 +0000 UTC m=+0.144783063 container create 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:49:06.313 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 podman[65020]: 2024-09-19 07:49:06.313550921 +0000 UTC m=+0.397728796 container init 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:49:06.654 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 podman[65020]: 2024-09-19 07:49:06.316618335 +0000 UTC m=+0.400796211 container start 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T07:49:06.654 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 ceph-mds[65039]: -- 172.21.15.137:0/1492434829 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a65e3cd860 con 0x55a65e3aa800 2024-09-19T07:49:06.654 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h[65035]: starting mds.h at 2024-09-19T07:49:06.654 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 bash[65020]: 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da 2024-09-19T07:49:06.654 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 07:49:06 smithi137 systemd[1]: Started Ceph mds.h for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:06.854 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:49:07.111 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:07.475 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6836/1714762912,v1:172.21.15.137:6837/1714762912] up:boot 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: fsmap 8 up:standby 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: Deploying daemon mds.i on smithi152 2024-09-19T07:49:07.476 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:07 smithi076 ceph-mon[30930]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:07.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6836/1714762912,v1:172.21.15.137:6837/1714762912] up:boot 2024-09-19T07:49:07.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: fsmap 8 up:standby 2024-09-19T07:49:07.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:49:07.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: Deploying daemon mds.i on smithi152 2024-09-19T07:49:07.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:07 smithi152 ceph-mon[35117]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 -- 172.21.15.76:0/291161426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c100a80 msgr2=0x7f0d7c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 --2- 172.21.15.76:0/291161426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c100a80 0x7f0d7c100ee0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009cd0 tx=0x7f0d7002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 -- 172.21.15.76:0/291161426 shutdown_connections 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 --2- 172.21.15.76:0/291161426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c101420 0x7f0d7c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 --2- 172.21.15.76:0/291161426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c100a80 0x7f0d7c100ee0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 --2- 172.21.15.76:0/291161426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d7c106a80 0x7f0d7c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 -- 172.21.15.76:0/291161426 >> 172.21.15.76:0/291161426 conn(0x7f0d7c0fc7a0 msgr2=0x7f0d7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 -- 172.21.15.76:0/291161426 shutdown_connections 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.556+0000 7f0d8416f640 1 -- 172.21.15.76:0/291161426 wait complete. 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 Processor -- start 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 -- start start 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d7c100a80 0x7f0d7c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c101420 0x7f0d7c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 0x7f0d7c1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c110fa0 con 0x7f0d7c106a80 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c110e20 con 0x7f0d7c100a80 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8416f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c111120 con 0x7f0d7c101420 2024-09-19T07:49:07.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 0x7f0d7c1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 0x7f0d7c1a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33444/0 (socket says 172.21.15.76:33444) 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 -- 172.21.15.76:0/3232979224 learned_addr learned my addr 172.21.15.76:0/3232979224 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8170a640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c101420 0x7f0d7c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d81f0b640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d7c100a80 0x7f0d7c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 -- 172.21.15.76:0/3232979224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c101420 msgr2=0x7f0d7c1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c101420 0x7f0d7c1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 -- 172.21.15.76:0/3232979224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d7c100a80 msgr2=0x7f0d7c1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d7c100a80 0x7f0d7c1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.557+0000 7f0d8270c640 1 -- 172.21.15.76:0/3232979224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c1a4970 con 0x7f0d7c106a80 2024-09-19T07:49:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.558+0000 7f0d8270c640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 0x7f0d7c1a4430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400d750 tx=0x7f0d7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.558+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74017070 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.558+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d74005520 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.558+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c1a4b40 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.558+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74004e00 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.558+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1a5000 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.559+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c100ee0 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.560+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0d74004fa0 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.560+0000 7f0d7affd640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0d640a32c0 0x7f0d640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.560+0000 7f0d81f0b640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0d640a32c0 0x7f0d640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.561+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f0d740ced50 con 0x7f0d7c106a80 2024-09-19T07:49:07.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.561+0000 7f0d81f0b640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0d640a32c0 0x7f0d640a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00bb60 tx=0x7f0d6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:07.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.565+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d740d2030 con 0x7f0d7c106a80 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6836/1714762912,v1:172.21.15.137:6837/1714762912] up:boot 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: fsmap 8 up:standby 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:07.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:07.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: Deploying daemon mds.i on smithi152 2024-09-19T07:49:07.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:07 smithi137 ceph-mon[35309]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:07.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.768+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d7c108ff0 con 0x7f0d7c106a80 2024-09-19T07:49:07.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.768+0000 7f0d7affd640 1 -- 172.21.15.76:0/3232979224 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f0d7409b8c0 con 0x7f0d7c106a80 2024-09-19T07:49:07.768 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:07.769 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":9,"btime":"2024-09-19T07:49:06:395207+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T07:49:07.769 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 9 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0d640a32c0 msgr2=0x7f0d640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0d640a32c0 0x7f0d640a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00bb60 tx=0x7f0d6c00b390 comp rx=0 tx=0).stop 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 msgr2=0x7f0d7c1a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 0x7f0d7c1a4430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400d750 tx=0x7f0d7400dc10 comp rx=0 tx=0).stop 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 shutdown_connections 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d7c106a80 0x7f0d7c1a4430 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c101420 0x7f0d7c1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0d640a32c0 0x7f0d640a5780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 --2- 172.21.15.76:0/3232979224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d7c100a80 0x7f0d7c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:07.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.770+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 >> 172.21.15.76:0/3232979224 conn(0x7f0d7c0fc7a0 msgr2=0x7f0d7c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:07.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.771+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 shutdown_connections 2024-09-19T07:49:07.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:07.771+0000 7f0d8416f640 1 -- 172.21.15.76:0/3232979224 wait complete. 2024-09-19T07:49:08.487 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 systemd[1]: Starting Ceph mds.i for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:49:08.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:08 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3232979224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:08.811 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 podman[65615]: 2024-09-19 07:49:08.551590338 +0000 UTC m=+0.016124294 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:49:08.812 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 podman[65615]: 2024-09-19 07:49:08.682442467 +0000 UTC m=+0.146976407 container create 7345404ec2922103f229f3f921858911095467fbe09fb40d896df7dba1501d63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T07:49:08.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:08 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3232979224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:08.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:08 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3232979224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:09.311 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 podman[65615]: 2024-09-19 07:49:08.93573308 +0000 UTC m=+0.400267021 container init 7345404ec2922103f229f3f921858911095467fbe09fb40d896df7dba1501d63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:49:09.311 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 podman[65615]: 2024-09-19 07:49:08.938594483 +0000 UTC m=+0.403128425 container start 7345404ec2922103f229f3f921858911095467fbe09fb40d896df7dba1501d63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T07:49:09.311 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 ceph-mds[65634]: -- 172.21.15.152:0/1141327553 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a181e03860 con 0x55a181de1000 2024-09-19T07:49:09.311 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: starting mds.i at 2024-09-19T07:49:09.311 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:09 smithi152 bash[65615]: 7345404ec2922103f229f3f921858911095467fbe09fb40d896df7dba1501d63 2024-09-19T07:49:09.311 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:09 smithi152 systemd[1]: Started Ceph mds.i for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:09.775 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:09.775 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.775 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.775 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.776 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:09.776 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:09.776 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:09 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:09.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:09 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:09.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:09 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:10.417 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:49:10.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:10 smithi076 ceph-mon[30930]: Deploying daemon mds.g on smithi076 2024-09-19T07:49:10.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:10 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] up:boot 2024-09-19T07:49:10.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:10 smithi076 ceph-mon[30930]: fsmap 9 up:standby 2024-09-19T07:49:10.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:10 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:49:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:10.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:10 smithi152 ceph-mon[35117]: Deploying daemon mds.g on smithi076 2024-09-19T07:49:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:10 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] up:boot 2024-09-19T07:49:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:10 smithi152 ceph-mon[35117]: fsmap 9 up:standby 2024-09-19T07:49:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:10 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:49:10.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:10 smithi137 ceph-mon[35309]: Deploying daemon mds.g on smithi076 2024-09-19T07:49:10.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:10 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] up:boot 2024-09-19T07:49:10.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:10 smithi137 ceph-mon[35309]: fsmap 9 up:standby 2024-09-19T07:49:10.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:10 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:49:11.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 -- 172.21.15.76:0/84409792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860100e20 msgr2=0x7fb860101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:11.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 --2- 172.21.15.76:0/84409792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860100e20 0x7fb860101200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009ca0 tx=0x7fb85c02a950 comp rx=0 tx=0).stop 2024-09-19T07:49:11.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 -- 172.21.15.76:0/84409792 shutdown_connections 2024-09-19T07:49:11.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 --2- 172.21.15.76:0/84409792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102ef0 0x7fb86010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 --2- 172.21.15.76:0/84409792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb860102570 0x7fb8601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 --2- 172.21.15.76:0/84409792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860100e20 0x7fb860101200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 -- 172.21.15.76:0/84409792 >> 172.21.15.76:0/84409792 conn(0x7fb8600fc7d0 msgr2=0x7fb8600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 -- 172.21.15.76:0/84409792 shutdown_connections 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.209+0000 7fb867e8b640 1 -- 172.21.15.76:0/84409792 wait complete. 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 Processor -- start 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 -- start start 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb860100e20 0x7fb8601993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102570 0x7fb860199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:11.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 0x7fb8601a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601110a0 con 0x7fb860102ef0 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb860110f20 con 0x7fb860102570 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb867e8b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb860111220 con 0x7fb860100e20 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 0x7fb8601a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 0x7fb8601a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33460/0 (socket says 172.21.15.76:33460) 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 -- 172.21.15.76:0/3225737825 learned_addr learned my addr 172.21.15.76:0/3225737825 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb865426640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102570 0x7fb860199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 -- 172.21.15.76:0/3225737825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb860100e20 msgr2=0x7fb8601993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb865c27640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb860100e20 0x7fb8601993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb860100e20 0x7fb8601993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 -- 172.21.15.76:0/3225737825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102570 msgr2=0x7fb860199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:11.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102570 0x7fb860199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 -- 172.21.15.76:0/3225737825 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8601a49b0 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb865426640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102570 0x7fb860199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.210+0000 7fb866428640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 0x7fb8601a4470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c970 tx=0x7fb85800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.211+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858007bb0 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.211+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601a4b80 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.211+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb858007d50 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.211+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580188a0 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.211+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601a5090 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.212+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb860101200 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.213+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb85800f450 con 0x7fb860102ef0 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.214+0000 7fb856ffd640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb84c0a3240 0x7fb84c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:11.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.214+0000 7fb865c27640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb84c0a3240 0x7fb84c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:11.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.214+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fb8580cf5a0 con 0x7fb860102ef0 2024-09-19T07:49:11.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.214+0000 7fb865c27640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb84c0a3240 0x7fb84c0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb85c030040 tx=0x7fb85c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:11.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.218+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb858014030 con 0x7fb860102ef0 2024-09-19T07:49:11.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.446+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb86006a560 con 0x7fb860102ef0 2024-09-19T07:49:11.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.447+0000 7fb856ffd640 1 -- 172.21.15.76:0/3225737825 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7fb86006a560 con 0x7fb860102ef0 2024-09-19T07:49:11.448 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:11.448 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":10,"btime":"2024-09-19T07:49:09:487823+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:49:11.449 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 10 2024-09-19T07:49:11.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb84c0a3240 msgr2=0x7fb84c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:11.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb84c0a3240 0x7fb84c0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb85c030040 tx=0x7fb85c005ef0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 msgr2=0x7fb8601a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:11.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 0x7fb8601a4470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c970 tx=0x7fb85800ce30 comp rx=0 tx=0).stop 2024-09-19T07:49:11.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 shutdown_connections 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb860102ef0 0x7fb8601a4470 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb84c0a3240 0x7fb84c0a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb860102570 0x7fb860199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 --2- 172.21.15.76:0/3225737825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb860100e20 0x7fb8601993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 >> 172.21.15.76:0/3225737825 conn(0x7fb8600fc7d0 msgr2=0x7fb860106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 shutdown_connections 2024-09-19T07:49:11.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:11.450+0000 7fb867e8b640 1 -- 172.21.15.76:0/3225737825 wait complete. 2024-09-19T07:49:11.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:11 smithi076 ceph-mon[30930]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:11.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:11 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3225737825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:11.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:11 smithi152 ceph-mon[35117]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:11.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:11 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3225737825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:11 smithi137 ceph-mon[35309]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:11.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:11 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3225737825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:12.404 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 07:49:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-g[72185]: starting mds.g at 2024-09-19T07:49:12.693 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 07:49:12 smithi076 bash[72156]: cd8bc9220e935c2565b31ce7caa06cfc21eea629badc24897f011430f28d57f2 2024-09-19T07:49:12.693 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 07:49:12 smithi076 systemd[1]: Started Ceph mds.g for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:13.706 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.706 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: Deploying daemon mds.a on smithi076 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.76:6838/654330768,v1:172.21.15.76:6839/654330768] up:boot 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: fsmap 10 up:standby 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:49:13.707 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:13 smithi137 ceph-mon[35309]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:13.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: Deploying daemon mds.a on smithi076 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.76:6838/654330768,v1:172.21.15.76:6839/654330768] up:boot 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: fsmap 10 up:standby 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:49:13.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:13 smithi152 ceph-mon[35117]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:13.879 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: Deploying daemon mds.a on smithi076 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.76:6838/654330768,v1:172.21.15.76:6839/654330768] up:boot 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: fsmap 10 up:standby 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:49:13.880 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:13 smithi076 ceph-mon[30930]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:14.182 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:49:14.443 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 systemd[1]: Starting Ceph mds.a for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:49:14.879 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 podman[72493]: 2024-09-19 07:49:14.608520972 +0000 UTC m=+0.111911004 container create dd7a2276da063ea75228cf2ea2d579688d6a80adacf4e2101df83f6f99b9a80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T07:49:14.879 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 podman[72493]: 2024-09-19 07:49:14.516652356 +0000 UTC m=+0.020042389 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:49:14.879 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 podman[72493]: 2024-09-19 07:49:14.853120318 +0000 UTC m=+0.356510360 container init dd7a2276da063ea75228cf2ea2d579688d6a80adacf4e2101df83f6f99b9a80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T07:49:14.879 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 podman[72493]: 2024-09-19 07:49:14.855888963 +0000 UTC m=+0.359279005 container start dd7a2276da063ea75228cf2ea2d579688d6a80adacf4e2101df83f6f99b9a80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:49:14.879 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 ceph-mds[72538]: -- 172.21.15.76:0/924104601 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d62056f860 con 0x55d62054c800 2024-09-19T07:49:14.990 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:15.128 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a[72534]: starting mds.a at 2024-09-19T07:49:15.129 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 bash[72493]: dd7a2276da063ea75228cf2ea2d579688d6a80adacf4e2101df83f6f99b9a80e 2024-09-19T07:49:15.129 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 07:49:14 smithi076 systemd[1]: Started Ceph mds.a for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:15.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 -- 172.21.15.76:0/1222793176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 msgr2=0x7f4848106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:15.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 --2- 172.21.15.76:0/1222793176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f4848106e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f483c009930 tx=0x7f483c02a420 comp rx=0 tx=0).stop 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 -- 172.21.15.76:0/1222793176 shutdown_connections 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 --2- 172.21.15.76:0/1222793176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848101420 0x7f484810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 --2- 172.21.15.76:0/1222793176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4848100a80 0x7f4848100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 --2- 172.21.15.76:0/1222793176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f4848106e60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 -- 172.21.15.76:0/1222793176 >> 172.21.15.76:0/1222793176 conn(0x7f48480fc7a0 msgr2=0x7f48480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 -- 172.21.15.76:0/1222793176 shutdown_connections 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.471+0000 7f4850300640 1 -- 172.21.15.76:0/1222793176 wait complete. 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 Processor -- start 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 -- start start 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848100a80 0x7f484819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:15.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4848101420 0x7f484819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f484819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4848110fe0 con 0x7f4848106a80 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4848110e60 con 0x7f4848101420 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f4850300640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4848111160 con 0x7f4848100a80 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f484e89d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f484819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f484e89d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f484819f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53408/0 (socket says 172.21.15.76:53408) 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f484e89d640 1 -- 172.21.15.76:0/2567823602 learned_addr learned my addr 172.21.15.76:0/2567823602 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.472+0000 7f484d89b640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4848101420 0x7f484819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e09c640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848100a80 0x7f484819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e89d640 1 -- 172.21.15.76:0/2567823602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848100a80 msgr2=0x7f484819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:15.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e89d640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848100a80 0x7f484819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e89d640 1 -- 172.21.15.76:0/2567823602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4848101420 msgr2=0x7f484819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e89d640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4848101420 0x7f484819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e89d640 1 -- 172.21.15.76:0/2567823602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484819f700 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f484e89d640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f484819f020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f484000b970 tx=0x7f484000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840019070 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f484000cb40 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484819f9f0 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840007700 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.473+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481a72d0 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.474+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4848100ee0 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.475+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f484001c070 con 0x7f4848106a80 2024-09-19T07:49:15.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.476+0000 7f483b7fe640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f48340a3240 0x7f48340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:15.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.476+0000 7f484e09c640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f48340a3240 0x7f48340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:15.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.476+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f48400ce9e0 con 0x7f4848106a80 2024-09-19T07:49:15.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.476+0000 7f484e09c640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f48340a3240 0x7f48340a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f483c006010 tx=0x7f483c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:15.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.480+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f484009b550 con 0x7f4848106a80 2024-09-19T07:49:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.683+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48481a7500 con 0x7f4848106a80 2024-09-19T07:49:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.684+0000 7f483b7fe640 1 -- 172.21.15.76:0/2567823602 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f484009f850 con 0x7f4848106a80 2024-09-19T07:49:15.684 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:15.684 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":12,"btime":"2024-09-19T07:49:15:655704+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:49:15.685 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 12 2024-09-19T07:49:15.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f48340a3240 msgr2=0x7f48340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:15.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f48340a3240 0x7f48340a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f483c006010 tx=0x7f483c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 msgr2=0x7f484819f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:15.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f484819f020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f484000b970 tx=0x7f484000be30 comp rx=0 tx=0).stop 2024-09-19T07:49:15.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 shutdown_connections 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4848106a80 0x7f484819f020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f48340a3240 0x7f48340a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4848101420 0x7f484819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 --2- 172.21.15.76:0/2567823602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848100a80 0x7f484819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 >> 172.21.15.76:0/2567823602 conn(0x7f48480fc7a0 msgr2=0x7f484806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 shutdown_connections 2024-09-19T07:49:15.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:15.686+0000 7f4850300640 1 -- 172.21.15.76:0/2567823602 wait complete. 2024-09-19T07:49:15.808 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:15.808 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:15.808 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:15.808 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:15.808 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:15.809 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:15.809 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:15 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:15.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:15.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:15.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:15 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:49:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:49:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:15 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:16.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:16 smithi137 ceph-mon[35309]: Deploying daemon mds.b on smithi137 2024-09-19T07:49:16.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:16 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.76:6840/57923082,v1:172.21.15.76:6841/57923082] up:boot 2024-09-19T07:49:16.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:16 smithi137 ceph-mon[35309]: fsmap 11 up:standby 2024-09-19T07:49:16.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:16 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:49:16.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:16 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2567823602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:16 smithi076 ceph-mon[30930]: Deploying daemon mds.b on smithi137 2024-09-19T07:49:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:16 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.76:6840/57923082,v1:172.21.15.76:6841/57923082] up:boot 2024-09-19T07:49:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:16 smithi076 ceph-mon[30930]: fsmap 11 up:standby 2024-09-19T07:49:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:16 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:49:16.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:16 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2567823602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:16 smithi152 ceph-mon[35117]: Deploying daemon mds.b on smithi137 2024-09-19T07:49:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:16 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.76:6840/57923082,v1:172.21.15.76:6841/57923082] up:boot 2024-09-19T07:49:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:16 smithi152 ceph-mon[35117]: fsmap 11 up:standby 2024-09-19T07:49:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:16 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:49:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:16 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2567823602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:17.404 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 systemd[1]: Starting Ceph mds.b for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T07:49:17.710 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:17 smithi137 ceph-mon[35309]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:17.710 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 podman[65334]: 2024-09-19 07:49:17.327942212 +0000 UTC m=+0.016225021 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:49:17.710 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 podman[65334]: 2024-09-19 07:49:17.457693291 +0000 UTC m=+0.145976139 container create 98e77d667f46910cd482f922ca2662bb0dea6a66071100bd3a3350ea7b15298b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T07:49:17.710 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 podman[65334]: 2024-09-19 07:49:17.710377583 +0000 UTC m=+0.398660382 container init 98e77d667f46910cd482f922ca2662bb0dea6a66071100bd3a3350ea7b15298b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T07:49:17.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:17 smithi076 ceph-mon[30930]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:18.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:17 smithi152 ceph-mon[35117]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:18.154 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 podman[65334]: 2024-09-19 07:49:17.713473811 +0000 UTC m=+0.401756612 container start 98e77d667f46910cd482f922ca2662bb0dea6a66071100bd3a3350ea7b15298b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T07:49:18.154 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 ceph-mds[65353]: -- 172.21.15.137:0/1174189804 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b50243860 con 0x557b50221400 2024-09-19T07:49:18.154 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b[65349]: starting mds.b at 2024-09-19T07:49:18.154 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 bash[65334]: 98e77d667f46910cd482f922ca2662bb0dea6a66071100bd3a3350ea7b15298b 2024-09-19T07:49:18.154 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 07:49:17 smithi137 systemd[1]: Started Ceph mds.b for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T07:49:18.356 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:49:18.897 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:18.897 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:18.897 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] up:boot 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: fsmap 12 up:standby 2024-09-19T07:49:18.898 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:18 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:49:19.069 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] up:boot 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: fsmap 12 up:standby 2024-09-19T07:49:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:18 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:49:19.191 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:19.192 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] up:boot 2024-09-19T07:49:19.192 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: fsmap 12 up:standby 2024-09-19T07:49:19.192 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:18 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 -- 172.21.15.76:0/1730266926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c106f00 msgr2=0x7fc67c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 --2- 172.21.15.76:0/1730266926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c106f00 0x7fc67c10ea80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc674009ca0 tx=0x7fc67402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 -- 172.21.15.76:0/1730266926 shutdown_connections 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 --2- 172.21.15.76:0/1730266926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c106f00 0x7fc67c10ea80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 --2- 172.21.15.76:0/1730266926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c102780 0x7fc67c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 --2- 172.21.15.76:0/1730266926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc67c101dd0 0x7fc67c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 -- 172.21.15.76:0/1730266926 >> 172.21.15.76:0/1730266926 conn(0x7fc67c0fd890 msgr2=0x7fc67c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 -- 172.21.15.76:0/1730266926 shutdown_connections 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 -- 172.21.15.76:0/1730266926 wait complete. 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 Processor -- start 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.562+0000 7fc6825f1640 1 -- start start 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc67c101dd0 0x7fc67c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 0x7fc67c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c106f00 0x7fc67c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c112080 con 0x7fc67c102780 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c111f00 con 0x7fc67c101dd0 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c112200 con 0x7fc67c106f00 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 0x7fc67c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 0x7fc67c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53424/0 (socket says 172.21.15.76:53424) 2024-09-19T07:49:19.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 -- 172.21.15.76:0/904725349 learned_addr learned my addr 172.21.15.76:0/904725349 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc680b8e640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c106f00 0x7fc67c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67bfff640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc67c101dd0 0x7fc67c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 -- 172.21.15.76:0/904725349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c106f00 msgr2=0x7fc67c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c106f00 0x7fc67c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 -- 172.21.15.76:0/904725349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc67c101dd0 msgr2=0x7fc67c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc67c101dd0 0x7fc67c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 -- 172.21.15.76:0/904725349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c1a6980 con 0x7fc67c102780 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc680b8e640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c106f00 0x7fc67c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc67b7fe640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 0x7fc67c074a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d950 tx=0x7fc66400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664017030 con 0x7fc67c102780 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc664004020 con 0x7fc67c102780 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67c1a6c70 con 0x7fc67c102780 2024-09-19T07:49:19.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.563+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664004a00 con 0x7fc67c102780 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.564+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67c1a71b0 con 0x7fc67c102780 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.564+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67c1021b0 con 0x7fc67c102780 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.566+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc6640041d0 con 0x7fc67c102780 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.566+0000 7fc6797fa640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6680a3240 0x7fc6680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.566+0000 7fc67bfff640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6680a3240 0x7fc6680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.566+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fc6640ceeb0 con 0x7fc67c102780 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.567+0000 7fc67bfff640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6680a3240 0x7fc6680a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc66c005fd0 tx=0x7fc66c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:19.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.571+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc66400e350 con 0x7fc67c102780 2024-09-19T07:49:19.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.804+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc67c109b50 con 0x7fc67c102780 2024-09-19T07:49:19.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.805+0000 7fc6797fa640 1 -- 172.21.15.76:0/904725349 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7fc66409c070 con 0x7fc67c102780 2024-09-19T07:49:19.805 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:19.805 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":13,"btime":"2024-09-19T07:49:18:668381+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:49:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 13 2024-09-19T07:49:19.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.807+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6680a3240 msgr2=0x7fc6680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:19.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.807+0000 7fc6825f1640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6680a3240 0x7fc6680a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc66c005fd0 tx=0x7fc66c005850 comp rx=0 tx=0).stop 2024-09-19T07:49:19.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.807+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 msgr2=0x7fc67c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:19.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.807+0000 7fc6825f1640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 0x7fc67c074a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d950 tx=0x7fc66400de10 comp rx=0 tx=0).stop 2024-09-19T07:49:19.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 shutdown_connections 2024-09-19T07:49:19.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc67c106f00 0x7fc67c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc67c102780 0x7fc67c074a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6680a3240 0x7fc6680a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 --2- 172.21.15.76:0/904725349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc67c101dd0 0x7fc67c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 >> 172.21.15.76:0/904725349 conn(0x7fc67c0fd890 msgr2=0x7fc67c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 shutdown_connections 2024-09-19T07:49:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:19.808+0000 7fc6825f1640 1 -- 172.21.15.76:0/904725349 wait complete. 2024-09-19T07:49:20.447 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T07:49:20.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:20 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:20 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:20 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:20 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:20 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/904725349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:20 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:20 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:20 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:20 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:20 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/904725349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:20 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:20 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/904725349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 -- 172.21.15.76:0/245519246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 msgr2=0x7fbb10103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 --2- 172.21.15.76:0/245519246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10103110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009930 tx=0x7fbb0402a420 comp rx=0 tx=0).stop 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 -- 172.21.15.76:0/245519246 shutdown_connections 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 --2- 172.21.15.76:0/245519246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb101082a0 0x7fbb1010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 --2- 172.21.15.76:0/245519246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 0x7fbb10107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 --2- 172.21.15.76:0/245519246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10103110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 -- 172.21.15.76:0/245519246 >> 172.21.15.76:0/245519246 conn(0x7fbb100fc7d0 msgr2=0x7fbb100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 -- 172.21.15.76:0/245519246 shutdown_connections 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 -- 172.21.15.76:0/245519246 wait complete. 2024-09-19T07:49:21.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 Processor -- start 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.219+0000 7fbb178d6640 1 -- start start 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 0x7fbb10198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb101082a0 0x7fbb1019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101121c0 con 0x7fbb10102d30 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10112040 con 0x7fbb101036e0 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10112340 con 0x7fbb101082a0 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53444/0 (socket says 172.21.15.76:53444) 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 -- 172.21.15.76:0/2578880939 learned_addr learned my addr 172.21.15.76:0/2578880939 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15e73640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb101082a0 0x7fbb1019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:21.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb14e71640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 0x7fbb10198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 -- 172.21.15.76:0/2578880939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb101082a0 msgr2=0x7fbb1019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb101082a0 0x7fbb1019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 -- 172.21.15.76:0/2578880939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 msgr2=0x7fbb10198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 0x7fbb10198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 -- 172.21.15.76:0/2578880939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1019d630 con 0x7fbb10102d30 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb14e71640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 0x7fbb10198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb15672640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10198680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009230 tx=0x7fbb04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0403f030 con 0x7fbb10102d30 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb04003af0 con 0x7fbb10102d30 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1019d8c0 con 0x7fbb10102d30 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04035070 con 0x7fbb10102d30 2024-09-19T07:49:21.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.220+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb101a5200 con 0x7fbb10102d30 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.222+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1006a850 con 0x7fbb10102d30 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.223+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb04042030 con 0x7fbb10102d30 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.224+0000 7fbb027fc640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbafc0a3240 0x7fbafc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.224+0000 7fbb14e71640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbafc0a3240 0x7fbafc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.224+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fbb040f0050 con 0x7fbb10102d30 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.224+0000 7fbb14e71640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbafc0a3240 0x7fbafc0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0058c0 tx=0x7fbb0c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:21.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.227+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb040bd2d0 con 0x7fbb10102d30 2024-09-19T07:49:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.417+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbb10199a10 con 0x7fbb10102d30 2024-09-19T07:49:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.418+0000 7fbb027fc640 1 -- 172.21.15.76:0/2578880939 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fbb10199a10 con 0x7fbb10102d30 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout:[ 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout: "poolnum": 1, 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout: "poolname": ".mgr" 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:49:21.422 INFO:teuthology.orchestra.run.smithi076.stdout:] 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbafc0a3240 msgr2=0x7fbafc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbafc0a3240 0x7fbafc0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0058c0 tx=0x7fbb0c005850 comp rx=0 tx=0).stop 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 msgr2=0x7fbb10198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10198680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009230 tx=0x7fbb04004270 comp rx=0 tx=0).stop 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 shutdown_connections 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb101082a0 0x7fbb1019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fbafc0a3240 0x7fbafc0a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb101036e0 0x7fbb10198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 --2- 172.21.15.76:0/2578880939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb10102d30 0x7fbb10198680 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 >> 172.21.15.76:0/2578880939 conn(0x7fbb100fc7d0 msgr2=0x7fbb10105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:21.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 shutdown_connections 2024-09-19T07:49:21.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:21.420+0000 7fbb178d6640 1 -- 172.21.15.76:0/2578880939 wait complete. 2024-09-19T07:49:21.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:49:21.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2578880939' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:49:21.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2578880939' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:49:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2578880939' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:49:22.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T07:49:22.686 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T07:49:22.963 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:23.386 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.386 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.386 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.386 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.386 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.386 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:23 smithi076 ceph-mon[30930]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:23.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:23 smithi137 ceph-mon[35309]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:23.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 -- 172.21.15.76:0/952174426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4102790 msgr2=0x7f74a41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:23.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 --2- 172.21.15.76:0/952174426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4102790 0x7f74a41067e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7490009900 tx=0x7f749002a410 comp rx=0 tx=0).stop 2024-09-19T07:49:23.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 -- 172.21.15.76:0/952174426 shutdown_connections 2024-09-19T07:49:23.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 --2- 172.21.15.76:0/952174426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 0x7f74a410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 --2- 172.21.15.76:0/952174426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4102790 0x7f74a41067e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 --2- 172.21.15.76:0/952174426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74a4101de0 0x7f74a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 -- 172.21.15.76:0/952174426 >> 172.21.15.76:0/952174426 conn(0x7f74a40fd8c0 msgr2=0x7f74a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 -- 172.21.15.76:0/952174426 shutdown_connections 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.469+0000 7f74aaee4640 1 -- 172.21.15.76:0/952174426 wait complete. 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 Processor -- start 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 -- start start 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 0x7f74a4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74a4102790 0x7f74a4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 0x7f74a419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f74a4112090 con 0x7f74a4101de0 2024-09-19T07:49:23.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.470+0000 7f74aaee4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74a4111f10 con 0x7f74a4106f10 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74aaee4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f74a4112210 con 0x7f74a4102790 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 0x7f74a4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 0x7f74a4198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40284/0 (socket says 172.21.15.76:40284) 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 -- 172.21.15.76:0/928550851 learned_addr learned my addr 172.21.15.76:0/928550851 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a3fff640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74a4102790 0x7f74a4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a9481640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 0x7f74a419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 -- 172.21.15.76:0/928550851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74a4102790 msgr2=0x7f74a4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74a4102790 0x7f74a4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:23.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 -- 172.21.15.76:0/928550851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 msgr2=0x7f74a419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 0x7f74a419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 -- 172.21.15.76:0/928550851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a419d540 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a9481640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 0x7f74a419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a8c80640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 0x7f74a4198590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f749800c970 tx=0x7f749800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498007bb0 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a419d830 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7498007d50 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749800f4b0 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.471+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a41a5110 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.472+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a41021c0 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.473+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f74980046c0 con 0x7f74a4101de0 2024-09-19T07:49:23.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.474+0000 7f74a1ffb640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f74940a3240 0x7f74940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:23.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.474+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f74980cf290 con 0x7f74a4101de0 2024-09-19T07:49:23.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.474+0000 7f74a3fff640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f74940a3240 0x7f74940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:23.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.474+0000 7f74a3fff640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f74940a3240 0x7f74940a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7490009230 tx=0x7f74900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:23.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.478+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7498014030 con 0x7f74a4101de0 2024-09-19T07:49:23.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:23 smithi152 ceph-mon[35117]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:23.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:23.648+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f74a410a0f0 con 0x7f74a4101de0 2024-09-19T07:49:24.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.550+0000 7f74a1ffb640 1 -- 172.21.15.76:0/928550851 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f749809c450 con 0x7f74a4101de0 2024-09-19T07:49:24.550 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_metadata' created 2024-09-19T07:49:24.550 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.550 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.551 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:24.551 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:49:24.551 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:24 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.551 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:24 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/928550851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:49:24.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f74940a3240 msgr2=0x7f74940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:24.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f74940a3240 0x7f74940a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7490009230 tx=0x7f74900058d0 comp rx=0 tx=0).stop 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 msgr2=0x7f74a4198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 0x7f74a4198590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f749800c970 tx=0x7f749800ce30 comp rx=0 tx=0).stop 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 shutdown_connections 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f74940a3240 0x7f74940a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74a4106f10 0x7f74a419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74a4102790 0x7f74a4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 --2- 172.21.15.76:0/928550851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f74a4101de0 0x7f74a4198590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.552+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 >> 172.21.15.76:0/928550851 conn(0x7f74a40fd8c0 msgr2=0x7f74a40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.553+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 shutdown_connections 2024-09-19T07:49:24.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:24.553+0000 7f74aaee4640 1 -- 172.21.15.76:0/928550851 wait complete. 2024-09-19T07:49:24.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:24.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:49:24.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:24 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:24 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/928550851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:49:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:49:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:49:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:24 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:49:24.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:24 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/928550851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:49:25.199 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T07:49:25.448 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:25.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:25 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/928550851' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:49:25.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:25 smithi152 ceph-mon[35117]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:49:25.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:25 smithi152 ceph-mon[35117]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:25.862 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:25 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/928550851' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:49:25.862 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:25 smithi076 ceph-mon[30930]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:49:25.862 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:25 smithi076 ceph-mon[30930]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:25.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:25 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/928550851' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:49:25.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:25 smithi137 ceph-mon[35309]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:49:25.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:25 smithi137 ceph-mon[35309]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:25.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 -- 172.21.15.76:0/4074038627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca30103660 msgr2=0x7fca3010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:25.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 --2- 172.21.15.76:0/4074038627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca30103660 0x7fca3010bb50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca24009900 tx=0x7fca2402a480 comp rx=0 tx=0).stop 2024-09-19T07:49:25.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 -- 172.21.15.76:0/4074038627 shutdown_connections 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 --2- 172.21.15.76:0/4074038627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca3010c170 0x7fca3010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 --2- 172.21.15.76:0/4074038627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca30103660 0x7fca3010bb50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 --2- 172.21.15.76:0/4074038627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca30102d40 0x7fca30103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 -- 172.21.15.76:0/4074038627 >> 172.21.15.76:0/4074038627 conn(0x7fca300fc7a0 msgr2=0x7fca300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 -- 172.21.15.76:0/4074038627 shutdown_connections 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.949+0000 7fca35061640 1 -- 172.21.15.76:0/4074038627 wait complete. 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 Processor -- start 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 -- start start 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca30102d40 0x7fca301985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca30103660 0x7fca30198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 0x7fca3019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:25.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fca301120f0 con 0x7fca3010c170 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca30111f70 con 0x7fca30103660 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca35061640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca30112270 con 0x7fca30102d40 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca2f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 0x7fca3019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca2f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 0x7fca3019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40296/0 (socket says 172.21.15.76:40296) 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca2f59e640 1 -- 172.21.15.76:0/2266166399 learned_addr learned my addr 172.21.15.76:0/2266166399 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.950+0000 7fca2ed9d640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca30102d40 0x7fca301985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2e59c640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca30103660 0x7fca30198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2f59e640 1 -- 172.21.15.76:0/2266166399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca30102d40 msgr2=0x7fca301985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2f59e640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca30102d40 0x7fca301985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2f59e640 1 -- 172.21.15.76:0/2266166399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca30103660 msgr2=0x7fca30198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:25.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2f59e640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca30103660 0x7fca30198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2f59e640 1 -- 172.21.15.76:0/2266166399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3019d560 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2e59c640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca30103660 0x7fca30198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca2f59e640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 0x7fca3019ce80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca2800cce0 tx=0x7fca2800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2800f450 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3019d850 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca2800faf0 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28018c50 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.951+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca301a5130 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.952+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca30103120 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.953+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fca2800fca0 con 0x7fca3010c170 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.954+0000 7fca17fff640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fca180a3240 0x7fca180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:25.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.954+0000 7fca2ed9d640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fca180a3240 0x7fca180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:25.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.954+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7fca280cfcd0 con 0x7fca3010c170 2024-09-19T07:49:25.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.954+0000 7fca2ed9d640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fca180a3240 0x7fca180a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca20009990 tx=0x7fca20009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:25.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:25.957+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca28014030 con 0x7fca3010c170 2024-09-19T07:49:26.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.125+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fca301071e0 con 0x7fca3010c170 2024-09-19T07:49:26.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.563+0000 7fca17fff640 1 -- 172.21.15.76:0/2266166399 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7fca2809cdb0 con 0x7fca3010c170 2024-09-19T07:49:26.563 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data' created 2024-09-19T07:49:26.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fca180a3240 msgr2=0x7fca180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:26.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fca180a3240 0x7fca180a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca20009990 tx=0x7fca20009110 comp rx=0 tx=0).stop 2024-09-19T07:49:26.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 msgr2=0x7fca3019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:26.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 0x7fca3019ce80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca2800cce0 tx=0x7fca2800a620 comp rx=0 tx=0).stop 2024-09-19T07:49:26.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 shutdown_connections 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca3010c170 0x7fca3019ce80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fca180a3240 0x7fca180a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca30103660 0x7fca30198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 --2- 172.21.15.76:0/2266166399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca30102d40 0x7fca301985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 >> 172.21.15.76:0/2266166399 conn(0x7fca300fc7a0 msgr2=0x7fca300fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 shutdown_connections 2024-09-19T07:49:26.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:26.565+0000 7fca35061640 1 -- 172.21.15.76:0/2266166399 wait complete. 2024-09-19T07:49:26.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:26 smithi152 ceph-mon[35117]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:49:26.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:26 smithi152 ceph-mon[35117]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:49:26.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:26 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2266166399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:49:26.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:26 smithi137 ceph-mon[35309]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:49:26.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:26 smithi137 ceph-mon[35309]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:49:26.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:26 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2266166399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:49:26.941 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:26 smithi076 ceph-mon[30930]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:49:26.941 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:26 smithi076 ceph-mon[30930]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:49:26.941 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:26 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2266166399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:49:27.270 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T07:49:27.515 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:27.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:27 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2266166399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:49:27.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:27 smithi137 ceph-mon[35309]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:49:27.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:27 smithi137 ceph-mon[35309]: pgmap v277: 97 pgs: 2 creating+activating, 4 creating+peering, 84 unknown, 7 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:27.921 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:27 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2266166399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:49:27.922 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:27 smithi076 ceph-mon[30930]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:49:27.922 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:27 smithi076 ceph-mon[30930]: pgmap v277: 97 pgs: 2 creating+activating, 4 creating+peering, 84 unknown, 7 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:28.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 -- 172.21.15.76:0/1028030539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40102790 msgr2=0x7f7f401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 --2- 172.21.15.76:0/1028030539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40102790 0x7f7f401067e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009900 tx=0x7f7f3402a410 comp rx=0 tx=0).stop 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 -- 172.21.15.76:0/1028030539 shutdown_connections 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 --2- 172.21.15.76:0/1028030539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f40106f10 0x7f7f4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 --2- 172.21.15.76:0/1028030539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40102790 0x7f7f401067e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 --2- 172.21.15.76:0/1028030539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40101de0 0x7f7f401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 -- 172.21.15.76:0/1028030539 >> 172.21.15.76:0/1028030539 conn(0x7f7f400fd8c0 msgr2=0x7f7f400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 -- 172.21.15.76:0/1028030539 shutdown_connections 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 -- 172.21.15.76:0/1028030539 wait complete. 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 Processor -- start 2024-09-19T07:49:28.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.004+0000 7f7f4673c640 1 -- start start 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f4673c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f40101de0 0x7f7f40198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f4673c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40102790 0x7f7f40198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f4673c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 0x7f7f4019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f4673c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7f401120f0 con 0x7f7f40106f10 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f4673c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40111f70 con 0x7f7f40102790 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f4673c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40112270 con 0x7f7f40101de0 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 0x7f7f4019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 0x7f7f4019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40304/0 (socket says 172.21.15.76:40304) 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 -- 172.21.15.76:0/4014510369 learned_addr learned my addr 172.21.15.76:0/4014510369 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f3f7fe640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40102790 0x7f7f40198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f3ffff640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f40101de0 0x7f7f40198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 -- 172.21.15.76:0/4014510369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f40101de0 msgr2=0x7f7f40198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f40101de0 0x7f7f40198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 -- 172.21.15.76:0/4014510369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40102790 msgr2=0x7f7f40198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40102790 0x7f7f40198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f44cd9640 1 -- 172.21.15.76:0/4014510369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4019d520 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.005+0000 7f7f3f7fe640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40102790 0x7f7f40198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.006+0000 7f7f44cd9640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 0x7f7f4019ce40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800cad0 tx=0x7f7f3800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.006+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800ae20 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.006+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4019d810 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.006+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f38004b20 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.006+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800f780 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.006+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f401a50f0 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.007+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f401021c0 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.008+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7f3800f940 con 0x7f7f40106f10 2024-09-19T07:49:28.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.009+0000 7f7f3d7fa640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7f280a3240 0x7f7f280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:28.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.009+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f7f380cfc20 con 0x7f7f40106f10 2024-09-19T07:49:28.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.009+0000 7f7f3ffff640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7f280a3240 0x7f7f280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:28.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.010+0000 7f7f3ffff640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7f280a3240 0x7f7f280a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009890 tx=0x7f7f30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:28.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.012+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f38014030 con 0x7f7f40106f10 2024-09-19T07:49:28.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:27 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2266166399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:49:28.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:27 smithi152 ceph-mon[35117]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:49:28.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:27 smithi152 ceph-mon[35117]: pgmap v277: 97 pgs: 2 creating+activating, 4 creating+peering, 84 unknown, 7 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:28.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.217+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7f4002d7c0 con 0x7f7f40106f10 2024-09-19T07:49:28.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.570+0000 7f7f3d7fa640 1 -- 172.21.15.76:0/4014510369 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f7f3809caf0 con 0x7f7f40106f10 2024-09-19T07:49:28.571 INFO:teuthology.orchestra.run.smithi076.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T07:49:28.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7f280a3240 msgr2=0x7f7f280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7f280a3240 0x7f7f280a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009890 tx=0x7f7f30008040 comp rx=0 tx=0).stop 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 msgr2=0x7f7f4019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 0x7f7f4019ce40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800cad0 tx=0x7f7f3800cf90 comp rx=0 tx=0).stop 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 shutdown_connections 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f40106f10 0x7f7f4019ce40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7f280a3240 0x7f7f280a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f40102790 0x7f7f40198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.573+0000 7f7f4673c640 1 --2- 172.21.15.76:0/4014510369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f40101de0 0x7f7f40198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.574+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 >> 172.21.15.76:0/4014510369 conn(0x7f7f400fd8c0 msgr2=0x7f7f400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.574+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 shutdown_connections 2024-09-19T07:49:28.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:28.574+0000 7f7f4673c640 1 -- 172.21.15.76:0/4014510369 wait complete. 2024-09-19T07:49:28.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:28 smithi137 ceph-mon[35309]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:49:28.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:28 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/4014510369' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:49:28.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:28 smithi137 ceph-mon[35309]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:49:28.942 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:28 smithi076 ceph-mon[30930]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:49:28.942 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:28 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/4014510369' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:49:28.942 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:28 smithi076 ceph-mon[30930]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:49:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:28 smithi152 ceph-mon[35117]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:49:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:28 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/4014510369' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:49:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:28 smithi152 ceph-mon[35117]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:49:29.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:49:29.522 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:29.835 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:29 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/4014510369' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:49:29.835 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:29 smithi076 ceph-mon[30930]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:49:29.835 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:29 smithi076 ceph-mon[30930]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:49:29.835 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:29 smithi076 ceph-mon[30930]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:49:29.835 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:29 smithi076 ceph-mon[30930]: pgmap v280: 97 pgs: 2 creating+activating, 13 creating+peering, 41 unknown, 41 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:29 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/4014510369' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:49:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:29 smithi137 ceph-mon[35309]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:49:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:29 smithi137 ceph-mon[35309]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:49:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:29 smithi137 ceph-mon[35309]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:49:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:29 smithi137 ceph-mon[35309]: pgmap v280: 97 pgs: 2 creating+activating, 13 creating+peering, 41 unknown, 41 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:29 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/4014510369' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:49:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:29 smithi152 ceph-mon[35117]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:49:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:29 smithi152 ceph-mon[35117]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:49:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:29 smithi152 ceph-mon[35117]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:49:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:29 smithi152 ceph-mon[35117]: pgmap v280: 97 pgs: 2 creating+activating, 13 creating+peering, 41 unknown, 41 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:49:30.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 -- 172.21.15.76:0/3351398164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 msgr2=0x7f56b810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:30.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 --2- 172.21.15.76:0/3351398164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b810bbb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009900 tx=0x7f56b402a480 comp rx=0 tx=0).stop 2024-09-19T07:49:30.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 -- 172.21.15.76:0/3351398164 shutdown_connections 2024-09-19T07:49:30.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 --2- 172.21.15.76:0/3351398164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56b810c180 0x7f56b810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 --2- 172.21.15.76:0/3351398164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b810bbb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 --2- 172.21.15.76:0/3351398164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56b8102da0 0x7f56b8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 -- 172.21.15.76:0/3351398164 >> 172.21.15.76:0/3351398164 conn(0x7f56b80fc7a0 msgr2=0x7f56b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 -- 172.21.15.76:0/3351398164 shutdown_connections 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.044+0000 7f56bf753640 1 -- 172.21.15.76:0/3351398164 wait complete. 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 Processor -- start 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 -- start start 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56b8102da0 0x7f56b8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56b810c180 0x7f56b819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8112080 con 0x7f56b81036c0 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8111f00 con 0x7f56b810c180 2024-09-19T07:49:30.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bf753640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8112200 con 0x7f56b8102da0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b8198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40308/0 (socket says 172.21.15.76:40308) 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 -- 172.21.15.76:0/2055162450 learned_addr learned my addr 172.21.15.76:0/2055162450 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bd4ef640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56b8102da0 0x7f56b8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bdcf0640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56b810c180 0x7f56b819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 -- 172.21.15.76:0/2055162450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56b8102da0 msgr2=0x7f56b8198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56b8102da0 0x7f56b8198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 -- 172.21.15.76:0/2055162450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56b810c180 msgr2=0x7f56b819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56b810c180 0x7f56b819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.045+0000 7f56bccee640 1 -- 172.21.15.76:0/2055162450 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b819d4d0 con 0x7f56b81036c0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.046+0000 7f56bccee640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b8198a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f56b4006010 tx=0x7f56b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.046+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b403f030 con 0x7f56b81036c0 2024-09-19T07:49:30.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.046+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f56b4003d00 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.046+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b819d760 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.046+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4035070 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.046+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b81a50a0 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.047+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b806b010 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.049+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f56b4042030 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.049+0000 7f56aa7fc640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f56a40a3240 0x7f56a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.049+0000 7f56bd4ef640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f56a40a3240 0x7f56a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.049+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f56b40effb0 con 0x7f56b81036c0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.050+0000 7f56bd4ef640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f56a40a3240 0x7f56a40a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56ac005d00 tx=0x7f56ac00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:30.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.053+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56b40bc890 con 0x7f56b81036c0 2024-09-19T07:49:30.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.223+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56b81071c0 con 0x7f56b81036c0 2024-09-19T07:49:30.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.224+0000 7f56aa7fc640 1 -- 172.21.15.76:0/2055162450 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22304 (secure 0 0 0) 0x7f56b40c0b90 con 0x7f56b81036c0 2024-09-19T07:49:30.225 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:30.226 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:49:28.218729+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f56a40a3240 msgr2=0x7f56a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f56a40a3240 0x7f56a40a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56ac005d00 tx=0x7f56ac00b410 comp rx=0 tx=0).stop 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 msgr2=0x7f56b8198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b8198a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f56b4006010 tx=0x7f56b40042f0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 shutdown_connections 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f56a40a3240 0x7f56a40a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56b810c180 0x7f56b819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f56b81036c0 0x7f56b8198a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 --2- 172.21.15.76:0/2055162450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56b8102da0 0x7f56b8198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:30.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 >> 172.21.15.76:0/2055162450 conn(0x7f56b80fc7a0 msgr2=0x7f56b80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:30.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 shutdown_connections 2024-09-19T07:49:30.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:30.227+0000 7f56bf753640 1 -- 172.21.15.76:0/2055162450 wait complete. 2024-09-19T07:49:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:30 smithi137 ceph-mon[35309]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:49:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:30 smithi137 ceph-mon[35309]: Cluster is now healthy 2024-09-19T07:49:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:30 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] up:active 2024-09-19T07:49:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:30 smithi137 ceph-mon[35309]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:30 smithi137 ceph-mon[35309]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:30 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2055162450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:30 smithi076 ceph-mon[30930]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:49:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:30 smithi076 ceph-mon[30930]: Cluster is now healthy 2024-09-19T07:49:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:30 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] up:active 2024-09-19T07:49:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:30 smithi076 ceph-mon[30930]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:30 smithi076 ceph-mon[30930]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:30.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:30 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2055162450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:30.993 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:49:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:30 smithi152 ceph-mon[35117]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:49:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:30 smithi152 ceph-mon[35117]: Cluster is now healthy 2024-09-19T07:49:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:30 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] up:active 2024-09-19T07:49:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:30 smithi152 ceph-mon[35117]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:30 smithi152 ceph-mon[35117]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:30 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2055162450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:31.244 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:31.643 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:31 smithi076 ceph-mon[30930]: pgmap v281: 97 pgs: 1 creating+activating, 9 creating+peering, 20 unknown, 67 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-19T07:49:31.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/4256600919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 msgr2=0x7f9cf81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:31.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/4256600919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf81021c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009900 tx=0x7f9ce802a410 comp rx=0 tx=0).stop 2024-09-19T07:49:31.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/4256600919 shutdown_connections 2024-09-19T07:49:31.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/4256600919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 0x7f9cf810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/4256600919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf8102790 0x7f9cf81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/4256600919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf81021c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/4256600919 >> 172.21.15.76:0/4256600919 conn(0x7f9cf80fd8c0 msgr2=0x7f9cf80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/4256600919 shutdown_connections 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.723+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/4256600919 wait complete. 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 Processor -- start 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 -- start start 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf8102790 0x7f9cf81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 0x7f9cf819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81120d0 con 0x7f9cf8101de0 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8111f50 con 0x7f9cf8102790 2024-09-19T07:49:31.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cfcdd9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8112250 con 0x7f9cf8106f10 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf8198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40326/0 (socket says 172.21.15.76:40326) 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cf659c640 1 -- 172.21.15.76:0/3939018111 learned_addr learned my addr 172.21.15.76:0/3939018111 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.724+0000 7f9cf5d9b640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf8102790 0x7f9cf81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf6d9d640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 0x7f9cf819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf659c640 1 -- 172.21.15.76:0/3939018111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 msgr2=0x7f9cf819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf659c640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 0x7f9cf819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf659c640 1 -- 172.21.15.76:0/3939018111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf8102790 msgr2=0x7f9cf81989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf659c640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf8102790 0x7f9cf81989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf659c640 1 -- 172.21.15.76:0/3939018111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf819d430 con 0x7f9cf8101de0 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf6d9d640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 0x7f9cf819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:31.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cf659c640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf8198480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8006010 tx=0x7f9ce80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce803f030 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ce8003d00 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf819d6c0 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8035070 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.725+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf81a5000 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.726+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf81032c0 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.727+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9ce8042030 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.728+0000 7f9cef7fe640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9ce40a3240 0x7f9ce40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.728+0000 7f9cf5d9b640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9ce40a3240 0x7f9ce40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.728+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f9ce80f0160 con 0x7f9cf8101de0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.728+0000 7f9cf5d9b640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9ce40a3240 0x7f9ce40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8108880 tx=0x7f9ce00075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:31.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.732+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ce80bcfd0 con 0x7f9cf8101de0 2024-09-19T07:49:31.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.899+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cf81a51d0 con 0x7f9cf8101de0 2024-09-19T07:49:31.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.900+0000 7f9cef7fe640 1 -- 172.21.15.76:0/3939018111 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22304 (secure 0 0 0) 0x7f9ce80bc8d0 con 0x7f9cf8101de0 2024-09-19T07:49:31.901 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:31.901 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:49:28.218729+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:49:31.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9ce40a3240 msgr2=0x7f9ce40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:31.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9ce40a3240 0x7f9ce40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8108880 tx=0x7f9ce00075b0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 msgr2=0x7f9cf8198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf8198480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8006010 tx=0x7f9ce80042f0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 shutdown_connections 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cf8106f10 0x7f9cf819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f9ce40a3240 0x7f9ce40a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf8102790 0x7f9cf81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 --2- 172.21.15.76:0/3939018111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9cf8101de0 0x7f9cf8198480 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 >> 172.21.15.76:0/3939018111 conn(0x7f9cf80fd8c0 msgr2=0x7f9cf80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 shutdown_connections 2024-09-19T07:49:31.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:31.902+0000 7f9cfcdd9640 1 -- 172.21.15.76:0/3939018111 wait complete. 2024-09-19T07:49:31.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:31 smithi137 ceph-mon[35309]: pgmap v281: 97 pgs: 1 creating+activating, 9 creating+peering, 20 unknown, 67 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-19T07:49:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:31 smithi152 ceph-mon[35117]: pgmap v281: 97 pgs: 1 creating+activating, 9 creating+peering, 20 unknown, 67 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-19T07:49:32.535 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T07:49:32.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:32 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3939018111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:32.789 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:32.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:32 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3939018111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:32 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3939018111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 -- 172.21.15.76:0/3217732106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 msgr2=0x7f061c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 --2- 172.21.15.76:0/3217732106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c101200 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0610009900 tx=0x7f061002a480 comp rx=0 tx=0).stop 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 -- 172.21.15.76:0/3217732106 shutdown_connections 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 --2- 172.21.15.76:0/3217732106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c102ef0 0x7f061c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 --2- 172.21.15.76:0/3217732106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 0x7f061c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 --2- 172.21.15.76:0/3217732106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c101200 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 -- 172.21.15.76:0/3217732106 >> 172.21.15.76:0/3217732106 conn(0x7f061c0fc7d0 msgr2=0x7f061c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 -- 172.21.15.76:0/3217732106 shutdown_connections 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 -- 172.21.15.76:0/3217732106 wait complete. 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 Processor -- start 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.304+0000 7f062424c640 1 -- start start 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f062424c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f062424c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 0x7f061c199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f062424c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c102ef0 0x7f061c1a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f062424c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f061c111160 con 0x7f061c100e20 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f062424c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f061c110fe0 con 0x7f061c102ef0 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f062424c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1112e0 con 0x7f061c102570 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40334/0 (socket says 172.21.15.76:40334) 2024-09-19T07:49:33.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 -- 172.21.15.76:0/3059341383 learned_addr learned my addr 172.21.15.76:0/3059341383 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f06217e7640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 0x7f061c199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 -- 172.21.15.76:0/3059341383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 msgr2=0x7f061c199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 0x7f061c199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 -- 172.21.15.76:0/3059341383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c102ef0 msgr2=0x7f061c1a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c102ef0 0x7f061c1a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 -- 172.21.15.76:0/3059341383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c1a4b30 con 0x7f061c100e20 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f06217e7640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 0x7f061c199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f0621fe8640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c199570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0610006010 tx=0x7f0610004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.305+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061003f030 con 0x7f061c100e20 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.306+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061c1a4d00 con 0x7f061c100e20 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.306+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0610005500 con 0x7f061c100e20 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.306+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610035070 con 0x7f061c100e20 2024-09-19T07:49:33.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.306+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061c1a5160 con 0x7f061c100e20 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.307+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061c101200 con 0x7f061c100e20 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.308+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0610042030 con 0x7f061c100e20 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.308+0000 7f060effd640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f06080a3240 0x7f06080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.308+0000 7f06217e7640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f06080a3240 0x7f06080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.308+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f06100eff20 con 0x7f061c100e20 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.309+0000 7f06217e7640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f06080a3240 0x7f06080a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f061c06aac0 tx=0x7f0618008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:33.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.312+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06100bcd90 con 0x7f061c100e20 2024-09-19T07:49:33.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.514+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f061c1a5330 con 0x7f061c100e20 2024-09-19T07:49:33.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.596+0000 7f060effd640 1 -- 172.21.15.76:0/3059341383 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f06100bc690 con 0x7f061c100e20 2024-09-19T07:49:33.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f06080a3240 msgr2=0x7f06080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:33.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f06080a3240 0x7f06080a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f061c06aac0 tx=0x7f0618008040 comp rx=0 tx=0).stop 2024-09-19T07:49:33.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 msgr2=0x7f061c199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c199570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0610006010 tx=0x7f0610004c00 comp rx=0 tx=0).stop 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 shutdown_connections 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f06080a3240 0x7f06080a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c102ef0 0x7f061c1a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c102570 0x7f061c199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 --2- 172.21.15.76:0/3059341383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f061c100e20 0x7f061c199570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 >> 172.21.15.76:0/3059341383 conn(0x7f061c0fc7d0 msgr2=0x7f061c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 shutdown_connections 2024-09-19T07:49:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:33.598+0000 7f062424c640 1 -- 172.21.15.76:0/3059341383 wait complete. 2024-09-19T07:49:33.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:33 smithi137 ceph-mon[35309]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-09-19T07:49:33.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:33 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3059341383' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:49:33.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:33 smithi076 ceph-mon[30930]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-09-19T07:49:33.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:33 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3059341383' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:49:34.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:33 smithi152 ceph-mon[35117]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-09-19T07:49:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:33 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3059341383' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:49:34.269 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T07:49:34.270 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T07:49:34.516 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:34 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3059341383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:49:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:34 smithi152 ceph-mon[35117]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:34.811 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: 2024-09-19T07:49:34.501+0000 7f85aa0f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T07:49:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:34 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3059341383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:49:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:34 smithi137 ceph-mon[35309]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:34.921 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:34 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3059341383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:49:34.921 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:34 smithi076 ceph-mon[30930]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:35.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2238036409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d41002f0 msgr2=0x7ff9d41006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:35.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2238036409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d41002f0 0x7ff9d41006d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009930 tx=0x7ff9c802a420 comp rx=0 tx=0).stop 2024-09-19T07:49:35.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2238036409 shutdown_connections 2024-09-19T07:49:35.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2238036409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d4106f50 0x7ff9d410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2238036409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 0x7ff9d4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2238036409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d41002f0 0x7ff9d41006d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2238036409 >> 172.21.15.76:0/2238036409 conn(0x7ff9d4077210 msgr2=0x7ff9d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2238036409 shutdown_connections 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2238036409 wait complete. 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 Processor -- start 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.003+0000 7ff9dc6ef640 1 -- start start 2024-09-19T07:49:35.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d41002f0 0x7ff9d41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 0x7ff9d4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 0x7ff9d419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4112160 con 0x7ff9d4106f50 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4111fe0 con 0x7ff9d4100ca0 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41122e0 con 0x7ff9d41002f0 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 0x7ff9d419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 0x7ff9d419ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48058/0 (socket says 172.21.15.76:48058) 2024-09-19T07:49:35.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 -- 172.21.15.76:0/2996705020 learned_addr learned my addr 172.21.15.76:0/2996705020 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9da48b640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d41002f0 0x7ff9d41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9d9c8a640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 0x7ff9d4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 -- 172.21.15.76:0/2996705020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d41002f0 msgr2=0x7ff9d41985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d41002f0 0x7ff9d41985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 -- 172.21.15.76:0/2996705020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 msgr2=0x7ff9d4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 0x7ff9d4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 -- 172.21.15.76:0/2996705020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d419d590 con 0x7ff9d4106f50 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9d9c8a640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 0x7ff9d4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9da48b640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d41002f0 0x7ff9d41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:35.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dac8c640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 0x7ff9d419ceb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00eaa0 tx=0x7ff9cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00cdb0 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9cc004b20 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d419d880 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc011760 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.004+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41a5160 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.006+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d41006d0 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.007+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff9cc004cd0 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.007+0000 7ff9c77fe640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff9c00a3240 0x7ff9c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.008+0000 7ff9da48b640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff9c00a3240 0x7ff9c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.008+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ff9cc0cfaf0 con 0x7ff9d4106f50 2024-09-19T07:49:35.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.008+0000 7ff9da48b640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff9c00a3240 0x7ff9c00a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:35.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.012+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9cc016030 con 0x7ff9d4106f50 2024-09-19T07:49:35.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.216+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7ff9d402d7c0 con 0x7ff9d4106f50 2024-09-19T07:49:35.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.602+0000 7ff9c77fe640 1 -- 172.21.15.76:0/2996705020 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ff9cc09c960 con 0x7ff9d4106f50 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff9c00a3240 msgr2=0x7ff9c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff9c00a3240 0x7ff9c00a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c8005a20 comp rx=0 tx=0).stop 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 msgr2=0x7ff9d419ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 0x7ff9d419ceb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00eaa0 tx=0x7ff9cc00ef60 comp rx=0 tx=0).stop 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 shutdown_connections 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff9d4106f50 0x7ff9d419ceb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff9c00a3240 0x7ff9c00a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9d4100ca0 0x7ff9d4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 --2- 172.21.15.76:0/2996705020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9d41002f0 0x7ff9d41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:35.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 >> 172.21.15.76:0/2996705020 conn(0x7ff9d4077210 msgr2=0x7ff9d4105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:35.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 shutdown_connections 2024-09-19T07:49:35.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:35.605+0000 7ff9dc6ef640 1 -- 172.21.15.76:0/2996705020 wait complete. 2024-09-19T07:49:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:35 smithi137 ceph-mon[35309]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:49:35.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:35 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2996705020' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:49:35.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:35 smithi076 ceph-mon[30930]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:49:35.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:35 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2996705020' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:49:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:35 smithi152 ceph-mon[35117]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:49:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:35 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2996705020' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:49:36.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T07:49:36.526 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:36 smithi137 ceph-mon[35309]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:49:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:36 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2996705020' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:49:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:36 smithi137 ceph-mon[35309]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:49:36.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:36 smithi137 ceph-mon[35309]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:36.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:36 smithi137 ceph-mon[35309]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T07:49:36.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:36 smithi137 ceph-mon[35309]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T07:49:36.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:36 smithi076 ceph-mon[30930]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:49:36.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:36 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2996705020' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:49:36.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:36 smithi076 ceph-mon[30930]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:49:36.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:36 smithi076 ceph-mon[30930]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:36.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:36 smithi076 ceph-mon[30930]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T07:49:36.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:36 smithi076 ceph-mon[30930]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T07:49:37.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 -- 172.21.15.76:0/3534224249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370074eb0 msgr2=0x7f2370112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:37.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 --2- 172.21.15.76:0/3534224249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370074eb0 0x7f2370112660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2360009900 tx=0x7f236002a480 comp rx=0 tx=0).stop 2024-09-19T07:49:37.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 -- 172.21.15.76:0/3534224249 shutdown_connections 2024-09-19T07:49:37.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 --2- 172.21.15.76:0/3534224249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2370112ba0 0x7f2370114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 --2- 172.21.15.76:0/3534224249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370074eb0 0x7f2370112660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 --2- 172.21.15.76:0/3534224249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2370074590 0x7f2370074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 -- 172.21.15.76:0/3534224249 >> 172.21.15.76:0/3534224249 conn(0x7f23700fd8b0 msgr2=0x7f23700ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 -- 172.21.15.76:0/3534224249 shutdown_connections 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.996+0000 7f23778df640 1 -- 172.21.15.76:0/3534224249 wait complete. 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 Processor -- start 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 -- start start 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2370074590 0x7f23701a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2370074eb0 0x7f23701a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 0x7f237019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2370118700 con 0x7f2370112ba0 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2370118580 con 0x7f2370074590 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.997+0000 7f23778df640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2370118880 con 0x7f2370074eb0 2024-09-19T07:49:37.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 0x7f237019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 0x7f237019e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48080/0 (socket says 172.21.15.76:48080) 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 -- 172.21.15.76:0/1807134145 learned_addr learned my addr 172.21.15.76:0/1807134145 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f237567b640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2370074590 0x7f23701a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2374e7a640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2370074eb0 0x7f23701a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 -- 172.21.15.76:0/1807134145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2370074eb0 msgr2=0x7f23701a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2370074eb0 0x7f23701a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 -- 172.21.15.76:0/1807134145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2370074590 msgr2=0x7f23701a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2370074590 0x7f23701a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 -- 172.21.15.76:0/1807134145 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237019f0a0 con 0x7f2370112ba0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f2375e7c640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 0x7f237019e970 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f236800ccb0 tx=0x7f236800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368003970 con 0x7f2370112ba0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2368004530 con 0x7f2370112ba0 2024-09-19T07:49:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237019f390 con 0x7f2370112ba0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236800f740 con 0x7f2370112ba0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.998+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23701ab680 con 0x7f2370112ba0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:36.999+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2370074970 con 0x7f2370112ba0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.000+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f23680046e0 con 0x7f2370112ba0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.001+0000 7f23667fc640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f235c0a32c0 0x7f235c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.001+0000 7f237567b640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f235c0a32c0 0x7f235c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.001+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f23680cfc90 con 0x7f2370112ba0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.002+0000 7f237567b640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f235c0a32c0 0x7f235c0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f237019fab0 tx=0x7f236c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.005+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2368014070 con 0x7f2370112ba0 2024-09-19T07:49:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:36 smithi152 ceph-mon[35117]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:49:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:36 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2996705020' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:49:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:36 smithi152 ceph-mon[35117]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:49:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:36 smithi152 ceph-mon[35117]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:49:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:36 smithi152 ceph-mon[35117]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T07:49:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:36 smithi152 ceph-mon[35117]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T07:49:37.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.209+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f23701aba10 con 0x7f2370112ba0 2024-09-19T07:49:37.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.615+0000 7f23667fc640 1 -- 172.21.15.76:0/1807134145 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f236809cb60 con 0x7f2370112ba0 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.617+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f235c0a32c0 msgr2=0x7f235c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.617+0000 7f23778df640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f235c0a32c0 0x7f235c0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f237019fab0 tx=0x7f236c009110 comp rx=0 tx=0).stop 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.617+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 msgr2=0x7f237019e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.617+0000 7f23778df640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 0x7f237019e970 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f236800ccb0 tx=0x7f236800a620 comp rx=0 tx=0).stop 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.617+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 shutdown_connections 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.617+0000 7f23778df640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2370112ba0 0x7f237019e970 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.618+0000 7f23778df640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2370074eb0 0x7f23701a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.618+0000 7f23778df640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f235c0a32c0 0x7f235c0a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.618+0000 7f23778df640 1 --2- 172.21.15.76:0/1807134145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2370074590 0x7f23701a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:37.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.618+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 >> 172.21.15.76:0/1807134145 conn(0x7f23700fd8b0 msgr2=0x7f23700fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:37.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.618+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 shutdown_connections 2024-09-19T07:49:37.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:37.618+0000 7f23778df640 1 -- 172.21.15.76:0/1807134145 wait complete. 2024-09-19T07:49:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-19T07:49:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] up:active 2024-09-19T07:49:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:49:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:49:37.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: Cluster is now healthy 2024-09-19T07:49:37.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T07:49:37.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T07:49:37.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T07:49:37.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:37 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1807134145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:49:37.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] up:active 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: Cluster is now healthy 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T07:49:37.927 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:37 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1807134145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] up:active 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: Cluster is now healthy 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T07:49:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T07:49:38.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:37 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1807134145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:49:38.263 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T07:49:38.508 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:38 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1807134145' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:49:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:38 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] up:active 2024-09-19T07:49:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:38 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T07:49:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:38 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:49:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:38 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1807134145' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:49:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:38 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] up:active 2024-09-19T07:49:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:38 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T07:49:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:38 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 -- 172.21.15.76:0/145800288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac103720 msgr2=0x7f12ac10bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 --2- 172.21.15.76:0/145800288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac103720 0x7f12ac10bc10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f129c009900 tx=0x7f129c02a480 comp rx=0 tx=0).stop 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 -- 172.21.15.76:0/145800288 shutdown_connections 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 --2- 172.21.15.76:0/145800288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ac10c1a0 0x7f12ac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 --2- 172.21.15.76:0/145800288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac103720 0x7f12ac10bc10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 --2- 172.21.15.76:0/145800288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac102e00 0x7f12ac1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 -- 172.21.15.76:0/145800288 >> 172.21.15.76:0/145800288 conn(0x7f12ac0fc7a0 msgr2=0x7f12ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 -- 172.21.15.76:0/145800288 shutdown_connections 2024-09-19T07:49:39.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.046+0000 7f12b3643640 1 -- 172.21.15.76:0/145800288 wait complete. 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 Processor -- start 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 -- start start 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 0x7f12ac1a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac103720 0x7f12ac1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ac10c1a0 0x7f12ac19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac112170 con 0x7f12ac102e00 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac111ff0 con 0x7f12ac103720 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b3643640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac1122f0 con 0x7f12ac10c1a0 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 0x7f12ac1a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 0x7f12ac1a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48106/0 (socket says 172.21.15.76:48106) 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 -- 172.21.15.76:0/2173026091 learned_addr learned my addr 172.21.15.76:0/2173026091 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:39.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b1be0640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ac10c1a0 0x7f12ac19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b0bde640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac103720 0x7f12ac1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 -- 172.21.15.76:0/2173026091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ac10c1a0 msgr2=0x7f12ac19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ac10c1a0 0x7f12ac19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 -- 172.21.15.76:0/2173026091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac103720 msgr2=0x7f12ac1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac103720 0x7f12ac1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.047+0000 7f12b13df640 1 -- 172.21.15.76:0/2173026091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac19aef0 con 0x7f12ac102e00 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.048+0000 7f12b13df640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 0x7f12ac1a05b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b4a0 tx=0x7f12a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.048+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8014070 con 0x7f12ac102e00 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.048+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12a8010b10 con 0x7f12ac102e00 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.048+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8017d60 con 0x7f12ac102e00 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.048+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac19b1e0 con 0x7f12ac102e00 2024-09-19T07:49:39.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.048+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a7360 con 0x7f12ac102e00 2024-09-19T07:49:39.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.049+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac06afb0 con 0x7f12ac102e00 2024-09-19T07:49:39.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.051+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f12a8017070 con 0x7f12ac102e00 2024-09-19T07:49:39.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.052+0000 7f12a27fc640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f12980a3240 0x7f12980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:39.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.052+0000 7f12b0bde640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f12980a3240 0x7f12980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:39.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.052+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f12a80cf050 con 0x7f12ac102e00 2024-09-19T07:49:39.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.052+0000 7f12b0bde640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f12980a3240 0x7f12980a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12ac19bed0 tx=0x7f129c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:39.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.055+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12a809be20 con 0x7f12ac102e00 2024-09-19T07:49:39.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:38 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1807134145' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:49:39.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:38 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] up:active 2024-09-19T07:49:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:38 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T07:49:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:38 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:49:39.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.255+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f12ac1a75c0 con 0x7f12ac102e00 2024-09-19T07:49:39.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.635+0000 7f12a27fc640 1 -- 172.21.15.76:0/2173026091 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f12a809b720 con 0x7f12ac102e00 2024-09-19T07:49:39.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f12980a3240 msgr2=0x7f12980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:39.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f12980a3240 0x7f12980a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12ac19bed0 tx=0x7f129c0095f0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 msgr2=0x7f12ac1a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:39.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 0x7f12ac1a05b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b4a0 tx=0x7f12a800b960 comp rx=0 tx=0).stop 2024-09-19T07:49:39.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 shutdown_connections 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ac10c1a0 0x7f12ac19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f12980a3240 0x7f12980a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac103720 0x7f12ac1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 --2- 172.21.15.76:0/2173026091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12ac102e00 0x7f12ac1a05b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 >> 172.21.15.76:0/2173026091 conn(0x7f12ac0fc7a0 msgr2=0x7f12ac101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 shutdown_connections 2024-09-19T07:49:39.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:39.638+0000 7f12b3643640 1 -- 172.21.15.76:0/2173026091 wait complete. 2024-09-19T07:49:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:39 smithi152 ceph-mon[35117]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 3.6 KiB/s wr, 10 op/s 2024-09-19T07:49:39.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:39 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2173026091' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:49:39.811 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: 2024-09-19T07:49:39.501+0000 7f85aa0f6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T07:49:39.811 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 07:49:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: 2024-09-19T07:49:39.501+0000 7f85aa0f6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T07:49:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:39 smithi137 ceph-mon[35309]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 3.6 KiB/s wr, 10 op/s 2024-09-19T07:49:39.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:39 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2173026091' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:49:39.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:39 smithi076 ceph-mon[30930]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 3.6 KiB/s wr, 10 op/s 2024-09-19T07:49:39.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:39 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2173026091' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:49:40.293 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T07:49:40.294 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T07:49:40.541 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:40 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2173026091' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:49:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:40 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:49:40.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:40 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2173026091' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:49:40.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:40 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:49:41.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 -- 172.21.15.76:0/2348811629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc101df0 msgr2=0x7fa8fc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 --2- 172.21.15.76:0/2348811629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc101df0 0x7fa8fc1021d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009900 tx=0x7fa8ec02a410 comp rx=0 tx=0).stop 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 -- 172.21.15.76:0/2348811629 shutdown_connections 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 --2- 172.21.15.76:0/2348811629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 0x7fa8fc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 --2- 172.21.15.76:0/2348811629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 --2- 172.21.15.76:0/2348811629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc101df0 0x7fa8fc1021d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 -- 172.21.15.76:0/2348811629 >> 172.21.15.76:0/2348811629 conn(0x7fa8fc0fd8b0 msgr2=0x7fa8fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 -- 172.21.15.76:0/2348811629 shutdown_connections 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.014+0000 7fa90245c640 1 -- 172.21.15.76:0/2348811629 wait complete. 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.015+0000 7fa90245c640 1 Processor -- start 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.015+0000 7fa90245c640 1 -- start start 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8fc101df0 0x7fa8fc1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:41.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 0x7fa8fc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc1120a0 con 0x7fa8fc1027a0 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc111f20 con 0x7fa8fc101df0 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc112220 con 0x7fa8fc106f20 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48120/0 (socket says 172.21.15.76:48120) 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 -- 172.21.15.76:0/2994295098 learned_addr learned my addr 172.21.15.76:0/2994295098 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fbfff640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8fc101df0 0x7fa8fc1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa9009f9640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 0x7fa8fc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 -- 172.21.15.76:0/2994295098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 msgr2=0x7fa8fc19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 0x7fa8fc19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 -- 172.21.15.76:0/2994295098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8fc101df0 msgr2=0x7fa8fc1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:41.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8fc101df0 0x7fa8fc1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 -- 172.21.15.76:0/2994295098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8fc19d590 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa9009f9640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 0x7fa8fc19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8fb7fe640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc198b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000d950 tx=0x7fa8f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0017070 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8f0009c30 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8fc19d880 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000f740 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.016+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8fc1a5160 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.017+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc1021d0 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.018+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa8f0010a80 con 0x7fa8fc1027a0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.019+0000 7fa8f97fa640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa8e40a3240 0x7fa8e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.019+0000 7fa8fbfff640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa8e40a3240 0x7fa8e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:41.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.019+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fa8f00cf410 con 0x7fa8fc1027a0 2024-09-19T07:49:41.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.020+0000 7fa8fbfff640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa8e40a3240 0x7fa8e40a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009230 tx=0x7fa8ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:41.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.023+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8f0009de0 con 0x7fa8fc1027a0 2024-09-19T07:49:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:40 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2173026091' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:49:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:40 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:49:41.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.213+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa8fc10a130 con 0x7fa8e40a3240 2024-09-19T07:49:41.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.237+0000 7fa8f97fa640 1 -- 172.21.15.76:0/2994295098 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8fc10a130 con 0x7fa8e40a3240 2024-09-19T07:49:41.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa8e40a3240 msgr2=0x7fa8e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa8e40a3240 0x7fa8e40a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009230 tx=0x7fa8ec0058d0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 msgr2=0x7fa8fc198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc198b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000d950 tx=0x7fa8f000de10 comp rx=0 tx=0).stop 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 shutdown_connections 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8fc106f20 0x7fa8fc19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa8fc1027a0 0x7fa8fc198b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa8e40a3240 0x7fa8e40a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 --2- 172.21.15.76:0/2994295098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8fc101df0 0x7fa8fc1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 >> 172.21.15.76:0/2994295098 conn(0x7fa8fc0fd8b0 msgr2=0x7fa8fc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.239+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 shutdown_connections 2024-09-19T07:49:41.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:41.240+0000 7fa90245c640 1 -- 172.21.15.76:0/2994295098 wait complete. 2024-09-19T07:49:41.642 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:49:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:49:41.218+0000 7fa06a25e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:49:41.642 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:49:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:49:41.218+0000 7fa06a25e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:49:41.642 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:49:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:49:41.218+0000 7fa06a25e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:49:41.643 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:49:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:49:41.218+0000 7fa06a25e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:49:41.643 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:49:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:49:41.218+0000 7fa06a25e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:49:41.859 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T07:49:41.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:41 smithi137 ceph-mon[35309]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-19T07:49:41.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:41 smithi076 ceph-mon[30930]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-19T07:49:42.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:41 smithi152 ceph-mon[35117]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-19T07:49:42.106 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:42.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 -- 172.21.15.76:0/1670822067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 msgr2=0x7f86ec103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:42.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 --2- 172.21.15.76:0/1670822067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec103120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009900 tx=0x7f86dc02a480 comp rx=0 tx=0).stop 2024-09-19T07:49:42.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 -- 172.21.15.76:0/1670822067 shutdown_connections 2024-09-19T07:49:42.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 --2- 172.21.15.76:0/1670822067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ec10c170 0x7f86ec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 --2- 172.21.15.76:0/1670822067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86ec103660 0x7f86ec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 --2- 172.21.15.76:0/1670822067 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec103120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 -- 172.21.15.76:0/1670822067 >> 172.21.15.76:0/1670822067 conn(0x7f86ec0fc7a0 msgr2=0x7f86ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 -- 172.21.15.76:0/1670822067 shutdown_connections 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.593+0000 7f86f1247640 1 -- 172.21.15.76:0/1670822067 wait complete. 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 Processor -- start 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 -- start start 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86ec103660 0x7f86ec100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ec10c170 0x7f86ec101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1120f0 con 0x7f86ec102d40 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec111f70 con 0x7f86ec10c170 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86f1247640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec112270 con 0x7f86ec103660 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86ead9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:42.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86ead9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48158/0 (socket says 172.21.15.76:48158) 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86ead9d640 1 -- 172.21.15.76:0/2049661155 learned_addr learned my addr 172.21.15.76:0/2049661155 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.594+0000 7f86ead9d640 1 -- 172.21.15.76:0/2049661155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86ec103660 msgr2=0x7f86ec100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86ead9d640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86ec103660 0x7f86ec100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86ead9d640 1 -- 172.21.15.76:0/2049661155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ec10c170 msgr2=0x7f86ec101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86ead9d640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ec10c170 0x7f86ec101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86ead9d640 1 -- 172.21.15.76:0/2049661155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec1a6a50 con 0x7f86ec102d40 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86ead9d640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec1009a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f86dc006010 tx=0x7f86dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc03f030 con 0x7f86ec102d40 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86dc003d00 con 0x7f86ec102d40 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec1a6ce0 con 0x7f86ec102d40 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc035070 con 0x7f86ec102d40 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.595+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec1a71c0 con 0x7f86ec102d40 2024-09-19T07:49:42.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.596+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ec103120 con 0x7f86ec102d40 2024-09-19T07:49:42.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.597+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f86dc042030 con 0x7f86ec102d40 2024-09-19T07:49:42.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.598+0000 7f86e8d99640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f86d80a3240 0x7f86d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:42.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.598+0000 7f86e3fff640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f86d80a3240 0x7f86d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:42.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.598+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f86dc0f0210 con 0x7f86ec102d40 2024-09-19T07:49:42.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.598+0000 7f86e3fff640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f86d80a3240 0x7f86d80a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f86ec102430 tx=0x7f86d4006d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:42.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.602+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86dc0bd080 con 0x7f86ec102d40 2024-09-19T07:49:42.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.796+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f86ec062630 con 0x7f86d80a3240 2024-09-19T07:49:42.798 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:42 smithi076 ceph-mon[30930]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:42.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.821+0000 7f86e8d99640 1 -- 172.21.15.76:0/2049661155 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86ec062630 con 0x7f86d80a3240 2024-09-19T07:49:42.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f86d80a3240 msgr2=0x7f86d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:42.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f86d80a3240 0x7f86d80a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f86ec102430 tx=0x7f86d4006d30 comp rx=0 tx=0).stop 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 msgr2=0x7f86ec1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec1009a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f86dc006010 tx=0x7f86dc0042f0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 shutdown_connections 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f86d80a3240 0x7f86d80a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86ec10c170 0x7f86ec101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86ec103660 0x7f86ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 --2- 172.21.15.76:0/2049661155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f86ec102d40 0x7f86ec1009a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 >> 172.21.15.76:0/2049661155 conn(0x7f86ec0fc7a0 msgr2=0x7f86ec0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 shutdown_connections 2024-09-19T07:49:42.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:42.823+0000 7f86f1247640 1 -- 172.21.15.76:0/2049661155 wait complete. 2024-09-19T07:49:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:42 smithi137 ceph-mon[35309]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:42 smithi152 ceph-mon[35117]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:43.560 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T07:49:43.809 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:43 smithi137 ceph-mon[35309]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-19T07:49:43.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:43 smithi137 ceph-mon[35309]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T07:49:43.931 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:43 smithi076 ceph-mon[30930]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-19T07:49:43.931 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:43 smithi076 ceph-mon[30930]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T07:49:43.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:43 smithi152 ceph-mon[35117]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-19T07:49:43.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:43 smithi152 ceph-mon[35117]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T07:49:44.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 -- 172.21.15.76:0/1508855081 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5681036c0 msgr2=0x7fc56810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 --2- 172.21.15.76:0/1508855081 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5681036c0 0x7fc56810bbb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc550009900 tx=0x7fc55002a480 comp rx=0 tx=0).stop 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 -- 172.21.15.76:0/1508855081 shutdown_connections 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 --2- 172.21.15.76:0/1508855081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 0x7fc56810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 --2- 172.21.15.76:0/1508855081 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc5681036c0 0x7fc56810bbb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 --2- 172.21.15.76:0/1508855081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc568102da0 0x7fc568103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 -- 172.21.15.76:0/1508855081 >> 172.21.15.76:0/1508855081 conn(0x7fc5680fc7a0 msgr2=0x7fc5680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 -- 172.21.15.76:0/1508855081 shutdown_connections 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 -- 172.21.15.76:0/1508855081 wait complete. 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.311+0000 7fc56dd35640 1 Processor -- start 2024-09-19T07:49:44.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 -- start start 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 0x7fc568198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5681036c0 0x7fc568198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 0x7fc56819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc568112100 con 0x7fc568102da0 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc568111f80 con 0x7fc5681036c0 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc568112280 con 0x7fc56810c180 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 0x7fc568198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 0x7fc568198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39774/0 (socket says 172.21.15.76:39774) 2024-09-19T07:49:44.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 -- 172.21.15.76:0/720224575 learned_addr learned my addr 172.21.15.76:0/720224575 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc55ffff640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5681036c0 0x7fc568198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc567fff640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 0x7fc56819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 -- 172.21.15.76:0/720224575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 msgr2=0x7fc56819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 0x7fc56819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 -- 172.21.15.76:0/720224575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5681036c0 msgr2=0x7fc568198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5681036c0 0x7fc568198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 -- 172.21.15.76:0/720224575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56819d510 con 0x7fc568102da0 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc567fff640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 0x7fc56819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5677fe640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 0x7fc568198560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b4a0 tx=0x7fc55800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558014070 con 0x7fc568102da0 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.312+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56819d800 con 0x7fc568102da0 2024-09-19T07:49:44.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.313+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc558010b10 con 0x7fc568102da0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.313+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681a50e0 con 0x7fc568102da0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.313+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558017d60 con 0x7fc568102da0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.314+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc568103180 con 0x7fc568102da0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.315+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc558017070 con 0x7fc568102da0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.315+0000 7fc5657fa640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc5540a32d0 0x7fc5540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.316+0000 7fc55ffff640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc5540a32d0 0x7fc5540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.316+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc5580ceb80 con 0x7fc568102da0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.316+0000 7fc55ffff640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc5540a32d0 0x7fc5540a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc550009230 tx=0x7fc5500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:44.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.320+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc55809ba00 con 0x7fc568102da0 2024-09-19T07:49:44.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.514+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc568107230 con 0x7fc5540a32d0 2024-09-19T07:49:44.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.519+0000 7fc5657fa640 1 -- 172.21.15.76:0/720224575 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc550031740 con 0x7fc5540a32d0 2024-09-19T07:49:44.521 INFO:teuthology.orchestra.run.smithi076.stdout:/volumes/qa/sv_0/548517e4-5218-4f1e-9a5b-bd1c6be09bf6 2024-09-19T07:49:44.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc5540a32d0 msgr2=0x7fc5540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:44.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc5540a32d0 0x7fc5540a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc550009230 tx=0x7fc5500058d0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 msgr2=0x7fc568198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:44.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 0x7fc568198560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b4a0 tx=0x7fc55800b960 comp rx=0 tx=0).stop 2024-09-19T07:49:44.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 shutdown_connections 2024-09-19T07:49:44.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc56810c180 0x7fc56819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc5540a32d0 0x7fc5540a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5681036c0 0x7fc568198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 --2- 172.21.15.76:0/720224575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc568102da0 0x7fc568198560 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:44.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 >> 172.21.15.76:0/720224575 conn(0x7fc5680fc7a0 msgr2=0x7fc5680fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:44.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 shutdown_connections 2024-09-19T07:49:44.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:44.522+0000 7fc56dd35640 1 -- 172.21.15.76:0/720224575 wait complete. 2024-09-19T07:49:44.890 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:44 smithi076 ceph-mon[30930]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:44 smithi137 ceph-mon[35309]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:45.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:44 smithi152 ceph-mon[35117]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:45.218 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T07:49:45.463 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:45.886 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:45 smithi076 ceph-mon[30930]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:45.887 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:45 smithi076 ceph-mon[30930]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-09-19T07:49:45.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:45 smithi137 ceph-mon[35309]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:45 smithi137 ceph-mon[35309]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 -- 172.21.15.76:0/4107296426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 msgr2=0x7f043410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 --2- 172.21.15.76:0/4107296426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043410e610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f042c009ca0 tx=0x7f042c02a950 comp rx=0 tx=0).stop 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 -- 172.21.15.76:0/4107296426 shutdown_connections 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 --2- 172.21.15.76:0/4107296426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043410e610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 --2- 172.21.15.76:0/4107296426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0434103700 0x7f043410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 --2- 172.21.15.76:0/4107296426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0434102de0 0x7f04341031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 -- 172.21.15.76:0/4107296426 >> 172.21.15.76:0/4107296426 conn(0x7f04340fc7a0 msgr2=0x7f04340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 -- 172.21.15.76:0/4107296426 shutdown_connections 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 -- 172.21.15.76:0/4107296426 wait complete. 2024-09-19T07:49:45.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.972+0000 7f04396c5640 1 Processor -- start 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 -- start start 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0434102de0 0x7f043419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0434103700 0x7f043419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04341120f0 con 0x7f043410c180 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0434111f70 con 0x7f0434102de0 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04396c5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0434112270 con 0x7f0434103700 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39794/0 (socket says 172.21.15.76:39794) 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 -- 172.21.15.76:0/3693004621 learned_addr learned my addr 172.21.15.76:0/3693004621 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f0432ffd640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0434102de0 0x7f043419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 -- 172.21.15.76:0/3693004621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0434103700 msgr2=0x7f043419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:45.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f042a7fc640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0434103700 0x7f043419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0434103700 0x7f043419ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 -- 172.21.15.76:0/3693004621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0434102de0 msgr2=0x7f043419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0434102de0 0x7f043419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.973+0000 7f04337fe640 1 -- 172.21.15.76:0/3693004621 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043419f6c0 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.974+0000 7f04337fe640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043419efe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f042c005cc0 tx=0x7f042c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.974+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c034040 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.974+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043419f950 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.974+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f042c030940 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.974+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c045480 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.974+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04341a7290 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.975+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04341031c0 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.976+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f042c037020 con 0x7f043410c180 2024-09-19T07:49:45.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.977+0000 7f0430ff9640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04200a32d0 0x7f04200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:45.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.977+0000 7f0432ffd640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04200a32d0 0x7f04200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:45.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.977+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f042c0f07f0 con 0x7f043410c180 2024-09-19T07:49:45.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.977+0000 7f0432ffd640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04200a32d0 0x7f04200a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0424009990 tx=0x7f0424009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:45.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:45.981+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f042c030b10 con 0x7f043410c180 2024-09-19T07:49:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:45 smithi152 ceph-mon[35117]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:45 smithi152 ceph-mon[35117]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-09-19T07:49:46.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.172+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0434102090 con 0x7f04200a32d0 2024-09-19T07:49:46.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.198+0000 7f0430ff9640 1 -- 172.21.15.76:0/3693004621 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0434102090 con 0x7f04200a32d0 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.200+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04200a32d0 msgr2=0x7f04200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.200+0000 7f04396c5640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04200a32d0 0x7f04200a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0424009990 tx=0x7f0424009110 comp rx=0 tx=0).stop 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.200+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 msgr2=0x7f043419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.200+0000 7f04396c5640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043419efe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f042c005cc0 tx=0x7f042c02f790 comp rx=0 tx=0).stop 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 shutdown_connections 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f043410c180 0x7f043419efe0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0434103700 0x7f043419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04200a32d0 0x7f04200a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 --2- 172.21.15.76:0/3693004621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0434102de0 0x7f043419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 >> 172.21.15.76:0/3693004621 conn(0x7f04340fc7a0 msgr2=0x7f0434100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 shutdown_connections 2024-09-19T07:49:46.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:46.201+0000 7f04396c5640 1 -- 172.21.15.76:0/3693004621 wait complete. 2024-09-19T07:49:46.981 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T07:49:47.227 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:47.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 -- 172.21.15.76:0/3220356150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 msgr2=0x7f66a8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 --2- 172.21.15.76:0/3220356150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8103120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009900 tx=0x7f66a402a480 comp rx=0 tx=0).stop 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 -- 172.21.15.76:0/3220356150 shutdown_connections 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 --2- 172.21.15.76:0/3220356150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a810c170 0x7f66a810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 --2- 172.21.15.76:0/3220356150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a8103660 0x7f66a810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 --2- 172.21.15.76:0/3220356150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8103120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 -- 172.21.15.76:0/3220356150 >> 172.21.15.76:0/3220356150 conn(0x7f66a80fc7a0 msgr2=0x7f66a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 -- 172.21.15.76:0/3220356150 shutdown_connections 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.731+0000 7f66af87f640 1 -- 172.21.15.76:0/3220356150 wait complete. 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 Processor -- start 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 -- start start 2024-09-19T07:49:47.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a8103660 0x7f66a8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a810c170 0x7f66a819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8112090 con 0x7f66a8102d40 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8111f10 con 0x7f66a8103660 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66af87f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8112210 con 0x7f66a810c170 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66ad61b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66ad61b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39808/0 (socket says 172.21.15.76:39808) 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66ad61b640 1 -- 172.21.15.76:0/2654811398 learned_addr learned my addr 172.21.15.76:0/2654811398 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66ade1c640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a810c170 0x7f66a819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:47.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66ace1a640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a8103660 0x7f66a8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.732+0000 7f66ad61b640 1 -- 172.21.15.76:0/2654811398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a810c170 msgr2=0x7f66a819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66ad61b640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a810c170 0x7f66a819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66ad61b640 1 -- 172.21.15.76:0/2654811398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a8103660 msgr2=0x7f66a8198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66ad61b640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a8103660 0x7f66a8198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66ad61b640 1 -- 172.21.15.76:0/2654811398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a819d520 con 0x7f66a8102d40 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66ace1a640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a8103660 0x7f66a8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66ad61b640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8198570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f66a4006010 tx=0x7f66a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a403f030 con 0x7f66a8102d40 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66a4003d00 con 0x7f66a8102d40 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4035070 con 0x7f66a8102d40 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a819d7b0 con 0x7f66a8102d40 2024-09-19T07:49:47.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.733+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a819dc40 con 0x7f66a8102d40 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.734+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a8103120 con 0x7f66a8102d40 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.735+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f66a4042030 con 0x7f66a8102d40 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.736+0000 7f669e7fc640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66940a32d0 0x7f66940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.736+0000 7f66ace1a640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66940a32d0 0x7f66940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.736+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f66a40f0140 con 0x7f66a8102d40 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.737+0000 7f66ace1a640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66940a32d0 0x7f66940a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6698005fd0 tx=0x7f6698005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:47.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.740+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66a40bcf70 con 0x7f66a8102d40 2024-09-19T07:49:47.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.932+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f66a80fe520 con 0x7f66940a32d0 2024-09-19T07:49:47.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:47 smithi076 ceph-mon[30930]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:47.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:47 smithi076 ceph-mon[30930]: pgmap v289: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T07:49:47.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.938+0000 7f669e7fc640 1 -- 172.21.15.76:0/2654811398 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f66a80fe520 con 0x7f66940a32d0 2024-09-19T07:49:47.938 INFO:teuthology.orchestra.run.smithi076.stdout:/volumes/qa/sv_1/6d8fa84e-4060-4069-bec6-a498c8a82e85 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66940a32d0 msgr2=0x7f66940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66940a32d0 0x7f66940a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6698005fd0 tx=0x7f6698005850 comp rx=0 tx=0).stop 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 msgr2=0x7f66a8198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8198570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f66a4006010 tx=0x7f66a40042f0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 shutdown_connections 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a810c170 0x7f66a819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f66940a32d0 0x7f66940a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66a8103660 0x7f66a8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 --2- 172.21.15.76:0/2654811398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f66a8102d40 0x7f66a8198570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:47.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 >> 172.21.15.76:0/2654811398 conn(0x7f66a80fc7a0 msgr2=0x7f66a80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:47.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 shutdown_connections 2024-09-19T07:49:47.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:47.940+0000 7f66af87f640 1 -- 172.21.15.76:0/2654811398 wait complete. 2024-09-19T07:49:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:47 smithi152 ceph-mon[35117]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:48.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:47 smithi152 ceph-mon[35117]: pgmap v289: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T07:49:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:47 smithi137 ceph-mon[35309]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:47 smithi137 ceph-mon[35309]: pgmap v289: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T07:49:48.595 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:49:48.842 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 -- 172.21.15.76:0/2975428353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 msgr2=0x7f5c0810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/2975428353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c0810d970 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009ca0 tx=0x7f5c0002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 -- 172.21.15.76:0/2975428353 shutdown_connections 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/2975428353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c0810d970 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/2975428353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c081011c0 0x7f5c08101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/2975428353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c08105ad0 0x7f5c08105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 -- 172.21.15.76:0/2975428353 >> 172.21.15.76:0/2975428353 conn(0x7f5c08077210 msgr2=0x7f5c080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 -- 172.21.15.76:0/2975428353 shutdown_connections 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.367+0000 7f5c0ed46640 1 -- 172.21.15.76:0/2975428353 wait complete. 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 Processor -- start 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 -- start start 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c081011c0 0x7f5c080fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c080fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c08105ad0 0x7f5c080fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08111090 con 0x7f5c08101b60 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08110f10 con 0x7f5c08105ad0 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0ed46640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08111210 con 0x7f5c081011c0 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c080fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c080fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39836/0 (socket says 172.21.15.76:39836) 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 -- 172.21.15.76:0/1319804154 learned_addr learned my addr 172.21.15.76:0/1319804154 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0cae2640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c081011c0 0x7f5c080fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 -- 172.21.15.76:0/1319804154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c081011c0 msgr2=0x7f5c080fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c081011c0 0x7f5c080fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 -- 172.21.15.76:0/1319804154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c08105ad0 msgr2=0x7f5c080fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0d2e3640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c08105ad0 0x7f5c080fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c08105ad0 0x7f5c080fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 -- 172.21.15.76:0/1319804154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c081a6aa0 con 0x7f5c08101b60 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0cae2640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c081011c0 0x7f5c080fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c0d2e3640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c08105ad0 0x7f5c080fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.368+0000 7f5c07fff640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c080fcbd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b4a0 tx=0x7f5bf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.369+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4014070 con 0x7f5c08101b60 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.369+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5bf4010b10 con 0x7f5c08101b60 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.369+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c081a6d90 con 0x7f5c08101b60 2024-09-19T07:49:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.369+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4017d60 con 0x7f5c08101b60 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.369+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c081a7270 con 0x7f5c08101b60 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.370+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c081016a0 con 0x7f5c08101b60 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.371+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5bf4017070 con 0x7f5c08101b60 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.371+0000 7f5c05ffb640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5bf80a32d0 0x7f5bf80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.371+0000 7f5c0cae2640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5bf80a32d0 0x7f5bf80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.371+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5bf40cec10 con 0x7f5c08101b60 2024-09-19T07:49:49.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.373+0000 7f5c0cae2640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5bf80a32d0 0x7f5bf80a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:49.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.376+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bf409ba90 con 0x7f5c08101b60 2024-09-19T07:49:49.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.577+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c081a75d0 con 0x7f5c08101b60 2024-09-19T07:49:49.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.578+0000 7f5c05ffb640 1 -- 172.21.15.76:0/1319804154 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f5bf409b390 con 0x7f5c08101b60 2024-09-19T07:49:49.579 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:49.579 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"btime":"2024-09-19T07:49:39:630718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:49:39.257174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:49:49.579 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:49:49.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5bf80a32d0 msgr2=0x7f5bf80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:49.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5bf80a32d0 0x7f5bf80a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2024-09-19T07:49:49.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 msgr2=0x7f5c080fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:49.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c080fcbd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b4a0 tx=0x7f5bf400b960 comp rx=0 tx=0).stop 2024-09-19T07:49:49.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 shutdown_connections 2024-09-19T07:49:49.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5bf80a32d0 0x7f5bf80a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c08105ad0 0x7f5c080fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c08101b60 0x7f5c080fcbd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 --2- 172.21.15.76:0/1319804154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c081011c0 0x7f5c080fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:49.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 >> 172.21.15.76:0/1319804154 conn(0x7f5c08077210 msgr2=0x7f5c08100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:49.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 shutdown_connections 2024-09-19T07:49:49.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:49.581+0000 7f5c0ed46640 1 -- 172.21.15.76:0/1319804154 wait complete. 2024-09-19T07:49:49.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:49 smithi076 ceph-mon[30930]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:49 smithi076 ceph-mon[30930]: pgmap v290: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T07:49:49.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:49 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1319804154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:49 smithi152 ceph-mon[35117]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:49 smithi152 ceph-mon[35117]: pgmap v290: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T07:49:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:49 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1319804154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:50.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:49 smithi137 ceph-mon[35309]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:49:50.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:49 smithi137 ceph-mon[35309]: pgmap v290: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-19T07:49:50.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:49 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1319804154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:49:50.243 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:49:50.489 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:50.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 -- 172.21.15.76:0/4223494873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230100a80 msgr2=0x7f8230100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:50.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 --2- 172.21.15.76:0/4223494873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230100a80 0x7f8230100ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8224009930 tx=0x7f822402a420 comp rx=0 tx=0).stop 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 -- 172.21.15.76:0/4223494873 shutdown_connections 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 --2- 172.21.15.76:0/4223494873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230101420 0x7f823010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 --2- 172.21.15.76:0/4223494873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230100a80 0x7f8230100ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 --2- 172.21.15.76:0/4223494873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8230106a80 0x7f8230106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 -- 172.21.15.76:0/4223494873 >> 172.21.15.76:0/4223494873 conn(0x7f82300fc7a0 msgr2=0x7f82300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 -- 172.21.15.76:0/4223494873 shutdown_connections 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 -- 172.21.15.76:0/4223494873 wait complete. 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.972+0000 7f82360bd640 1 Processor -- start 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 -- start start 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8230100a80 0x7f8230199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 0x7f82301998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:50.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230106a80 0x7f82301a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8230110fa0 con 0x7f8230101420 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8230110e20 con 0x7f8230100a80 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f82360bd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8230111120 con 0x7f8230106a80 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 0x7f82301998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 0x7f82301998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39850/0 (socket says 172.21.15.76:39850) 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 -- 172.21.15.76:0/2223547473 learned_addr learned my addr 172.21.15.76:0/2223547473 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822f7fe640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8230100a80 0x7f8230199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822ffff640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230106a80 0x7f82301a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 -- 172.21.15.76:0/2223547473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230106a80 msgr2=0x7f82301a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230106a80 0x7f82301a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 -- 172.21.15.76:0/2223547473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8230100a80 msgr2=0x7f8230199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8230100a80 0x7f8230199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:50.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 -- 172.21.15.76:0/2223547473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82301a4930 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822ffff640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230106a80 0x7f82301a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822effd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 0x7f82301998b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8224009230 tx=0x7f8224004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.973+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822403f030 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.974+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8224003af0 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.974+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82301a4b00 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.974+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224035070 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.974+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82301a4f50 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.975+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8230100ee0 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.976+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8224042030 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.976+0000 7f822cff9640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f82180a32d0 0x7f82180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.976+0000 7f822f7fe640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f82180a32d0 0x7f82180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.976+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f82240efdc0 con 0x7f8230101420 2024-09-19T07:49:50.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.977+0000 7f822f7fe640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f82180a32d0 0x7f82180a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f822000bb60 tx=0x7f822000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:50.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:50.980+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82240bcb70 con 0x7f8230101420 2024-09-19T07:49:51.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.147+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82301a51e0 con 0x7f8230101420 2024-09-19T07:49:51.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.149+0000 7f822cff9640 1 -- 172.21.15.76:0/2223547473 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22304 (secure 0 0 0) 0x7f82240bc470 con 0x7f8230101420 2024-09-19T07:49:51.149 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:51.149 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:49:28.218729+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:49:51.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f82180a32d0 msgr2=0x7f82180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:51.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f82180a32d0 0x7f82180a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f822000bb60 tx=0x7f822000b390 comp rx=0 tx=0).stop 2024-09-19T07:49:51.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 msgr2=0x7f82301998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:51.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 0x7f82301998b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8224009230 tx=0x7f8224004270 comp rx=0 tx=0).stop 2024-09-19T07:49:51.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 shutdown_connections 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8230106a80 0x7f82301a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8230101420 0x7f82301998b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f82180a32d0 0x7f82180a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 --2- 172.21.15.76:0/2223547473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8230100a80 0x7f8230199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 >> 172.21.15.76:0/2223547473 conn(0x7f82300fc7a0 msgr2=0x7f82300fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 shutdown_connections 2024-09-19T07:49:51.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:51.151+0000 7f82360bd640 1 -- 172.21.15.76:0/2223547473 wait complete. 2024-09-19T07:49:51.772 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:51 smithi076 ceph-mon[30930]: pgmap v291: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T07:49:51.772 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:51 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2223547473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:51.773 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:49:51.773 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:49:52.022 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:52.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:51 smithi152 ceph-mon[35117]: pgmap v291: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T07:49:52.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:51 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2223547473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:52.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:51 smithi137 ceph-mon[35309]: pgmap v291: 97 pgs: 97 active+clean; 607 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T07:49:52.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:51 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2223547473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:49:52.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 -- 172.21.15.76:0/2755518146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c103660 msgr2=0x7fad3c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:52.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 --2- 172.21.15.76:0/2755518146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c103660 0x7fad3c10bb50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad30009900 tx=0x7fad3002a480 comp rx=0 tx=0).stop 2024-09-19T07:49:52.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 -- 172.21.15.76:0/2755518146 shutdown_connections 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 --2- 172.21.15.76:0/2755518146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c10c170 0x7fad3c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 --2- 172.21.15.76:0/2755518146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c103660 0x7fad3c10bb50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 --2- 172.21.15.76:0/2755518146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad3c102d40 0x7fad3c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 -- 172.21.15.76:0/2755518146 >> 172.21.15.76:0/2755518146 conn(0x7fad3c0fc7a0 msgr2=0x7fad3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 -- 172.21.15.76:0/2755518146 shutdown_connections 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.521+0000 7fad4266b640 1 -- 172.21.15.76:0/2755518146 wait complete. 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 Processor -- start 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 -- start start 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 0x7fad3c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c103660 0x7fad3c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad3c10c170 0x7fad3c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c112090 con 0x7fad3c102d40 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c111f10 con 0x7fad3c103660 2024-09-19T07:49:52.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad4266b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c112210 con 0x7fad3c10c170 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.522+0000 7fad3bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 0x7fad3c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 0x7fad3c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39872/0 (socket says 172.21.15.76:39872) 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 -- 172.21.15.76:0/2552307465 learned_addr learned my addr 172.21.15.76:0/2552307465 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad40c08640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad3c10c170 0x7fad3c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3b7fe640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c103660 0x7fad3c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 -- 172.21.15.76:0/2552307465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad3c10c170 msgr2=0x7fad3c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad3c10c170 0x7fad3c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 -- 172.21.15.76:0/2552307465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c103660 msgr2=0x7fad3c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c103660 0x7fad3c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 -- 172.21.15.76:0/2552307465 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c1a69a0 con 0x7fad3c102d40 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3b7fe640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c103660 0x7fad3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad3bfff640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 0x7fad3c1009a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00d950 tx=0x7fad2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:52.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c017070 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c1a6c90 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad2c009c30 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c00f740 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.523+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c1a71c0 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.524+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3c103120 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.525+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fad2c010a80 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.526+0000 7fad397fa640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fad240a32d0 0x7fad240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.526+0000 7fad3b7fe640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fad240a32d0 0x7fad240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.526+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fad2c0cf580 con 0x7fad3c102d40 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.526+0000 7fad3b7fe640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fad240a32d0 0x7fad240a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad30000c00 tx=0x7fad30032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:52.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.530+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad2c009de0 con 0x7fad3c102d40 2024-09-19T07:49:52.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.698+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad3c062630 con 0x7fad240a32d0 2024-09-19T07:49:52.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.705+0000 7fad397fa640 1 -- 172.21.15.76:0/2552307465 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258863 (secure 0 0 0) 0x7fad3c062630 con 0x7fad240a32d0 2024-09-19T07:49:52.707 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:52.709 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:49:52.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.707+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fad240a32d0 msgr2=0x7fad240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:52.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.707+0000 7fad4266b640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fad240a32d0 0x7fad240a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad30000c00 tx=0x7fad30032c80 comp rx=0 tx=0).stop 2024-09-19T07:49:52.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.707+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 msgr2=0x7fad3c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:52.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.707+0000 7fad4266b640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 0x7fad3c1009a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00d950 tx=0x7fad2c00de10 comp rx=0 tx=0).stop 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 shutdown_connections 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad3c10c170 0x7fad3c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fad240a32d0 0x7fad240a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad3c103660 0x7fad3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 --2- 172.21.15.76:0/2552307465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad3c102d40 0x7fad3c1009a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 >> 172.21.15.76:0/2552307465 conn(0x7fad3c0fc7a0 msgr2=0x7fad3c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 shutdown_connections 2024-09-19T07:49:52.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:52.708+0000 7fad4266b640 1 -- 172.21.15.76:0/2552307465 wait complete. 2024-09-19T07:49:53.523 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T07:49:52.611422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644717,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":241,"num_read_kb":229,"num_write":338,"num_write_kb":3037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376700,"kb_used_data":10812,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565124,"statfs":{"total":1151940427776,"available":1151554686976,"internally_reserved":0,"allocated":11071488,"data_stored":7013620,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":96,"num_write":36,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576867+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:49:28.576867+0000","last_peered":"2024-09-19T07:49:28.576867+0000","last_clean":"2024-09-19T07:49:28.576867+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:49:28.576867+0000","last_undegraded":"2024-09-19T07:49:28.576867+0000","last_fullsized":"2024-09-19T07:49:28.576867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586278+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:49:28.586278+0000","last_peered":"2024-09-19T07:49:28.586278+0000","last_clean":"2024-09-19T07:49:28.586278+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:49:28.586278+0000","last_undegraded":"2024-09-19T07:49:28.586278+0000","last_fullsized":"2024-09-19T07:49:28.586278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586428+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:49:28.586428+0000","last_peered":"2024-09-19T07:49:28.586428+0000","last_clean":"2024-09-19T07:49:28.586428+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:49:28.586428+0000","last_undegraded":"2024-09-19T07:49:28.586428+0000","last_fullsized":"2024-09-19T07:49:28.586428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574665+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:49:28.574665+0000","last_peered":"2024-09-19T07:49:28.574665+0000","last_clean":"2024-09-19T07:49:28.574665+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:49:28.574665+0000","last_undegraded":"2024-09-19T07:49:28.574665+0000","last_fullsized":"2024-09-19T07:49:28.574665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587400+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:49:28.587400+0000","last_peered":"2024-09-19T07:49:28.587400+0000","last_clean":"2024-09-19T07:49:28.587400+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:49:28.587400+0000","last_undegraded":"2024-09-19T07:49:28.587400+0000","last_fullsized":"2024-09-19T07:49:28.587400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583883+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:49:28.583883+0000","last_peered":"2024-09-19T07:49:28.583883+0000","last_clean":"2024-09-19T07:49:28.583883+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:49:28.583883+0000","last_undegraded":"2024-09-19T07:49:28.583883+0000","last_fullsized":"2024-09-19T07:49:28.583883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588881+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:49:28.588881+0000","last_peered":"2024-09-19T07:49:28.588881+0000","last_clean":"2024-09-19T07:49:28.588881+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:49:28.588881+0000","last_undegraded":"2024-09-19T07:49:28.588881+0000","last_fullsized":"2024-09-19T07:49:28.588881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582672+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:49:28.582672+0000","last_peered":"2024-09-19T07:49:28.582672+0000","last_clean":"2024-09-19T07:49:28.582672+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:49:28.582672+0000","last_undegraded":"2024-09-19T07:49:28.582672+0000","last_fullsized":"2024-09-19T07:49:28.582672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587654+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:49:28.587654+0000","last_peered":"2024-09-19T07:49:28.587654+0000","last_clean":"2024-09-19T07:49:28.587654+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:49:28.587654+0000","last_undegraded":"2024-09-19T07:49:28.587654+0000","last_fullsized":"2024-09-19T07:49:28.587654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584443+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:49:28.584443+0000","last_peered":"2024-09-19T07:49:28.584443+0000","last_clean":"2024-09-19T07:49:28.584443+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:49:28.584443+0000","last_undegraded":"2024-09-19T07:49:28.584443+0000","last_fullsized":"2024-09-19T07:49:28.584443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588871+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:49:28.588871+0000","last_peered":"2024-09-19T07:49:28.588871+0000","last_clean":"2024-09-19T07:49:28.588871+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:49:28.588871+0000","last_undegraded":"2024-09-19T07:49:28.588871+0000","last_fullsized":"2024-09-19T07:49:28.588871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574716+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:49:28.574716+0000","last_peered":"2024-09-19T07:49:28.574716+0000","last_clean":"2024-09-19T07:49:28.574716+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:49:28.574716+0000","last_undegraded":"2024-09-19T07:49:28.574716+0000","last_fullsized":"2024-09-19T07:49:28.574716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574235+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:49:28.574235+0000","last_peered":"2024-09-19T07:49:28.574235+0000","last_clean":"2024-09-19T07:49:28.574235+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:49:28.574235+0000","last_undegraded":"2024-09-19T07:49:28.574235+0000","last_fullsized":"2024-09-19T07:49:28.574235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585963+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:49:28.585963+0000","last_peered":"2024-09-19T07:49:28.585963+0000","last_clean":"2024-09-19T07:49:28.585963+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:49:28.585963+0000","last_undegraded":"2024-09-19T07:49:28.585963+0000","last_fullsized":"2024-09-19T07:49:28.585963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585859+0000","last_change":"2024-09-19T07:49:27.593189+0000","last_active":"2024-09-19T07:49:28.585859+0000","last_peered":"2024-09-19T07:49:28.585859+0000","last_clean":"2024-09-19T07:49:28.585859+0000","last_became_active":"2024-09-19T07:49:27.592865+0000","last_became_peered":"2024-09-19T07:49:27.592865+0000","last_unstale":"2024-09-19T07:49:28.585859+0000","last_undegraded":"2024-09-19T07:49:28.585859+0000","last_fullsized":"2024-09-19T07:49:28.585859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:21.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586532+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:49:28.586532+0000","last_peered":"2024-09-19T07:49:28.586532+0000","last_clean":"2024-09-19T07:49:28.586532+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:49:28.586532+0000","last_undegraded":"2024-09-19T07:49:28.586532+0000","last_fullsized":"2024-09-19T07:49:28.586532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576910+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:49:28.576910+0000","last_peered":"2024-09-19T07:49:28.576910+0000","last_clean":"2024-09-19T07:49:28.576910+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:49:28.576910+0000","last_undegraded":"2024-09-19T07:49:28.576910+0000","last_fullsized":"2024-09-19T07:49:28.576910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585053+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:49:28.585053+0000","last_peered":"2024-09-19T07:49:28.585053+0000","last_clean":"2024-09-19T07:49:28.585053+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:49:28.585053+0000","last_undegraded":"2024-09-19T07:49:28.585053+0000","last_fullsized":"2024-09-19T07:49:28.585053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585034+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:49:28.585034+0000","last_peered":"2024-09-19T07:49:28.585034+0000","last_clean":"2024-09-19T07:49:28.585034+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:49:28.585034+0000","last_undegraded":"2024-09-19T07:49:28.585034+0000","last_fullsized":"2024-09-19T07:49:28.585034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576513+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:49:28.576513+0000","last_peered":"2024-09-19T07:49:28.576513+0000","last_clean":"2024-09-19T07:49:28.576513+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:49:28.576513+0000","last_undegraded":"2024-09-19T07:49:28.576513+0000","last_fullsized":"2024-09-19T07:49:28.576513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574252+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:49:28.574252+0000","last_peered":"2024-09-19T07:49:28.574252+0000","last_clean":"2024-09-19T07:49:28.574252+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:49:28.574252+0000","last_undegraded":"2024-09-19T07:49:28.574252+0000","last_fullsized":"2024-09-19T07:49:28.574252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586710+0000","last_change":"2024-09-19T07:49:27.592113+0000","last_active":"2024-09-19T07:49:28.586710+0000","last_peered":"2024-09-19T07:49:28.586710+0000","last_clean":"2024-09-19T07:49:28.586710+0000","last_became_active":"2024-09-19T07:49:27.591783+0000","last_became_peered":"2024-09-19T07:49:27.591783+0000","last_unstale":"2024-09-19T07:49:28.586710+0000","last_undegraded":"2024-09-19T07:49:28.586710+0000","last_fullsized":"2024-09-19T07:49:28.586710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:45.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582670+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:49:28.582670+0000","last_peered":"2024-09-19T07:49:28.582670+0000","last_clean":"2024-09-19T07:49:28.582670+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:49:28.582670+0000","last_undegraded":"2024-09-19T07:49:28.582670+0000","last_fullsized":"2024-09-19T07:49:28.582670+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589221+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:49:28.589221+0000","last_peered":"2024-09-19T07:49:28.589221+0000","last_clean":"2024-09-19T07:49:28.589221+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:49:28.589221+0000","last_undegraded":"2024-09-19T07:49:28.589221+0000","last_fullsized":"2024-09-19T07:49:28.589221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582878+0000","last_change":"2024-09-19T07:49:27.590378+0000","last_active":"2024-09-19T07:49:28.582878+0000","last_peered":"2024-09-19T07:49:28.582878+0000","last_clean":"2024-09-19T07:49:28.582878+0000","last_became_active":"2024-09-19T07:49:27.590081+0000","last_became_peered":"2024-09-19T07:49:27.590081+0000","last_unstale":"2024-09-19T07:49:28.582878+0000","last_undegraded":"2024-09-19T07:49:28.582878+0000","last_fullsized":"2024-09-19T07:49:28.582878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:09.817291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585293+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:49:28.585293+0000","last_peered":"2024-09-19T07:49:28.585293+0000","last_clean":"2024-09-19T07:49:28.585293+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:49:28.585293+0000","last_undegraded":"2024-09-19T07:49:28.585293+0000","last_fullsized":"2024-09-19T07:49:28.585293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576810+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:49:28.576810+0000","last_peered":"2024-09-19T07:49:28.576810+0000","last_clean":"2024-09-19T07:49:28.576810+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:49:28.576810+0000","last_undegraded":"2024-09-19T07:49:28.576810+0000","last_fullsized":"2024-09-19T07:49:28.576810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574340+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:49:28.574340+0000","last_peered":"2024-09-19T07:49:28.574340+0000","last_clean":"2024-09-19T07:49:28.574340+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:49:28.574340+0000","last_undegraded":"2024-09-19T07:49:28.574340+0000","last_fullsized":"2024-09-19T07:49:28.574340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586159+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:49:28.586159+0000","last_peered":"2024-09-19T07:49:28.586159+0000","last_clean":"2024-09-19T07:49:28.586159+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:49:28.586159+0000","last_undegraded":"2024-09-19T07:49:28.586159+0000","last_fullsized":"2024-09-19T07:49:28.586159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584703+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:49:28.584703+0000","last_peered":"2024-09-19T07:49:28.584703+0000","last_clean":"2024-09-19T07:49:28.584703+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:49:28.584703+0000","last_undegraded":"2024-09-19T07:49:28.584703+0000","last_fullsized":"2024-09-19T07:49:28.584703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585161+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:49:28.585161+0000","last_peered":"2024-09-19T07:49:28.585161+0000","last_clean":"2024-09-19T07:49:28.585161+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:49:28.585161+0000","last_undegraded":"2024-09-19T07:49:28.585161+0000","last_fullsized":"2024-09-19T07:49:28.585161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576716+0000","last_change":"2024-09-19T07:49:27.596400+0000","last_active":"2024-09-19T07:49:28.576716+0000","last_peered":"2024-09-19T07:49:28.576716+0000","last_clean":"2024-09-19T07:49:28.576716+0000","last_became_active":"2024-09-19T07:49:27.595951+0000","last_became_peered":"2024-09-19T07:49:27.595951+0000","last_unstale":"2024-09-19T07:49:28.576716+0000","last_undegraded":"2024-09-19T07:49:28.576716+0000","last_fullsized":"2024-09-19T07:49:28.576716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587551+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:49:28.587551+0000","last_peered":"2024-09-19T07:49:28.587551+0000","last_clean":"2024-09-19T07:49:28.587551+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:49:28.587551+0000","last_undegraded":"2024-09-19T07:49:28.587551+0000","last_fullsized":"2024-09-19T07:49:28.587551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:45.647742+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:49:45.647742+0000","last_peered":"2024-09-19T07:49:45.647742+0000","last_clean":"2024-09-19T07:49:45.647742+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:49:45.647742+0000","last_undegraded":"2024-09-19T07:49:45.647742+0000","last_fullsized":"2024-09-19T07:49:45.647742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588104+0000","last_change":"2024-09-19T07:49:27.595889+0000","last_active":"2024-09-19T07:49:28.588104+0000","last_peered":"2024-09-19T07:49:28.588104+0000","last_clean":"2024-09-19T07:49:28.588104+0000","last_became_active":"2024-09-19T07:49:27.595590+0000","last_became_peered":"2024-09-19T07:49:27.595590+0000","last_unstale":"2024-09-19T07:49:28.588104+0000","last_undegraded":"2024-09-19T07:49:28.588104+0000","last_fullsized":"2024-09-19T07:49:28.588104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:19.670997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624694+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:49:36.624694+0000","last_peered":"2024-09-19T07:49:36.624694+0000","last_clean":"2024-09-19T07:49:36.624694+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:49:36.624694+0000","last_undegraded":"2024-09-19T07:49:36.624694+0000","last_fullsized":"2024-09-19T07:49:36.624694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.623615+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:49:36.623615+0000","last_peered":"2024-09-19T07:49:36.623615+0000","last_clean":"2024-09-19T07:49:36.623615+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:49:36.623615+0000","last_undegraded":"2024-09-19T07:49:36.623615+0000","last_fullsized":"2024-09-19T07:49:36.623615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582684+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:49:28.582684+0000","last_peered":"2024-09-19T07:49:28.582684+0000","last_clean":"2024-09-19T07:49:28.582684+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:49:28.582684+0000","last_undegraded":"2024-09-19T07:49:28.582684+0000","last_fullsized":"2024-09-19T07:49:28.582684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589700+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:49:28.589700+0000","last_peered":"2024-09-19T07:49:28.589700+0000","last_clean":"2024-09-19T07:49:28.589700+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:49:28.589700+0000","last_undegraded":"2024-09-19T07:49:28.589700+0000","last_fullsized":"2024-09-19T07:49:28.589700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584791+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:49:28.584791+0000","last_peered":"2024-09-19T07:49:28.584791+0000","last_clean":"2024-09-19T07:49:28.584791+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:49:28.584791+0000","last_undegraded":"2024-09-19T07:49:28.584791+0000","last_fullsized":"2024-09-19T07:49:28.584791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:49.652455+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:49:49.652455+0000","last_peered":"2024-09-19T07:49:49.652455+0000","last_clean":"2024-09-19T07:49:49.652455+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:49:49.652455+0000","last_undegraded":"2024-09-19T07:49:49.652455+0000","last_fullsized":"2024-09-19T07:49:49.652455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587177+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:49:28.587177+0000","last_peered":"2024-09-19T07:49:28.587177+0000","last_clean":"2024-09-19T07:49:28.587177+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:49:28.587177+0000","last_undegraded":"2024-09-19T07:49:28.587177+0000","last_fullsized":"2024-09-19T07:49:28.587177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.618941+0000","last_change":"2024-09-19T07:49:25.573557+0000","last_active":"2024-09-19T07:49:35.618941+0000","last_peered":"2024-09-19T07:49:35.618941+0000","last_clean":"2024-09-19T07:49:35.618941+0000","last_became_active":"2024-09-19T07:49:25.572813+0000","last_became_peered":"2024-09-19T07:49:25.572813+0000","last_unstale":"2024-09-19T07:49:35.618941+0000","last_undegraded":"2024-09-19T07:49:35.618941+0000","last_fullsized":"2024-09-19T07:49:35.618941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.030536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586536+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:49:28.586536+0000","last_peered":"2024-09-19T07:49:28.586536+0000","last_clean":"2024-09-19T07:49:28.586536+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:49:28.586536+0000","last_undegraded":"2024-09-19T07:49:28.586536+0000","last_fullsized":"2024-09-19T07:49:28.586536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616949+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:49:35.616949+0000","last_peered":"2024-09-19T07:49:35.616949+0000","last_clean":"2024-09-19T07:49:35.616949+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:49:35.616949+0000","last_undegraded":"2024-09-19T07:49:35.616949+0000","last_fullsized":"2024-09-19T07:49:35.616949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587741+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:49:28.587741+0000","last_peered":"2024-09-19T07:49:28.587741+0000","last_clean":"2024-09-19T07:49:28.587741+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:49:28.587741+0000","last_undegraded":"2024-09-19T07:49:28.587741+0000","last_fullsized":"2024-09-19T07:49:28.587741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:50.659564+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:49:50.659564+0000","last_peered":"2024-09-19T07:49:50.659564+0000","last_clean":"2024-09-19T07:49:50.659564+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:49:50.659564+0000","last_undegraded":"2024-09-19T07:49:50.659564+0000","last_fullsized":"2024-09-19T07:49:50.659564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":65,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588154+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:49:28.588154+0000","last_peered":"2024-09-19T07:49:28.588154+0000","last_clean":"2024-09-19T07:49:28.588154+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:49:28.588154+0000","last_undegraded":"2024-09-19T07:49:28.588154+0000","last_fullsized":"2024-09-19T07:49:28.588154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624761+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:49:36.624761+0000","last_peered":"2024-09-19T07:49:36.624761+0000","last_clean":"2024-09-19T07:49:36.624761+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:49:36.624761+0000","last_undegraded":"2024-09-19T07:49:36.624761+0000","last_fullsized":"2024-09-19T07:49:36.624761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573970+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:49:28.573970+0000","last_peered":"2024-09-19T07:49:28.573970+0000","last_clean":"2024-09-19T07:49:28.573970+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:49:28.573970+0000","last_undegraded":"2024-09-19T07:49:28.573970+0000","last_fullsized":"2024-09-19T07:49:28.573970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619079+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:49:35.619079+0000","last_peered":"2024-09-19T07:49:35.619079+0000","last_clean":"2024-09-19T07:49:35.619079+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:49:35.619079+0000","last_undegraded":"2024-09-19T07:49:35.619079+0000","last_fullsized":"2024-09-19T07:49:35.619079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588646+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:49:28.588646+0000","last_peered":"2024-09-19T07:49:28.588646+0000","last_clean":"2024-09-19T07:49:28.588646+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:49:28.588646+0000","last_undegraded":"2024-09-19T07:49:28.588646+0000","last_fullsized":"2024-09-19T07:49:28.588646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:50.657491+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:49:50.657491+0000","last_peered":"2024-09-19T07:49:50.657491+0000","last_clean":"2024-09-19T07:49:50.657491+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:49:50.657491+0000","last_undegraded":"2024-09-19T07:49:50.657491+0000","last_fullsized":"2024-09-19T07:49:50.657491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588304+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:49:28.588304+0000","last_peered":"2024-09-19T07:49:28.588304+0000","last_clean":"2024-09-19T07:49:28.588304+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:49:28.588304+0000","last_undegraded":"2024-09-19T07:49:28.588304+0000","last_fullsized":"2024-09-19T07:49:28.588304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.626521+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:49:36.626521+0000","last_peered":"2024-09-19T07:49:36.626521+0000","last_clean":"2024-09-19T07:49:36.626521+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:49:36.626521+0000","last_undegraded":"2024-09-19T07:49:36.626521+0000","last_fullsized":"2024-09-19T07:49:36.626521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587514+0000","last_change":"2024-09-19T07:49:27.598489+0000","last_active":"2024-09-19T07:49:28.587514+0000","last_peered":"2024-09-19T07:49:28.587514+0000","last_clean":"2024-09-19T07:49:28.587514+0000","last_became_active":"2024-09-19T07:49:27.598118+0000","last_became_peered":"2024-09-19T07:49:27.598118+0000","last_unstale":"2024-09-19T07:49:28.587514+0000","last_undegraded":"2024-09-19T07:49:28.587514+0000","last_fullsized":"2024-09-19T07:49:28.587514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:26.602600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.635893+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:49:37.635893+0000","last_peered":"2024-09-19T07:49:37.635893+0000","last_clean":"2024-09-19T07:49:37.635893+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:49:37.635893+0000","last_undegraded":"2024-09-19T07:49:37.635893+0000","last_fullsized":"2024-09-19T07:49:37.635893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576593+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:49:28.576593+0000","last_peered":"2024-09-19T07:49:28.576593+0000","last_clean":"2024-09-19T07:49:28.576593+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:49:28.576593+0000","last_undegraded":"2024-09-19T07:49:28.576593+0000","last_fullsized":"2024-09-19T07:49:28.576593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582573+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:49:28.582573+0000","last_peered":"2024-09-19T07:49:28.582573+0000","last_clean":"2024-09-19T07:49:28.582573+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:49:28.582573+0000","last_undegraded":"2024-09-19T07:49:28.582573+0000","last_fullsized":"2024-09-19T07:49:28.582573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588985+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:49:28.588985+0000","last_peered":"2024-09-19T07:49:28.588985+0000","last_clean":"2024-09-19T07:49:28.588985+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:49:28.588985+0000","last_undegraded":"2024-09-19T07:49:28.588985+0000","last_fullsized":"2024-09-19T07:49:28.588985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.595098+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:49:28.595098+0000","last_peered":"2024-09-19T07:49:28.595098+0000","last_clean":"2024-09-19T07:49:28.595098+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:49:28.595098+0000","last_undegraded":"2024-09-19T07:49:28.595098+0000","last_fullsized":"2024-09-19T07:49:28.595098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589042+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:49:28.589042+0000","last_peered":"2024-09-19T07:49:28.589042+0000","last_clean":"2024-09-19T07:49:28.589042+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:49:28.589042+0000","last_undegraded":"2024-09-19T07:49:28.589042+0000","last_fullsized":"2024-09-19T07:49:28.589042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624093+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:49:36.624093+0000","last_peered":"2024-09-19T07:49:36.624093+0000","last_clean":"2024-09-19T07:49:36.624093+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:49:36.624093+0000","last_undegraded":"2024-09-19T07:49:36.624093+0000","last_fullsized":"2024-09-19T07:49:36.624093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589058+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:49:28.589058+0000","last_peered":"2024-09-19T07:49:28.589058+0000","last_clean":"2024-09-19T07:49:28.589058+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:49:28.589058+0000","last_undegraded":"2024-09-19T07:49:28.589058+0000","last_fullsized":"2024-09-19T07:49:28.589058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588467+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:49:28.588467+0000","last_peered":"2024-09-19T07:49:28.588467+0000","last_clean":"2024-09-19T07:49:28.588467+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:49:28.588467+0000","last_undegraded":"2024-09-19T07:49:28.588467+0000","last_fullsized":"2024-09-19T07:49:28.588467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.633473+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:49:37.633473+0000","last_peered":"2024-09-19T07:49:37.633473+0000","last_clean":"2024-09-19T07:49:37.633473+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:49:37.633473+0000","last_undegraded":"2024-09-19T07:49:37.633473+0000","last_fullsized":"2024-09-19T07:49:37.633473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583820+0000","last_change":"2024-09-19T07:49:27.590765+0000","last_active":"2024-09-19T07:49:28.583820+0000","last_peered":"2024-09-19T07:49:28.583820+0000","last_clean":"2024-09-19T07:49:28.583820+0000","last_became_active":"2024-09-19T07:49:27.590433+0000","last_became_peered":"2024-09-19T07:49:27.590433+0000","last_unstale":"2024-09-19T07:49:28.583820+0000","last_undegraded":"2024-09-19T07:49:28.583820+0000","last_fullsized":"2024-09-19T07:49:28.583820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:09.614365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.625036+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:49:36.625036+0000","last_peered":"2024-09-19T07:49:36.625036+0000","last_clean":"2024-09-19T07:49:36.625036+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:49:36.625036+0000","last_undegraded":"2024-09-19T07:49:36.625036+0000","last_fullsized":"2024-09-19T07:49:36.625036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573881+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:49:28.573881+0000","last_peered":"2024-09-19T07:49:28.573881+0000","last_clean":"2024-09-19T07:49:28.573881+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:49:28.573881+0000","last_undegraded":"2024-09-19T07:49:28.573881+0000","last_fullsized":"2024-09-19T07:49:28.573881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:47.651987+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:49:47.651987+0000","last_peered":"2024-09-19T07:49:47.651987+0000","last_clean":"2024-09-19T07:49:47.651987+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:49:47.651987+0000","last_undegraded":"2024-09-19T07:49:47.651987+0000","last_fullsized":"2024-09-19T07:49:47.651987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589391+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:49:28.589391+0000","last_peered":"2024-09-19T07:49:28.589391+0000","last_clean":"2024-09-19T07:49:28.589391+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:49:28.589391+0000","last_undegraded":"2024-09-19T07:49:28.589391+0000","last_fullsized":"2024-09-19T07:49:28.589391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589007+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:49:28.589007+0000","last_peered":"2024-09-19T07:49:28.589007+0000","last_clean":"2024-09-19T07:49:28.589007+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:49:28.589007+0000","last_undegraded":"2024-09-19T07:49:28.589007+0000","last_fullsized":"2024-09-19T07:49:28.589007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584283+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:49:28.584283+0000","last_peered":"2024-09-19T07:49:28.584283+0000","last_clean":"2024-09-19T07:49:28.584283+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:49:28.584283+0000","last_undegraded":"2024-09-19T07:49:28.584283+0000","last_fullsized":"2024-09-19T07:49:28.584283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585005+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:49:28.585005+0000","last_peered":"2024-09-19T07:49:28.585005+0000","last_clean":"2024-09-19T07:49:28.585005+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:49:28.585005+0000","last_undegraded":"2024-09-19T07:49:28.585005+0000","last_fullsized":"2024-09-19T07:49:28.585005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:30.667533+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:49:30.667533+0000","last_peered":"2024-09-19T07:49:30.667533+0000","last_clean":"2024-09-19T07:49:30.667533+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:49:30.667533+0000","last_undegraded":"2024-09-19T07:49:30.667533+0000","last_fullsized":"2024-09-19T07:49:30.667533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617930+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:49:35.617930+0000","last_peered":"2024-09-19T07:49:35.617930+0000","last_clean":"2024-09-19T07:49:35.617930+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:49:35.617930+0000","last_undegraded":"2024-09-19T07:49:35.617930+0000","last_fullsized":"2024-09-19T07:49:35.617930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574273+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:49:28.574273+0000","last_peered":"2024-09-19T07:49:28.574273+0000","last_clean":"2024-09-19T07:49:28.574273+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:49:28.574273+0000","last_undegraded":"2024-09-19T07:49:28.574273+0000","last_fullsized":"2024-09-19T07:49:28.574273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:48.581617+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:49:48.581617+0000","last_peered":"2024-09-19T07:49:48.581617+0000","last_clean":"2024-09-19T07:49:48.581617+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:49:48.581617+0000","last_undegraded":"2024-09-19T07:49:48.581617+0000","last_fullsized":"2024-09-19T07:49:48.581617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583086+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:49:28.583086+0000","last_peered":"2024-09-19T07:49:28.583086+0000","last_clean":"2024-09-19T07:49:28.583086+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:49:28.583086+0000","last_undegraded":"2024-09-19T07:49:28.583086+0000","last_fullsized":"2024-09-19T07:49:28.583086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.615957+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:49:35.615957+0000","last_peered":"2024-09-19T07:49:35.615957+0000","last_clean":"2024-09-19T07:49:35.615957+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:49:35.615957+0000","last_undegraded":"2024-09-19T07:49:35.615957+0000","last_fullsized":"2024-09-19T07:49:35.615957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586442+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:49:28.586442+0000","last_peered":"2024-09-19T07:49:28.586442+0000","last_clean":"2024-09-19T07:49:28.586442+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:49:28.586442+0000","last_undegraded":"2024-09-19T07:49:28.586442+0000","last_fullsized":"2024-09-19T07:49:28.586442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616873+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:49:35.616873+0000","last_peered":"2024-09-19T07:49:35.616873+0000","last_clean":"2024-09-19T07:49:35.616873+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:49:35.616873+0000","last_undegraded":"2024-09-19T07:49:35.616873+0000","last_fullsized":"2024-09-19T07:49:35.616873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588048+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:49:28.588048+0000","last_peered":"2024-09-19T07:49:28.588048+0000","last_clean":"2024-09-19T07:49:28.588048+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:49:28.588048+0000","last_undegraded":"2024-09-19T07:49:28.588048+0000","last_fullsized":"2024-09-19T07:49:28.588048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617633+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:49:35.617633+0000","last_peered":"2024-09-19T07:49:35.617633+0000","last_clean":"2024-09-19T07:49:35.617633+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:49:35.617633+0000","last_undegraded":"2024-09-19T07:49:35.617633+0000","last_fullsized":"2024-09-19T07:49:35.617633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576519+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:49:28.576519+0000","last_peered":"2024-09-19T07:49:28.576519+0000","last_clean":"2024-09-19T07:49:28.576519+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:49:28.576519+0000","last_undegraded":"2024-09-19T07:49:28.576519+0000","last_fullsized":"2024-09-19T07:49:28.576519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584849+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:49:28.584849+0000","last_peered":"2024-09-19T07:49:28.584849+0000","last_clean":"2024-09-19T07:49:28.584849+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:49:28.584849+0000","last_undegraded":"2024-09-19T07:49:28.584849+0000","last_fullsized":"2024-09-19T07:49:28.584849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582861+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:49:28.582861+0000","last_peered":"2024-09-19T07:49:28.582861+0000","last_clean":"2024-09-19T07:49:28.582861+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:49:28.582861+0000","last_undegraded":"2024-09-19T07:49:28.582861+0000","last_fullsized":"2024-09-19T07:49:28.582861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619153+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:49:35.619153+0000","last_peered":"2024-09-19T07:49:35.619153+0000","last_clean":"2024-09-19T07:49:35.619153+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:49:35.619153+0000","last_undegraded":"2024-09-19T07:49:35.619153+0000","last_fullsized":"2024-09-19T07:49:35.619153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588576+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:49:28.588576+0000","last_peered":"2024-09-19T07:49:28.588576+0000","last_clean":"2024-09-19T07:49:28.588576+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:49:28.588576+0000","last_undegraded":"2024-09-19T07:49:28.588576+0000","last_fullsized":"2024-09-19T07:49:28.588576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587226+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:49:28.587226+0000","last_peered":"2024-09-19T07:49:28.587226+0000","last_clean":"2024-09-19T07:49:28.587226+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:49:28.587226+0000","last_undegraded":"2024-09-19T07:49:28.587226+0000","last_fullsized":"2024-09-19T07:49:28.587226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.594832+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:49:28.594832+0000","last_peered":"2024-09-19T07:49:28.594832+0000","last_clean":"2024-09-19T07:49:28.594832+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:49:28.594832+0000","last_undegraded":"2024-09-19T07:49:28.594832+0000","last_fullsized":"2024-09-19T07:49:28.594832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587575+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:49:28.587575+0000","last_peered":"2024-09-19T07:49:28.587575+0000","last_clean":"2024-09-19T07:49:28.587575+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:49:28.587575+0000","last_undegraded":"2024-09-19T07:49:28.587575+0000","last_fullsized":"2024-09-19T07:49:28.587575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624562+0000","last_change":"2024-09-19T07:49:25.574247+0000","last_active":"2024-09-19T07:49:36.624562+0000","last_peered":"2024-09-19T07:49:36.624562+0000","last_clean":"2024-09-19T07:49:36.624562+0000","last_became_active":"2024-09-19T07:49:25.573911+0000","last_became_peered":"2024-09-19T07:49:25.573911+0000","last_unstale":"2024-09-19T07:49:36.624562+0000","last_undegraded":"2024-09-19T07:49:36.624562+0000","last_fullsized":"2024-09-19T07:49:36.624562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:35.765779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586434+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:49:28.586434+0000","last_peered":"2024-09-19T07:49:28.586434+0000","last_clean":"2024-09-19T07:49:28.586434+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:49:28.586434+0000","last_undegraded":"2024-09-19T07:49:28.586434+0000","last_fullsized":"2024-09-19T07:49:28.586434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584596+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:49:28.584596+0000","last_peered":"2024-09-19T07:49:28.584596+0000","last_clean":"2024-09-19T07:49:28.584596+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:49:28.584596+0000","last_undegraded":"2024-09-19T07:49:28.584596+0000","last_fullsized":"2024-09-19T07:49:28.584596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583193+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:49:28.583193+0000","last_peered":"2024-09-19T07:49:28.583193+0000","last_clean":"2024-09-19T07:49:28.583193+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:49:28.583193+0000","last_undegraded":"2024-09-19T07:49:28.583193+0000","last_fullsized":"2024-09-19T07:49:28.583193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624915+0000","last_change":"2024-09-19T07:49:25.571029+0000","last_active":"2024-09-19T07:49:36.624915+0000","last_peered":"2024-09-19T07:49:36.624915+0000","last_clean":"2024-09-19T07:49:36.624915+0000","last_became_active":"2024-09-19T07:49:25.570685+0000","last_became_peered":"2024-09-19T07:49:25.570685+0000","last_unstale":"2024-09-19T07:49:36.624915+0000","last_undegraded":"2024-09-19T07:49:36.624915+0000","last_fullsized":"2024-09-19T07:49:36.624915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:54.896230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54115,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":105,"num_read_kb":110,"num_write":155,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":162345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281526,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":424625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1066218,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":424861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":424781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1016713,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":424250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1016397,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":424687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":424561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":475898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":465108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":425521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:49:53.527 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:49:53.777 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:53.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:53 smithi076 ceph-mon[30930]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:49:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:53 smithi152 ceph-mon[35117]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:49:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:53 smithi137 ceph-mon[35309]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:49:54.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.272+0000 7f884f7d9640 1 -- 172.21.15.76:0/719764329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88481027c0 msgr2=0x7f8848106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:54.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.272+0000 7f884f7d9640 1 --2- 172.21.15.76:0/719764329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88481027c0 0x7f8848106810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8838009900 tx=0x7f883802a410 comp rx=0 tx=0).stop 2024-09-19T07:49:54.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- 172.21.15.76:0/719764329 shutdown_connections 2024-09-19T07:49:54.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 --2- 172.21.15.76:0/719764329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8848106f40 0x7f884810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 --2- 172.21.15.76:0/719764329 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88481027c0 0x7f8848106810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 --2- 172.21.15.76:0/719764329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8848101e10 0x7f88481021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- 172.21.15.76:0/719764329 >> 172.21.15.76:0/719764329 conn(0x7f88480fd8d0 msgr2=0x7f88480ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- 172.21.15.76:0/719764329 shutdown_connections 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- 172.21.15.76:0/719764329 wait complete. 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 Processor -- start 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- start start 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8848101e10 0x7f8848198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88481027c0 0x7f8848198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 0x7f884819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88481120c0 con 0x7f8848106f40 2024-09-19T07:49:54.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8848111f40 con 0x7f88481027c0 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.273+0000 7f884f7d9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8848112240 con 0x7f8848101e10 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 0x7f884819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 0x7f884819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52566/0 (socket says 172.21.15.76:52566) 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 -- 172.21.15.76:0/4119064768 learned_addr learned my addr 172.21.15.76:0/4119064768 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884cd74640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88481027c0 0x7f8848198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884d575640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8848101e10 0x7f8848198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 -- 172.21.15.76:0/4119064768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8848101e10 msgr2=0x7f8848198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8848101e10 0x7f8848198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 -- 172.21.15.76:0/4119064768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88481027c0 msgr2=0x7f8848198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88481027c0 0x7f8848198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 -- 172.21.15.76:0/4119064768 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884819d4e0 con 0x7f8848106f40 2024-09-19T07:49:54.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884dd76640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 0x7f884819ce00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f884000eaa0 tx=0x7f884000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884000cdb0 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884819d7d0 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8840004b20 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840011760 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.274+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88481a50b0 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.275+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88481021f0 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.276+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8840011900 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.277+0000 7f883e7fc640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f88340a32d0 0x7f88340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.277+0000 7f884d575640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f88340a32d0 0x7f88340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.277+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f88400cfab0 con 0x7f8848106f40 2024-09-19T07:49:54.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.277+0000 7f884d575640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f88340a32d0 0x7f88340a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8844005fd0 tx=0x7f8844005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:54.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.281+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8840016030 con 0x7f8848106f40 2024-09-19T07:49:54.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.446+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8848062630 con 0x7f88340a32d0 2024-09-19T07:49:54.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.452+0000 7f883e7fc640 1 -- 172.21.15.76:0/4119064768 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258863 (secure 0 0 0) 0x7f8848062630 con 0x7f88340a32d0 2024-09-19T07:49:54.454 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:54.455 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f88340a32d0 msgr2=0x7f88340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f88340a32d0 0x7f88340a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8844005fd0 tx=0x7f8844005850 comp rx=0 tx=0).stop 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 msgr2=0x7f884819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 0x7f884819ce00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f884000eaa0 tx=0x7f884000ef60 comp rx=0 tx=0).stop 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 shutdown_connections 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8848106f40 0x7f884819ce00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f88340a32d0 0x7f88340a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88481027c0 0x7f8848198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 --2- 172.21.15.76:0/4119064768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8848101e10 0x7f8848198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:54.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 >> 172.21.15.76:0/4119064768 conn(0x7f88480fd8d0 msgr2=0x7f88480fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:54.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 shutdown_connections 2024-09-19T07:49:54.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:54.456+0000 7f884f7d9640 1 -- 172.21.15.76:0/4119064768 wait complete. 2024-09-19T07:49:54.935 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:54 smithi076 ceph-mon[30930]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:49:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:54 smithi152 ceph-mon[35117]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:49:55.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:54 smithi137 ceph-mon[35309]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:49:55.237 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T07:49:52.611422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644717,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":241,"num_read_kb":229,"num_write":338,"num_write_kb":3037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376700,"kb_used_data":10812,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565124,"statfs":{"total":1151940427776,"available":1151554686976,"internally_reserved":0,"allocated":11071488,"data_stored":7013620,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":96,"num_write":36,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576867+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:49:28.576867+0000","last_peered":"2024-09-19T07:49:28.576867+0000","last_clean":"2024-09-19T07:49:28.576867+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:49:28.576867+0000","last_undegraded":"2024-09-19T07:49:28.576867+0000","last_fullsized":"2024-09-19T07:49:28.576867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586278+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:49:28.586278+0000","last_peered":"2024-09-19T07:49:28.586278+0000","last_clean":"2024-09-19T07:49:28.586278+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:49:28.586278+0000","last_undegraded":"2024-09-19T07:49:28.586278+0000","last_fullsized":"2024-09-19T07:49:28.586278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586428+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:49:28.586428+0000","last_peered":"2024-09-19T07:49:28.586428+0000","last_clean":"2024-09-19T07:49:28.586428+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:49:28.586428+0000","last_undegraded":"2024-09-19T07:49:28.586428+0000","last_fullsized":"2024-09-19T07:49:28.586428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574665+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:49:28.574665+0000","last_peered":"2024-09-19T07:49:28.574665+0000","last_clean":"2024-09-19T07:49:28.574665+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:49:28.574665+0000","last_undegraded":"2024-09-19T07:49:28.574665+0000","last_fullsized":"2024-09-19T07:49:28.574665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587400+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:49:28.587400+0000","last_peered":"2024-09-19T07:49:28.587400+0000","last_clean":"2024-09-19T07:49:28.587400+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:49:28.587400+0000","last_undegraded":"2024-09-19T07:49:28.587400+0000","last_fullsized":"2024-09-19T07:49:28.587400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583883+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:49:28.583883+0000","last_peered":"2024-09-19T07:49:28.583883+0000","last_clean":"2024-09-19T07:49:28.583883+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:49:28.583883+0000","last_undegraded":"2024-09-19T07:49:28.583883+0000","last_fullsized":"2024-09-19T07:49:28.583883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588881+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:49:28.588881+0000","last_peered":"2024-09-19T07:49:28.588881+0000","last_clean":"2024-09-19T07:49:28.588881+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:49:28.588881+0000","last_undegraded":"2024-09-19T07:49:28.588881+0000","last_fullsized":"2024-09-19T07:49:28.588881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582672+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:49:28.582672+0000","last_peered":"2024-09-19T07:49:28.582672+0000","last_clean":"2024-09-19T07:49:28.582672+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:49:28.582672+0000","last_undegraded":"2024-09-19T07:49:28.582672+0000","last_fullsized":"2024-09-19T07:49:28.582672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587654+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:49:28.587654+0000","last_peered":"2024-09-19T07:49:28.587654+0000","last_clean":"2024-09-19T07:49:28.587654+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:49:28.587654+0000","last_undegraded":"2024-09-19T07:49:28.587654+0000","last_fullsized":"2024-09-19T07:49:28.587654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584443+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:49:28.584443+0000","last_peered":"2024-09-19T07:49:28.584443+0000","last_clean":"2024-09-19T07:49:28.584443+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:49:28.584443+0000","last_undegraded":"2024-09-19T07:49:28.584443+0000","last_fullsized":"2024-09-19T07:49:28.584443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588871+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:49:28.588871+0000","last_peered":"2024-09-19T07:49:28.588871+0000","last_clean":"2024-09-19T07:49:28.588871+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:49:28.588871+0000","last_undegraded":"2024-09-19T07:49:28.588871+0000","last_fullsized":"2024-09-19T07:49:28.588871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574716+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:49:28.574716+0000","last_peered":"2024-09-19T07:49:28.574716+0000","last_clean":"2024-09-19T07:49:28.574716+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:49:28.574716+0000","last_undegraded":"2024-09-19T07:49:28.574716+0000","last_fullsized":"2024-09-19T07:49:28.574716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574235+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:49:28.574235+0000","last_peered":"2024-09-19T07:49:28.574235+0000","last_clean":"2024-09-19T07:49:28.574235+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:49:28.574235+0000","last_undegraded":"2024-09-19T07:49:28.574235+0000","last_fullsized":"2024-09-19T07:49:28.574235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585963+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:49:28.585963+0000","last_peered":"2024-09-19T07:49:28.585963+0000","last_clean":"2024-09-19T07:49:28.585963+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:49:28.585963+0000","last_undegraded":"2024-09-19T07:49:28.585963+0000","last_fullsized":"2024-09-19T07:49:28.585963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585859+0000","last_change":"2024-09-19T07:49:27.593189+0000","last_active":"2024-09-19T07:49:28.585859+0000","last_peered":"2024-09-19T07:49:28.585859+0000","last_clean":"2024-09-19T07:49:28.585859+0000","last_became_active":"2024-09-19T07:49:27.592865+0000","last_became_peered":"2024-09-19T07:49:27.592865+0000","last_unstale":"2024-09-19T07:49:28.585859+0000","last_undegraded":"2024-09-19T07:49:28.585859+0000","last_fullsized":"2024-09-19T07:49:28.585859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:21.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586532+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:49:28.586532+0000","last_peered":"2024-09-19T07:49:28.586532+0000","last_clean":"2024-09-19T07:49:28.586532+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:49:28.586532+0000","last_undegraded":"2024-09-19T07:49:28.586532+0000","last_fullsized":"2024-09-19T07:49:28.586532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576910+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:49:28.576910+0000","last_peered":"2024-09-19T07:49:28.576910+0000","last_clean":"2024-09-19T07:49:28.576910+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:49:28.576910+0000","last_undegraded":"2024-09-19T07:49:28.576910+0000","last_fullsized":"2024-09-19T07:49:28.576910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585053+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:49:28.585053+0000","last_peered":"2024-09-19T07:49:28.585053+0000","last_clean":"2024-09-19T07:49:28.585053+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:49:28.585053+0000","last_undegraded":"2024-09-19T07:49:28.585053+0000","last_fullsized":"2024-09-19T07:49:28.585053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585034+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:49:28.585034+0000","last_peered":"2024-09-19T07:49:28.585034+0000","last_clean":"2024-09-19T07:49:28.585034+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:49:28.585034+0000","last_undegraded":"2024-09-19T07:49:28.585034+0000","last_fullsized":"2024-09-19T07:49:28.585034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576513+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:49:28.576513+0000","last_peered":"2024-09-19T07:49:28.576513+0000","last_clean":"2024-09-19T07:49:28.576513+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:49:28.576513+0000","last_undegraded":"2024-09-19T07:49:28.576513+0000","last_fullsized":"2024-09-19T07:49:28.576513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574252+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:49:28.574252+0000","last_peered":"2024-09-19T07:49:28.574252+0000","last_clean":"2024-09-19T07:49:28.574252+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:49:28.574252+0000","last_undegraded":"2024-09-19T07:49:28.574252+0000","last_fullsized":"2024-09-19T07:49:28.574252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586710+0000","last_change":"2024-09-19T07:49:27.592113+0000","last_active":"2024-09-19T07:49:28.586710+0000","last_peered":"2024-09-19T07:49:28.586710+0000","last_clean":"2024-09-19T07:49:28.586710+0000","last_became_active":"2024-09-19T07:49:27.591783+0000","last_became_peered":"2024-09-19T07:49:27.591783+0000","last_unstale":"2024-09-19T07:49:28.586710+0000","last_undegraded":"2024-09-19T07:49:28.586710+0000","last_fullsized":"2024-09-19T07:49:28.586710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:45.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582670+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:49:28.582670+0000","last_peered":"2024-09-19T07:49:28.582670+0000","last_clean":"2024-09-19T07:49:28.582670+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:49:28.582670+0000","last_undegraded":"2024-09-19T07:49:28.582670+0000","last_fullsized":"2024-09-19T07:49:28.582670+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589221+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:49:28.589221+0000","last_peered":"2024-09-19T07:49:28.589221+0000","last_clean":"2024-09-19T07:49:28.589221+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:49:28.589221+0000","last_undegraded":"2024-09-19T07:49:28.589221+0000","last_fullsized":"2024-09-19T07:49:28.589221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582878+0000","last_change":"2024-09-19T07:49:27.590378+0000","last_active":"2024-09-19T07:49:28.582878+0000","last_peered":"2024-09-19T07:49:28.582878+0000","last_clean":"2024-09-19T07:49:28.582878+0000","last_became_active":"2024-09-19T07:49:27.590081+0000","last_became_peered":"2024-09-19T07:49:27.590081+0000","last_unstale":"2024-09-19T07:49:28.582878+0000","last_undegraded":"2024-09-19T07:49:28.582878+0000","last_fullsized":"2024-09-19T07:49:28.582878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:09.817291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585293+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:49:28.585293+0000","last_peered":"2024-09-19T07:49:28.585293+0000","last_clean":"2024-09-19T07:49:28.585293+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:49:28.585293+0000","last_undegraded":"2024-09-19T07:49:28.585293+0000","last_fullsized":"2024-09-19T07:49:28.585293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576810+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:49:28.576810+0000","last_peered":"2024-09-19T07:49:28.576810+0000","last_clean":"2024-09-19T07:49:28.576810+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:49:28.576810+0000","last_undegraded":"2024-09-19T07:49:28.576810+0000","last_fullsized":"2024-09-19T07:49:28.576810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574340+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:49:28.574340+0000","last_peered":"2024-09-19T07:49:28.574340+0000","last_clean":"2024-09-19T07:49:28.574340+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:49:28.574340+0000","last_undegraded":"2024-09-19T07:49:28.574340+0000","last_fullsized":"2024-09-19T07:49:28.574340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586159+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:49:28.586159+0000","last_peered":"2024-09-19T07:49:28.586159+0000","last_clean":"2024-09-19T07:49:28.586159+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:49:28.586159+0000","last_undegraded":"2024-09-19T07:49:28.586159+0000","last_fullsized":"2024-09-19T07:49:28.586159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584703+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:49:28.584703+0000","last_peered":"2024-09-19T07:49:28.584703+0000","last_clean":"2024-09-19T07:49:28.584703+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:49:28.584703+0000","last_undegraded":"2024-09-19T07:49:28.584703+0000","last_fullsized":"2024-09-19T07:49:28.584703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585161+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:49:28.585161+0000","last_peered":"2024-09-19T07:49:28.585161+0000","last_clean":"2024-09-19T07:49:28.585161+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:49:28.585161+0000","last_undegraded":"2024-09-19T07:49:28.585161+0000","last_fullsized":"2024-09-19T07:49:28.585161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576716+0000","last_change":"2024-09-19T07:49:27.596400+0000","last_active":"2024-09-19T07:49:28.576716+0000","last_peered":"2024-09-19T07:49:28.576716+0000","last_clean":"2024-09-19T07:49:28.576716+0000","last_became_active":"2024-09-19T07:49:27.595951+0000","last_became_peered":"2024-09-19T07:49:27.595951+0000","last_unstale":"2024-09-19T07:49:28.576716+0000","last_undegraded":"2024-09-19T07:49:28.576716+0000","last_fullsized":"2024-09-19T07:49:28.576716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587551+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:49:28.587551+0000","last_peered":"2024-09-19T07:49:28.587551+0000","last_clean":"2024-09-19T07:49:28.587551+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:49:28.587551+0000","last_undegraded":"2024-09-19T07:49:28.587551+0000","last_fullsized":"2024-09-19T07:49:28.587551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:45.647742+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:49:45.647742+0000","last_peered":"2024-09-19T07:49:45.647742+0000","last_clean":"2024-09-19T07:49:45.647742+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:49:45.647742+0000","last_undegraded":"2024-09-19T07:49:45.647742+0000","last_fullsized":"2024-09-19T07:49:45.647742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588104+0000","last_change":"2024-09-19T07:49:27.595889+0000","last_active":"2024-09-19T07:49:28.588104+0000","last_peered":"2024-09-19T07:49:28.588104+0000","last_clean":"2024-09-19T07:49:28.588104+0000","last_became_active":"2024-09-19T07:49:27.595590+0000","last_became_peered":"2024-09-19T07:49:27.595590+0000","last_unstale":"2024-09-19T07:49:28.588104+0000","last_undegraded":"2024-09-19T07:49:28.588104+0000","last_fullsized":"2024-09-19T07:49:28.588104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:19.670997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624694+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:49:36.624694+0000","last_peered":"2024-09-19T07:49:36.624694+0000","last_clean":"2024-09-19T07:49:36.624694+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:49:36.624694+0000","last_undegraded":"2024-09-19T07:49:36.624694+0000","last_fullsized":"2024-09-19T07:49:36.624694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.623615+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:49:36.623615+0000","last_peered":"2024-09-19T07:49:36.623615+0000","last_clean":"2024-09-19T07:49:36.623615+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:49:36.623615+0000","last_undegraded":"2024-09-19T07:49:36.623615+0000","last_fullsized":"2024-09-19T07:49:36.623615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582684+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:49:28.582684+0000","last_peered":"2024-09-19T07:49:28.582684+0000","last_clean":"2024-09-19T07:49:28.582684+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:49:28.582684+0000","last_undegraded":"2024-09-19T07:49:28.582684+0000","last_fullsized":"2024-09-19T07:49:28.582684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589700+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:49:28.589700+0000","last_peered":"2024-09-19T07:49:28.589700+0000","last_clean":"2024-09-19T07:49:28.589700+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:49:28.589700+0000","last_undegraded":"2024-09-19T07:49:28.589700+0000","last_fullsized":"2024-09-19T07:49:28.589700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584791+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:49:28.584791+0000","last_peered":"2024-09-19T07:49:28.584791+0000","last_clean":"2024-09-19T07:49:28.584791+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:49:28.584791+0000","last_undegraded":"2024-09-19T07:49:28.584791+0000","last_fullsized":"2024-09-19T07:49:28.584791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:49.652455+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:49:49.652455+0000","last_peered":"2024-09-19T07:49:49.652455+0000","last_clean":"2024-09-19T07:49:49.652455+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:49:49.652455+0000","last_undegraded":"2024-09-19T07:49:49.652455+0000","last_fullsized":"2024-09-19T07:49:49.652455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587177+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:49:28.587177+0000","last_peered":"2024-09-19T07:49:28.587177+0000","last_clean":"2024-09-19T07:49:28.587177+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:49:28.587177+0000","last_undegraded":"2024-09-19T07:49:28.587177+0000","last_fullsized":"2024-09-19T07:49:28.587177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.618941+0000","last_change":"2024-09-19T07:49:25.573557+0000","last_active":"2024-09-19T07:49:35.618941+0000","last_peered":"2024-09-19T07:49:35.618941+0000","last_clean":"2024-09-19T07:49:35.618941+0000","last_became_active":"2024-09-19T07:49:25.572813+0000","last_became_peered":"2024-09-19T07:49:25.572813+0000","last_unstale":"2024-09-19T07:49:35.618941+0000","last_undegraded":"2024-09-19T07:49:35.618941+0000","last_fullsized":"2024-09-19T07:49:35.618941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.030536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586536+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:49:28.586536+0000","last_peered":"2024-09-19T07:49:28.586536+0000","last_clean":"2024-09-19T07:49:28.586536+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:49:28.586536+0000","last_undegraded":"2024-09-19T07:49:28.586536+0000","last_fullsized":"2024-09-19T07:49:28.586536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616949+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:49:35.616949+0000","last_peered":"2024-09-19T07:49:35.616949+0000","last_clean":"2024-09-19T07:49:35.616949+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:49:35.616949+0000","last_undegraded":"2024-09-19T07:49:35.616949+0000","last_fullsized":"2024-09-19T07:49:35.616949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587741+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:49:28.587741+0000","last_peered":"2024-09-19T07:49:28.587741+0000","last_clean":"2024-09-19T07:49:28.587741+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:49:28.587741+0000","last_undegraded":"2024-09-19T07:49:28.587741+0000","last_fullsized":"2024-09-19T07:49:28.587741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:50.659564+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:49:50.659564+0000","last_peered":"2024-09-19T07:49:50.659564+0000","last_clean":"2024-09-19T07:49:50.659564+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:49:50.659564+0000","last_undegraded":"2024-09-19T07:49:50.659564+0000","last_fullsized":"2024-09-19T07:49:50.659564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":65,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588154+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:49:28.588154+0000","last_peered":"2024-09-19T07:49:28.588154+0000","last_clean":"2024-09-19T07:49:28.588154+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:49:28.588154+0000","last_undegraded":"2024-09-19T07:49:28.588154+0000","last_fullsized":"2024-09-19T07:49:28.588154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624761+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:49:36.624761+0000","last_peered":"2024-09-19T07:49:36.624761+0000","last_clean":"2024-09-19T07:49:36.624761+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:49:36.624761+0000","last_undegraded":"2024-09-19T07:49:36.624761+0000","last_fullsized":"2024-09-19T07:49:36.624761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573970+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:49:28.573970+0000","last_peered":"2024-09-19T07:49:28.573970+0000","last_clean":"2024-09-19T07:49:28.573970+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:49:28.573970+0000","last_undegraded":"2024-09-19T07:49:28.573970+0000","last_fullsized":"2024-09-19T07:49:28.573970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619079+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:49:35.619079+0000","last_peered":"2024-09-19T07:49:35.619079+0000","last_clean":"2024-09-19T07:49:35.619079+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:49:35.619079+0000","last_undegraded":"2024-09-19T07:49:35.619079+0000","last_fullsized":"2024-09-19T07:49:35.619079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588646+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:49:28.588646+0000","last_peered":"2024-09-19T07:49:28.588646+0000","last_clean":"2024-09-19T07:49:28.588646+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:49:28.588646+0000","last_undegraded":"2024-09-19T07:49:28.588646+0000","last_fullsized":"2024-09-19T07:49:28.588646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:50.657491+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:49:50.657491+0000","last_peered":"2024-09-19T07:49:50.657491+0000","last_clean":"2024-09-19T07:49:50.657491+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:49:50.657491+0000","last_undegraded":"2024-09-19T07:49:50.657491+0000","last_fullsized":"2024-09-19T07:49:50.657491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588304+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:49:28.588304+0000","last_peered":"2024-09-19T07:49:28.588304+0000","last_clean":"2024-09-19T07:49:28.588304+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:49:28.588304+0000","last_undegraded":"2024-09-19T07:49:28.588304+0000","last_fullsized":"2024-09-19T07:49:28.588304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.626521+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:49:36.626521+0000","last_peered":"2024-09-19T07:49:36.626521+0000","last_clean":"2024-09-19T07:49:36.626521+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:49:36.626521+0000","last_undegraded":"2024-09-19T07:49:36.626521+0000","last_fullsized":"2024-09-19T07:49:36.626521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587514+0000","last_change":"2024-09-19T07:49:27.598489+0000","last_active":"2024-09-19T07:49:28.587514+0000","last_peered":"2024-09-19T07:49:28.587514+0000","last_clean":"2024-09-19T07:49:28.587514+0000","last_became_active":"2024-09-19T07:49:27.598118+0000","last_became_peered":"2024-09-19T07:49:27.598118+0000","last_unstale":"2024-09-19T07:49:28.587514+0000","last_undegraded":"2024-09-19T07:49:28.587514+0000","last_fullsized":"2024-09-19T07:49:28.587514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:26.602600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.635893+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:49:37.635893+0000","last_peered":"2024-09-19T07:49:37.635893+0000","last_clean":"2024-09-19T07:49:37.635893+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:49:37.635893+0000","last_undegraded":"2024-09-19T07:49:37.635893+0000","last_fullsized":"2024-09-19T07:49:37.635893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576593+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:49:28.576593+0000","last_peered":"2024-09-19T07:49:28.576593+0000","last_clean":"2024-09-19T07:49:28.576593+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:49:28.576593+0000","last_undegraded":"2024-09-19T07:49:28.576593+0000","last_fullsized":"2024-09-19T07:49:28.576593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582573+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:49:28.582573+0000","last_peered":"2024-09-19T07:49:28.582573+0000","last_clean":"2024-09-19T07:49:28.582573+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:49:28.582573+0000","last_undegraded":"2024-09-19T07:49:28.582573+0000","last_fullsized":"2024-09-19T07:49:28.582573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588985+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:49:28.588985+0000","last_peered":"2024-09-19T07:49:28.588985+0000","last_clean":"2024-09-19T07:49:28.588985+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:49:28.588985+0000","last_undegraded":"2024-09-19T07:49:28.588985+0000","last_fullsized":"2024-09-19T07:49:28.588985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.595098+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:49:28.595098+0000","last_peered":"2024-09-19T07:49:28.595098+0000","last_clean":"2024-09-19T07:49:28.595098+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:49:28.595098+0000","last_undegraded":"2024-09-19T07:49:28.595098+0000","last_fullsized":"2024-09-19T07:49:28.595098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589042+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:49:28.589042+0000","last_peered":"2024-09-19T07:49:28.589042+0000","last_clean":"2024-09-19T07:49:28.589042+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:49:28.589042+0000","last_undegraded":"2024-09-19T07:49:28.589042+0000","last_fullsized":"2024-09-19T07:49:28.589042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624093+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:49:36.624093+0000","last_peered":"2024-09-19T07:49:36.624093+0000","last_clean":"2024-09-19T07:49:36.624093+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:49:36.624093+0000","last_undegraded":"2024-09-19T07:49:36.624093+0000","last_fullsized":"2024-09-19T07:49:36.624093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589058+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:49:28.589058+0000","last_peered":"2024-09-19T07:49:28.589058+0000","last_clean":"2024-09-19T07:49:28.589058+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:49:28.589058+0000","last_undegraded":"2024-09-19T07:49:28.589058+0000","last_fullsized":"2024-09-19T07:49:28.589058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588467+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:49:28.588467+0000","last_peered":"2024-09-19T07:49:28.588467+0000","last_clean":"2024-09-19T07:49:28.588467+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:49:28.588467+0000","last_undegraded":"2024-09-19T07:49:28.588467+0000","last_fullsized":"2024-09-19T07:49:28.588467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.633473+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:49:37.633473+0000","last_peered":"2024-09-19T07:49:37.633473+0000","last_clean":"2024-09-19T07:49:37.633473+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:49:37.633473+0000","last_undegraded":"2024-09-19T07:49:37.633473+0000","last_fullsized":"2024-09-19T07:49:37.633473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583820+0000","last_change":"2024-09-19T07:49:27.590765+0000","last_active":"2024-09-19T07:49:28.583820+0000","last_peered":"2024-09-19T07:49:28.583820+0000","last_clean":"2024-09-19T07:49:28.583820+0000","last_became_active":"2024-09-19T07:49:27.590433+0000","last_became_peered":"2024-09-19T07:49:27.590433+0000","last_unstale":"2024-09-19T07:49:28.583820+0000","last_undegraded":"2024-09-19T07:49:28.583820+0000","last_fullsized":"2024-09-19T07:49:28.583820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:09.614365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.625036+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:49:36.625036+0000","last_peered":"2024-09-19T07:49:36.625036+0000","last_clean":"2024-09-19T07:49:36.625036+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:49:36.625036+0000","last_undegraded":"2024-09-19T07:49:36.625036+0000","last_fullsized":"2024-09-19T07:49:36.625036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573881+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:49:28.573881+0000","last_peered":"2024-09-19T07:49:28.573881+0000","last_clean":"2024-09-19T07:49:28.573881+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:49:28.573881+0000","last_undegraded":"2024-09-19T07:49:28.573881+0000","last_fullsized":"2024-09-19T07:49:28.573881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:47.651987+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:49:47.651987+0000","last_peered":"2024-09-19T07:49:47.651987+0000","last_clean":"2024-09-19T07:49:47.651987+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:49:47.651987+0000","last_undegraded":"2024-09-19T07:49:47.651987+0000","last_fullsized":"2024-09-19T07:49:47.651987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589391+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:49:28.589391+0000","last_peered":"2024-09-19T07:49:28.589391+0000","last_clean":"2024-09-19T07:49:28.589391+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:49:28.589391+0000","last_undegraded":"2024-09-19T07:49:28.589391+0000","last_fullsized":"2024-09-19T07:49:28.589391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589007+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:49:28.589007+0000","last_peered":"2024-09-19T07:49:28.589007+0000","last_clean":"2024-09-19T07:49:28.589007+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:49:28.589007+0000","last_undegraded":"2024-09-19T07:49:28.589007+0000","last_fullsized":"2024-09-19T07:49:28.589007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584283+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:49:28.584283+0000","last_peered":"2024-09-19T07:49:28.584283+0000","last_clean":"2024-09-19T07:49:28.584283+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:49:28.584283+0000","last_undegraded":"2024-09-19T07:49:28.584283+0000","last_fullsized":"2024-09-19T07:49:28.584283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585005+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:49:28.585005+0000","last_peered":"2024-09-19T07:49:28.585005+0000","last_clean":"2024-09-19T07:49:28.585005+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:49:28.585005+0000","last_undegraded":"2024-09-19T07:49:28.585005+0000","last_fullsized":"2024-09-19T07:49:28.585005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:30.667533+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:49:30.667533+0000","last_peered":"2024-09-19T07:49:30.667533+0000","last_clean":"2024-09-19T07:49:30.667533+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:49:30.667533+0000","last_undegraded":"2024-09-19T07:49:30.667533+0000","last_fullsized":"2024-09-19T07:49:30.667533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617930+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:49:35.617930+0000","last_peered":"2024-09-19T07:49:35.617930+0000","last_clean":"2024-09-19T07:49:35.617930+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:49:35.617930+0000","last_undegraded":"2024-09-19T07:49:35.617930+0000","last_fullsized":"2024-09-19T07:49:35.617930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574273+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:49:28.574273+0000","last_peered":"2024-09-19T07:49:28.574273+0000","last_clean":"2024-09-19T07:49:28.574273+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:49:28.574273+0000","last_undegraded":"2024-09-19T07:49:28.574273+0000","last_fullsized":"2024-09-19T07:49:28.574273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:48.581617+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:49:48.581617+0000","last_peered":"2024-09-19T07:49:48.581617+0000","last_clean":"2024-09-19T07:49:48.581617+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:49:48.581617+0000","last_undegraded":"2024-09-19T07:49:48.581617+0000","last_fullsized":"2024-09-19T07:49:48.581617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583086+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:49:28.583086+0000","last_peered":"2024-09-19T07:49:28.583086+0000","last_clean":"2024-09-19T07:49:28.583086+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:49:28.583086+0000","last_undegraded":"2024-09-19T07:49:28.583086+0000","last_fullsized":"2024-09-19T07:49:28.583086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.615957+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:49:35.615957+0000","last_peered":"2024-09-19T07:49:35.615957+0000","last_clean":"2024-09-19T07:49:35.615957+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:49:35.615957+0000","last_undegraded":"2024-09-19T07:49:35.615957+0000","last_fullsized":"2024-09-19T07:49:35.615957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586442+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:49:28.586442+0000","last_peered":"2024-09-19T07:49:28.586442+0000","last_clean":"2024-09-19T07:49:28.586442+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:49:28.586442+0000","last_undegraded":"2024-09-19T07:49:28.586442+0000","last_fullsized":"2024-09-19T07:49:28.586442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616873+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:49:35.616873+0000","last_peered":"2024-09-19T07:49:35.616873+0000","last_clean":"2024-09-19T07:49:35.616873+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:49:35.616873+0000","last_undegraded":"2024-09-19T07:49:35.616873+0000","last_fullsized":"2024-09-19T07:49:35.616873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588048+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:49:28.588048+0000","last_peered":"2024-09-19T07:49:28.588048+0000","last_clean":"2024-09-19T07:49:28.588048+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:49:28.588048+0000","last_undegraded":"2024-09-19T07:49:28.588048+0000","last_fullsized":"2024-09-19T07:49:28.588048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617633+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:49:35.617633+0000","last_peered":"2024-09-19T07:49:35.617633+0000","last_clean":"2024-09-19T07:49:35.617633+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:49:35.617633+0000","last_undegraded":"2024-09-19T07:49:35.617633+0000","last_fullsized":"2024-09-19T07:49:35.617633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576519+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:49:28.576519+0000","last_peered":"2024-09-19T07:49:28.576519+0000","last_clean":"2024-09-19T07:49:28.576519+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:49:28.576519+0000","last_undegraded":"2024-09-19T07:49:28.576519+0000","last_fullsized":"2024-09-19T07:49:28.576519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584849+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:49:28.584849+0000","last_peered":"2024-09-19T07:49:28.584849+0000","last_clean":"2024-09-19T07:49:28.584849+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:49:28.584849+0000","last_undegraded":"2024-09-19T07:49:28.584849+0000","last_fullsized":"2024-09-19T07:49:28.584849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582861+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:49:28.582861+0000","last_peered":"2024-09-19T07:49:28.582861+0000","last_clean":"2024-09-19T07:49:28.582861+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:49:28.582861+0000","last_undegraded":"2024-09-19T07:49:28.582861+0000","last_fullsized":"2024-09-19T07:49:28.582861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619153+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:49:35.619153+0000","last_peered":"2024-09-19T07:49:35.619153+0000","last_clean":"2024-09-19T07:49:35.619153+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:49:35.619153+0000","last_undegraded":"2024-09-19T07:49:35.619153+0000","last_fullsized":"2024-09-19T07:49:35.619153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588576+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:49:28.588576+0000","last_peered":"2024-09-19T07:49:28.588576+0000","last_clean":"2024-09-19T07:49:28.588576+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:49:28.588576+0000","last_undegraded":"2024-09-19T07:49:28.588576+0000","last_fullsized":"2024-09-19T07:49:28.588576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587226+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:49:28.587226+0000","last_peered":"2024-09-19T07:49:28.587226+0000","last_clean":"2024-09-19T07:49:28.587226+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:49:28.587226+0000","last_undegraded":"2024-09-19T07:49:28.587226+0000","last_fullsized":"2024-09-19T07:49:28.587226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.594832+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:49:28.594832+0000","last_peered":"2024-09-19T07:49:28.594832+0000","last_clean":"2024-09-19T07:49:28.594832+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:49:28.594832+0000","last_undegraded":"2024-09-19T07:49:28.594832+0000","last_fullsized":"2024-09-19T07:49:28.594832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587575+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:49:28.587575+0000","last_peered":"2024-09-19T07:49:28.587575+0000","last_clean":"2024-09-19T07:49:28.587575+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:49:28.587575+0000","last_undegraded":"2024-09-19T07:49:28.587575+0000","last_fullsized":"2024-09-19T07:49:28.587575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624562+0000","last_change":"2024-09-19T07:49:25.574247+0000","last_active":"2024-09-19T07:49:36.624562+0000","last_peered":"2024-09-19T07:49:36.624562+0000","last_clean":"2024-09-19T07:49:36.624562+0000","last_became_active":"2024-09-19T07:49:25.573911+0000","last_became_peered":"2024-09-19T07:49:25.573911+0000","last_unstale":"2024-09-19T07:49:36.624562+0000","last_undegraded":"2024-09-19T07:49:36.624562+0000","last_fullsized":"2024-09-19T07:49:36.624562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:35.765779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586434+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:49:28.586434+0000","last_peered":"2024-09-19T07:49:28.586434+0000","last_clean":"2024-09-19T07:49:28.586434+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:49:28.586434+0000","last_undegraded":"2024-09-19T07:49:28.586434+0000","last_fullsized":"2024-09-19T07:49:28.586434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584596+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:49:28.584596+0000","last_peered":"2024-09-19T07:49:28.584596+0000","last_clean":"2024-09-19T07:49:28.584596+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:49:28.584596+0000","last_undegraded":"2024-09-19T07:49:28.584596+0000","last_fullsized":"2024-09-19T07:49:28.584596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583193+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:49:28.583193+0000","last_peered":"2024-09-19T07:49:28.583193+0000","last_clean":"2024-09-19T07:49:28.583193+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:49:28.583193+0000","last_undegraded":"2024-09-19T07:49:28.583193+0000","last_fullsized":"2024-09-19T07:49:28.583193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624915+0000","last_change":"2024-09-19T07:49:25.571029+0000","last_active":"2024-09-19T07:49:36.624915+0000","last_peered":"2024-09-19T07:49:36.624915+0000","last_clean":"2024-09-19T07:49:36.624915+0000","last_became_active":"2024-09-19T07:49:25.570685+0000","last_became_peered":"2024-09-19T07:49:25.570685+0000","last_unstale":"2024-09-19T07:49:36.624915+0000","last_undegraded":"2024-09-19T07:49:36.624915+0000","last_fullsized":"2024-09-19T07:49:36.624915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:54.896230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54115,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":105,"num_read_kb":110,"num_write":155,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":162345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281526,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":424625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":1066218,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":424861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":424781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1016713,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":424250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1016397,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":424687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":424561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":475898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":465108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":425521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:49:55.245 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:49:55.246 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T07:49:55.246 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T07:49:55.496 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:55.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:55 smithi137 ceph-mon[35309]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:49:55.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:55 smithi137 ceph-mon[35309]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-09-19T07:49:55.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:55 smithi076 ceph-mon[30930]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:49:55.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:55 smithi076 ceph-mon[30930]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-09-19T07:49:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:55 smithi152 ceph-mon[35117]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:49:56.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:55 smithi152 ceph-mon[35117]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 -- 172.21.15.76:0/2815613185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044101cd0 msgr2=0x7fa044102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 --2- 172.21.15.76:0/2815613185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044101cd0 0x7fa044102150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa038009900 tx=0x7fa03802a410 comp rx=0 tx=0).stop 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 -- 172.21.15.76:0/2815613185 shutdown_connections 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 --2- 172.21.15.76:0/2815613185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa044102690 0x7fa044108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 --2- 172.21.15.76:0/2815613185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044101cd0 0x7fa044102150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 --2- 172.21.15.76:0/2815613185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044100ad0 0x7fa044100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 -- 172.21.15.76:0/2815613185 >> 172.21.15.76:0/2815613185 conn(0x7fa0440fc280 msgr2=0x7fa0440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 -- 172.21.15.76:0/2815613185 shutdown_connections 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.050+0000 7fa04a81e640 1 -- 172.21.15.76:0/2815613185 wait complete. 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 Processor -- start 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 -- start start 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa044100ad0 0x7fa0441981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044101cd0 0x7fa0441986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 0x7fa04419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa04410c990 con 0x7fa044102690 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa04410c810 con 0x7fa044101cd0 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa04a81e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa04410cb10 con 0x7fa044100ad0 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa048dbb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 0x7fa04419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa048dbb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 0x7fa04419f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52570/0 (socket says 172.21.15.76:52570) 2024-09-19T07:49:56.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.051+0000 7fa048dbb640 1 -- 172.21.15.76:0/681392391 learned_addr learned my addr 172.21.15.76:0/681392391 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa043fff640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa044100ad0 0x7fa0441981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa0437fe640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044101cd0 0x7fa0441986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa048dbb640 1 -- 172.21.15.76:0/681392391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa044100ad0 msgr2=0x7fa0441981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa048dbb640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa044100ad0 0x7fa0441981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa048dbb640 1 -- 172.21.15.76:0/681392391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044101cd0 msgr2=0x7fa0441986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa048dbb640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044101cd0 0x7fa0441986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa048dbb640 1 -- 172.21.15.76:0/681392391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04419fdd0 con 0x7fa044102690 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa0437fe640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044101cd0 0x7fa0441986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa048dbb640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 0x7fa04419f760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00b970 tx=0x7fa03c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c019070 con 0x7fa044102690 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa03c014440 con 0x7fa044102690 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0441a00c0 con 0x7fa044102690 2024-09-19T07:49:56.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0075d0 con 0x7fa044102690 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.052+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0441a0630 con 0x7fa044102690 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.053+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0441a08f0 con 0x7fa044102690 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.054+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa03c01c070 con 0x7fa044102690 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.055+0000 7fa0417fa640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa02c0a3300 0x7fa02c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.055+0000 7fa043fff640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa02c0a3300 0x7fa02c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.055+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fa03c0cf1d0 con 0x7fa044102690 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.056+0000 7fa043fff640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa02c0a3300 0x7fa02c0a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa044101b30 tx=0x7fa034009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:56.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.058+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa03c09c050 con 0x7fa044102690 2024-09-19T07:49:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.287+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa0441a0c80 con 0x7fa044102690 2024-09-19T07:49:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.289+0000 7fa0417fa640 1 -- 172.21.15.76:0/681392391 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fa03c09b950 con 0x7fa044102690 2024-09-19T07:49:56.289 INFO:teuthology.orchestra.run.smithi076.stdout:[client.0] 2024-09-19T07:49:56.289 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQCk1+tmKLoyERAAPsKSiHDPZkyqwoQumKwh6A== 2024-09-19T07:49:56.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa02c0a3300 msgr2=0x7fa02c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:56.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa02c0a3300 0x7fa02c0a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa044101b30 tx=0x7fa034009110 comp rx=0 tx=0).stop 2024-09-19T07:49:56.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 msgr2=0x7fa04419f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:56.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 0x7fa04419f760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00b970 tx=0x7fa03c00bd70 comp rx=0 tx=0).stop 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 shutdown_connections 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa044102690 0x7fa04419f760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa02c0a3300 0x7fa02c0a57c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa044101cd0 0x7fa0441986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 --2- 172.21.15.76:0/681392391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa044100ad0 0x7fa0441981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 >> 172.21.15.76:0/681392391 conn(0x7fa0440fc280 msgr2=0x7fa044069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 shutdown_connections 2024-09-19T07:49:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:56.291+0000 7fa04a81e640 1 -- 172.21.15.76:0/681392391 wait complete. 2024-09-19T07:49:56.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:56 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/681392391' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:49:56.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:56 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/681392391' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:49:57.031 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:49:57.032 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T07:49:57.032 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T07:49:57.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:56 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/681392391' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:49:57.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:56 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/681392391' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:49:57.070 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T07:49:57.070 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T07:49:57.070 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T07:49:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:56 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/681392391' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:49:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:56 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/681392391' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:49:57.355 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:57.765 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:57 smithi076 ceph-mon[30930]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-19T07:49:57.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 -- 172.21.15.76:0/1974573926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c101de0 msgr2=0x7ff47c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:57.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 --2- 172.21.15.76:0/1974573926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c101de0 0x7ff47c1021c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009900 tx=0x7ff46c02a410 comp rx=0 tx=0).stop 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 -- 172.21.15.76:0/1974573926 shutdown_connections 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 --2- 172.21.15.76:0/1974573926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c106f10 0x7ff47c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 --2- 172.21.15.76:0/1974573926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c102790 0x7ff47c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 --2- 172.21.15.76:0/1974573926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c101de0 0x7ff47c1021c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 -- 172.21.15.76:0/1974573926 >> 172.21.15.76:0/1974573926 conn(0x7ff47c0fd8c0 msgr2=0x7ff47c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 -- 172.21.15.76:0/1974573926 shutdown_connections 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.845+0000 7ff48151d640 1 -- 172.21.15.76:0/1974573926 wait complete. 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 Processor -- start 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 -- start start 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c101de0 0x7ff47c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 0x7ff47c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c106f10 0x7ff47c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:57.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c112150 con 0x7ff47c102790 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c111fd0 con 0x7ff47c106f10 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff48151d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c1122d0 con 0x7ff47c101de0 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 0x7ff47c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 0x7ff47c198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52596/0 (socket says 172.21.15.76:52596) 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 -- 172.21.15.76:0/3096052722 learned_addr learned my addr 172.21.15.76:0/3096052722 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47b7fe640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c106f10 0x7ff47c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47affd640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c101de0 0x7ff47c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 -- 172.21.15.76:0/3096052722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c101de0 msgr2=0x7ff47c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c101de0 0x7ff47c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 -- 172.21.15.76:0/3096052722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c106f10 msgr2=0x7ff47c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.846+0000 7ff47a7fc640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c106f10 0x7ff47c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff47a7fc640 1 -- 172.21.15.76:0/3096052722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c19d620 con 0x7ff47c102790 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff47b7fe640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c106f10 0x7ff47c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:49:57.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff47affd640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c101de0 0x7ff47c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff47a7fc640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 0x7ff47c198bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b4a0 tx=0x7ff47000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470014070 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47c19d910 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff470010b10 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470017d60 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.847+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47c1a51f0 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.848+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47c102240 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.849+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff470017070 con 0x7ff47c102790 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.849+0000 7ff463fff640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff4640a3350 0x7ff4640a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:57.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.850+0000 7ff47affd640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff4640a3350 0x7ff4640a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:57.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.850+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ff4700cebb0 con 0x7ff47c102790 2024-09-19T07:49:57.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.850+0000 7ff47affd640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff4640a3350 0x7ff4640a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff46c000c00 tx=0x7ff46c032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:57.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:57.854+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4700d5080 con 0x7ff47c102790 2024-09-19T07:49:58.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:57 smithi152 ceph-mon[35117]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-19T07:49:58.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.064+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff47c02d7c0 con 0x7ff47c102790 2024-09-19T07:49:58.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.071+0000 7ff463fff640 1 -- 172.21.15.76:0/3096052722 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264050 (secure 0 0 0) 0x7ff47009ba30 con 0x7ff47c102790 2024-09-19T07:49:58.074 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff4640a3350 msgr2=0x7ff4640a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff4640a3350 0x7ff4640a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff46c000c00 tx=0x7ff46c032d60 comp rx=0 tx=0).stop 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 msgr2=0x7ff47c198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 0x7ff47c198bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b4a0 tx=0x7ff47000b960 comp rx=0 tx=0).stop 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 shutdown_connections 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff4640a3350 0x7ff4640a5810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff47c106f10 0x7ff47c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff47c102790 0x7ff47c198bb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:58.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 --2- 172.21.15.76:0/3096052722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff47c101de0 0x7ff47c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:58.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 >> 172.21.15.76:0/3096052722 conn(0x7ff47c0fd8c0 msgr2=0x7ff47c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:58.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 shutdown_connections 2024-09-19T07:49:58.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:58.074+0000 7ff48151d640 1 -- 172.21.15.76:0/3096052722 wait complete. 2024-09-19T07:49:58.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:57 smithi137 ceph-mon[35309]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-19T07:49:58.806 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1377496784},{"type":"v1","addr":"172.21.15.76:6801","nonce":1377496784}]},"active_addr":"172.21.15.76:6801/1377496784","active_change":"2024-09-19T07:42:32.492473+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.76:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":3175575583}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":1524312740}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":2768770565}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":1359391390}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":1724642611}]}]} 2024-09-19T07:49:58.812 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T07:49:58.812 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T07:49:58.812 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:49:58.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:58 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3096052722' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:49:59.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:58 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3096052722' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:49:59.063 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:49:59.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:58 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3096052722' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:49:59.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 -- 172.21.15.76:0/694827598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 msgr2=0x7f1c4810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:59.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 --2- 172.21.15.76:0/694827598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4810ea90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009ca0 tx=0x7f1c4002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 -- 172.21.15.76:0/694827598 shutdown_connections 2024-09-19T07:49:59.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 --2- 172.21.15.76:0/694827598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4810ea90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 --2- 172.21.15.76:0/694827598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c48102790 0x7f1c481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 --2- 172.21.15.76:0/694827598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c48101de0 0x7f1c481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 -- 172.21.15.76:0/694827598 >> 172.21.15.76:0/694827598 conn(0x7f1c480fd8c0 msgr2=0x7f1c480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 -- 172.21.15.76:0/694827598 shutdown_connections 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.564+0000 7f1c4d415640 1 -- 172.21.15.76:0/694827598 wait complete. 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 Processor -- start 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 -- start start 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c48101de0 0x7f1c481984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c48102790 0x7f1c48198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c481120d0 con 0x7f1c48106f10 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111f50 con 0x7f1c48101de0 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c4d415640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48112250 con 0x7f1c48102790 2024-09-19T07:49:59.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52606/0 (socket says 172.21.15.76:52606) 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 -- 172.21.15.76:0/1648309174 learned_addr learned my addr 172.21.15.76:0/1648309174 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c467fc640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c48102790 0x7f1c48198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c46ffd640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c48101de0 0x7f1c481984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 -- 172.21.15.76:0/1648309174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c48102790 msgr2=0x7f1c48198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c48102790 0x7f1c48198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 -- 172.21.15.76:0/1648309174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c48101de0 msgr2=0x7f1c481984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c48101de0 0x7f1c481984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.565+0000 7f1c477fe640 1 -- 172.21.15.76:0/1648309174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4819d490 con 0x7f1c48106f10 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.566+0000 7f1c477fe640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4819cdb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009dc0 tx=0x7f1c40031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.566+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4002fba0 con 0x7f1c48106f10 2024-09-19T07:49:59.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.566+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4819d720 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.566+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c4002fd40 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.566+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40046a70 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.566+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c481a5060 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.567+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c481021c0 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.568+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1c400305c0 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.569+0000 7f1c2ffff640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1c300a32d0 0x7f1c300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.569+0000 7f1c46ffd640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1c300a32d0 0x7f1c300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.569+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f1c400f1200 con 0x7f1c48106f10 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.569+0000 7f1c46ffd640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1c300a32d0 0x7f1c300a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009890 tx=0x7f1c38008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:49:59.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.572+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c400be000 con 0x7f1c48106f10 2024-09-19T07:49:59.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.745+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c481a5230 con 0x7f1c48106f10 2024-09-19T07:49:59.746 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:49:59 smithi076 ceph-mon[30930]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-19T07:49:59.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.747+0000 7f1c2ffff640 1 -- 172.21.15.76:0/1648309174 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22304 (secure 0 0 0) 0x7f1c400bd900 con 0x7f1c48106f10 2024-09-19T07:49:59.747 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:49:59.747 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:49:28.218729+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:49:59.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1c300a32d0 msgr2=0x7f1c300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:59.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1c300a32d0 0x7f1c300a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009890 tx=0x7f1c38008040 comp rx=0 tx=0).stop 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 msgr2=0x7f1c4819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4819cdb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009dc0 tx=0x7f1c40031b10 comp rx=0 tx=0).stop 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 shutdown_connections 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c48106f10 0x7f1c4819cdb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c48102790 0x7f1c48198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1c300a32d0 0x7f1c300a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 --2- 172.21.15.76:0/1648309174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c48101de0 0x7f1c481984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:49:59.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 >> 172.21.15.76:0/1648309174 conn(0x7f1c480fd8c0 msgr2=0x7f1c480ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:49:59.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 shutdown_connections 2024-09-19T07:49:59.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:49:59.749+0000 7f1c4d415640 1 -- 172.21.15.76:0/1648309174 wait complete. 2024-09-19T07:50:00.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:49:59 smithi152 ceph-mon[35117]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-19T07:50:00.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:49:59 smithi137 ceph-mon[35309]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-19T07:50:00.462 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T07:50:00.462 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:50:00.730 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:00 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1648309174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:00 smithi076 ceph-mon[30930]: overall HEALTH_OK 2024-09-19T07:50:01.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:00 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1648309174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:01.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:00 smithi152 ceph-mon[35117]: overall HEALTH_OK 2024-09-19T07:50:01.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:00 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1648309174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:01.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:00 smithi137 ceph-mon[35309]: overall HEALTH_OK 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 -- 172.21.15.76:0/3862091785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 msgr2=0x7f2c841067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/3862091785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c841067f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009900 tx=0x7f2c7802a410 comp rx=0 tx=0).stop 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 -- 172.21.15.76:0/3862091785 shutdown_connections 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/3862091785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c84106f20 0x7f2c8410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/3862091785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c841067f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/3862091785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84101df0 0x7f2c841021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 -- 172.21.15.76:0/3862091785 >> 172.21.15.76:0/3862091785 conn(0x7f2c840fd8f0 msgr2=0x7f2c840ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:01.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 -- 172.21.15.76:0/3862091785 shutdown_connections 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.278+0000 7f2c88c0a640 1 -- 172.21.15.76:0/3862091785 wait complete. 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 Processor -- start 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 -- start start 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c84101df0 0x7f2c84198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c84198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84106f20 0x7f2c8419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841120a0 con 0x7f2c841027a0 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84111f20 con 0x7f2c84106f20 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.279+0000 7f2c88c0a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84112220 con 0x7f2c84101df0 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c84198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:01.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c8259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c84101df0 0x7f2c84198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c84198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52614/0 (socket says 172.21.15.76:52614) 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 -- 172.21.15.76:0/1088502388 learned_addr learned my addr 172.21.15.76:0/1088502388 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c82d9d640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84106f20 0x7f2c8419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 -- 172.21.15.76:0/1088502388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c84101df0 msgr2=0x7f2c84198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c84101df0 0x7f2c84198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 -- 172.21.15.76:0/1088502388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84106f20 msgr2=0x7f2c8419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84106f20 0x7f2c8419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 -- 172.21.15.76:0/1088502388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8419d5b0 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c82d9d640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84106f20 0x7f2c8419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c81d9b640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c84198b40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c78006010 tx=0x7f2c780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7803f030 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c78003d00 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8419d840 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78035070 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.280+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c84074420 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.281+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c841032d0 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.283+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2c78042030 con 0x7f2c841027a0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.283+0000 7f2c737fe640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2c6c0a32d0 0x7f2c6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.283+0000 7f2c8259c640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2c6c0a32d0 0x7f2c6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:01.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.283+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2c780eff00 con 0x7f2c841027a0 2024-09-19T07:50:01.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.284+0000 7f2c8259c640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2c6c0a32d0 0x7f2c6c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2c740058c0 tx=0x7f2c74010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:01.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.287+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c780bcd30 con 0x7f2c841027a0 2024-09-19T07:50:01.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.458+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c8410a100 con 0x7f2c841027a0 2024-09-19T07:50:01.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.460+0000 7f2c737fe640 1 -- 172.21.15.76:0/1088502388 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22304 (secure 0 0 0) 0x7f2c780dc090 con 0x7f2c841027a0 2024-09-19T07:50:01.461 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:01.461 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":82,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:49:28.218729+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2c6c0a32d0 msgr2=0x7f2c6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2c6c0a32d0 0x7f2c6c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2c740058c0 tx=0x7f2c74010040 comp rx=0 tx=0).stop 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 msgr2=0x7f2c84198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c84198b40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c78006010 tx=0x7f2c780042f0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 shutdown_connections 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2c6c0a32d0 0x7f2c6c0a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c84106f20 0x7f2c8419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c841027a0 0x7f2c84198b40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 --2- 172.21.15.76:0/1088502388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c84101df0 0x7f2c84198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:01.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 >> 172.21.15.76:0/1088502388 conn(0x7f2c840fd8f0 msgr2=0x7f2c840fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:01.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 shutdown_connections 2024-09-19T07:50:01.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:01.462+0000 7f2c88c0a640 1 -- 172.21.15.76:0/1088502388 wait complete. 2024-09-19T07:50:01.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:01 smithi076 ceph-mon[30930]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-19T07:50:01.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:01 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1088502388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:01 smithi152 ceph-mon[35117]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-19T07:50:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:01 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1088502388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:02.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:01 smithi137 ceph-mon[35309]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-19T07:50:02.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:01 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1088502388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:02.173 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T07:50:02.173 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T07:50:02.174 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T07:50:02.174 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T07:50:02.175 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T07:50:02.175 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T07:50:02.175 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T07:50:02.176 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T07:50:02.177 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T07:50:02.177 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T07:50:02.177 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T07:50:02.178 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T07:50:02.828 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:02.844 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.007 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:02 smithi076 ceph-mon[30930]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-19T07:50:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:02 smithi152 ceph-mon[35117]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-19T07:50:03.148 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.149 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.149 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.150 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.151 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.151 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.152 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:03.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:02 smithi137 ceph-mon[35309]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-19T07:50:03.160 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:04.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 -- 172.21.15.76:0/2944266376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 msgr2=0x7f2504103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 --2- 172.21.15.76:0/2944266376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504103190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009930 tx=0x7f24f402a440 comp rx=0 tx=0).stop 2024-09-19T07:50:04.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 -- 172.21.15.76:0/2944266376 shutdown_connections 2024-09-19T07:50:04.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 --2- 172.21.15.76:0/2944266376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25041082e0 0x7f250410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 --2- 172.21.15.76:0/2944266376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2504103760 0x7f2504107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 --2- 172.21.15.76:0/2944266376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504103190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 -- 172.21.15.76:0/2944266376 >> 172.21.15.76:0/2944266376 conn(0x7f25040fc7d0 msgr2=0x7f25040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 -- 172.21.15.76:0/2944266376 shutdown_connections 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 -- 172.21.15.76:0/2944266376 wait complete. 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 Processor -- start 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.022+0000 7f250acd6640 1 -- start start 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f250acd6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f250acd6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2504103760 0x7f2504198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f250acd6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25041082e0 0x7f250419d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f250acd6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f25041122b0 con 0x7f2504102db0 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60866/0 (socket says 172.21.15.76:60866) 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 -- 172.21.15.76:0/3383999774 learned_addr learned my addr 172.21.15.76:0/3383999774 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112130 con 0x7f2504103760 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112430 con 0x7f25041082e0 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2509273640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25041082e0 0x7f250419d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 -- 172.21.15.76:0/3383999774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25041082e0 msgr2=0x7f250419d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25041082e0 0x7f250419d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 -- 172.21.15.76:0/3383999774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2504103760 msgr2=0x7f2504198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2504103760 0x7f2504198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250419d700 con 0x7f2504102db0 2024-09-19T07:50:04.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.023+0000 7f2508a72640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504198750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009a50 tx=0x7f24f4004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:04.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.024+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f403f030 con 0x7f2504102db0 2024-09-19T07:50:04.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.024+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24f4005000 con 0x7f2504102db0 2024-09-19T07:50:04.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.024+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4035070 con 0x7f2504102db0 2024-09-19T07:50:04.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.024+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250419d990 con 0x7f2504102db0 2024-09-19T07:50:04.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.024+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a52d0 con 0x7f2504102db0 2024-09-19T07:50:04.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.025+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2504062980 con 0x7f2504102db0 2024-09-19T07:50:04.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.026+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f24f4042030 con 0x7f2504102db0 2024-09-19T07:50:04.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2501ffb640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f24ec0a3350 0x7f24ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2503fff640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f24ec0a3350 0x7f24ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f24f40f0470 con 0x7f2504102db0 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2501ffb640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] conn(0x7f24ec0acba0 0x7f24ec0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24f40047a0 con 0x7f24ec0acba0 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f24f40f0950 con 0x7f2504102db0 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.027+0000 7f2509273640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] conn(0x7f24ec0acba0 0x7f24ec0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.028+0000 7f2503fff640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f24ec0a3350 0x7f24ec0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25040fed80 tx=0x7f24f8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.028+0000 7f2509273640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] conn(0x7f24ec0acba0 0x7f24ec0aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:04.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.028+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== osd.3 v2:172.21.15.76:6810/1561520625 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24f40047a0 con 0x7f24ec0acba0 2024-09-19T07:50:04.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.042+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 --> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2504062d80 con 0x7f24ec0acba0 2024-09-19T07:50:04.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.042+0000 7f2501ffb640 1 -- 172.21.15.76:0/3383999774 <== osd.3 v2:172.21.15.76:6810/1561520625 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2504062d80 con 0x7f24ec0acba0 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.042+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] conn(0x7f24ec0acba0 msgr2=0x7f24ec0aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.042+0000 7f250acd6640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] conn(0x7f24ec0acba0 0x7f24ec0aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f24ec0a3350 msgr2=0x7f24ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f24ec0a3350 0x7f24ec0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25040fed80 tx=0x7f24f8006c90 comp rx=0 tx=0).stop 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 msgr2=0x7f2504198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 --2- 172.21.15.76:0/3383999774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2504102db0 0x7f2504198750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009a50 tx=0x7f24f4004b80 comp rx=0 tx=0).stop 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f2509273640 1 -- 172.21.15.76:0/3383999774 reap_dead start 2024-09-19T07:50:04.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 shutdown_connections 2024-09-19T07:50:04.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 >> 172.21.15.76:0/3383999774 conn(0x7f25040fc7d0 msgr2=0x7f2504106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:04.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 shutdown_connections 2024-09-19T07:50:04.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.043+0000 7f250acd6640 1 -- 172.21.15.76:0/3383999774 wait complete. 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 -- 172.21.15.76:0/1032230965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50100e20 msgr2=0x7fcc50101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 --2- 172.21.15.76:0/1032230965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50100e20 0x7fcc50101200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009900 tx=0x7fcc4c02a480 comp rx=0 tx=0).stop 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 -- 172.21.15.76:0/1032230965 shutdown_connections 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 --2- 172.21.15.76:0/1032230965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc50102ef0 0x7fcc5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 --2- 172.21.15.76:0/1032230965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc50102570 0x7fcc501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 --2- 172.21.15.76:0/1032230965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50100e20 0x7fcc50101200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 -- 172.21.15.76:0/1032230965 >> 172.21.15.76:0/1032230965 conn(0x7fcc500fc7d0 msgr2=0x7fcc500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:04.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 -- 172.21.15.76:0/1032230965 shutdown_connections 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.223+0000 7fcc58008640 1 -- 172.21.15.76:0/1032230965 wait complete. 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 Processor -- start 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 -- start start 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc50100e20 0x7fcc50199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc50102570 0x7fcc50199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50102ef0 0x7fcc501a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcc501110a0 con 0x7fcc50102ef0 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcc50110f20 con 0x7fcc50102570 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc58008640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc50111220 con 0x7fcc50100e20 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc565a5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50102ef0 0x7fcc501a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc565a5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50102ef0 0x7fcc501a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60874/0 (socket says 172.21.15.76:60874) 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc565a5640 1 -- 172.21.15.76:0/3434422949 learned_addr learned my addr 172.21.15.76:0/3434422949 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:04.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.224+0000 7fcc55da4640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc50100e20 0x7fcc50199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc555a3640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc50102570 0x7fcc50199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc565a5640 1 -- 172.21.15.76:0/3434422949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc50100e20 msgr2=0x7fcc50199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc565a5640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc50100e20 0x7fcc50199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc565a5640 1 -- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc50102570 msgr2=0x7fcc50199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc565a5640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc50102570 0x7fcc50199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc565a5640 1 -- 172.21.15.76:0/3434422949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc501a4a10 con 0x7fcc50102ef0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc565a5640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50102ef0 0x7fcc501a44d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800eaa0 tx=0x7fcc4800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800cdb0 con 0x7fcc50102ef0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc48004b20 con 0x7fcc50102ef0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc501a4be0 con 0x7fcc50102ef0 2024-09-19T07:50:04.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48011760 con 0x7fcc50102ef0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.225+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc501a50f0 con 0x7fcc50102ef0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.226+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc500fea00 con 0x7fcc50102ef0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.227+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcc48011900 con 0x7fcc50102ef0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc46ffd640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcc3c0a32d0 0x7fcc3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc55da4640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcc3c0a32d0 0x7fcc3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fcc480cfe40 con 0x7fcc50102ef0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc46ffd640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] conn(0x7fcc3c0acb20 0x7fcc3c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 --> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc48014ec0 con 0x7fcc3c0acb20 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fcc480d0320 con 0x7fcc50102ef0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc55da4640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcc3c0a32d0 0x7fcc3c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009230 tx=0x7fcc4c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.228+0000 7fcc555a3640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] conn(0x7fcc3c0acb20 0x7fcc3c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.229+0000 7fcc555a3640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] conn(0x7fcc3c0acb20 0x7fcc3c0aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:04.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.230+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== osd.7 v2:172.21.15.137:6816/3569961551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc48014ec0 con 0x7fcc3c0acb20 2024-09-19T07:50:04.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.243+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 --> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc501021b0 con 0x7fcc3c0acb20 2024-09-19T07:50:04.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.244+0000 7fcc46ffd640 1 -- 172.21.15.76:0/3434422949 <== osd.7 v2:172.21.15.137:6816/3569961551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcc501021b0 con 0x7fcc3c0acb20 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.244+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] conn(0x7fcc3c0acb20 msgr2=0x7fcc3c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.244+0000 7fcc58008640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] conn(0x7fcc3c0acb20 0x7fcc3c0aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcc3c0a32d0 msgr2=0x7fcc3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fcc3c0a32d0 0x7fcc3c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009230 tx=0x7fcc4c0058d0 comp rx=0 tx=0).stop 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50102ef0 msgr2=0x7fcc501a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 --2- 172.21.15.76:0/3434422949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc50102ef0 0x7fcc501a44d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800eaa0 tx=0x7fcc4800ef60 comp rx=0 tx=0).stop 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc565a5640 1 -- 172.21.15.76:0/3434422949 reap_dead start 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 shutdown_connections 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 >> 172.21.15.76:0/3434422949 conn(0x7fcc500fc7d0 msgr2=0x7fcc500fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 shutdown_connections 2024-09-19T07:50:04.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:04.245+0000 7fcc58008640 1 -- 172.21.15.76:0/3434422949 wait complete. 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 -- 172.21.15.76:0/4023387473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954101450 msgr2=0x7f5954105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 --2- 172.21.15.76:0/4023387473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954101450 0x7f5954105920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5944009900 tx=0x7f594402a470 comp rx=0 tx=0).stop 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 -- 172.21.15.76:0/4023387473 shutdown_connections 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 --2- 172.21.15.76:0/4023387473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5954105f40 0x7f59541063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 --2- 172.21.15.76:0/4023387473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954101450 0x7f5954105920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 --2- 172.21.15.76:0/4023387473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5954100b30 0x7f5954100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 -- 172.21.15.76:0/4023387473 >> 172.21.15.76:0/4023387473 conn(0x7f59540fc7a0 msgr2=0x7f59540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 -- 172.21.15.76:0/4023387473 shutdown_connections 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.385+0000 7f595c08b640 1 -- 172.21.15.76:0/4023387473 wait complete. 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 Processor -- start 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 -- start start 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954100b30 0x7f59541a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5954101450 0x7f59541a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5954105f40 0x7f595419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5954118720 con 0x7f5954100b30 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59541185a0 con 0x7f5954101450 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595c08b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59541188a0 con 0x7f5954105f40 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954100b30 0x7f59541a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954100b30 0x7f59541a4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60888/0 (socket says 172.21.15.76:60888) 2024-09-19T07:50:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 -- 172.21.15.76:0/1111420963 learned_addr learned my addr 172.21.15.76:0/1111420963 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595a628640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5954105f40 0x7f595419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959626640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5954101450 0x7f59541a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 -- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5954105f40 msgr2=0x7f595419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5954105f40 0x7f595419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 -- 172.21.15.76:0/1111420963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5954101450 msgr2=0x7f59541a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5954101450 0x7f59541a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f5959e27640 1 -- 172.21.15.76:0/1111420963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595419f180 con 0x7f5954100b30 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.386+0000 7f595a628640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5954105f40 0x7f595419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.387+0000 7f5959e27640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954100b30 0x7f59541a4890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f595000d770 tx=0x7f595000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.387+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950017070 con 0x7f5954100b30 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.387+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595419f470 con 0x7f5954100b30 2024-09-19T07:50:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.387+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5950005520 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.387+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950010460 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.387+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59541ab760 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.388+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59541052b0 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.389+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5950004ea0 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f594affd640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f59400a32d0 0x7f59400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f5959626640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f59400a32d0 0x7f59400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f59500cf8c0 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f594affd640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] conn(0x7f59400acb20 0x7f59400aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 --> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5950001d30 con 0x7f59400acb20 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f59500cfda0 con 0x7f5954100b30 2024-09-19T07:50:05.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f5959626640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f59400a32d0 0x7f59400a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59541a0240 tx=0x7f5944005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.390+0000 7f595a628640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] conn(0x7f59400acb20 0x7f59400aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.391+0000 7f595a628640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] conn(0x7f59400acb20 0x7f59400aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.392+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== osd.8 v2:172.21.15.152:6816/2407728016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5950001d30 con 0x7f59400acb20 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.405+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 --> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f595406b070 con 0x7f59400acb20 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.405+0000 7f594affd640 1 -- 172.21.15.76:0/1111420963 <== osd.8 v2:172.21.15.152:6816/2407728016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f595406b070 con 0x7f59400acb20 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] conn(0x7f59400acb20 msgr2=0x7f59400aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] conn(0x7f59400acb20 0x7f59400aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f59400a32d0 msgr2=0x7f59400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f59400a32d0 0x7f59400a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59541a0240 tx=0x7f5944005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954100b30 msgr2=0x7f59541a4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 --2- 172.21.15.76:0/1111420963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5954100b30 0x7f59541a4890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f595000d770 tx=0x7f595000dc30 comp rx=0 tx=0).stop 2024-09-19T07:50:05.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595a628640 1 -- 172.21.15.76:0/1111420963 reap_dead start 2024-09-19T07:50:05.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 shutdown_connections 2024-09-19T07:50:05.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 >> 172.21.15.76:0/1111420963 conn(0x7f59540fc7a0 msgr2=0x7f59541038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:05.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 shutdown_connections 2024-09-19T07:50:05.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.406+0000 7f595c08b640 1 -- 172.21.15.76:0/1111420963 wait complete. 2024-09-19T07:50:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 -- 172.21.15.76:0/3950625606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420102790 msgr2=0x7f54201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 --2- 172.21.15.76:0/3950625606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420102790 0x7f54201067e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5410009900 tx=0x7f541002a410 comp rx=0 tx=0).stop 2024-09-19T07:50:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 -- 172.21.15.76:0/3950625606 shutdown_connections 2024-09-19T07:50:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 --2- 172.21.15.76:0/3950625606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5420106f10 0x7f542010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 --2- 172.21.15.76:0/3950625606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420102790 0x7f54201067e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 --2- 172.21.15.76:0/3950625606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5420101de0 0x7f54201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 -- 172.21.15.76:0/3950625606 >> 172.21.15.76:0/3950625606 conn(0x7f54200fd8c0 msgr2=0x7f54200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 -- 172.21.15.76:0/3950625606 shutdown_connections 2024-09-19T07:50:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.805+0000 7f5427815640 1 -- 172.21.15.76:0/3950625606 wait complete. 2024-09-19T07:50:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 Processor -- start 2024-09-19T07:50:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 -- start start 2024-09-19T07:50:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420101de0 0x7f5420198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5420102790 0x7f5420198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5420106f10 0x7f542019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5420112090 con 0x7f5420101de0 2024-09-19T07:50:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5420111f10 con 0x7f5420102790 2024-09-19T07:50:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5427815640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5420112210 con 0x7f5420106f10 2024-09-19T07:50:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f54255b1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420101de0 0x7f5420198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f54255b1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420101de0 0x7f5420198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60912/0 (socket says 172.21.15.76:60912) 2024-09-19T07:50:05.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f54255b1640 1 -- 172.21.15.76:0/1201514010 learned_addr learned my addr 172.21.15.76:0/1201514010 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:05.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.806+0000 7f5425db2640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5420106f10 0x7f542019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f5424db0640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5420102790 0x7f5420198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54255b1640 1 -- 172.21.15.76:0/1201514010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5420106f10 msgr2=0x7f542019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54255b1640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5420106f10 0x7f542019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54255b1640 1 -- 172.21.15.76:0/1201514010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5420102790 msgr2=0x7f5420198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54255b1640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5420102790 0x7f5420198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54255b1640 1 -- 172.21.15.76:0/1201514010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542019d500 con 0x7f5420101de0 2024-09-19T07:50:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f5424db0640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5420102790 0x7f5420198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f5425db2640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5420106f10 0x7f542019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54255b1640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420101de0 0x7f5420198550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c890 tx=0x7f541c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:05.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c004220 con 0x7f5420101de0 2024-09-19T07:50:05.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f541c0043c0 con 0x7f5420101de0 2024-09-19T07:50:05.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542019d7f0 con 0x7f5420101de0 2024-09-19T07:50:05.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c004b10 con 0x7f5420101de0 2024-09-19T07:50:05.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.807+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54201a50d0 con 0x7f5420101de0 2024-09-19T07:50:05.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.808+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5420062980 con 0x7f5420101de0 2024-09-19T07:50:05.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.809+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f541c0051b0 con 0x7f5420101de0 2024-09-19T07:50:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f54167fc640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f540c0a32d0 0x7f540c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f5424db0640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f540c0a32d0 0x7f540c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f541c0cfbb0 con 0x7f5420101de0 2024-09-19T07:50:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f54167fc640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] conn(0x7f540c0acb20 0x7f540c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 --> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f540c0af5f0 con 0x7f540c0acb20 2024-09-19T07:50:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f541c0d0090 con 0x7f5420101de0 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f5425db2640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] conn(0x7f540c0acb20 0x7f540c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f5424db0640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f540c0a32d0 0x7f540c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5410000c00 tx=0x7f5410032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.810+0000 7f5425db2640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] conn(0x7f540c0acb20 0x7f540c0aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.811+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== osd.9 v2:172.21.15.76:6826/356414316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f540c0af5f0 con 0x7f540c0acb20 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.824+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 --> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5420062e00 con 0x7f540c0acb20 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f54167fc640 1 -- 172.21.15.76:0/1201514010 <== osd.9 v2:172.21.15.76:6826/356414316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5420062e00 con 0x7f540c0acb20 2024-09-19T07:50:05.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] conn(0x7f540c0acb20 msgr2=0x7f540c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] conn(0x7f540c0acb20 0x7f540c0aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:05.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f540c0a32d0 msgr2=0x7f540c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f540c0a32d0 0x7f540c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5410000c00 tx=0x7f5410032d60 comp rx=0 tx=0).stop 2024-09-19T07:50:05.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420101de0 msgr2=0x7f5420198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:05.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 --2- 172.21.15.76:0/1201514010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5420101de0 0x7f5420198550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c890 tx=0x7f541c00cd50 comp rx=0 tx=0).stop 2024-09-19T07:50:05.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5425db2640 1 -- 172.21.15.76:0/1201514010 reap_dead start 2024-09-19T07:50:05.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 shutdown_connections 2024-09-19T07:50:05.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 >> 172.21.15.76:0/1201514010 conn(0x7f54200fd8c0 msgr2=0x7f54200fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:05.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 shutdown_connections 2024-09-19T07:50:05.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:05.825+0000 7f5427815640 1 -- 172.21.15.76:0/1201514010 wait complete. 2024-09-19T07:50:05.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:05 smithi076 ceph-mon[30930]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:50:06.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:05 smithi152 ceph-mon[35117]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:50:06.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:05 smithi137 ceph-mon[35309]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:50:06.621 INFO:teuthology.orchestra.run.smithi076.stdout:274877906976 2024-09-19T07:50:06.621 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 -- 172.21.15.76:0/4077186694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 msgr2=0x7fdd30100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 --2- 172.21.15.76:0/4077186694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd30100ee0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009930 tx=0x7fdd2402a420 comp rx=0 tx=0).stop 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 -- 172.21.15.76:0/4077186694 shutdown_connections 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 --2- 172.21.15.76:0/4077186694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd30101420 0x7fdd3010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 --2- 172.21.15.76:0/4077186694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd30100ee0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 --2- 172.21.15.76:0/4077186694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd30106a80 0x7fdd30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 -- 172.21.15.76:0/4077186694 >> 172.21.15.76:0/4077186694 conn(0x7fdd300fc7a0 msgr2=0x7fdd300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 -- 172.21.15.76:0/4077186694 shutdown_connections 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 -- 172.21.15.76:0/4077186694 wait complete. 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 Processor -- start 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.044+0000 7fdd384dd640 1 -- start start 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd301994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd30101420 0x7fdd30199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd30106a80 0x7fdd301a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdd30111060 con 0x7fdd30100a80 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd30110ee0 con 0x7fdd30101420 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd301111e0 con 0x7fdd30106a80 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd301994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd301994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60924/0 (socket says 172.21.15.76:60924) 2024-09-19T07:50:07.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 -- 172.21.15.76:0/2652340990 learned_addr learned my addr 172.21.15.76:0/2652340990 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd35a78640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd30101420 0x7fdd30199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36a7a640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd30106a80 0x7fdd301a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 -- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd30106a80 msgr2=0x7fdd301a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd30106a80 0x7fdd301a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 -- 172.21.15.76:0/2652340990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd30101420 msgr2=0x7fdd30199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd30101420 0x7fdd30199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 -- 172.21.15.76:0/2652340990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd301a4ab0 con 0x7fdd30100a80 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36a7a640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd30106a80 0x7fdd301a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd36279640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd301994f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800b4a0 tx=0x7fdd2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28014070 con 0x7fdd30100a80 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd28010b10 con 0x7fdd30100a80 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28017d60 con 0x7fdd30100a80 2024-09-19T07:50:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.045+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd301a4c80 con 0x7fdd30100a80 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.046+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd301a5140 con 0x7fdd30100a80 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.046+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd300628c0 con 0x7fdd30100a80 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.047+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdd28017070 con 0x7fdd30100a80 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.048+0000 7fdd2f7fe640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fdd180a32d0 0x7fdd180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.048+0000 7fdd35a78640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fdd180a32d0 0x7fdd180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.048+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fdd280cf020 con 0x7fdd30100a80 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.048+0000 7fdd2f7fe640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] conn(0x7fdd180acb20 0x7fdd180aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.048+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 --> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd28020e70 con 0x7fdd180acb20 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.048+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fdd280cf500 con 0x7fdd30100a80 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.049+0000 7fdd35a78640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fdd180a32d0 0x7fdd180a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdd24000c00 tx=0x7fdd240095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.049+0000 7fdd36a7a640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] conn(0x7fdd180acb20 0x7fdd180aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.049+0000 7fdd36a7a640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] conn(0x7fdd180acb20 0x7fdd180aef40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.050+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== osd.2 v2:172.21.15.152:6800/3696302179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd28020e70 con 0x7fdd180acb20 2024-09-19T07:50:07.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.063+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 --> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd30062d40 con 0x7fdd180acb20 2024-09-19T07:50:07.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.064+0000 7fdd2f7fe640 1 -- 172.21.15.76:0/2652340990 <== osd.2 v2:172.21.15.152:6800/3696302179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd30062d40 con 0x7fdd180acb20 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] conn(0x7fdd180acb20 msgr2=0x7fdd180aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] conn(0x7fdd180acb20 0x7fdd180aef40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fdd180a32d0 msgr2=0x7fdd180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fdd180a32d0 0x7fdd180a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdd24000c00 tx=0x7fdd240095f0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 msgr2=0x7fdd301994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 --2- 172.21.15.76:0/2652340990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd30100a80 0x7fdd301994f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800b4a0 tx=0x7fdd2800b960 comp rx=0 tx=0).stop 2024-09-19T07:50:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd36a7a640 1 -- 172.21.15.76:0/2652340990 reap_dead start 2024-09-19T07:50:07.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 shutdown_connections 2024-09-19T07:50:07.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 >> 172.21.15.76:0/2652340990 conn(0x7fdd300fc7a0 msgr2=0x7fdd300fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:07.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 shutdown_connections 2024-09-19T07:50:07.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.065+0000 7fdd384dd640 1 -- 172.21.15.76:0/2652340990 wait complete. 2024-09-19T07:50:07.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 -- 172.21.15.76:0/3439927628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8102790 msgr2=0x7f5ac81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 --2- 172.21.15.76:0/3439927628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8102790 0x7f5ac81067e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009900 tx=0x7f5abc02a410 comp rx=0 tx=0).stop 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 -- 172.21.15.76:0/3439927628 shutdown_connections 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 --2- 172.21.15.76:0/3439927628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac8106f10 0x7f5ac810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 --2- 172.21.15.76:0/3439927628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8102790 0x7f5ac81067e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 --2- 172.21.15.76:0/3439927628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac8101de0 0x7f5ac81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 -- 172.21.15.76:0/3439927628 >> 172.21.15.76:0/3439927628 conn(0x7f5ac80fd8c0 msgr2=0x7f5ac80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 -- 172.21.15.76:0/3439927628 shutdown_connections 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.251+0000 7f5accb56640 1 -- 172.21.15.76:0/3439927628 wait complete. 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 Processor -- start 2024-09-19T07:50:07.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 -- start start 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac8101de0 0x7f5ac80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac8102790 0x7f5ac8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8106f10 0x7f5ac8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8112090 con 0x7f5ac8106f10 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8111f10 con 0x7f5ac8102790 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5accb56640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8112210 con 0x7f5ac8101de0 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5ac6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8106f10 0x7f5ac8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5ac6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8106f10 0x7f5ac8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60934/0 (socket says 172.21.15.76:60934) 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.252+0000 7f5ac6d9d640 1 -- 172.21.15.76:0/3420622022 learned_addr learned my addr 172.21.15.76:0/3420622022 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac659c640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac8101de0 0x7f5ac80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac6d9d640 1 -- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac8101de0 msgr2=0x7f5ac80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac6d9d640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac8101de0 0x7f5ac80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac6d9d640 1 -- 172.21.15.76:0/3420622022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac8102790 msgr2=0x7f5ac8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac6d9d640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac8102790 0x7f5ac8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac6d9d640 1 -- 172.21.15.76:0/3420622022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac81a69d0 con 0x7f5ac8106f10 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac659c640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac8101de0 0x7f5ac80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ac6d9d640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8106f10 0x7f5ac8074f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000eaa0 tx=0x7f5ac000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000cdb0 con 0x7f5ac8106f10 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81a6cc0 con 0x7f5ac8106f10 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ac0004b20 con 0x7f5ac8106f10 2024-09-19T07:50:07.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0011760 con 0x7f5ac8106f10 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.253+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac81a7250 con 0x7f5ac8106f10 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.254+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ac80628c0 con 0x7f5ac8106f10 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.255+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5ac0011900 con 0x7f5ac8106f10 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ab77fe640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5ab00a32d0 0x7f5ab00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ac659c640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5ab00a32d0 0x7f5ab00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5ac00cff30 con 0x7f5ac8106f10 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ab77fe640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] conn(0x7f5ab00acb20 0x7f5ab00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 --> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ac0014ec0 con 0x7f5ab00acb20 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5ac00d0410 con 0x7f5ac8106f10 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ac659c640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5ab00a32d0 0x7f5ab00a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005fd0 tx=0x7f5ab800b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.256+0000 7f5ac5d9b640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] conn(0x7f5ab00acb20 0x7f5ab00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.257+0000 7f5ac5d9b640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] conn(0x7f5ab00acb20 0x7f5ab00aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.258+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== osd.11 v2:172.21.15.152:6824/4215098574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ac0014ec0 con 0x7f5ab00acb20 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.271+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 --> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ac8062cc0 con 0x7f5ab00acb20 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5ab77fe640 1 -- 172.21.15.76:0/3420622022 <== osd.11 v2:172.21.15.152:6824/4215098574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5ac8062cc0 con 0x7f5ab00acb20 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] conn(0x7f5ab00acb20 msgr2=0x7f5ab00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] conn(0x7f5ab00acb20 0x7f5ab00aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5ab00a32d0 msgr2=0x7f5ab00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5ab00a32d0 0x7f5ab00a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005fd0 tx=0x7f5ab800b5f0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8106f10 msgr2=0x7f5ac8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 --2- 172.21.15.76:0/3420622022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac8106f10 0x7f5ac8074f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000eaa0 tx=0x7f5ac000ef60 comp rx=0 tx=0).stop 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5ac6d9d640 1 -- 172.21.15.76:0/3420622022 reap_dead start 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 shutdown_connections 2024-09-19T07:50:07.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 >> 172.21.15.76:0/3420622022 conn(0x7f5ac80fd8c0 msgr2=0x7f5ac80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:07.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 shutdown_connections 2024-09-19T07:50:07.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.272+0000 7f5accb56640 1 -- 172.21.15.76:0/3420622022 wait complete. 2024-09-19T07:50:07.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 -- 172.21.15.76:0/1939198536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c106f10 msgr2=0x7f946c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 --2- 172.21.15.76:0/1939198536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c106f10 0x7f946c10ea90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9464009ca0 tx=0x7f946402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 -- 172.21.15.76:0/1939198536 shutdown_connections 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 --2- 172.21.15.76:0/1939198536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c106f10 0x7f946c10ea90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 --2- 172.21.15.76:0/1939198536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f946c102790 0x7f946c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 --2- 172.21.15.76:0/1939198536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f946c101de0 0x7f946c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 -- 172.21.15.76:0/1939198536 >> 172.21.15.76:0/1939198536 conn(0x7f946c0fd8c0 msgr2=0x7f946c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 -- 172.21.15.76:0/1939198536 shutdown_connections 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.649+0000 7f947086f640 1 -- 172.21.15.76:0/1939198536 wait complete. 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 Processor -- start 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 -- start start 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c101de0 0x7f946c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f946c102790 0x7f946c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f946c106f10 0x7f946c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f946c112090 con 0x7f946c101de0 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f946c111f10 con 0x7f946c102790 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f947086f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f946c112210 con 0x7f946c106f10 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c101de0 0x7f946c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c101de0 0x7f946c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60946/0 (socket says 172.21.15.76:60946) 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 -- 172.21.15.76:0/2620233436 learned_addr learned my addr 172.21.15.76:0/2620233436 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f9469d9b640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f946c102790 0x7f946c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 -- 172.21.15.76:0/2620233436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f946c106f10 msgr2=0x7f946c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f946c106f10 0x7f946c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 -- 172.21.15.76:0/2620233436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f946c102790 msgr2=0x7f946c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f946c102790 0x7f946c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f946a59c640 1 -- 172.21.15.76:0/2620233436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c19d300 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.650+0000 7f9469d9b640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f946c102790 0x7f946c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.651+0000 7f946a59c640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c101de0 0x7f946c198350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f945c00c920 tx=0x7f945c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.651+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c007c70 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.651+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f945c007e10 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.651+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946c19d5f0 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.651+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c018940 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.651+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946c1a4ed0 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.652+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f946c0fec60 con 0x7f946c101de0 2024-09-19T07:50:07.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.653+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f945c018ae0 con 0x7f946c101de0 2024-09-19T07:50:07.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f945b7fe640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f94540a32d0 0x7f94540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f9469d9b640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f94540a32d0 0x7f94540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f945c0cff50 con 0x7f946c101de0 2024-09-19T07:50:07.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f945b7fe640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] conn(0x7f94540acb20 0x7f94540aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:07.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 --> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f945c01fe50 con 0x7f94540acb20 2024-09-19T07:50:07.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f945c0d0430 con 0x7f946c101de0 2024-09-19T07:50:07.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f946ad9d640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] conn(0x7f94540acb20 0x7f94540aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:07.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f9469d9b640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f94540a32d0 0x7f94540a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9460005e10 tx=0x7f9460005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.654+0000 7f946ad9d640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] conn(0x7f94540acb20 0x7f94540aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:07.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.655+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== osd.0 v2:172.21.15.76:6802/3678505020 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f945c01fe50 con 0x7f94540acb20 2024-09-19T07:50:07.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 --> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f946c1032c0 con 0x7f94540acb20 2024-09-19T07:50:07.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f945b7fe640 1 -- 172.21.15.76:0/2620233436 <== osd.0 v2:172.21.15.76:6802/3678505020 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f946c1032c0 con 0x7f94540acb20 2024-09-19T07:50:07.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] conn(0x7f94540acb20 msgr2=0x7f94540aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] conn(0x7f94540acb20 0x7f94540aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f94540a32d0 msgr2=0x7f94540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f94540a32d0 0x7f94540a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9460005e10 tx=0x7f9460005da0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c101de0 msgr2=0x7f946c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 --2- 172.21.15.76:0/2620233436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f946c101de0 0x7f946c198350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f945c00c920 tx=0x7f945c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f946ad9d640 1 -- 172.21.15.76:0/2620233436 reap_dead start 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 shutdown_connections 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.669+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 >> 172.21.15.76:0/2620233436 conn(0x7f946c0fd8c0 msgr2=0x7f946c0fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.670+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 shutdown_connections 2024-09-19T07:50:07.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:07.670+0000 7f947086f640 1 -- 172.21.15.76:0/2620233436 wait complete. 2024-09-19T07:50:07.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:07 smithi076 ceph-mon[30930]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:50:08.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:07 smithi152 ceph-mon[35117]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:50:08.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:07 smithi137 ceph-mon[35309]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:50:08.428 INFO:teuthology.orchestra.run.smithi076.stdout:210453397545 2024-09-19T07:50:08.429 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T07:50:09.378 INFO:teuthology.orchestra.run.smithi076.stdout:77309411396 2024-09-19T07:50:09.379 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T07:50:09.925 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:09 smithi076 ceph-mon[30930]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:50:09.951 INFO:teuthology.orchestra.run.smithi076.stdout:107374182461 2024-09-19T07:50:09.951 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T07:50:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:09 smithi152 ceph-mon[35117]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/1659095888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78102570 msgr2=0x7f4b781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/1659095888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78102570 0x7f4b781029b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009900 tx=0x7f4b6c02a480 comp rx=0 tx=0).stop 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/1659095888 shutdown_connections 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/1659095888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b78102ef0 0x7f4b7810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/1659095888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78102570 0x7f4b781029b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/1659095888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b78100e20 0x7f4b78101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/1659095888 >> 172.21.15.76:0/1659095888 conn(0x7f4b780fc7d0 msgr2=0x7f4b780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/1659095888 shutdown_connections 2024-09-19T07:50:10.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/1659095888 wait complete. 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 Processor -- start 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.116+0000 7f4b7f4fe640 1 -- start start 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78100e20 0x7f4b78198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b78102570 0x7f4b78198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b78102ef0 0x7f4b7819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4b781110e0 con 0x7f4b78100e20 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78110f60 con 0x7f4b78102570 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78111260 con 0x7f4b78102ef0 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78100e20 0x7f4b78198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78100e20 0x7f4b78198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60970/0 (socket says 172.21.15.76:60970) 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 -- 172.21.15.76:0/3159083381 learned_addr learned my addr 172.21.15.76:0/3159083381 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7ca99640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b78102570 0x7f4b78198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7da9b640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b78102ef0 0x7f4b7819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:10.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 -- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b78102ef0 msgr2=0x7f4b7819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b78102ef0 0x7f4b7819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 -- 172.21.15.76:0/3159083381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b78102570 msgr2=0x7f4b78198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b78102570 0x7f4b78198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 -- 172.21.15.76:0/3159083381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7819d640 con 0x7f4b78100e20 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7d29a640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78100e20 0x7f4b78198690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400d950 tx=0x7f4b7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74017070 con 0x7f4b78100e20 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7819d930 con 0x7f4b78100e20 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4b74009c30 con 0x7f4b78100e20 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7400f740 con 0x7f4b78100e20 2024-09-19T07:50:10.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.117+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b780fcbb0 con 0x7f4b78100e20 2024-09-19T07:50:10.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.118+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b78062980 con 0x7f4b78100e20 2024-09-19T07:50:10.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.120+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b74010a80 con 0x7f4b78100e20 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.120+0000 7f4b6a7fc640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b640a3350 0x7f4b640a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b7ca99640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b640a3350 0x7f4b640a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f4b740cf930 con 0x7f4b78100e20 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b6a7fc640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] conn(0x7f4b640acba0 0x7f4b640aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 --> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b640af670 con 0x7f4b640acba0 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f4b740cfe10 con 0x7f4b78100e20 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b7ca99640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b640a3350 0x7f4b640a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b780fff50 tx=0x7f4b6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b7da9b640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] conn(0x7f4b640acba0 0x7f4b640aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.121+0000 7f4b7da9b640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] conn(0x7f4b640acba0 0x7f4b640aefc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:10.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.122+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== osd.5 v2:172.21.15.152:6808/1589616787 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b640af670 con 0x7f4b640acba0 2024-09-19T07:50:10.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.136+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 --> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b78062d80 con 0x7f4b640acba0 2024-09-19T07:50:10.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b6a7fc640 1 -- 172.21.15.76:0/3159083381 <== osd.5 v2:172.21.15.152:6808/1589616787 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4b78062d80 con 0x7f4b640acba0 2024-09-19T07:50:10.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] conn(0x7f4b640acba0 msgr2=0x7f4b640aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:10.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] conn(0x7f4b640acba0 0x7f4b640aefc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:10.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b640a3350 msgr2=0x7f4b640a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b640a3350 0x7f4b640a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b780fff50 tx=0x7f4b6c005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78100e20 msgr2=0x7f4b78198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 --2- 172.21.15.76:0/3159083381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b78100e20 0x7f4b78198690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400d950 tx=0x7f4b7400de10 comp rx=0 tx=0).stop 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7da9b640 1 -- 172.21.15.76:0/3159083381 reap_dead start 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 shutdown_connections 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 >> 172.21.15.76:0/3159083381 conn(0x7f4b780fc7d0 msgr2=0x7f4b7806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 shutdown_connections 2024-09-19T07:50:10.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:10.137+0000 7f4b7f4fe640 1 -- 172.21.15.76:0/3159083381 wait complete. 2024-09-19T07:50:10.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:09 smithi137 ceph-mon[35309]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:50:10.547 INFO:teuthology.orchestra.run.smithi076.stdout:34359738446 2024-09-19T07:50:10.548 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T07:50:11.000 INFO:teuthology.orchestra.run.smithi076.stdout:326417514518 2024-09-19T07:50:11.000 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T07:50:11.196 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:11.196 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:11.609 INFO:teuthology.orchestra.run.smithi076.stdout:240518168612 2024-09-19T07:50:11.610 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T07:50:11.836 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:11 smithi076 ceph-mon[30930]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:50:11.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 -- 172.21.15.76:0/1820363399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c101de0 msgr2=0x7f685c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 --2- 172.21.15.76:0/1820363399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c101de0 0x7f685c1021c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f684c009900 tx=0x7f684c02a410 comp rx=0 tx=0).stop 2024-09-19T07:50:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 -- 172.21.15.76:0/1820363399 shutdown_connections 2024-09-19T07:50:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 --2- 172.21.15.76:0/1820363399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f685c106f10 0x7f685c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 --2- 172.21.15.76:0/1820363399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f685c102790 0x7f685c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 --2- 172.21.15.76:0/1820363399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c101de0 0x7f685c1021c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:12.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 -- 172.21.15.76:0/1820363399 >> 172.21.15.76:0/1820363399 conn(0x7f685c0fd8c0 msgr2=0x7f685c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 -- 172.21.15.76:0/1820363399 shutdown_connections 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.980+0000 7f686271a640 1 -- 172.21.15.76:0/1820363399 wait complete. 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 Processor -- start 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 -- start start 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f685c101de0 0x7f685c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f685c102790 0x7f685c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c106f10 0x7f685c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f685c112090 con 0x7f685c106f10 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f685c111f10 con 0x7f685c101de0 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f686271a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f685c112210 con 0x7f685c102790 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f6860cb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c106f10 0x7f685c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f6860cb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c106f10 0x7f685c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60996/0 (socket says 172.21.15.76:60996) 2024-09-19T07:50:12.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.981+0000 7f6860cb7640 1 -- 172.21.15.76:0/744371219 learned_addr learned my addr 172.21.15.76:0/744371219 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f685bfff640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f685c101de0 0x7f685c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f685b7fe640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f685c102790 0x7f685c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f6860cb7640 1 -- 172.21.15.76:0/744371219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f685c102790 msgr2=0x7f685c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f6860cb7640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f685c102790 0x7f685c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f6860cb7640 1 -- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f685c101de0 msgr2=0x7f685c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f6860cb7640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f685c101de0 0x7f685c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f6860cb7640 1 -- 172.21.15.76:0/744371219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c19d4e0 con 0x7f685c106f10 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f685b7fe640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f685c102790 0x7f685c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f6860cb7640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c106f10 0x7f685c19ce00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f685400cad0 tx=0x7f685400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685400ae20 con 0x7f685c106f10 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6854004b20 con 0x7f685c106f10 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c19d7d0 con 0x7f685c106f10 2024-09-19T07:50:12.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685400f780 con 0x7f685c106f10 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.982+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c1a50b0 con 0x7f685c106f10 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.983+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f685c062980 con 0x7f685c106f10 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.984+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f685400f920 con 0x7f685c106f10 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f68597fa640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68440a32d0 0x7f68440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f685bfff640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68440a32d0 0x7f68440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f68540cfd50 con 0x7f685c106f10 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f68597fa640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] conn(0x7f68440acb20 0x7f68440aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 --> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68440af5f0 con 0x7f68440acb20 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f68540d0230 con 0x7f685c106f10 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f685b7fe640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] conn(0x7f68440acb20 0x7f68440aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.985+0000 7f685bfff640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68440a32d0 0x7f68440a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f684c005ab0 tx=0x7f684c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.986+0000 7f685b7fe640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] conn(0x7f68440acb20 0x7f68440aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:12.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:11.986+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== osd.1 v2:172.21.15.137:6800/943192386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68440af5f0 con 0x7f68440acb20 2024-09-19T07:50:12.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.000+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 --> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f685c062e00 con 0x7f68440acb20 2024-09-19T07:50:12.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.000+0000 7f68597fa640 1 -- 172.21.15.76:0/744371219 <== osd.1 v2:172.21.15.137:6800/943192386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f685c062e00 con 0x7f68440acb20 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] conn(0x7f68440acb20 msgr2=0x7f68440aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] conn(0x7f68440acb20 0x7f68440aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68440a32d0 msgr2=0x7f68440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f68440a32d0 0x7f68440a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f684c005ab0 tx=0x7f684c005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c106f10 msgr2=0x7f685c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 --2- 172.21.15.76:0/744371219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f685c106f10 0x7f685c19ce00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f685400cad0 tx=0x7f685400cf90 comp rx=0 tx=0).stop 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f6860cb7640 1 -- 172.21.15.76:0/744371219 reap_dead start 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 shutdown_connections 2024-09-19T07:50:12.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 >> 172.21.15.76:0/744371219 conn(0x7f685c0fd8c0 msgr2=0x7f685c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:12.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 shutdown_connections 2024-09-19T07:50:12.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:12.001+0000 7f686271a640 1 -- 172.21.15.76:0/744371219 wait complete. 2024-09-19T07:50:12.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:11 smithi152 ceph-mon[35117]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:50:12.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:11 smithi137 ceph-mon[35309]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:50:13.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 -- 172.21.15.76:0/520204781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08106a80 msgr2=0x7f7b08106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 --2- 172.21.15.76:0/520204781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08106a80 0x7f7b08106e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009930 tx=0x7f7b0402a420 comp rx=0 tx=0).stop 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 -- 172.21.15.76:0/520204781 shutdown_connections 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 --2- 172.21.15.76:0/520204781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101420 0x7f7b0810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 --2- 172.21.15.76:0/520204781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b08100a80 0x7f7b08100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 --2- 172.21.15.76:0/520204781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08106a80 0x7f7b08106e60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 -- 172.21.15.76:0/520204781 >> 172.21.15.76:0/520204781 conn(0x7f7b080fc7a0 msgr2=0x7f7b080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 -- 172.21.15.76:0/520204781 shutdown_connections 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.004+0000 7f7b10633640 1 -- 172.21.15.76:0/520204781 wait complete. 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 Processor -- start 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 -- start start 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08100a80 0x7f7b080fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b08101420 0x7f7b080fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08106a80 0x7f7b080fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08110f60 con 0x7f7b08100a80 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08110de0 con 0x7f7b08101420 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b10633640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081110e0 con 0x7f7b08106a80 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08100a80 0x7f7b080fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08100a80 0x7f7b080fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:32794/0 (socket says 172.21.15.76:32794) 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 -- 172.21.15.76:0/2908667392 learned_addr learned my addr 172.21.15.76:0/2908667392 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0ebd0640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08106a80 0x7f7b080fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 -- 172.21.15.76:0/2908667392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08106a80 msgr2=0x7f7b080fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08106a80 0x7f7b080fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 -- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b08101420 msgr2=0x7f7b080fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b08101420 0x7f7b080fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 -- 172.21.15.76:0/2908667392 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b081a69f0 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.005+0000 7f7b0e3cf640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08100a80 0x7f7b080fcd10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009230 tx=0x7f7b04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.006+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0403f030 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.006+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b081a6c80 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.006+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7b04003af0 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.006+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04035070 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.006+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b081a71b0 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.007+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b080628c0 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.008+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7b04042030 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7aff7fe640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7af40a32d0 0x7f7af40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7b0dbce640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7af40a32d0 0x7f7af40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7b040f05c0 con 0x7f7b08100a80 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7aff7fe640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] conn(0x7f7af40acb20 0x7f7af40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 --> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7af40af5f0 con 0x7f7af40acb20 2024-09-19T07:50:13.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7b040f0aa0 con 0x7f7b08100a80 2024-09-19T07:50:13.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7b0dbce640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7af40a32d0 0x7f7af40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005fd0 tx=0x7f7af8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:13.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.009+0000 7f7b0ebd0640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] conn(0x7f7af40acb20 0x7f7af40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.010+0000 7f7b0ebd0640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] conn(0x7f7af40acb20 0x7f7af40aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:13.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.010+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== osd.4 v2:172.21.15.137:6808/2368598531 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7af40af5f0 con 0x7f7af40acb20 2024-09-19T07:50:13.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.025+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 --> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b08062cc0 con 0x7f7af40acb20 2024-09-19T07:50:13.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.025+0000 7f7aff7fe640 1 -- 172.21.15.76:0/2908667392 <== osd.4 v2:172.21.15.137:6808/2368598531 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7b08062cc0 con 0x7f7af40acb20 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] conn(0x7f7af40acb20 msgr2=0x7f7af40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] conn(0x7f7af40acb20 0x7f7af40aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7af40a32d0 msgr2=0x7f7af40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7af40a32d0 0x7f7af40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005fd0 tx=0x7f7af8005850 comp rx=0 tx=0).stop 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08100a80 msgr2=0x7f7b080fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 --2- 172.21.15.76:0/2908667392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7b08100a80 0x7f7b080fcd10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009230 tx=0x7f7b04004270 comp rx=0 tx=0).stop 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b0ebd0640 1 -- 172.21.15.76:0/2908667392 reap_dead start 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 shutdown_connections 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 >> 172.21.15.76:0/2908667392 conn(0x7f7b080fc7a0 msgr2=0x7f7b0806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 shutdown_connections 2024-09-19T07:50:13.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.026+0000 7f7b10633640 1 -- 172.21.15.76:0/2908667392 wait complete. 2024-09-19T07:50:13.458 INFO:teuthology.orchestra.run.smithi076.stdout:55834574922 2024-09-19T07:50:13.459 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T07:50:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 -- 172.21.15.76:0/3028557268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102ef0 msgr2=0x7f5d1c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/3028557268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102ef0 0x7f5d1c10da40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009ca0 tx=0x7f5d1402a950 comp rx=0 tx=0).stop 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 -- 172.21.15.76:0/3028557268 shutdown_connections 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/3028557268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102ef0 0x7f5d1c10da40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/3028557268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c102570 0x7f5d1c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/3028557268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d1c100e20 0x7f5d1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 -- 172.21.15.76:0/3028557268 >> 172.21.15.76:0/3028557268 conn(0x7f5d1c0fc7d0 msgr2=0x7f5d1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 -- 172.21.15.76:0/3028557268 shutdown_connections 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.628+0000 7f5d22a2f640 1 -- 172.21.15.76:0/3028557268 wait complete. 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 Processor -- start 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 -- start start 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c100e20 0x7f5d1c1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102570 0x7f5d1c198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d1c102ef0 0x7f5d1c19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c111160 con 0x7f5d1c102570 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c110fe0 con 0x7f5d1c102ef0 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d22a2f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c1112e0 con 0x7f5d1c100e20 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.629+0000 7f5d1bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c100e20 0x7f5d1c1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d20fcc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d1c102ef0 0x7f5d1c19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c100e20 0x7f5d1c1986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:54736/0 (socket says 172.21.15.76:54736) 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d20fcc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d1c102ef0 0x7f5d1c19cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:34514/0 (socket says 172.21.15.76:34514) 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d20fcc640 1 -- 172.21.15.76:0/1540167494 learned_addr learned my addr 172.21.15.76:0/1540167494 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1b7fe640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102570 0x7f5d1c198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 -- 172.21.15.76:0/1540167494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d1c102ef0 msgr2=0x7f5d1c19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d1c102ef0 0x7f5d1c19cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 -- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102570 msgr2=0x7f5d1c198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d1c102570 0x7f5d1c198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 -- 172.21.15.76:0/1540167494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c19d690 con 0x7f5d1c100e20 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.630+0000 7f5d1bfff640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c100e20 0x7f5d1c1986e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00b3f0 tx=0x7f5d0c00b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.631+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c015020 con 0x7f5d1c100e20 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.631+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1c19d980 con 0x7f5d1c100e20 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.631+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d0c011d30 con 0x7f5d1c100e20 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.631+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00f2e0 con 0x7f5d1c100e20 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.631+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1c1a5260 con 0x7f5d1c100e20 2024-09-19T07:50:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.632+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d1c062980 con 0x7f5d1c100e20 2024-09-19T07:50:13.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.633+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5d0c018020 con 0x7f5d1c100e20 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d197fa640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d040a32d0 0x7f5d040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d1b7fe640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d040a32d0 0x7f5d040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5d0c0cf5c0 con 0x7f5d1c100e20 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d197fa640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] conn(0x7f5d040acb20 0x7f5d040aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 --> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d040af5f0 con 0x7f5d040acb20 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5d0c0cf970 con 0x7f5d1c100e20 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d20fcc640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] conn(0x7f5d040acb20 0x7f5d040aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.634+0000 7f5d1b7fe640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d040a32d0 0x7f5d040a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c105240 tx=0x7f5d10009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.635+0000 7f5d20fcc640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] conn(0x7f5d040acb20 0x7f5d040aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.635+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== osd.6 v2:172.21.15.76:6818/3902035917 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d040af5f0 con 0x7f5d040acb20 2024-09-19T07:50:13.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.650+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 --> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d1c062d80 con 0x7f5d040acb20 2024-09-19T07:50:13.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.650+0000 7f5d197fa640 1 -- 172.21.15.76:0/1540167494 <== osd.6 v2:172.21.15.76:6818/3902035917 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5d1c062d80 con 0x7f5d040acb20 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.650+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] conn(0x7f5d040acb20 msgr2=0x7f5d040aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.650+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] conn(0x7f5d040acb20 0x7f5d040aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d040a32d0 msgr2=0x7f5d040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f5d040a32d0 0x7f5d040a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c105240 tx=0x7f5d10009110 comp rx=0 tx=0).stop 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c100e20 msgr2=0x7f5d1c1986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 --2- 172.21.15.76:0/1540167494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d1c100e20 0x7f5d1c1986e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00b3f0 tx=0x7f5d0c00b7f0 comp rx=0 tx=0).stop 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d20fcc640 1 -- 172.21.15.76:0/1540167494 reap_dead start 2024-09-19T07:50:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 shutdown_connections 2024-09-19T07:50:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 >> 172.21.15.76:0/1540167494 conn(0x7f5d1c0fc7d0 msgr2=0x7f5d1c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 shutdown_connections 2024-09-19T07:50:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:13.651+0000 7f5d22a2f640 1 -- 172.21.15.76:0/1540167494 wait complete. 2024-09-19T07:50:13.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:13 smithi076 ceph-mon[30930]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:50:13.956 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:13 smithi137 ceph-mon[35309]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:50:14.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:13 smithi152 ceph-mon[35117]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:50:14.462 INFO:teuthology.orchestra.run.smithi076.stdout:193273528368 2024-09-19T07:50:14.462 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T07:50:15.057 INFO:teuthology.orchestra.run.smithi076.stdout:163208757300 2024-09-19T07:50:15.058 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T07:50:15.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.735+0000 7f76c4f63640 1 -- 172.21.15.76:0/2989289107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c0103660 msgr2=0x7f76c010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:15.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.735+0000 7f76c4f63640 1 --2- 172.21.15.76:0/2989289107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c0103660 0x7f76c010bb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009900 tx=0x7f76b402a480 comp rx=0 tx=0).stop 2024-09-19T07:50:15.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 -- 172.21.15.76:0/2989289107 shutdown_connections 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 --2- 172.21.15.76:0/2989289107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76c010c170 0x7f76c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 --2- 172.21.15.76:0/2989289107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c0103660 0x7f76c010bb50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 --2- 172.21.15.76:0/2989289107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c0102d40 0x7f76c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 -- 172.21.15.76:0/2989289107 >> 172.21.15.76:0/2989289107 conn(0x7f76c00fc7a0 msgr2=0x7f76c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 -- 172.21.15.76:0/2989289107 shutdown_connections 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 -- 172.21.15.76:0/2989289107 wait complete. 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 Processor -- start 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.736+0000 7f76c4f63640 1 -- start start 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c0102d40 0x7f76c0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76c0103660 0x7f76c0198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:15.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c010c170 0x7f76c019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0112170 con 0x7f76c010c170 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0111ff0 con 0x7f76c0103660 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76c01122f0 con 0x7f76c0102d40 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c010c170 0x7f76c019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c010c170 0x7f76c019cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58802/0 (socket says 172.21.15.76:58802) 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 -- 172.21.15.76:0/3354417117 learned_addr learned my addr 172.21.15.76:0/3354417117 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76be59c640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c0102d40 0x7f76c0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bdd9b640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76c0103660 0x7f76c0198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 -- 172.21.15.76:0/3354417117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c0102d40 msgr2=0x7f76c0198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c0102d40 0x7f76c0198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 -- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76c0103660 msgr2=0x7f76c0198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76c0103660 0x7f76c0198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:15.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 -- 172.21.15.76:0/3354417117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c019d620 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bdd9b640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76c0103660 0x7f76c0198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76bed9d640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c010c170 0x7f76c019cf40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f76b800b970 tx=0x7f76b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8019070 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76b800cb40 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c019d910 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8007700 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.737+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01a51f0 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.738+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76c0062980 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.739+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f76b801c070 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76af7fe640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f76a80a32d0 0x7f76a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76be59c640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f76a80a32d0 0x7f76a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f76b80cee20 con 0x7f76c010c170 2024-09-19T07:50:15.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76af7fe640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] conn(0x7f76a80acb20 0x7f76a80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 --> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76b8017e70 con 0x7f76a80acb20 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f76b80d1570 con 0x7f76c010c170 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.740+0000 7f76be59c640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f76a80a32d0 0x7f76a80a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009890 tx=0x7f76b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.741+0000 7f76bdd9b640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] conn(0x7f76a80acb20 0x7f76a80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.741+0000 7f76bdd9b640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] conn(0x7f76a80acb20 0x7f76a80aef40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.742+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== osd.10 v2:172.21.15.137:6824/3618747545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76b8017e70 con 0x7f76a80acb20 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.755+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 --> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76c0062e00 con 0x7f76a80acb20 2024-09-19T07:50:15.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76af7fe640 1 -- 172.21.15.76:0/3354417117 <== osd.10 v2:172.21.15.137:6824/3618747545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f76c0062e00 con 0x7f76a80acb20 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] conn(0x7f76a80acb20 msgr2=0x7f76a80aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76c4f63640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] conn(0x7f76a80acb20 0x7f76a80aef40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f76a80a32d0 msgr2=0x7f76a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76c4f63640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f76a80a32d0 0x7f76a80a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009890 tx=0x7f76b0008040 comp rx=0 tx=0).stop 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c010c170 msgr2=0x7f76c019cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76c4f63640 1 --2- 172.21.15.76:0/3354417117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76c010c170 0x7f76c019cf40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f76b800b970 tx=0x7f76b800be30 comp rx=0 tx=0).stop 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.756+0000 7f76bed9d640 1 -- 172.21.15.76:0/3354417117 reap_dead start 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.757+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 shutdown_connections 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.757+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 >> 172.21.15.76:0/3354417117 conn(0x7f76c00fc7a0 msgr2=0x7f76c00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.757+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 shutdown_connections 2024-09-19T07:50:15.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:14.757+0000 7f76c4f63640 1 -- 172.21.15.76:0/3354417117 wait complete. 2024-09-19T07:50:15.395 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:15.396 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:15.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:15 smithi076 ceph-mon[30930]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T07:50:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:15 smithi152 ceph-mon[35117]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T07:50:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:15 smithi137 ceph-mon[35309]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T07:50:16.179 INFO:teuthology.orchestra.run.smithi076.stdout:141733920827 2024-09-19T07:50:16.180 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T07:50:16.571 INFO:teuthology.orchestra.run.smithi076.stdout:296352743452 2024-09-19T07:50:16.572 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T07:50:17.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 -- 172.21.15.76:0/2530610365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 msgr2=0x7fc1101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- 172.21.15.76:0/2530610365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1101029b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009900 tx=0x7fc0fc02a480 comp rx=0 tx=0).stop 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 -- 172.21.15.76:0/2530610365 shutdown_connections 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- 172.21.15.76:0/2530610365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc110102ef0 0x7fc11010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- 172.21.15.76:0/2530610365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1101029b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- 172.21.15.76:0/2530610365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc110100e20 0x7fc110101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 -- 172.21.15.76:0/2530610365 >> 172.21.15.76:0/2530610365 conn(0x7fc1100fc7d0 msgr2=0x7fc1100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 -- 172.21.15.76:0/2530610365 shutdown_connections 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 -- 172.21.15.76:0/2530610365 wait complete. 2024-09-19T07:50:17.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 Processor -- start 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 -- start start 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc110100e20 0x7fc1100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.123+0000 7fc116f13640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc110102ef0 0x7fc1100fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc116f13640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc1101110a0 con 0x7fc110102570 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc116f13640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc110110f20 con 0x7fc110100e20 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc116f13640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc110111220 con 0x7fc110102ef0 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1100fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58816/0 (socket says 172.21.15.76:58816) 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 -- 172.21.15.76:0/1947077003 learned_addr learned my addr 172.21.15.76:0/1947077003 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc1154b0640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc110102ef0 0x7fc1100fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 -- 172.21.15.76:0/1947077003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc110102ef0 msgr2=0x7fc1100fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc114caf640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc110100e20 0x7fc1100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc110102ef0 0x7fc1100fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 -- 172.21.15.76:0/1947077003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc110100e20 msgr2=0x7fc1100fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc110100e20 0x7fc1100fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 -- 172.21.15.76:0/1947077003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1101a6a30 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10ffff640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1100fd1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006010 tx=0x7fc0fc004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc03f030 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1101a6cc0 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0fc005500 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.124+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc035070 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.125+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1101a71a0 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.125+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc110101200 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.127+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc0fc042030 con 0x7fc110102570 2024-09-19T07:50:17.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.127+0000 7fc10dffb640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1000a32d0 0x7fc1000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.127+0000 7fc114caf640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1000a32d0 0x7fc1000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.127+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc0fc0effd0 con 0x7fc110102570 2024-09-19T07:50:17.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.128+0000 7fc114caf640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1000a32d0 0x7fc1000a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc1040058c0 tx=0x7fc104005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:17.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.131+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0fc0bcd40 con 0x7fc110102570 2024-09-19T07:50:17.240 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:17.244 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:17.244 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:17.246 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:17.248 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:17.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.330+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc11010a0a0 con 0x7fc110102570 2024-09-19T07:50:17.333 INFO:teuthology.orchestra.run.smithi076.stdout:77309411398 2024-09-19T07:50:17.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.331+0000 7fc10dffb640 1 -- 172.21.15.76:0/1947077003 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0fc0b8070 con 0x7fc110102570 2024-09-19T07:50:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1000a32d0 msgr2=0x7fc1000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1000a32d0 0x7fc1000a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc1040058c0 tx=0x7fc104005c60 comp rx=0 tx=0).stop 2024-09-19T07:50:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 msgr2=0x7fc1100fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1100fd1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006010 tx=0x7fc0fc004c00 comp rx=0 tx=0).stop 2024-09-19T07:50:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 shutdown_connections 2024-09-19T07:50:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc110102ef0 0x7fc1100fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc110102570 0x7fc1100fd1c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1000a32d0 0x7fc1000a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 --2- 172.21.15.76:0/1947077003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc110100e20 0x7fc1100fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 >> 172.21.15.76:0/1947077003 conn(0x7fc1100fc7d0 msgr2=0x7fc11006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 shutdown_connections 2024-09-19T07:50:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.335+0000 7fc116f13640 1 -- 172.21.15.76:0/1947077003 wait complete. 2024-09-19T07:50:17.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 -- 172.21.15.76:0/2657502229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 msgr2=0x7f6bf010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/2657502229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf010da40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009ca0 tx=0x7f6be802a950 comp rx=0 tx=0).stop 2024-09-19T07:50:17.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 -- 172.21.15.76:0/2657502229 shutdown_connections 2024-09-19T07:50:17.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/2657502229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf010da40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/2657502229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bf0102570 0x7f6bf01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/2657502229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bf0100e20 0x7f6bf0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 -- 172.21.15.76:0/2657502229 >> 172.21.15.76:0/2657502229 conn(0x7f6bf00fc7d0 msgr2=0x7f6bf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:17.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 -- 172.21.15.76:0/2657502229 shutdown_connections 2024-09-19T07:50:17.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.811+0000 7f6bf7c96640 1 -- 172.21.15.76:0/2657502229 wait complete. 2024-09-19T07:50:17.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 Processor -- start 2024-09-19T07:50:17.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 -- start start 2024-09-19T07:50:17.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bf0100e20 0x7f6bf00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bf0102570 0x7f6bf00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01110a0 con 0x7f6bf0102ef0 2024-09-19T07:50:17.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0110f20 con 0x7f6bf0100e20 2024-09-19T07:50:17.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf7c96640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0111220 con 0x7f6bf0102570 2024-09-19T07:50:17.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf6233640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf6233640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58826/0 (socket says 172.21.15.76:58826) 2024-09-19T07:50:17.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf6233640 1 -- 172.21.15.76:0/3929772559 learned_addr learned my addr 172.21.15.76:0/3929772559 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:17.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf5a32640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bf0100e20 0x7f6bf00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.812+0000 7f6bf5231640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bf0102570 0x7f6bf00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf6233640 1 -- 172.21.15.76:0/3929772559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bf0102570 msgr2=0x7f6bf00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf6233640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bf0102570 0x7f6bf00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf6233640 1 -- 172.21.15.76:0/3929772559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bf0100e20 msgr2=0x7f6bf00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf6233640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bf0100e20 0x7f6bf00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf6233640 1 -- 172.21.15.76:0/3929772559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf01a6a30 con 0x7f6bf0102ef0 2024-09-19T07:50:17.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf6233640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf00fd700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005cc0 tx=0x7f6be802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:17.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8034040 con 0x7f6bf0102ef0 2024-09-19T07:50:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf01a6cc0 con 0x7f6bf0102ef0 2024-09-19T07:50:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6be8030940 con 0x7f6bf0102ef0 2024-09-19T07:50:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be80456e0 con 0x7f6bf0102ef0 2024-09-19T07:50:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.813+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf01a71a0 con 0x7f6bf0102ef0 2024-09-19T07:50:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.815+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf0101200 con 0x7f6bf0102ef0 2024-09-19T07:50:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.816+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6be8037020 con 0x7f6bf0102ef0 2024-09-19T07:50:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.817+0000 7f6be6ffd640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6bdc0a32d0 0x7f6bdc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.817+0000 7f6bf5a32640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6bdc0a32d0 0x7f6bdc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.817+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f6be80f07e0 con 0x7f6bf0102ef0 2024-09-19T07:50:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.818+0000 7f6bf5a32640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6bdc0a32d0 0x7f6bdc0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00bbe0 tx=0x7f6bec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.822+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6be80bd660 con 0x7f6bf0102ef0 2024-09-19T07:50:17.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:17 smithi076 ceph-mon[30930]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:50:17.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:17 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1947077003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:50:17.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.994+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6bf010a0a0 con 0x7f6bf0102ef0 2024-09-19T07:50:17.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.995+0000 7f6be6ffd640 1 -- 172.21.15.76:0/3929772559 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6be80bcf60 con 0x7f6bf0102ef0 2024-09-19T07:50:17.995 INFO:teuthology.orchestra.run.smithi076.stdout:326417514519 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.996+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6bdc0a32d0 msgr2=0x7f6bdc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.996+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6bdc0a32d0 0x7f6bdc0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00bbe0 tx=0x7f6bec00b390 comp rx=0 tx=0).stop 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.996+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 msgr2=0x7f6bf00fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.996+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf00fd700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005cc0 tx=0x7f6be802f790 comp rx=0 tx=0).stop 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 shutdown_connections 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6bf0102ef0 0x7f6bf00fd700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bf0102570 0x7f6bf00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f6bdc0a32d0 0x7f6bdc0a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 --2- 172.21.15.76:0/3929772559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bf0100e20 0x7f6bf00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:17.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 >> 172.21.15.76:0/3929772559 conn(0x7f6bf00fc7d0 msgr2=0x7f6bf006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 shutdown_connections 2024-09-19T07:50:17.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:17.997+0000 7f6bf7c96640 1 -- 172.21.15.76:0/3929772559 wait complete. 2024-09-19T07:50:18.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:17 smithi152 ceph-mon[35117]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:50:18.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:17 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1947077003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:50:18.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:17 smithi137 ceph-mon[35309]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:50:18.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:17 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1947077003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:50:18.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 -- 172.21.15.76:0/1485680987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0102ef0 msgr2=0x7f99a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 --2- 172.21.15.76:0/1485680987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0102ef0 0x7f99a010da40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9998009ca0 tx=0x7f999802a950 comp rx=0 tx=0).stop 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 -- 172.21.15.76:0/1485680987 shutdown_connections 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 --2- 172.21.15.76:0/1485680987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0102ef0 0x7f99a010da40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 --2- 172.21.15.76:0/1485680987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99a0102570 0x7f99a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 --2- 172.21.15.76:0/1485680987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99a0100e20 0x7f99a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 -- 172.21.15.76:0/1485680987 >> 172.21.15.76:0/1485680987 conn(0x7f99a00fc7d0 msgr2=0x7f99a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 -- 172.21.15.76:0/1485680987 shutdown_connections 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.703+0000 7f99a4d71640 1 -- 172.21.15.76:0/1485680987 wait complete. 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 Processor -- start 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 -- start start 2024-09-19T07:50:18.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 0x7f99a0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99a0102570 0x7f99a0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99a0102ef0 0x7f99a019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f99a01110a0 con 0x7f99a0100e20 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0110f20 con 0x7f99a0102570 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f99a4d71640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f99a0111220 con 0x7f99a0102ef0 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 0x7f99a0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 0x7f99a0198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58856/0 (socket says 172.21.15.76:58856) 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 -- 172.21.15.76:0/3670994669 learned_addr learned my addr 172.21.15.76:0/3670994669 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 -- 172.21.15.76:0/3670994669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99a0102ef0 msgr2=0x7f99a019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99a0102ef0 0x7f99a019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 -- 172.21.15.76:0/3670994669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99a0102570 msgr2=0x7f99a0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999dd9b640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99a0102570 0x7f99a0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:18.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99a0102570 0x7f99a0198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.704+0000 7f999e59c640 1 -- 172.21.15.76:0/3670994669 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a019d540 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.705+0000 7f999e59c640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 0x7f99a0198590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f999400d950 tx=0x7f999400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.705+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994017030 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.705+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a019d830 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.705+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9994004020 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.705+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994004a00 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.705+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a01a5110 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.706+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a0101200 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.707+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f99940041d0 con 0x7f99a0100e20 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.708+0000 7f998f7fe640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99880a3350 0x7f99880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.708+0000 7f999dd9b640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99880a3350 0x7f99880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:18.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.708+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f99940cf4e0 con 0x7f99a0100e20 2024-09-19T07:50:18.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.708+0000 7f999dd9b640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99880a3350 0x7f99880a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9990005d80 tx=0x7f9990005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:18.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.712+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f999409c150 con 0x7f99a0100e20 2024-09-19T07:50:18.744 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:18.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.884+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f99a01998f0 con 0x7f99a0100e20 2024-09-19T07:50:18.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.884+0000 7f998f7fe640 1 -- 172.21.15.76:0/3670994669 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f999409ba50 con 0x7f99a0100e20 2024-09-19T07:50:18.885 INFO:teuthology.orchestra.run.smithi076.stdout:240518168615 2024-09-19T07:50:18.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99880a3350 msgr2=0x7f99880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:18.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99880a3350 0x7f99880a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9990005d80 tx=0x7f9990005c90 comp rx=0 tx=0).stop 2024-09-19T07:50:18.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 msgr2=0x7f99a0198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:18.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 0x7f99a0198590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f999400d950 tx=0x7f999400de10 comp rx=0 tx=0).stop 2024-09-19T07:50:18.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 shutdown_connections 2024-09-19T07:50:18.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99a0102ef0 0x7f99a019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99880a3350 0x7f99880a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99a0102570 0x7f99a0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 --2- 172.21.15.76:0/3670994669 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99a0100e20 0x7f99a0198590 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:18.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 >> 172.21.15.76:0/3670994669 conn(0x7f99a00fc7d0 msgr2=0x7f99a006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:18.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 shutdown_connections 2024-09-19T07:50:18.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:18.886+0000 7f99a4d71640 1 -- 172.21.15.76:0/3670994669 wait complete. 2024-09-19T07:50:18.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:18 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3929772559' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:50:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:18 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3929772559' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:50:19.151 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411398 for osd.2 2024-09-19T07:50:19.152 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:19.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:18 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3929772559' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:50:19.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 -- 172.21.15.76:0/2526478614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 msgr2=0x7f524c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:19.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 --2- 172.21.15.76:0/2526478614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c106e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5248009930 tx=0x7f524802a420 comp rx=0 tx=0).stop 2024-09-19T07:50:19.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 -- 172.21.15.76:0/2526478614 shutdown_connections 2024-09-19T07:50:19.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 --2- 172.21.15.76:0/2526478614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c101420 0x7f524c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 --2- 172.21.15.76:0/2526478614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f524c100a80 0x7f524c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 --2- 172.21.15.76:0/2526478614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c106e60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 -- 172.21.15.76:0/2526478614 >> 172.21.15.76:0/2526478614 conn(0x7f524c0fc7a0 msgr2=0x7f524c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:19.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 -- 172.21.15.76:0/2526478614 shutdown_connections 2024-09-19T07:50:19.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.516+0000 7f5252df2640 1 -- 172.21.15.76:0/2526478614 wait complete. 2024-09-19T07:50:19.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 Processor -- start 2024-09-19T07:50:19.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 -- start start 2024-09-19T07:50:19.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f524c100a80 0x7f524c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:19.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c101420 0x7f524c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:19.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c1a4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:19.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f524c111060 con 0x7f524c106a80 2024-09-19T07:50:19.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f524c110ee0 con 0x7f524c101420 2024-09-19T07:50:19.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5252df2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f524c1111e0 con 0x7f524c100a80 2024-09-19T07:50:19.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c1a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:19.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c1a4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58878/0 (socket says 172.21.15.76:58878) 2024-09-19T07:50:19.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 -- 172.21.15.76:0/221115473 learned_addr learned my addr 172.21.15.76:0/221115473 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:19.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5243fff640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c101420 0x7f524c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:19.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 -- 172.21.15.76:0/221115473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f524c100a80 msgr2=0x7f524c1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:19.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f524c100a80 0x7f524c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 -- 172.21.15.76:0/221115473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c101420 msgr2=0x7f524c199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:19.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c101420 0x7f524c199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 -- 172.21.15.76:0/221115473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c1a4a90 con 0x7f524c106a80 2024-09-19T07:50:19.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f525138f640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c1a4550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f524400b970 tx=0x7f524400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:19.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.517+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244019070 con 0x7f524c106a80 2024-09-19T07:50:19.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.518+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f524400cb40 con 0x7f524c106a80 2024-09-19T07:50:19.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.518+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524c1a4c60 con 0x7f524c106a80 2024-09-19T07:50:19.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.518+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244007700 con 0x7f524c106a80 2024-09-19T07:50:19.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.518+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524c1a5120 con 0x7f524c106a80 2024-09-19T07:50:19.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.519+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524c100f60 con 0x7f524c106a80 2024-09-19T07:50:19.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.520+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f524401c070 con 0x7f524c106a80 2024-09-19T07:50:19.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.520+0000 7f5241ffb640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f52340a32d0 0x7f52340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:19.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.521+0000 7f5250b8e640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f52340a32d0 0x7f52340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:19.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.521+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f52440cee30 con 0x7f524c106a80 2024-09-19T07:50:19.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.521+0000 7f5250b8e640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f52340a32d0 0x7f52340a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f52480096c0 tx=0x7f5248000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:19.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.525+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f524409bcb0 con 0x7f524c106a80 2024-09-19T07:50:19.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.699+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f524c108ff0 con 0x7f524c106a80 2024-09-19T07:50:19.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.699+0000 7f5241ffb640 1 -- 172.21.15.76:0/221115473 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f524409b5b0 con 0x7f524c106a80 2024-09-19T07:50:19.699 INFO:teuthology.orchestra.run.smithi076.stdout:210453397548 2024-09-19T07:50:19.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f52340a32d0 msgr2=0x7f52340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:19.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f52340a32d0 0x7f52340a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f52480096c0 tx=0x7f5248000bc0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 msgr2=0x7f524c1a4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:19.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c1a4550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f524400b970 tx=0x7f524400be30 comp rx=0 tx=0).stop 2024-09-19T07:50:19.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 shutdown_connections 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f524c106a80 0x7f524c1a4550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f52340a32d0 0x7f52340a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f524c101420 0x7f524c199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 --2- 172.21.15.76:0/221115473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f524c100a80 0x7f524c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 >> 172.21.15.76:0/221115473 conn(0x7f524c0fc7a0 msgr2=0x7f524c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 shutdown_connections 2024-09-19T07:50:19.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:19.701+0000 7f5252df2640 1 -- 172.21.15.76:0/221115473 wait complete. 2024-09-19T07:50:19.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:19 smithi076 ceph-mon[30930]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:19.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:19 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3670994669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:50:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:19 smithi152 ceph-mon[35117]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:20.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:19 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3670994669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:50:20.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:19 smithi137 ceph-mon[35309]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:20.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:19 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3670994669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:50:20.426 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:20.427 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:20.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397545 got 210453397548 for osd.7 2024-09-19T07:50:20.434 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:20.950 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:20 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/221115473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:50:20.950 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:20 smithi076 ceph-mon[30930]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:20.996 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:20 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/221115473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:50:20.996 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:20 smithi152 ceph-mon[35117]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:21.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 -- 172.21.15.76:0/344948757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050106a80 msgr2=0x7f5050106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 --2- 172.21.15.76:0/344948757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050106a80 0x7f5050106e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5040009930 tx=0x7f504002a420 comp rx=0 tx=0).stop 2024-09-19T07:50:21.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 -- 172.21.15.76:0/344948757 shutdown_connections 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 --2- 172.21.15.76:0/344948757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5050101420 0x7f505010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 --2- 172.21.15.76:0/344948757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 0x7f5050100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 --2- 172.21.15.76:0/344948757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050106a80 0x7f5050106e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 -- 172.21.15.76:0/344948757 >> 172.21.15.76:0/344948757 conn(0x7f50500fc7a0 msgr2=0x7f50500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 -- 172.21.15.76:0/344948757 shutdown_connections 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 -- 172.21.15.76:0/344948757 wait complete. 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.031+0000 7f5055792640 1 Processor -- start 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 -- start start 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 0x7f5050198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 0x7f5050198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5050106a80 0x7f505019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5050112120 con 0x7f5050101420 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5050111fa0 con 0x7f5050100a80 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f5055792640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50501122a0 con 0x7f5050106a80 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 0x7f5050198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 0x7f5050198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58902/0 (socket says 172.21.15.76:58902) 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 -- 172.21.15.76:0/2400259657 learned_addr learned my addr 172.21.15.76:0/2400259657 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f504effd640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 0x7f5050198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 -- 172.21.15.76:0/2400259657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5050106a80 msgr2=0x7f505019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5050106a80 0x7f505019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 -- 172.21.15.76:0/2400259657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 msgr2=0x7f5050198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 0x7f5050198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f50467fc640 1 -- 172.21.15.76:0/2400259657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505019d530 con 0x7f5050101420 2024-09-19T07:50:21.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.032+0000 7f504effd640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 0x7f5050198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.033+0000 7f50467fc640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 0x7f5050198ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f503800c890 tx=0x7f503800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.033+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038004220 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.033+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505019d820 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.033+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f50380043c0 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.033+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038004b10 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.033+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50501a5100 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.034+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5050100ee0 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.035+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f50380051b0 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.035+0000 7f504cff9640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f503c0a32d0 0x7f503c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.036+0000 7f504effd640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f503c0a32d0 0x7f503c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.036+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f50380cfa20 con 0x7f5050101420 2024-09-19T07:50:21.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.036+0000 7f504effd640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f503c0a32d0 0x7f503c0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5040000c00 tx=0x7f5040005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:21.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.040+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5038014030 con 0x7f5050101420 2024-09-19T07:50:21.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:20 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/221115473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:50:21.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:20 smithi137 ceph-mon[35309]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:21.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.212+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f50501a5490 con 0x7f5050101420 2024-09-19T07:50:21.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.212+0000 7f504cff9640 1 -- 172.21.15.76:0/2400259657 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f503809c790 con 0x7f5050101420 2024-09-19T07:50:21.213 INFO:teuthology.orchestra.run.smithi076.stdout:34359738448 2024-09-19T07:50:21.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f503c0a32d0 msgr2=0x7f503c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f503c0a32d0 0x7f503c0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5040000c00 tx=0x7f5040005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:21.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 msgr2=0x7f5050198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 0x7f5050198ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f503800c890 tx=0x7f503800cd50 comp rx=0 tx=0).stop 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 shutdown_connections 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5050106a80 0x7f505019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5050101420 0x7f5050198ac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f503c0a32d0 0x7f503c0a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 --2- 172.21.15.76:0/2400259657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5050100a80 0x7f5050198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 >> 172.21.15.76:0/2400259657 conn(0x7f50500fc7a0 msgr2=0x7f50500fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.214+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 shutdown_connections 2024-09-19T07:50:21.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.215+0000 7f5055792640 1 -- 172.21.15.76:0/2400259657 wait complete. 2024-09-19T07:50:21.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 -- 172.21.15.76:0/3022229037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c84102de0 msgr2=0x7f0c841031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/3022229037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c84102de0 0x7f0c841031c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009900 tx=0x7f0c8002a480 comp rx=0 tx=0).stop 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 -- 172.21.15.76:0/3022229037 shutdown_connections 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/3022229037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c8410c180 0x7f0c8410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/3022229037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c84103700 0x7f0c8410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/3022229037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c84102de0 0x7f0c841031c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 -- 172.21.15.76:0/3022229037 >> 172.21.15.76:0/3022229037 conn(0x7f0c840fc7a0 msgr2=0x7f0c840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 -- 172.21.15.76:0/3022229037 shutdown_connections 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.241+0000 7f0c8b91a640 1 -- 172.21.15.76:0/3022229037 wait complete. 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 Processor -- start 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 -- start start 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c84102de0 0x7f0c84198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c84103700 0x7f0c84198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 0x7f0c8419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0c84112110 con 0x7f0c8410c180 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c84111f90 con 0x7f0c84103700 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.242+0000 7f0c8b91a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0c84112290 con 0x7f0c84102de0 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 0x7f0c8419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 0x7f0c8419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58908/0 (socket says 172.21.15.76:58908) 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 -- 172.21.15.76:0/1441166583 learned_addr learned my addr 172.21.15.76:0/1441166583 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c896b6640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c84102de0 0x7f0c84198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c88eb5640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c84103700 0x7f0c84198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 -- 172.21.15.76:0/1441166583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c84102de0 msgr2=0x7f0c84198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c84102de0 0x7f0c84198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 -- 172.21.15.76:0/1441166583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c84103700 msgr2=0x7f0c84198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c84103700 0x7f0c84198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 -- 172.21.15.76:0/1441166583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8419d520 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c89eb7640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 0x7f0c8419ce40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b970 tx=0x7f0c7c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c019070 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8419d810 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c7c00cb40 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c007700 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.243+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c841a50f0 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.245+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c841031c0 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.246+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0c7c01c070 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.246+0000 7f0c7a7fc640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0c700a32d0 0x7f0c700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.246+0000 7f0c896b6640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0c700a32d0 0x7f0c700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.246+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f0c7c0cf2f0 con 0x7f0c8410c180 2024-09-19T07:50:21.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.247+0000 7f0c896b6640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0c700a32d0 0x7f0c700a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009230 tx=0x7f0c800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:21.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.250+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c7c09baa0 con 0x7f0c8410c180 2024-09-19T07:50:21.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.418+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0c84106cb0 con 0x7f0c8410c180 2024-09-19T07:50:21.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.418+0000 7f0c7a7fc640 1 -- 172.21.15.76:0/1441166583 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c7c09fda0 con 0x7f0c8410c180 2024-09-19T07:50:21.419 INFO:teuthology.orchestra.run.smithi076.stdout:55834574924 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.420+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0c700a32d0 msgr2=0x7f0c700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.420+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0c700a32d0 0x7f0c700a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009230 tx=0x7f0c800058d0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.420+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 msgr2=0x7f0c8419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.420+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 0x7f0c8419ce40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b970 tx=0x7f0c7c00be30 comp rx=0 tx=0).stop 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 shutdown_connections 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0c8410c180 0x7f0c8419ce40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f0c700a32d0 0x7f0c700a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c84103700 0x7f0c84198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 --2- 172.21.15.76:0/1441166583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c84102de0 0x7f0c84198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 >> 172.21.15.76:0/1441166583 conn(0x7f0c840fc7a0 msgr2=0x7f0c840fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 shutdown_connections 2024-09-19T07:50:21.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:21.421+0000 7f0c8b91a640 1 -- 172.21.15.76:0/1441166583 wait complete. 2024-09-19T07:50:21.890 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2400259657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:50:21.891 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1441166583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:50:21.919 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738448 for osd.0 2024-09-19T07:50:21.919 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2400259657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:50:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1441166583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:50:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2400259657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:50:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1441166583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:50:22.351 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514518 got 326417514519 for osd.11 2024-09-19T07:50:22.351 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:22.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:22 smithi076 ceph-mon[30930]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:23.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168612 got 240518168615 for osd.8 2024-09-19T07:50:23.011 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:22 smithi152 ceph-mon[35117]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:22 smithi137 ceph-mon[35309]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:23.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 -- 172.21.15.76:0/2941483095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2481027c0 msgr2=0x7fd248106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 --2- 172.21.15.76:0/2941483095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2481027c0 0x7fd248106810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009900 tx=0x7fd23c02a410 comp rx=0 tx=0).stop 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 -- 172.21.15.76:0/2941483095 shutdown_connections 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 --2- 172.21.15.76:0/2941483095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd248106f40 0x7fd24810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 --2- 172.21.15.76:0/2941483095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2481027c0 0x7fd248106810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 --2- 172.21.15.76:0/2941483095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd248101e10 0x7fd2481021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 -- 172.21.15.76:0/2941483095 >> 172.21.15.76:0/2941483095 conn(0x7fd2480fd8d0 msgr2=0x7fd2480ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 -- 172.21.15.76:0/2941483095 shutdown_connections 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.172+0000 7fd24d890640 1 -- 172.21.15.76:0/2941483095 wait complete. 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 Processor -- start 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 -- start start 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd248101e10 0x7fd248198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2481027c0 0x7fd248198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 0x7fd24819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd248112100 con 0x7fd248106f40 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd248111f80 con 0x7fd2481027c0 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.173+0000 7fd24d890640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd248112280 con 0x7fd248101e10 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 0x7fd24819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 0x7fd24819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58936/0 (socket says 172.21.15.76:58936) 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 -- 172.21.15.76:0/3139411865 learned_addr learned my addr 172.21.15.76:0/3139411865 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd246ffd640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd248101e10 0x7fd248198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2467fc640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2481027c0 0x7fd248198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 -- 172.21.15.76:0/3139411865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd248101e10 msgr2=0x7fd248198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd248101e10 0x7fd248198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 -- 172.21.15.76:0/3139411865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2481027c0 msgr2=0x7fd248198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2481027c0 0x7fd248198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 -- 172.21.15.76:0/3139411865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24819d4b0 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2467fc640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2481027c0 0x7fd248198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd2477fe640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 0x7fd24819cdd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd240009fd0 tx=0x7fd24000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240011830 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd240016070 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24819d7a0 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24000f2e0 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.174+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2481a5080 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.175+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2481021f0 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.176+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd24001b460 con 0x7fd248106f40 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.177+0000 7fd24c88e640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd2300a32d0 0x7fd2300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.177+0000 7fd246ffd640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd2300a32d0 0x7fd2300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.178+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd2400ceef0 con 0x7fd248106f40 2024-09-19T07:50:23.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.178+0000 7fd246ffd640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd2300a32d0 0x7fd2300a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd238007350 tx=0x7fd2380072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:23.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.182+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd24009bd70 con 0x7fd248106f40 2024-09-19T07:50:23.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.356+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd248109b90 con 0x7fd248106f40 2024-09-19T07:50:23.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.357+0000 7fd24c88e640 1 -- 172.21.15.76:0/3139411865 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd24009b670 con 0x7fd248106f40 2024-09-19T07:50:23.357 INFO:teuthology.orchestra.run.smithi076.stdout:274877906979 2024-09-19T07:50:23.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd2300a32d0 msgr2=0x7fd2300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd2300a32d0 0x7fd2300a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd238007350 tx=0x7fd2380072e0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 msgr2=0x7fd24819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 0x7fd24819cdd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd240009fd0 tx=0x7fd24000b8e0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 shutdown_connections 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd248106f40 0x7fd24819cdd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fd2300a32d0 0x7fd2300a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2481027c0 0x7fd248198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 --2- 172.21.15.76:0/3139411865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd248101e10 0x7fd248198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 >> 172.21.15.76:0/3139411865 conn(0x7fd2480fd8d0 msgr2=0x7fd2480feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 shutdown_connections 2024-09-19T07:50:23.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.359+0000 7fd24d890640 1 -- 172.21.15.76:0/3139411865 wait complete. 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 -- 172.21.15.76:0/3893845890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24106b80 msgr2=0x7f8e24106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 --2- 172.21.15.76:0/3893845890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24106b80 0x7f8e24106f60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009900 tx=0x7f8e1402a410 comp rx=0 tx=0).stop 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 -- 172.21.15.76:0/3893845890 shutdown_connections 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 --2- 172.21.15.76:0/3893845890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24100aa0 0x7f8e2410ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 --2- 172.21.15.76:0/3893845890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e24100100 0x7f8e24100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 --2- 172.21.15.76:0/3893845890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24106b80 0x7f8e24106f60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 -- 172.21.15.76:0/3893845890 >> 172.21.15.76:0/3893845890 conn(0x7f8e24077230 msgr2=0x7f8e240fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 -- 172.21.15.76:0/3893845890 shutdown_connections 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 -- 172.21.15.76:0/3893845890 wait complete. 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.376+0000 7f8e289b8640 1 Processor -- start 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 -- start start 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e24100100 0x7f8e24198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 0x7f8e24198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24106b80 0x7f8e2419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8e241121c0 con 0x7f8e24100aa0 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24112040 con 0x7f8e24100100 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e289b8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24112340 con 0x7f8e24106b80 2024-09-19T07:50:23.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 0x7f8e24198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 0x7f8e24198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37182/0 (socket says 172.21.15.76:37182) 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 -- 172.21.15.76:0/2724801603 learned_addr learned my addr 172.21.15.76:0/2724801603 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e2259c640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e24100100 0x7f8e24198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e22d9d640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24106b80 0x7f8e2419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 -- 172.21.15.76:0/2724801603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24106b80 msgr2=0x7f8e2419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24106b80 0x7f8e2419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 -- 172.21.15.76:0/2724801603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e24100100 msgr2=0x7f8e24198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e24100100 0x7f8e24198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 -- 172.21.15.76:0/2724801603 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2419d5d0 con 0x7f8e24100aa0 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e22d9d640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24106b80 0x7f8e2419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:23.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.377+0000 7f8e21d9b640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 0x7f8e24198b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800d950 tx=0x7f8e1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.378+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18017070 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.378+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e18009c30 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.378+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2419d8c0 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.378+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e241a51a0 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.378+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800f740 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.379+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e24100560 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.380+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8e18010a80 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.381+0000 7f8e137fe640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e0c0a3350 0x7f8e0c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.381+0000 7f8e2259c640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e0c0a3350 0x7f8e0c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.381+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f8e180cf9c0 con 0x7f8e24100aa0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.382+0000 7f8e2259c640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e0c0a3350 0x7f8e0c0a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000c00 tx=0x7f8e14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:23.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.385+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e18009de0 con 0x7f8e24100aa0 2024-09-19T07:50:23.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.569+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8e241a5430 con 0x7f8e24100aa0 2024-09-19T07:50:23.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.569+0000 7f8e137fe640 1 -- 172.21.15.76:0/2724801603 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e1809c6b0 con 0x7f8e24100aa0 2024-09-19T07:50:23.570 INFO:teuthology.orchestra.run.smithi076.stdout:163208757302 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e0c0a3350 msgr2=0x7f8e0c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e0c0a3350 0x7f8e0c0a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000c00 tx=0x7f8e14005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 msgr2=0x7f8e24198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 0x7f8e24198b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800d950 tx=0x7f8e1800de10 comp rx=0 tx=0).stop 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 shutdown_connections 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e24106b80 0x7f8e2419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e24100aa0 0x7f8e24198b60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e0c0a3350 0x7f8e0c0a5810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 --2- 172.21.15.76:0/2724801603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e24100100 0x7f8e24198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:23.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 >> 172.21.15.76:0/2724801603 conn(0x7f8e24077230 msgr2=0x7f8e24104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:23.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 shutdown_connections 2024-09-19T07:50:23.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:23.573+0000 7f8e289b8640 1 -- 172.21.15.76:0/2724801603 wait complete. 2024-09-19T07:50:23.915 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:23 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3139411865' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:50:23.915 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:23 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:50:23.915 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:23 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2724801603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:50:24.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:23 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3139411865' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:50:24.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:23 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:50:24.028 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:23 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2724801603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:50:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:23 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3139411865' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:50:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:23 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:50:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:23 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2724801603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:50:24.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906976 got 274877906979 for osd.9 2024-09-19T07:50:24.472 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:24.663 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:24.664 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:25.059 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:24 smithi076 ceph-mon[30930]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:25.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:24 smithi152 ceph-mon[35117]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:25.085 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574924 for osd.1 2024-09-19T07:50:25.085 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:25.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:24 smithi137 ceph-mon[35309]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:25.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3323123679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 msgr2=0x7fc6dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:25.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3323123679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc101200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009900 tx=0x7fc6d802a480 comp rx=0 tx=0).stop 2024-09-19T07:50:25.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3323123679 shutdown_connections 2024-09-19T07:50:25.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3323123679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6dc102ef0 0x7fc6dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3323123679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102570 0x7fc6dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3323123679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc101200 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3323123679 >> 172.21.15.76:0/3323123679 conn(0x7fc6dc0fc7d0 msgr2=0x7fc6dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3323123679 shutdown_connections 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.389+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3323123679 wait complete. 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 Processor -- start 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 -- start start 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6dc102570 0x7fc6dc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102ef0 0x7fc6dc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc1121e0 con 0x7fc6dc100e20 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc112060 con 0x7fc6dc102ef0 2024-09-19T07:50:25.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e39a4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc112360 con 0x7fc6dc102570 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37194/0 (socket says 172.21.15.76:37194) 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 -- 172.21.15.76:0/3502776139 learned_addr learned my addr 172.21.15.76:0/3502776139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1f41640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102ef0 0x7fc6dc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 -- 172.21.15.76:0/3502776139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6dc102570 msgr2=0x7fc6dc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6dc102570 0x7fc6dc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 -- 172.21.15.76:0/3502776139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102ef0 msgr2=0x7fc6dc19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102ef0 0x7fc6dc19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1740640 1 -- 172.21.15.76:0/3502776139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc19d560 con 0x7fc6dc100e20 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.390+0000 7fc6e1f41640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102ef0 0x7fc6dc19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:25.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.391+0000 7fc6e1740640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc1985b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8006010 tx=0x7fc6d8004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.391+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d803f030 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.391+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc19d7f0 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.391+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc6d8005500 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.391+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8035070 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.391+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc1a5130 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.392+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc101200 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.393+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc6d8042030 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.393+0000 7fc6d27fc640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6c80a32d0 0x7fc6c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.394+0000 7fc6e0f3f640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6c80a32d0 0x7fc6c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.394+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc6d80eff30 con 0x7fc6dc100e20 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.394+0000 7fc6e0f3f640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6c80a32d0 0x7fc6c80a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005fd0 tx=0x7fc6cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:25.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.397+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc6d80bcc20 con 0x7fc6dc100e20 2024-09-19T07:50:25.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.574+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc6dc1a5300 con 0x7fc6dc100e20 2024-09-19T07:50:25.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.575+0000 7fc6d27fc640 1 -- 172.21.15.76:0/3502776139 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc6d80bc520 con 0x7fc6dc100e20 2024-09-19T07:50:25.575 INFO:teuthology.orchestra.run.smithi076.stdout:107374182465 2024-09-19T07:50:25.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6c80a32d0 msgr2=0x7fc6c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:25.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6c80a32d0 0x7fc6c80a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005fd0 tx=0x7fc6cc005850 comp rx=0 tx=0).stop 2024-09-19T07:50:25.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 msgr2=0x7fc6dc1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:25.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc1985b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8006010 tx=0x7fc6d8004c00 comp rx=0 tx=0).stop 2024-09-19T07:50:25.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 shutdown_connections 2024-09-19T07:50:25.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6c80a32d0 0x7fc6c80a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6dc102ef0 0x7fc6dc19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6dc102570 0x7fc6dc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 --2- 172.21.15.76:0/3502776139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc6dc100e20 0x7fc6dc1985b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:25.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 >> 172.21.15.76:0/3502776139 conn(0x7fc6dc0fc7d0 msgr2=0x7fc6dc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:25.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 shutdown_connections 2024-09-19T07:50:25.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:25.577+0000 7fc6e39a4640 1 -- 172.21.15.76:0/3502776139 wait complete. 2024-09-19T07:50:26.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:25 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:25 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3502776139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:50:26.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:25 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:25 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3502776139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:50:26.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 -- 172.21.15.76:0/2023390657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c101420 msgr2=0x7f8f8c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 --2- 172.21.15.76:0/2023390657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c101420 0x7f8f8c10d950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009cd0 tx=0x7f8f8402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 -- 172.21.15.76:0/2023390657 shutdown_connections 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 --2- 172.21.15.76:0/2023390657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c101420 0x7f8f8c10d950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 --2- 172.21.15.76:0/2023390657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c100a80 0x7f8f8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 --2- 172.21.15.76:0/2023390657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8c106a80 0x7f8f8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 -- 172.21.15.76:0/2023390657 >> 172.21.15.76:0/2023390657 conn(0x7f8f8c0fc7a0 msgr2=0x7f8f8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 -- 172.21.15.76:0/2023390657 shutdown_connections 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.323+0000 7f8f93c29640 1 -- 172.21.15.76:0/2023390657 wait complete. 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 Processor -- start 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 -- start start 2024-09-19T07:50:26.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8c100a80 0x7f8f8c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c101420 0x7f8f8c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 0x7f8f8c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c111060 con 0x7f8f8c106a80 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c110ee0 con 0x7f8f8c101420 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f93c29640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c1111e0 con 0x7f8f8c100a80 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 0x7f8f8c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 0x7f8f8c19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37216/0 (socket says 172.21.15.76:37216) 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 -- 172.21.15.76:0/4289054037 learned_addr learned my addr 172.21.15.76:0/4289054037 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f911c4640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c101420 0x7f8f8c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f919c5640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8c100a80 0x7f8f8c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 -- 172.21.15.76:0/4289054037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8c100a80 msgr2=0x7f8f8c197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8c100a80 0x7f8f8c197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 -- 172.21.15.76:0/4289054037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c101420 msgr2=0x7f8f8c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c101420 0x7f8f8c197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 -- 172.21.15.76:0/4289054037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c19c4f0 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f911c4640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c101420 0x7f8f8c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.324+0000 7f8f921c6640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 0x7f8f8c19be10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009df0 tx=0x7f8f84032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.325+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84004240 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.325+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f840305a0 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.325+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f840466c0 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.325+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c19c780 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.325+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c06a790 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.326+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c100f60 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.327+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8f84030750 con 0x7f8f8c106a80 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.327+0000 7f8f82ffd640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8f780a3350 0x7f8f780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.328+0000 7f8f919c5640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8f780a3350 0x7f8f780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.328+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f8f8402e030 con 0x7f8f8c106a80 2024-09-19T07:50:26.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.328+0000 7f8f919c5640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8f780a3350 0x7f8f780a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800a810 tx=0x7f8f88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:26.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.331+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f8404b060 con 0x7f8f8c106a80 2024-09-19T07:50:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:25 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:25 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3502776139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:50:26.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.503+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8f8c1988a0 con 0x7f8f8c106a80 2024-09-19T07:50:26.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.503+0000 7f8f82ffd640 1 -- 172.21.15.76:0/4289054037 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f8c1988a0 con 0x7f8f8c106a80 2024-09-19T07:50:26.504 INFO:teuthology.orchestra.run.smithi076.stdout:193273528371 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.505+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8f780a3350 msgr2=0x7f8f780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.505+0000 7f8f93c29640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8f780a3350 0x7f8f780a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800a810 tx=0x7f8f88008040 comp rx=0 tx=0).stop 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.505+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 msgr2=0x7f8f8c19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.505+0000 7f8f93c29640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 0x7f8f8c19be10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009df0 tx=0x7f8f84032c00 comp rx=0 tx=0).stop 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 shutdown_connections 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f8c106a80 0x7f8f8c19be10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8f780a3350 0x7f8f780a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f8c101420 0x7f8f8c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 --2- 172.21.15.76:0/4289054037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8c100a80 0x7f8f8c197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 >> 172.21.15.76:0/4289054037 conn(0x7f8f8c0fc7a0 msgr2=0x7f8f8c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:26.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 shutdown_connections 2024-09-19T07:50:26.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.506+0000 7f8f93c29640 1 -- 172.21.15.76:0/4289054037 wait complete. 2024-09-19T07:50:26.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 -- 172.21.15.76:0/696868880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa81009b0 msgr2=0x7f3aa8100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/696868880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa81009b0 0x7f3aa8100d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009ca0 tx=0x7f3a9802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 -- 172.21.15.76:0/696868880 shutdown_connections 2024-09-19T07:50:26.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/696868880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3aa810e4d0 0x7f3aa81108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/696868880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa8101360 0x7f3aa810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/696868880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa81009b0 0x7f3aa8100d90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 -- 172.21.15.76:0/696868880 >> 172.21.15.76:0/696868880 conn(0x7f3aa80fc7d0 msgr2=0x7f3aa80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 -- 172.21.15.76:0/696868880 shutdown_connections 2024-09-19T07:50:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.552+0000 7f3ab05ae640 1 -- 172.21.15.76:0/696868880 wait complete. 2024-09-19T07:50:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.553+0000 7f3ab05ae640 1 Processor -- start 2024-09-19T07:50:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.553+0000 7f3ab05ae640 1 -- start start 2024-09-19T07:50:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.553+0000 7f3ab05ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3aa81009b0 0x7f3aa81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.553+0000 7f3ab05ae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 0x7f3aa81a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3ab05ae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa810e4d0 0x7f3aa819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3ab05ae640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa8114360 con 0x7f3aa8101360 2024-09-19T07:50:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3ab05ae640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa81141e0 con 0x7f3aa810e4d0 2024-09-19T07:50:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3ab05ae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa81144e0 con 0x7f3aa81009b0 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 0x7f3aa81a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 0x7f3aa81a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37226/0 (socket says 172.21.15.76:37226) 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 -- 172.21.15.76:0/2863188366 learned_addr learned my addr 172.21.15.76:0/2863188366 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aae34a640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3aa81009b0 0x7f3aa81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aaeb4b640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa810e4d0 0x7f3aa819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 -- 172.21.15.76:0/2863188366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3aa81009b0 msgr2=0x7f3aa81a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3aa81009b0 0x7f3aa81a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 -- 172.21.15.76:0/2863188366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa810e4d0 msgr2=0x7f3aa819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa810e4d0 0x7f3aa819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 -- 172.21.15.76:0/2863188366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa819ace0 con 0x7f3aa8101360 2024-09-19T07:50:26.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aaeb4b640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa810e4d0 0x7f3aa819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aadb49640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 0x7f3aa81a0930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00d950 tx=0x7f3a9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c017030 con 0x7f3aa8101360 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa819afd0 con 0x7f3aa8101360 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a9c004020 con 0x7f3aa8101360 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.554+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c004a00 con 0x7f3aa8101360 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.555+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa81a72c0 con 0x7f3aa8101360 2024-09-19T07:50:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.555+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa806a7f0 con 0x7f3aa8101360 2024-09-19T07:50:26.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.557+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3a9c0041d0 con 0x7f3aa8101360 2024-09-19T07:50:26.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.557+0000 7f3aa77fe640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3a900a3350 0x7f3a900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:26.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.557+0000 7f3aae34a640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3a900a3350 0x7f3a900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:26.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.557+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f3a9c0cf300 con 0x7f3aa8101360 2024-09-19T07:50:26.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.558+0000 7f3aae34a640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3a900a3350 0x7f3a900a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a98000f80 tx=0x7f3a980093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:26.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.561+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a9c09c070 con 0x7f3aa8101360 2024-09-19T07:50:26.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.732+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3aa8100d90 con 0x7f3aa8101360 2024-09-19T07:50:26.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.732+0000 7f3aa77fe640 1 -- 172.21.15.76:0/2863188366 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3a9c09b970 con 0x7f3aa8101360 2024-09-19T07:50:26.733 INFO:teuthology.orchestra.run.smithi076.stdout:141733920829 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3a900a3350 msgr2=0x7f3a900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3a900a3350 0x7f3a900a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a98000f80 tx=0x7f3a980093f0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 msgr2=0x7f3aa81a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 0x7f3aa81a0930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00d950 tx=0x7f3a9c00de10 comp rx=0 tx=0).stop 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 shutdown_connections 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3a900a3350 0x7f3a900a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3aa810e4d0 0x7f3aa819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.734+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3aa8101360 0x7f3aa81a0930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.735+0000 7f3ab05ae640 1 --2- 172.21.15.76:0/2863188366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3aa81009b0 0x7f3aa81a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:26.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.735+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 >> 172.21.15.76:0/2863188366 conn(0x7f3aa80fc7d0 msgr2=0x7f3aa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:26.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.735+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 shutdown_connections 2024-09-19T07:50:26.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:26.735+0000 7f3ab05ae640 1 -- 172.21.15.76:0/2863188366 wait complete. 2024-09-19T07:50:27.083 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:26 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/4289054037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:50:27.083 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:26 smithi076 ceph-mon[30930]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:27.083 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:26 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2863188366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:50:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:26 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/4289054037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:50:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:26 smithi152 ceph-mon[35117]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:26 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2863188366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:50:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:26 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/4289054037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:50:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:26 smithi137 ceph-mon[35309]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:26 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2863188366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:50:27.422 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182461 got 107374182465 for osd.3 2024-09-19T07:50:27.422 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:27.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920827 got 141733920829 for osd.4 2024-09-19T07:50:27.819 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:28.273 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528368 got 193273528371 for osd.6 2024-09-19T07:50:28.273 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:28.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 -- 172.21.15.76:0/2915259202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14106a80 msgr2=0x7fba14106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2915259202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14106a80 0x7fba14106e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fba04009930 tx=0x7fba0402a420 comp rx=0 tx=0).stop 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 -- 172.21.15.76:0/2915259202 shutdown_connections 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2915259202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba14101420 0x7fba1410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2915259202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14100a80 0x7fba14100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2915259202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14106a80 0x7fba14106e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 -- 172.21.15.76:0/2915259202 >> 172.21.15.76:0/2915259202 conn(0x7fba140fc7a0 msgr2=0x7fba140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 -- 172.21.15.76:0/2915259202 shutdown_connections 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.681+0000 7fba18fe5640 1 -- 172.21.15.76:0/2915259202 wait complete. 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 Processor -- start 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 -- start start 2024-09-19T07:50:28.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 0x7fba14199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14101420 0x7fba14199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba14106a80 0x7fba141a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fba141110b0 con 0x7fba14100a80 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba14110f30 con 0x7fba14106a80 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba18fe5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fba14111230 con 0x7fba14101420 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba1259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 0x7fba14199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba1259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 0x7fba14199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37240/0 (socket says 172.21.15.76:37240) 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.682+0000 7fba1259c640 1 -- 172.21.15.76:0/2786546674 learned_addr learned my addr 172.21.15.76:0/2786546674 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba11d9b640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14101420 0x7fba14199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba1259c640 1 -- 172.21.15.76:0/2786546674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14101420 msgr2=0x7fba14199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba1259c640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14101420 0x7fba14199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba1259c640 1 -- 172.21.15.76:0/2786546674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba14106a80 msgr2=0x7fba141a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:28.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba1259c640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba14106a80 0x7fba141a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba1259c640 1 -- 172.21.15.76:0/2786546674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba141a4ac0 con 0x7fba14100a80 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba1259c640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 0x7fba14199500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba0402a940 tx=0x7fba04032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0403f030 con 0x7fba14100a80 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba04003d00 con 0x7fba14100a80 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba141a4c90 con 0x7fba14100a80 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04035070 con 0x7fba14100a80 2024-09-19T07:50:28.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.683+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a50e0 con 0x7fba14100a80 2024-09-19T07:50:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.684+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14100f60 con 0x7fba14100a80 2024-09-19T07:50:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.686+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba04042030 con 0x7fba14100a80 2024-09-19T07:50:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.686+0000 7fba037fe640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb9fc0a32d0 0x7fb9fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.686+0000 7fba11d9b640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb9fc0a32d0 0x7fb9fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.686+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fba040f0370 con 0x7fba14100a80 2024-09-19T07:50:28.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.687+0000 7fba11d9b640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb9fc0a32d0 0x7fb9fc0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba1406b2e0 tx=0x7fba08008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:28.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.690+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba040bd0e0 con 0x7fba14100a80 2024-09-19T07:50:28.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.866+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fba14108a60 con 0x7fba14100a80 2024-09-19T07:50:28.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.866+0000 7fba037fe640 1 -- 172.21.15.76:0/2786546674 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fba040bc9e0 con 0x7fba14100a80 2024-09-19T07:50:28.867 INFO:teuthology.orchestra.run.smithi076.stdout:296352743455 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb9fc0a32d0 msgr2=0x7fb9fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb9fc0a32d0 0x7fb9fc0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba1406b2e0 tx=0x7fba08008040 comp rx=0 tx=0).stop 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 msgr2=0x7fba14199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 0x7fba14199500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba0402a940 tx=0x7fba04032bf0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 shutdown_connections 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fb9fc0a32d0 0x7fb9fc0a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba14106a80 0x7fba141a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14101420 0x7fba14199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 --2- 172.21.15.76:0/2786546674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fba14100a80 0x7fba14199500 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 >> 172.21.15.76:0/2786546674 conn(0x7fba140fc7a0 msgr2=0x7fba140fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:28.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 shutdown_connections 2024-09-19T07:50:28.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:28.868+0000 7fba18fe5640 1 -- 172.21.15.76:0/2786546674 wait complete. 2024-09-19T07:50:29.101 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757300 got 163208757302 for osd.5 2024-09-19T07:50:29.101 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:29.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743452 got 296352743455 for osd.10 2024-09-19T07:50:29.723 DEBUG:teuthology.parallel:result is None 2024-09-19T07:50:29.723 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:50:29.724 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:50:29.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:29 smithi076 ceph-mon[30930]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:29.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:29 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2786546674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:50:30.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:29 smithi152 ceph-mon[35117]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:29 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2786546674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:50:30.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:29 smithi137 ceph-mon[35309]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:30.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:29 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2786546674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:50:30.483 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:30.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 -- 172.21.15.76:0/247896358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c103760 msgr2=0x7f4b3c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:30.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 --2- 172.21.15.76:0/247896358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c103760 0x7f4b3c107ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009930 tx=0x7f4b2c02a420 comp rx=0 tx=0).stop 2024-09-19T07:50:30.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 -- 172.21.15.76:0/247896358 shutdown_connections 2024-09-19T07:50:30.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 --2- 172.21.15.76:0/247896358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 --2- 172.21.15.76:0/247896358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c103760 0x7f4b3c107ba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 --2- 172.21.15.76:0/247896358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c102db0 0x7f4b3c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 -- 172.21.15.76:0/247896358 >> 172.21.15.76:0/247896358 conn(0x7f4b3c0fc7d0 msgr2=0x7f4b3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 -- 172.21.15.76:0/247896358 shutdown_connections 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.958+0000 7f4b4349d640 1 -- 172.21.15.76:0/247896358 wait complete. 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 Processor -- start 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 -- start start 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c102db0 0x7f4b3c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c103760 0x7f4b3c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c19c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c112210 con 0x7f4b3c1082e0 2024-09-19T07:50:30.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c112090 con 0x7f4b3c103760 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b4349d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c112390 con 0x7f4b3c102db0 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b41a3a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c19c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b41a3a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c19c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37262/0 (socket says 172.21.15.76:37262) 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.959+0000 7f4b41a3a640 1 -- 172.21.15.76:0/3558632532 learned_addr learned my addr 172.21.15.76:0/3558632532 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b40a38640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c103760 0x7f4b3c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41239640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c102db0 0x7f4b3c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41a3a640 1 -- 172.21.15.76:0/3558632532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c102db0 msgr2=0x7f4b3c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41a3a640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c102db0 0x7f4b3c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41a3a640 1 -- 172.21.15.76:0/3558632532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c103760 msgr2=0x7f4b3c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41a3a640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c103760 0x7f4b3c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41a3a640 1 -- 172.21.15.76:0/3558632532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c19c730 con 0x7f4b3c1082e0 2024-09-19T07:50:30.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41239640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c102db0 0x7f4b3c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b41a3a640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c19c000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b970 tx=0x7f4b3400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34019070 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4b3400cb40 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c19ca20 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34007700 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.960+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a5390 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.961+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c103190 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.962+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b3401c070 con 0x7f4b3c1082e0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.963+0000 7f4b327fc640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b280a32d0 0x7f4b280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.963+0000 7f4b41239640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b280a32d0 0x7f4b280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:30.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.963+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f4b340cee20 con 0x7f4b3c1082e0 2024-09-19T07:50:30.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.963+0000 7f4b41239640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b280a32d0 0x7f4b280a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009b40 tx=0x7f4b38005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:30.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:30.967+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b3409bca0 con 0x7f4b3c1082e0 2024-09-19T07:50:31.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.153+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b3c062630 con 0x7f4b280a32d0 2024-09-19T07:50:31.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.160+0000 7f4b327fc640 1 -- 172.21.15.76:0/3558632532 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258864 (secure 0 0 0) 0x7f4b3c062630 con 0x7f4b280a32d0 2024-09-19T07:50:31.163 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:31.164 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b280a32d0 msgr2=0x7f4b280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b280a32d0 0x7f4b280a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009b40 tx=0x7f4b38005e50 comp rx=0 tx=0).stop 2024-09-19T07:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 msgr2=0x7f4b3c19c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c19c000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b970 tx=0x7f4b3400be30 comp rx=0 tx=0).stop 2024-09-19T07:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 shutdown_connections 2024-09-19T07:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4b3c1082e0 0x7f4b3c19c000 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f4b280a32d0 0x7f4b280a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b3c103760 0x7f4b3c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 --2- 172.21.15.76:0/3558632532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b3c102db0 0x7f4b3c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 >> 172.21.15.76:0/3558632532 conn(0x7f4b3c0fc7d0 msgr2=0x7f4b3c106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 shutdown_connections 2024-09-19T07:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:31.163+0000 7f4b4349d640 1 -- 172.21.15.76:0/3558632532 wait complete. 2024-09-19T07:50:31.797 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:31 smithi076 ceph-mon[30930]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:31.825 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-19T07:50:30.620598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":460,"num_read_kb":348,"num_write":347,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376736,"kb_used_data":10848,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565088,"statfs":{"total":1151940427776,"available":1151554650112,"internally_reserved":0,"allocated":11108352,"data_stored":7051623,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002707"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576867+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:49:28.576867+0000","last_peered":"2024-09-19T07:49:28.576867+0000","last_clean":"2024-09-19T07:49:28.576867+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:49:28.576867+0000","last_undegraded":"2024-09-19T07:49:28.576867+0000","last_fullsized":"2024-09-19T07:49:28.576867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586278+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:49:28.586278+0000","last_peered":"2024-09-19T07:49:28.586278+0000","last_clean":"2024-09-19T07:49:28.586278+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:49:28.586278+0000","last_undegraded":"2024-09-19T07:49:28.586278+0000","last_fullsized":"2024-09-19T07:49:28.586278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586428+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:49:28.586428+0000","last_peered":"2024-09-19T07:49:28.586428+0000","last_clean":"2024-09-19T07:49:28.586428+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:49:28.586428+0000","last_undegraded":"2024-09-19T07:49:28.586428+0000","last_fullsized":"2024-09-19T07:49:28.586428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574665+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:49:28.574665+0000","last_peered":"2024-09-19T07:49:28.574665+0000","last_clean":"2024-09-19T07:49:28.574665+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:49:28.574665+0000","last_undegraded":"2024-09-19T07:49:28.574665+0000","last_fullsized":"2024-09-19T07:49:28.574665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587400+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:49:28.587400+0000","last_peered":"2024-09-19T07:49:28.587400+0000","last_clean":"2024-09-19T07:49:28.587400+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:49:28.587400+0000","last_undegraded":"2024-09-19T07:49:28.587400+0000","last_fullsized":"2024-09-19T07:49:28.587400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583883+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:49:28.583883+0000","last_peered":"2024-09-19T07:49:28.583883+0000","last_clean":"2024-09-19T07:49:28.583883+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:49:28.583883+0000","last_undegraded":"2024-09-19T07:49:28.583883+0000","last_fullsized":"2024-09-19T07:49:28.583883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588881+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:49:28.588881+0000","last_peered":"2024-09-19T07:49:28.588881+0000","last_clean":"2024-09-19T07:49:28.588881+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:49:28.588881+0000","last_undegraded":"2024-09-19T07:49:28.588881+0000","last_fullsized":"2024-09-19T07:49:28.588881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582672+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:49:28.582672+0000","last_peered":"2024-09-19T07:49:28.582672+0000","last_clean":"2024-09-19T07:49:28.582672+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:49:28.582672+0000","last_undegraded":"2024-09-19T07:49:28.582672+0000","last_fullsized":"2024-09-19T07:49:28.582672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587654+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:49:28.587654+0000","last_peered":"2024-09-19T07:49:28.587654+0000","last_clean":"2024-09-19T07:49:28.587654+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:49:28.587654+0000","last_undegraded":"2024-09-19T07:49:28.587654+0000","last_fullsized":"2024-09-19T07:49:28.587654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584443+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:49:28.584443+0000","last_peered":"2024-09-19T07:49:28.584443+0000","last_clean":"2024-09-19T07:49:28.584443+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:49:28.584443+0000","last_undegraded":"2024-09-19T07:49:28.584443+0000","last_fullsized":"2024-09-19T07:49:28.584443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588871+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:49:28.588871+0000","last_peered":"2024-09-19T07:49:28.588871+0000","last_clean":"2024-09-19T07:49:28.588871+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:49:28.588871+0000","last_undegraded":"2024-09-19T07:49:28.588871+0000","last_fullsized":"2024-09-19T07:49:28.588871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574716+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:49:28.574716+0000","last_peered":"2024-09-19T07:49:28.574716+0000","last_clean":"2024-09-19T07:49:28.574716+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:49:28.574716+0000","last_undegraded":"2024-09-19T07:49:28.574716+0000","last_fullsized":"2024-09-19T07:49:28.574716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574235+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:49:28.574235+0000","last_peered":"2024-09-19T07:49:28.574235+0000","last_clean":"2024-09-19T07:49:28.574235+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:49:28.574235+0000","last_undegraded":"2024-09-19T07:49:28.574235+0000","last_fullsized":"2024-09-19T07:49:28.574235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585963+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:49:28.585963+0000","last_peered":"2024-09-19T07:49:28.585963+0000","last_clean":"2024-09-19T07:49:28.585963+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:49:28.585963+0000","last_undegraded":"2024-09-19T07:49:28.585963+0000","last_fullsized":"2024-09-19T07:49:28.585963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585859+0000","last_change":"2024-09-19T07:49:27.593189+0000","last_active":"2024-09-19T07:49:28.585859+0000","last_peered":"2024-09-19T07:49:28.585859+0000","last_clean":"2024-09-19T07:49:28.585859+0000","last_became_active":"2024-09-19T07:49:27.592865+0000","last_became_peered":"2024-09-19T07:49:27.592865+0000","last_unstale":"2024-09-19T07:49:28.585859+0000","last_undegraded":"2024-09-19T07:49:28.585859+0000","last_fullsized":"2024-09-19T07:49:28.585859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:21.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586532+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:49:28.586532+0000","last_peered":"2024-09-19T07:49:28.586532+0000","last_clean":"2024-09-19T07:49:28.586532+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:49:28.586532+0000","last_undegraded":"2024-09-19T07:49:28.586532+0000","last_fullsized":"2024-09-19T07:49:28.586532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576910+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:49:28.576910+0000","last_peered":"2024-09-19T07:49:28.576910+0000","last_clean":"2024-09-19T07:49:28.576910+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:49:28.576910+0000","last_undegraded":"2024-09-19T07:49:28.576910+0000","last_fullsized":"2024-09-19T07:49:28.576910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585053+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:49:28.585053+0000","last_peered":"2024-09-19T07:49:28.585053+0000","last_clean":"2024-09-19T07:49:28.585053+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:49:28.585053+0000","last_undegraded":"2024-09-19T07:49:28.585053+0000","last_fullsized":"2024-09-19T07:49:28.585053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585034+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:49:28.585034+0000","last_peered":"2024-09-19T07:49:28.585034+0000","last_clean":"2024-09-19T07:49:28.585034+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:49:28.585034+0000","last_undegraded":"2024-09-19T07:49:28.585034+0000","last_fullsized":"2024-09-19T07:49:28.585034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576513+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:49:28.576513+0000","last_peered":"2024-09-19T07:49:28.576513+0000","last_clean":"2024-09-19T07:49:28.576513+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:49:28.576513+0000","last_undegraded":"2024-09-19T07:49:28.576513+0000","last_fullsized":"2024-09-19T07:49:28.576513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574252+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:49:28.574252+0000","last_peered":"2024-09-19T07:49:28.574252+0000","last_clean":"2024-09-19T07:49:28.574252+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:49:28.574252+0000","last_undegraded":"2024-09-19T07:49:28.574252+0000","last_fullsized":"2024-09-19T07:49:28.574252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586710+0000","last_change":"2024-09-19T07:49:27.592113+0000","last_active":"2024-09-19T07:49:28.586710+0000","last_peered":"2024-09-19T07:49:28.586710+0000","last_clean":"2024-09-19T07:49:28.586710+0000","last_became_active":"2024-09-19T07:49:27.591783+0000","last_became_peered":"2024-09-19T07:49:27.591783+0000","last_unstale":"2024-09-19T07:49:28.586710+0000","last_undegraded":"2024-09-19T07:49:28.586710+0000","last_fullsized":"2024-09-19T07:49:28.586710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:45.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582670+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:49:28.582670+0000","last_peered":"2024-09-19T07:49:28.582670+0000","last_clean":"2024-09-19T07:49:28.582670+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:49:28.582670+0000","last_undegraded":"2024-09-19T07:49:28.582670+0000","last_fullsized":"2024-09-19T07:49:28.582670+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589221+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:49:28.589221+0000","last_peered":"2024-09-19T07:49:28.589221+0000","last_clean":"2024-09-19T07:49:28.589221+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:49:28.589221+0000","last_undegraded":"2024-09-19T07:49:28.589221+0000","last_fullsized":"2024-09-19T07:49:28.589221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582878+0000","last_change":"2024-09-19T07:49:27.590378+0000","last_active":"2024-09-19T07:49:28.582878+0000","last_peered":"2024-09-19T07:49:28.582878+0000","last_clean":"2024-09-19T07:49:28.582878+0000","last_became_active":"2024-09-19T07:49:27.590081+0000","last_became_peered":"2024-09-19T07:49:27.590081+0000","last_unstale":"2024-09-19T07:49:28.582878+0000","last_undegraded":"2024-09-19T07:49:28.582878+0000","last_fullsized":"2024-09-19T07:49:28.582878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:09.817291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585293+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:49:28.585293+0000","last_peered":"2024-09-19T07:49:28.585293+0000","last_clean":"2024-09-19T07:49:28.585293+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:49:28.585293+0000","last_undegraded":"2024-09-19T07:49:28.585293+0000","last_fullsized":"2024-09-19T07:49:28.585293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576810+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:49:28.576810+0000","last_peered":"2024-09-19T07:49:28.576810+0000","last_clean":"2024-09-19T07:49:28.576810+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:49:28.576810+0000","last_undegraded":"2024-09-19T07:49:28.576810+0000","last_fullsized":"2024-09-19T07:49:28.576810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574340+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:49:28.574340+0000","last_peered":"2024-09-19T07:49:28.574340+0000","last_clean":"2024-09-19T07:49:28.574340+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:49:28.574340+0000","last_undegraded":"2024-09-19T07:49:28.574340+0000","last_fullsized":"2024-09-19T07:49:28.574340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586159+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:49:28.586159+0000","last_peered":"2024-09-19T07:49:28.586159+0000","last_clean":"2024-09-19T07:49:28.586159+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:49:28.586159+0000","last_undegraded":"2024-09-19T07:49:28.586159+0000","last_fullsized":"2024-09-19T07:49:28.586159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584703+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:49:28.584703+0000","last_peered":"2024-09-19T07:49:28.584703+0000","last_clean":"2024-09-19T07:49:28.584703+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:49:28.584703+0000","last_undegraded":"2024-09-19T07:49:28.584703+0000","last_fullsized":"2024-09-19T07:49:28.584703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585161+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:49:28.585161+0000","last_peered":"2024-09-19T07:49:28.585161+0000","last_clean":"2024-09-19T07:49:28.585161+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:49:28.585161+0000","last_undegraded":"2024-09-19T07:49:28.585161+0000","last_fullsized":"2024-09-19T07:49:28.585161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576716+0000","last_change":"2024-09-19T07:49:27.596400+0000","last_active":"2024-09-19T07:49:28.576716+0000","last_peered":"2024-09-19T07:49:28.576716+0000","last_clean":"2024-09-19T07:49:28.576716+0000","last_became_active":"2024-09-19T07:49:27.595951+0000","last_became_peered":"2024-09-19T07:49:27.595951+0000","last_unstale":"2024-09-19T07:49:28.576716+0000","last_undegraded":"2024-09-19T07:49:28.576716+0000","last_fullsized":"2024-09-19T07:49:28.576716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587551+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:49:28.587551+0000","last_peered":"2024-09-19T07:49:28.587551+0000","last_clean":"2024-09-19T07:49:28.587551+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:49:28.587551+0000","last_undegraded":"2024-09-19T07:49:28.587551+0000","last_fullsized":"2024-09-19T07:49:28.587551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:25.703569+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:50:25.703569+0000","last_peered":"2024-09-19T07:50:25.703569+0000","last_clean":"2024-09-19T07:50:25.703569+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:50:25.703569+0000","last_undegraded":"2024-09-19T07:50:25.703569+0000","last_fullsized":"2024-09-19T07:50:25.703569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588104+0000","last_change":"2024-09-19T07:49:27.595889+0000","last_active":"2024-09-19T07:49:28.588104+0000","last_peered":"2024-09-19T07:49:28.588104+0000","last_clean":"2024-09-19T07:49:28.588104+0000","last_became_active":"2024-09-19T07:49:27.595590+0000","last_became_peered":"2024-09-19T07:49:27.595590+0000","last_unstale":"2024-09-19T07:49:28.588104+0000","last_undegraded":"2024-09-19T07:49:28.588104+0000","last_fullsized":"2024-09-19T07:49:28.588104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:19.670997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624694+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:49:36.624694+0000","last_peered":"2024-09-19T07:49:36.624694+0000","last_clean":"2024-09-19T07:49:36.624694+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:49:36.624694+0000","last_undegraded":"2024-09-19T07:49:36.624694+0000","last_fullsized":"2024-09-19T07:49:36.624694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.623615+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:49:36.623615+0000","last_peered":"2024-09-19T07:49:36.623615+0000","last_clean":"2024-09-19T07:49:36.623615+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:49:36.623615+0000","last_undegraded":"2024-09-19T07:49:36.623615+0000","last_fullsized":"2024-09-19T07:49:36.623615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582684+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:49:28.582684+0000","last_peered":"2024-09-19T07:49:28.582684+0000","last_clean":"2024-09-19T07:49:28.582684+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:49:28.582684+0000","last_undegraded":"2024-09-19T07:49:28.582684+0000","last_fullsized":"2024-09-19T07:49:28.582684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589700+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:49:28.589700+0000","last_peered":"2024-09-19T07:49:28.589700+0000","last_clean":"2024-09-19T07:49:28.589700+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:49:28.589700+0000","last_undegraded":"2024-09-19T07:49:28.589700+0000","last_fullsized":"2024-09-19T07:49:28.589700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584791+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:49:28.584791+0000","last_peered":"2024-09-19T07:49:28.584791+0000","last_clean":"2024-09-19T07:49:28.584791+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:49:28.584791+0000","last_undegraded":"2024-09-19T07:49:28.584791+0000","last_fullsized":"2024-09-19T07:49:28.584791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:23.700457+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:50:23.700457+0000","last_peered":"2024-09-19T07:50:23.700457+0000","last_clean":"2024-09-19T07:50:23.700457+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:50:23.700457+0000","last_undegraded":"2024-09-19T07:50:23.700457+0000","last_fullsized":"2024-09-19T07:50:23.700457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587177+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:49:28.587177+0000","last_peered":"2024-09-19T07:49:28.587177+0000","last_clean":"2024-09-19T07:49:28.587177+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:49:28.587177+0000","last_undegraded":"2024-09-19T07:49:28.587177+0000","last_fullsized":"2024-09-19T07:49:28.587177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.618941+0000","last_change":"2024-09-19T07:49:25.573557+0000","last_active":"2024-09-19T07:49:35.618941+0000","last_peered":"2024-09-19T07:49:35.618941+0000","last_clean":"2024-09-19T07:49:35.618941+0000","last_became_active":"2024-09-19T07:49:25.572813+0000","last_became_peered":"2024-09-19T07:49:25.572813+0000","last_unstale":"2024-09-19T07:49:35.618941+0000","last_undegraded":"2024-09-19T07:49:35.618941+0000","last_fullsized":"2024-09-19T07:49:35.618941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.030536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586536+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:49:28.586536+0000","last_peered":"2024-09-19T07:49:28.586536+0000","last_clean":"2024-09-19T07:49:28.586536+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:49:28.586536+0000","last_undegraded":"2024-09-19T07:49:28.586536+0000","last_fullsized":"2024-09-19T07:49:28.586536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616949+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:49:35.616949+0000","last_peered":"2024-09-19T07:49:35.616949+0000","last_clean":"2024-09-19T07:49:35.616949+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:49:35.616949+0000","last_undegraded":"2024-09-19T07:49:35.616949+0000","last_fullsized":"2024-09-19T07:49:35.616949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587741+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:49:28.587741+0000","last_peered":"2024-09-19T07:49:28.587741+0000","last_clean":"2024-09-19T07:49:28.587741+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:49:28.587741+0000","last_undegraded":"2024-09-19T07:49:28.587741+0000","last_fullsized":"2024-09-19T07:49:28.587741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":151,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:24.701601+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:50:24.701601+0000","last_peered":"2024-09-19T07:50:24.701601+0000","last_clean":"2024-09-19T07:50:24.701601+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:50:24.701601+0000","last_undegraded":"2024-09-19T07:50:24.701601+0000","last_fullsized":"2024-09-19T07:50:24.701601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":110,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588154+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:49:28.588154+0000","last_peered":"2024-09-19T07:49:28.588154+0000","last_clean":"2024-09-19T07:49:28.588154+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:49:28.588154+0000","last_undegraded":"2024-09-19T07:49:28.588154+0000","last_fullsized":"2024-09-19T07:49:28.588154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624761+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:49:36.624761+0000","last_peered":"2024-09-19T07:49:36.624761+0000","last_clean":"2024-09-19T07:49:36.624761+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:49:36.624761+0000","last_undegraded":"2024-09-19T07:49:36.624761+0000","last_fullsized":"2024-09-19T07:49:36.624761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573970+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:49:28.573970+0000","last_peered":"2024-09-19T07:49:28.573970+0000","last_clean":"2024-09-19T07:49:28.573970+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:49:28.573970+0000","last_undegraded":"2024-09-19T07:49:28.573970+0000","last_fullsized":"2024-09-19T07:49:28.573970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619079+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:49:35.619079+0000","last_peered":"2024-09-19T07:49:35.619079+0000","last_clean":"2024-09-19T07:49:35.619079+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:49:35.619079+0000","last_undegraded":"2024-09-19T07:49:35.619079+0000","last_fullsized":"2024-09-19T07:49:35.619079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588646+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:49:28.588646+0000","last_peered":"2024-09-19T07:49:28.588646+0000","last_clean":"2024-09-19T07:49:28.588646+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:49:28.588646+0000","last_undegraded":"2024-09-19T07:49:28.588646+0000","last_fullsized":"2024-09-19T07:49:28.588646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:25.707154+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:50:25.707154+0000","last_peered":"2024-09-19T07:50:25.707154+0000","last_clean":"2024-09-19T07:50:25.707154+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:50:25.707154+0000","last_undegraded":"2024-09-19T07:50:25.707154+0000","last_fullsized":"2024-09-19T07:50:25.707154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588304+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:49:28.588304+0000","last_peered":"2024-09-19T07:49:28.588304+0000","last_clean":"2024-09-19T07:49:28.588304+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:49:28.588304+0000","last_undegraded":"2024-09-19T07:49:28.588304+0000","last_fullsized":"2024-09-19T07:49:28.588304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.626521+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:49:36.626521+0000","last_peered":"2024-09-19T07:49:36.626521+0000","last_clean":"2024-09-19T07:49:36.626521+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:49:36.626521+0000","last_undegraded":"2024-09-19T07:49:36.626521+0000","last_fullsized":"2024-09-19T07:49:36.626521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587514+0000","last_change":"2024-09-19T07:49:27.598489+0000","last_active":"2024-09-19T07:49:28.587514+0000","last_peered":"2024-09-19T07:49:28.587514+0000","last_clean":"2024-09-19T07:49:28.587514+0000","last_became_active":"2024-09-19T07:49:27.598118+0000","last_became_peered":"2024-09-19T07:49:27.598118+0000","last_unstale":"2024-09-19T07:49:28.587514+0000","last_undegraded":"2024-09-19T07:49:28.587514+0000","last_fullsized":"2024-09-19T07:49:28.587514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:26.602600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.635893+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:49:37.635893+0000","last_peered":"2024-09-19T07:49:37.635893+0000","last_clean":"2024-09-19T07:49:37.635893+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:49:37.635893+0000","last_undegraded":"2024-09-19T07:49:37.635893+0000","last_fullsized":"2024-09-19T07:49:37.635893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576593+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:49:28.576593+0000","last_peered":"2024-09-19T07:49:28.576593+0000","last_clean":"2024-09-19T07:49:28.576593+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:49:28.576593+0000","last_undegraded":"2024-09-19T07:49:28.576593+0000","last_fullsized":"2024-09-19T07:49:28.576593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582573+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:49:28.582573+0000","last_peered":"2024-09-19T07:49:28.582573+0000","last_clean":"2024-09-19T07:49:28.582573+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:49:28.582573+0000","last_undegraded":"2024-09-19T07:49:28.582573+0000","last_fullsized":"2024-09-19T07:49:28.582573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588985+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:49:28.588985+0000","last_peered":"2024-09-19T07:49:28.588985+0000","last_clean":"2024-09-19T07:49:28.588985+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:49:28.588985+0000","last_undegraded":"2024-09-19T07:49:28.588985+0000","last_fullsized":"2024-09-19T07:49:28.588985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.595098+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:49:28.595098+0000","last_peered":"2024-09-19T07:49:28.595098+0000","last_clean":"2024-09-19T07:49:28.595098+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:49:28.595098+0000","last_undegraded":"2024-09-19T07:49:28.595098+0000","last_fullsized":"2024-09-19T07:49:28.595098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589042+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:49:28.589042+0000","last_peered":"2024-09-19T07:49:28.589042+0000","last_clean":"2024-09-19T07:49:28.589042+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:49:28.589042+0000","last_undegraded":"2024-09-19T07:49:28.589042+0000","last_fullsized":"2024-09-19T07:49:28.589042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624093+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:49:36.624093+0000","last_peered":"2024-09-19T07:49:36.624093+0000","last_clean":"2024-09-19T07:49:36.624093+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:49:36.624093+0000","last_undegraded":"2024-09-19T07:49:36.624093+0000","last_fullsized":"2024-09-19T07:49:36.624093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589058+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:49:28.589058+0000","last_peered":"2024-09-19T07:49:28.589058+0000","last_clean":"2024-09-19T07:49:28.589058+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:49:28.589058+0000","last_undegraded":"2024-09-19T07:49:28.589058+0000","last_fullsized":"2024-09-19T07:49:28.589058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588467+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:49:28.588467+0000","last_peered":"2024-09-19T07:49:28.588467+0000","last_clean":"2024-09-19T07:49:28.588467+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:49:28.588467+0000","last_undegraded":"2024-09-19T07:49:28.588467+0000","last_fullsized":"2024-09-19T07:49:28.588467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.633473+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:49:37.633473+0000","last_peered":"2024-09-19T07:49:37.633473+0000","last_clean":"2024-09-19T07:49:37.633473+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:49:37.633473+0000","last_undegraded":"2024-09-19T07:49:37.633473+0000","last_fullsized":"2024-09-19T07:49:37.633473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583820+0000","last_change":"2024-09-19T07:49:27.590765+0000","last_active":"2024-09-19T07:49:28.583820+0000","last_peered":"2024-09-19T07:49:28.583820+0000","last_clean":"2024-09-19T07:49:28.583820+0000","last_became_active":"2024-09-19T07:49:27.590433+0000","last_became_peered":"2024-09-19T07:49:27.590433+0000","last_unstale":"2024-09-19T07:49:28.583820+0000","last_undegraded":"2024-09-19T07:49:28.583820+0000","last_fullsized":"2024-09-19T07:49:28.583820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:09.614365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.625036+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:49:36.625036+0000","last_peered":"2024-09-19T07:49:36.625036+0000","last_clean":"2024-09-19T07:49:36.625036+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:49:36.625036+0000","last_undegraded":"2024-09-19T07:49:36.625036+0000","last_fullsized":"2024-09-19T07:49:36.625036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573881+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:49:28.573881+0000","last_peered":"2024-09-19T07:49:28.573881+0000","last_clean":"2024-09-19T07:49:28.573881+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:49:28.573881+0000","last_undegraded":"2024-09-19T07:49:28.573881+0000","last_fullsized":"2024-09-19T07:49:28.573881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:27.709415+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:50:27.709415+0000","last_peered":"2024-09-19T07:50:27.709415+0000","last_clean":"2024-09-19T07:50:27.709415+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:50:27.709415+0000","last_undegraded":"2024-09-19T07:50:27.709415+0000","last_fullsized":"2024-09-19T07:50:27.709415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589391+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:49:28.589391+0000","last_peered":"2024-09-19T07:49:28.589391+0000","last_clean":"2024-09-19T07:49:28.589391+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:49:28.589391+0000","last_undegraded":"2024-09-19T07:49:28.589391+0000","last_fullsized":"2024-09-19T07:49:28.589391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589007+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:49:28.589007+0000","last_peered":"2024-09-19T07:49:28.589007+0000","last_clean":"2024-09-19T07:49:28.589007+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:49:28.589007+0000","last_undegraded":"2024-09-19T07:49:28.589007+0000","last_fullsized":"2024-09-19T07:49:28.589007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584283+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:49:28.584283+0000","last_peered":"2024-09-19T07:49:28.584283+0000","last_clean":"2024-09-19T07:49:28.584283+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:49:28.584283+0000","last_undegraded":"2024-09-19T07:49:28.584283+0000","last_fullsized":"2024-09-19T07:49:28.584283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585005+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:49:28.585005+0000","last_peered":"2024-09-19T07:49:28.585005+0000","last_clean":"2024-09-19T07:49:28.585005+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:49:28.585005+0000","last_undegraded":"2024-09-19T07:49:28.585005+0000","last_fullsized":"2024-09-19T07:49:28.585005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:30.667533+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:49:30.667533+0000","last_peered":"2024-09-19T07:49:30.667533+0000","last_clean":"2024-09-19T07:49:30.667533+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:49:30.667533+0000","last_undegraded":"2024-09-19T07:49:30.667533+0000","last_fullsized":"2024-09-19T07:49:30.667533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617930+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:49:35.617930+0000","last_peered":"2024-09-19T07:49:35.617930+0000","last_clean":"2024-09-19T07:49:35.617930+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:49:35.617930+0000","last_undegraded":"2024-09-19T07:49:35.617930+0000","last_fullsized":"2024-09-19T07:49:35.617930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574273+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:49:28.574273+0000","last_peered":"2024-09-19T07:49:28.574273+0000","last_clean":"2024-09-19T07:49:28.574273+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:49:28.574273+0000","last_undegraded":"2024-09-19T07:49:28.574273+0000","last_fullsized":"2024-09-19T07:49:28.574273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:51.582393+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:49:51.582393+0000","last_peered":"2024-09-19T07:49:51.582393+0000","last_clean":"2024-09-19T07:49:51.582393+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:49:51.582393+0000","last_undegraded":"2024-09-19T07:49:51.582393+0000","last_fullsized":"2024-09-19T07:49:51.582393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583086+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:49:28.583086+0000","last_peered":"2024-09-19T07:49:28.583086+0000","last_clean":"2024-09-19T07:49:28.583086+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:49:28.583086+0000","last_undegraded":"2024-09-19T07:49:28.583086+0000","last_fullsized":"2024-09-19T07:49:28.583086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.615957+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:49:35.615957+0000","last_peered":"2024-09-19T07:49:35.615957+0000","last_clean":"2024-09-19T07:49:35.615957+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:49:35.615957+0000","last_undegraded":"2024-09-19T07:49:35.615957+0000","last_fullsized":"2024-09-19T07:49:35.615957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586442+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:49:28.586442+0000","last_peered":"2024-09-19T07:49:28.586442+0000","last_clean":"2024-09-19T07:49:28.586442+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:49:28.586442+0000","last_undegraded":"2024-09-19T07:49:28.586442+0000","last_fullsized":"2024-09-19T07:49:28.586442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616873+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:49:35.616873+0000","last_peered":"2024-09-19T07:49:35.616873+0000","last_clean":"2024-09-19T07:49:35.616873+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:49:35.616873+0000","last_undegraded":"2024-09-19T07:49:35.616873+0000","last_fullsized":"2024-09-19T07:49:35.616873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588048+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:49:28.588048+0000","last_peered":"2024-09-19T07:49:28.588048+0000","last_clean":"2024-09-19T07:49:28.588048+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:49:28.588048+0000","last_undegraded":"2024-09-19T07:49:28.588048+0000","last_fullsized":"2024-09-19T07:49:28.588048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617633+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:49:35.617633+0000","last_peered":"2024-09-19T07:49:35.617633+0000","last_clean":"2024-09-19T07:49:35.617633+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:49:35.617633+0000","last_undegraded":"2024-09-19T07:49:35.617633+0000","last_fullsized":"2024-09-19T07:49:35.617633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576519+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:49:28.576519+0000","last_peered":"2024-09-19T07:49:28.576519+0000","last_clean":"2024-09-19T07:49:28.576519+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:49:28.576519+0000","last_undegraded":"2024-09-19T07:49:28.576519+0000","last_fullsized":"2024-09-19T07:49:28.576519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584849+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:49:28.584849+0000","last_peered":"2024-09-19T07:49:28.584849+0000","last_clean":"2024-09-19T07:49:28.584849+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:49:28.584849+0000","last_undegraded":"2024-09-19T07:49:28.584849+0000","last_fullsized":"2024-09-19T07:49:28.584849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582861+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:49:28.582861+0000","last_peered":"2024-09-19T07:49:28.582861+0000","last_clean":"2024-09-19T07:49:28.582861+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:49:28.582861+0000","last_undegraded":"2024-09-19T07:49:28.582861+0000","last_fullsized":"2024-09-19T07:49:28.582861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619153+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:49:35.619153+0000","last_peered":"2024-09-19T07:49:35.619153+0000","last_clean":"2024-09-19T07:49:35.619153+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:49:35.619153+0000","last_undegraded":"2024-09-19T07:49:35.619153+0000","last_fullsized":"2024-09-19T07:49:35.619153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588576+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:49:28.588576+0000","last_peered":"2024-09-19T07:49:28.588576+0000","last_clean":"2024-09-19T07:49:28.588576+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:49:28.588576+0000","last_undegraded":"2024-09-19T07:49:28.588576+0000","last_fullsized":"2024-09-19T07:49:28.588576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587226+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:49:28.587226+0000","last_peered":"2024-09-19T07:49:28.587226+0000","last_clean":"2024-09-19T07:49:28.587226+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:49:28.587226+0000","last_undegraded":"2024-09-19T07:49:28.587226+0000","last_fullsized":"2024-09-19T07:49:28.587226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.594832+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:49:28.594832+0000","last_peered":"2024-09-19T07:49:28.594832+0000","last_clean":"2024-09-19T07:49:28.594832+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:49:28.594832+0000","last_undegraded":"2024-09-19T07:49:28.594832+0000","last_fullsized":"2024-09-19T07:49:28.594832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587575+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:49:28.587575+0000","last_peered":"2024-09-19T07:49:28.587575+0000","last_clean":"2024-09-19T07:49:28.587575+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:49:28.587575+0000","last_undegraded":"2024-09-19T07:49:28.587575+0000","last_fullsized":"2024-09-19T07:49:28.587575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624562+0000","last_change":"2024-09-19T07:49:25.574247+0000","last_active":"2024-09-19T07:49:36.624562+0000","last_peered":"2024-09-19T07:49:36.624562+0000","last_clean":"2024-09-19T07:49:36.624562+0000","last_became_active":"2024-09-19T07:49:25.573911+0000","last_became_peered":"2024-09-19T07:49:25.573911+0000","last_unstale":"2024-09-19T07:49:36.624562+0000","last_undegraded":"2024-09-19T07:49:36.624562+0000","last_fullsized":"2024-09-19T07:49:36.624562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:35.765779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586434+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:49:28.586434+0000","last_peered":"2024-09-19T07:49:28.586434+0000","last_clean":"2024-09-19T07:49:28.586434+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:49:28.586434+0000","last_undegraded":"2024-09-19T07:49:28.586434+0000","last_fullsized":"2024-09-19T07:49:28.586434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584596+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:49:28.584596+0000","last_peered":"2024-09-19T07:49:28.584596+0000","last_clean":"2024-09-19T07:49:28.584596+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:49:28.584596+0000","last_undegraded":"2024-09-19T07:49:28.584596+0000","last_fullsized":"2024-09-19T07:49:28.584596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583193+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:49:28.583193+0000","last_peered":"2024-09-19T07:49:28.583193+0000","last_clean":"2024-09-19T07:49:28.583193+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:49:28.583193+0000","last_undegraded":"2024-09-19T07:49:28.583193+0000","last_fullsized":"2024-09-19T07:49:28.583193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624915+0000","last_change":"2024-09-19T07:49:25.571029+0000","last_active":"2024-09-19T07:49:36.624915+0000","last_peered":"2024-09-19T07:49:36.624915+0000","last_clean":"2024-09-19T07:49:36.624915+0000","last_became_active":"2024-09-19T07:49:25.570685+0000","last_became_peered":"2024-09-19T07:49:25.570685+0000","last_unstale":"2024-09-19T07:49:36.624915+0000","last_undegraded":"2024-09-19T07:49:36.624915+0000","last_fullsized":"2024-09-19T07:49:36.624915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:54.896230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281526,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":424625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1075870,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":424861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":424781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1016713,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":424250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1016397,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":424687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":424561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":485550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":483807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":425521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:50:31.829 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:50:32.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:31 smithi152 ceph-mon[35117]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:32.126 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:32.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:31 smithi137 ceph-mon[35309]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:32.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 -- 172.21.15.76:0/128155073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 msgr2=0x7f1d901067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/128155073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d901067e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009900 tx=0x7f1d8c02a410 comp rx=0 tx=0).stop 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 -- 172.21.15.76:0/128155073 shutdown_connections 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/128155073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d90106f10 0x7f1d9010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/128155073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d901067e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/128155073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d90101de0 0x7f1d901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 -- 172.21.15.76:0/128155073 >> 172.21.15.76:0/128155073 conn(0x7f1d900fd8c0 msgr2=0x7f1d900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 -- 172.21.15.76:0/128155073 shutdown_connections 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.701+0000 7f1d97bcf640 1 -- 172.21.15.76:0/128155073 wait complete. 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 Processor -- start 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 -- start start 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d90101de0 0x7f1d901985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d90198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:32.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d90106f10 0x7f1d9019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1d90112140 con 0x7f1d90102790 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d90111fc0 con 0x7f1d90101de0 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d97bcf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1d901122c0 con 0x7f1d90106f10 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d9516a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d90198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d9516a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d90198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37282/0 (socket says 172.21.15.76:37282) 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d9516a640 1 -- 172.21.15.76:0/3107551429 learned_addr learned my addr 172.21.15.76:0/3107551429 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d9616c640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d90106f10 0x7f1d9019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.702+0000 7f1d9596b640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d90101de0 0x7f1d901985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d9516a640 1 -- 172.21.15.76:0/3107551429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d90106f10 msgr2=0x7f1d9019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d9516a640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d90106f10 0x7f1d9019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d9516a640 1 -- 172.21.15.76:0/3107551429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d90101de0 msgr2=0x7f1d901985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d9516a640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d90101de0 0x7f1d901985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d9516a640 1 -- 172.21.15.76:0/3107551429 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9019d550 con 0x7f1d90102790 2024-09-19T07:50:32.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d9516a640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d90198ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c004770 tx=0x7f1d8c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:32.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c03f030 con 0x7f1d90102790 2024-09-19T07:50:32.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d8c003d00 con 0x7f1d90102790 2024-09-19T07:50:32.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9019d7e0 con 0x7f1d90102790 2024-09-19T07:50:32.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c035070 con 0x7f1d90102790 2024-09-19T07:50:32.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.703+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d901a5120 con 0x7f1d90102790 2024-09-19T07:50:32.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.704+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d901021c0 con 0x7f1d90102790 2024-09-19T07:50:32.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.705+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1d8c042030 con 0x7f1d90102790 2024-09-19T07:50:32.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.706+0000 7f1d86ffd640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1d7c0a3350 0x7f1d7c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:32.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.706+0000 7f1d9596b640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1d7c0a3350 0x7f1d7c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:32.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.706+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f1d8c0f0210 con 0x7f1d90102790 2024-09-19T07:50:32.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.707+0000 7f1d9596b640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1d7c0a3350 0x7f1d7c0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005fd0 tx=0x7f1d8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:32.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.709+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d8c0bc830 con 0x7f1d90102790 2024-09-19T07:50:32.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.875+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d9010a180 con 0x7f1d7c0a3350 2024-09-19T07:50:32.875 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:50:32.875 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-19T07:50:32.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:50:32.877 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:50:32.877 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:32 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:32.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.884+0000 7f1d86ffd640 1 -- 172.21.15.76:0/3107551429 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258864 (secure 0 0 0) 0x7f1d9010a180 con 0x7f1d7c0a3350 2024-09-19T07:50:32.886 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:32.887 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:50:32.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1d7c0a3350 msgr2=0x7f1d7c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:32.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1d7c0a3350 0x7f1d7c0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005fd0 tx=0x7f1d8000b390 comp rx=0 tx=0).stop 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 msgr2=0x7f1d90198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d90198ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c004770 tx=0x7f1d8c032c90 comp rx=0 tx=0).stop 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 shutdown_connections 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d90106f10 0x7f1d9019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1d90102790 0x7f1d90198ae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f1d7c0a3350 0x7f1d7c0a5810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 --2- 172.21.15.76:0/3107551429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d90101de0 0x7f1d901985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 >> 172.21.15.76:0/3107551429 conn(0x7f1d900fd8c0 msgr2=0x7f1d900fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 shutdown_connections 2024-09-19T07:50:32.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:32.887+0000 7f1d97bcf640 1 -- 172.21.15.76:0/3107551429 wait complete. 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-19T07:50:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:50:33.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:32 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-19T07:50:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:50:33.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:32 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' 2024-09-19T07:50:33.571 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-19T07:50:32.620942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":480,"num_read_kb":358,"num_write":347,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376736,"kb_used_data":10848,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565088,"statfs":{"total":1151940427776,"available":1151554650112,"internally_reserved":0,"allocated":11108352,"data_stored":7051623,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002550"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576867+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:49:28.576867+0000","last_peered":"2024-09-19T07:49:28.576867+0000","last_clean":"2024-09-19T07:49:28.576867+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:49:28.576867+0000","last_undegraded":"2024-09-19T07:49:28.576867+0000","last_fullsized":"2024-09-19T07:49:28.576867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586278+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:49:28.586278+0000","last_peered":"2024-09-19T07:49:28.586278+0000","last_clean":"2024-09-19T07:49:28.586278+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:49:28.586278+0000","last_undegraded":"2024-09-19T07:49:28.586278+0000","last_fullsized":"2024-09-19T07:49:28.586278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586428+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:49:28.586428+0000","last_peered":"2024-09-19T07:49:28.586428+0000","last_clean":"2024-09-19T07:49:28.586428+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:49:28.586428+0000","last_undegraded":"2024-09-19T07:49:28.586428+0000","last_fullsized":"2024-09-19T07:49:28.586428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574665+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:49:28.574665+0000","last_peered":"2024-09-19T07:49:28.574665+0000","last_clean":"2024-09-19T07:49:28.574665+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:49:28.574665+0000","last_undegraded":"2024-09-19T07:49:28.574665+0000","last_fullsized":"2024-09-19T07:49:28.574665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587400+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:49:28.587400+0000","last_peered":"2024-09-19T07:49:28.587400+0000","last_clean":"2024-09-19T07:49:28.587400+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:49:28.587400+0000","last_undegraded":"2024-09-19T07:49:28.587400+0000","last_fullsized":"2024-09-19T07:49:28.587400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583883+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:49:28.583883+0000","last_peered":"2024-09-19T07:49:28.583883+0000","last_clean":"2024-09-19T07:49:28.583883+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:49:28.583883+0000","last_undegraded":"2024-09-19T07:49:28.583883+0000","last_fullsized":"2024-09-19T07:49:28.583883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588881+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:49:28.588881+0000","last_peered":"2024-09-19T07:49:28.588881+0000","last_clean":"2024-09-19T07:49:28.588881+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:49:28.588881+0000","last_undegraded":"2024-09-19T07:49:28.588881+0000","last_fullsized":"2024-09-19T07:49:28.588881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582672+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:49:28.582672+0000","last_peered":"2024-09-19T07:49:28.582672+0000","last_clean":"2024-09-19T07:49:28.582672+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:49:28.582672+0000","last_undegraded":"2024-09-19T07:49:28.582672+0000","last_fullsized":"2024-09-19T07:49:28.582672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587654+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:49:28.587654+0000","last_peered":"2024-09-19T07:49:28.587654+0000","last_clean":"2024-09-19T07:49:28.587654+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:49:28.587654+0000","last_undegraded":"2024-09-19T07:49:28.587654+0000","last_fullsized":"2024-09-19T07:49:28.587654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584443+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:49:28.584443+0000","last_peered":"2024-09-19T07:49:28.584443+0000","last_clean":"2024-09-19T07:49:28.584443+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:49:28.584443+0000","last_undegraded":"2024-09-19T07:49:28.584443+0000","last_fullsized":"2024-09-19T07:49:28.584443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588871+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:49:28.588871+0000","last_peered":"2024-09-19T07:49:28.588871+0000","last_clean":"2024-09-19T07:49:28.588871+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:49:28.588871+0000","last_undegraded":"2024-09-19T07:49:28.588871+0000","last_fullsized":"2024-09-19T07:49:28.588871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574716+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:49:28.574716+0000","last_peered":"2024-09-19T07:49:28.574716+0000","last_clean":"2024-09-19T07:49:28.574716+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:49:28.574716+0000","last_undegraded":"2024-09-19T07:49:28.574716+0000","last_fullsized":"2024-09-19T07:49:28.574716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574235+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:49:28.574235+0000","last_peered":"2024-09-19T07:49:28.574235+0000","last_clean":"2024-09-19T07:49:28.574235+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:49:28.574235+0000","last_undegraded":"2024-09-19T07:49:28.574235+0000","last_fullsized":"2024-09-19T07:49:28.574235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585963+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:49:28.585963+0000","last_peered":"2024-09-19T07:49:28.585963+0000","last_clean":"2024-09-19T07:49:28.585963+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:49:28.585963+0000","last_undegraded":"2024-09-19T07:49:28.585963+0000","last_fullsized":"2024-09-19T07:49:28.585963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585859+0000","last_change":"2024-09-19T07:49:27.593189+0000","last_active":"2024-09-19T07:49:28.585859+0000","last_peered":"2024-09-19T07:49:28.585859+0000","last_clean":"2024-09-19T07:49:28.585859+0000","last_became_active":"2024-09-19T07:49:27.592865+0000","last_became_peered":"2024-09-19T07:49:27.592865+0000","last_unstale":"2024-09-19T07:49:28.585859+0000","last_undegraded":"2024-09-19T07:49:28.585859+0000","last_fullsized":"2024-09-19T07:49:28.585859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:21.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586532+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:49:28.586532+0000","last_peered":"2024-09-19T07:49:28.586532+0000","last_clean":"2024-09-19T07:49:28.586532+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:49:28.586532+0000","last_undegraded":"2024-09-19T07:49:28.586532+0000","last_fullsized":"2024-09-19T07:49:28.586532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576910+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:49:28.576910+0000","last_peered":"2024-09-19T07:49:28.576910+0000","last_clean":"2024-09-19T07:49:28.576910+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:49:28.576910+0000","last_undegraded":"2024-09-19T07:49:28.576910+0000","last_fullsized":"2024-09-19T07:49:28.576910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585053+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:49:28.585053+0000","last_peered":"2024-09-19T07:49:28.585053+0000","last_clean":"2024-09-19T07:49:28.585053+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:49:28.585053+0000","last_undegraded":"2024-09-19T07:49:28.585053+0000","last_fullsized":"2024-09-19T07:49:28.585053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585034+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:49:28.585034+0000","last_peered":"2024-09-19T07:49:28.585034+0000","last_clean":"2024-09-19T07:49:28.585034+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:49:28.585034+0000","last_undegraded":"2024-09-19T07:49:28.585034+0000","last_fullsized":"2024-09-19T07:49:28.585034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576513+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:49:28.576513+0000","last_peered":"2024-09-19T07:49:28.576513+0000","last_clean":"2024-09-19T07:49:28.576513+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:49:28.576513+0000","last_undegraded":"2024-09-19T07:49:28.576513+0000","last_fullsized":"2024-09-19T07:49:28.576513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574252+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:49:28.574252+0000","last_peered":"2024-09-19T07:49:28.574252+0000","last_clean":"2024-09-19T07:49:28.574252+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:49:28.574252+0000","last_undegraded":"2024-09-19T07:49:28.574252+0000","last_fullsized":"2024-09-19T07:49:28.574252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586710+0000","last_change":"2024-09-19T07:49:27.592113+0000","last_active":"2024-09-19T07:49:28.586710+0000","last_peered":"2024-09-19T07:49:28.586710+0000","last_clean":"2024-09-19T07:49:28.586710+0000","last_became_active":"2024-09-19T07:49:27.591783+0000","last_became_peered":"2024-09-19T07:49:27.591783+0000","last_unstale":"2024-09-19T07:49:28.586710+0000","last_undegraded":"2024-09-19T07:49:28.586710+0000","last_fullsized":"2024-09-19T07:49:28.586710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:45.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582670+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:49:28.582670+0000","last_peered":"2024-09-19T07:49:28.582670+0000","last_clean":"2024-09-19T07:49:28.582670+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:49:28.582670+0000","last_undegraded":"2024-09-19T07:49:28.582670+0000","last_fullsized":"2024-09-19T07:49:28.582670+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589221+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:49:28.589221+0000","last_peered":"2024-09-19T07:49:28.589221+0000","last_clean":"2024-09-19T07:49:28.589221+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:49:28.589221+0000","last_undegraded":"2024-09-19T07:49:28.589221+0000","last_fullsized":"2024-09-19T07:49:28.589221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582878+0000","last_change":"2024-09-19T07:49:27.590378+0000","last_active":"2024-09-19T07:49:28.582878+0000","last_peered":"2024-09-19T07:49:28.582878+0000","last_clean":"2024-09-19T07:49:28.582878+0000","last_became_active":"2024-09-19T07:49:27.590081+0000","last_became_peered":"2024-09-19T07:49:27.590081+0000","last_unstale":"2024-09-19T07:49:28.582878+0000","last_undegraded":"2024-09-19T07:49:28.582878+0000","last_fullsized":"2024-09-19T07:49:28.582878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:09.817291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585293+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:49:28.585293+0000","last_peered":"2024-09-19T07:49:28.585293+0000","last_clean":"2024-09-19T07:49:28.585293+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:49:28.585293+0000","last_undegraded":"2024-09-19T07:49:28.585293+0000","last_fullsized":"2024-09-19T07:49:28.585293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576810+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:49:28.576810+0000","last_peered":"2024-09-19T07:49:28.576810+0000","last_clean":"2024-09-19T07:49:28.576810+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:49:28.576810+0000","last_undegraded":"2024-09-19T07:49:28.576810+0000","last_fullsized":"2024-09-19T07:49:28.576810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574340+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:49:28.574340+0000","last_peered":"2024-09-19T07:49:28.574340+0000","last_clean":"2024-09-19T07:49:28.574340+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:49:28.574340+0000","last_undegraded":"2024-09-19T07:49:28.574340+0000","last_fullsized":"2024-09-19T07:49:28.574340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586159+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:49:28.586159+0000","last_peered":"2024-09-19T07:49:28.586159+0000","last_clean":"2024-09-19T07:49:28.586159+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:49:28.586159+0000","last_undegraded":"2024-09-19T07:49:28.586159+0000","last_fullsized":"2024-09-19T07:49:28.586159+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584703+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:49:28.584703+0000","last_peered":"2024-09-19T07:49:28.584703+0000","last_clean":"2024-09-19T07:49:28.584703+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:49:28.584703+0000","last_undegraded":"2024-09-19T07:49:28.584703+0000","last_fullsized":"2024-09-19T07:49:28.584703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585161+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:49:28.585161+0000","last_peered":"2024-09-19T07:49:28.585161+0000","last_clean":"2024-09-19T07:49:28.585161+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:49:28.585161+0000","last_undegraded":"2024-09-19T07:49:28.585161+0000","last_fullsized":"2024-09-19T07:49:28.585161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576716+0000","last_change":"2024-09-19T07:49:27.596400+0000","last_active":"2024-09-19T07:49:28.576716+0000","last_peered":"2024-09-19T07:49:28.576716+0000","last_clean":"2024-09-19T07:49:28.576716+0000","last_became_active":"2024-09-19T07:49:27.595951+0000","last_became_peered":"2024-09-19T07:49:27.595951+0000","last_unstale":"2024-09-19T07:49:28.576716+0000","last_undegraded":"2024-09-19T07:49:28.576716+0000","last_fullsized":"2024-09-19T07:49:28.576716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587551+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:49:28.587551+0000","last_peered":"2024-09-19T07:49:28.587551+0000","last_clean":"2024-09-19T07:49:28.587551+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:49:28.587551+0000","last_undegraded":"2024-09-19T07:49:28.587551+0000","last_fullsized":"2024-09-19T07:49:28.587551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:25.703569+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:50:25.703569+0000","last_peered":"2024-09-19T07:50:25.703569+0000","last_clean":"2024-09-19T07:50:25.703569+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:50:25.703569+0000","last_undegraded":"2024-09-19T07:50:25.703569+0000","last_fullsized":"2024-09-19T07:50:25.703569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588104+0000","last_change":"2024-09-19T07:49:27.595889+0000","last_active":"2024-09-19T07:49:28.588104+0000","last_peered":"2024-09-19T07:49:28.588104+0000","last_clean":"2024-09-19T07:49:28.588104+0000","last_became_active":"2024-09-19T07:49:27.595590+0000","last_became_peered":"2024-09-19T07:49:27.595590+0000","last_unstale":"2024-09-19T07:49:28.588104+0000","last_undegraded":"2024-09-19T07:49:28.588104+0000","last_fullsized":"2024-09-19T07:49:28.588104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:19.670997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624694+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:49:36.624694+0000","last_peered":"2024-09-19T07:49:36.624694+0000","last_clean":"2024-09-19T07:49:36.624694+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:49:36.624694+0000","last_undegraded":"2024-09-19T07:49:36.624694+0000","last_fullsized":"2024-09-19T07:49:36.624694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.623615+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:49:36.623615+0000","last_peered":"2024-09-19T07:49:36.623615+0000","last_clean":"2024-09-19T07:49:36.623615+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:49:36.623615+0000","last_undegraded":"2024-09-19T07:49:36.623615+0000","last_fullsized":"2024-09-19T07:49:36.623615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582684+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:49:28.582684+0000","last_peered":"2024-09-19T07:49:28.582684+0000","last_clean":"2024-09-19T07:49:28.582684+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:49:28.582684+0000","last_undegraded":"2024-09-19T07:49:28.582684+0000","last_fullsized":"2024-09-19T07:49:28.582684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589700+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:49:28.589700+0000","last_peered":"2024-09-19T07:49:28.589700+0000","last_clean":"2024-09-19T07:49:28.589700+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:49:28.589700+0000","last_undegraded":"2024-09-19T07:49:28.589700+0000","last_fullsized":"2024-09-19T07:49:28.589700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584791+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:49:28.584791+0000","last_peered":"2024-09-19T07:49:28.584791+0000","last_clean":"2024-09-19T07:49:28.584791+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:49:28.584791+0000","last_undegraded":"2024-09-19T07:49:28.584791+0000","last_fullsized":"2024-09-19T07:49:28.584791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:28.706701+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:50:28.706701+0000","last_peered":"2024-09-19T07:50:28.706701+0000","last_clean":"2024-09-19T07:50:28.706701+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:50:28.706701+0000","last_undegraded":"2024-09-19T07:50:28.706701+0000","last_fullsized":"2024-09-19T07:50:28.706701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587177+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:49:28.587177+0000","last_peered":"2024-09-19T07:49:28.587177+0000","last_clean":"2024-09-19T07:49:28.587177+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:49:28.587177+0000","last_undegraded":"2024-09-19T07:49:28.587177+0000","last_fullsized":"2024-09-19T07:49:28.587177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.618941+0000","last_change":"2024-09-19T07:49:25.573557+0000","last_active":"2024-09-19T07:49:35.618941+0000","last_peered":"2024-09-19T07:49:35.618941+0000","last_clean":"2024-09-19T07:49:35.618941+0000","last_became_active":"2024-09-19T07:49:25.572813+0000","last_became_peered":"2024-09-19T07:49:25.572813+0000","last_unstale":"2024-09-19T07:49:35.618941+0000","last_undegraded":"2024-09-19T07:49:35.618941+0000","last_fullsized":"2024-09-19T07:49:35.618941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:43.030536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586536+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:49:28.586536+0000","last_peered":"2024-09-19T07:49:28.586536+0000","last_clean":"2024-09-19T07:49:28.586536+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:49:28.586536+0000","last_undegraded":"2024-09-19T07:49:28.586536+0000","last_fullsized":"2024-09-19T07:49:28.586536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616949+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:49:35.616949+0000","last_peered":"2024-09-19T07:49:35.616949+0000","last_clean":"2024-09-19T07:49:35.616949+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:49:35.616949+0000","last_undegraded":"2024-09-19T07:49:35.616949+0000","last_fullsized":"2024-09-19T07:49:35.616949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587741+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:49:28.587741+0000","last_peered":"2024-09-19T07:49:28.587741+0000","last_clean":"2024-09-19T07:49:28.587741+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:49:28.587741+0000","last_undegraded":"2024-09-19T07:49:28.587741+0000","last_fullsized":"2024-09-19T07:49:28.587741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":161,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:29.708266+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:50:29.708266+0000","last_peered":"2024-09-19T07:50:29.708266+0000","last_clean":"2024-09-19T07:50:29.708266+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:50:29.708266+0000","last_undegraded":"2024-09-19T07:50:29.708266+0000","last_fullsized":"2024-09-19T07:50:29.708266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588154+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:49:28.588154+0000","last_peered":"2024-09-19T07:49:28.588154+0000","last_clean":"2024-09-19T07:49:28.588154+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:49:28.588154+0000","last_undegraded":"2024-09-19T07:49:28.588154+0000","last_fullsized":"2024-09-19T07:49:28.588154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624761+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:49:36.624761+0000","last_peered":"2024-09-19T07:49:36.624761+0000","last_clean":"2024-09-19T07:49:36.624761+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:49:36.624761+0000","last_undegraded":"2024-09-19T07:49:36.624761+0000","last_fullsized":"2024-09-19T07:49:36.624761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573970+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:49:28.573970+0000","last_peered":"2024-09-19T07:49:28.573970+0000","last_clean":"2024-09-19T07:49:28.573970+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:49:28.573970+0000","last_undegraded":"2024-09-19T07:49:28.573970+0000","last_fullsized":"2024-09-19T07:49:28.573970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619079+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:49:35.619079+0000","last_peered":"2024-09-19T07:49:35.619079+0000","last_clean":"2024-09-19T07:49:35.619079+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:49:35.619079+0000","last_undegraded":"2024-09-19T07:49:35.619079+0000","last_fullsized":"2024-09-19T07:49:35.619079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588646+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:49:28.588646+0000","last_peered":"2024-09-19T07:49:28.588646+0000","last_clean":"2024-09-19T07:49:28.588646+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:49:28.588646+0000","last_undegraded":"2024-09-19T07:49:28.588646+0000","last_fullsized":"2024-09-19T07:49:28.588646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:30.714765+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:50:30.714765+0000","last_peered":"2024-09-19T07:50:30.714765+0000","last_clean":"2024-09-19T07:50:30.714765+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:50:30.714765+0000","last_undegraded":"2024-09-19T07:50:30.714765+0000","last_fullsized":"2024-09-19T07:50:30.714765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588304+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:49:28.588304+0000","last_peered":"2024-09-19T07:49:28.588304+0000","last_clean":"2024-09-19T07:49:28.588304+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:49:28.588304+0000","last_undegraded":"2024-09-19T07:49:28.588304+0000","last_fullsized":"2024-09-19T07:49:28.588304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.626521+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:49:36.626521+0000","last_peered":"2024-09-19T07:49:36.626521+0000","last_clean":"2024-09-19T07:49:36.626521+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:49:36.626521+0000","last_undegraded":"2024-09-19T07:49:36.626521+0000","last_fullsized":"2024-09-19T07:49:36.626521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587514+0000","last_change":"2024-09-19T07:49:27.598489+0000","last_active":"2024-09-19T07:49:28.587514+0000","last_peered":"2024-09-19T07:49:28.587514+0000","last_clean":"2024-09-19T07:49:28.587514+0000","last_became_active":"2024-09-19T07:49:27.598118+0000","last_became_peered":"2024-09-19T07:49:27.598118+0000","last_unstale":"2024-09-19T07:49:28.587514+0000","last_undegraded":"2024-09-19T07:49:28.587514+0000","last_fullsized":"2024-09-19T07:49:28.587514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:26.602600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.635893+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:49:37.635893+0000","last_peered":"2024-09-19T07:49:37.635893+0000","last_clean":"2024-09-19T07:49:37.635893+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:49:37.635893+0000","last_undegraded":"2024-09-19T07:49:37.635893+0000","last_fullsized":"2024-09-19T07:49:37.635893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576593+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:49:28.576593+0000","last_peered":"2024-09-19T07:49:28.576593+0000","last_clean":"2024-09-19T07:49:28.576593+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:49:28.576593+0000","last_undegraded":"2024-09-19T07:49:28.576593+0000","last_fullsized":"2024-09-19T07:49:28.576593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582573+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:49:28.582573+0000","last_peered":"2024-09-19T07:49:28.582573+0000","last_clean":"2024-09-19T07:49:28.582573+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:49:28.582573+0000","last_undegraded":"2024-09-19T07:49:28.582573+0000","last_fullsized":"2024-09-19T07:49:28.582573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588985+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:49:28.588985+0000","last_peered":"2024-09-19T07:49:28.588985+0000","last_clean":"2024-09-19T07:49:28.588985+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:49:28.588985+0000","last_undegraded":"2024-09-19T07:49:28.588985+0000","last_fullsized":"2024-09-19T07:49:28.588985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.595098+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:49:28.595098+0000","last_peered":"2024-09-19T07:49:28.595098+0000","last_clean":"2024-09-19T07:49:28.595098+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:49:28.595098+0000","last_undegraded":"2024-09-19T07:49:28.595098+0000","last_fullsized":"2024-09-19T07:49:28.595098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589042+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:49:28.589042+0000","last_peered":"2024-09-19T07:49:28.589042+0000","last_clean":"2024-09-19T07:49:28.589042+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:49:28.589042+0000","last_undegraded":"2024-09-19T07:49:28.589042+0000","last_fullsized":"2024-09-19T07:49:28.589042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624093+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:49:36.624093+0000","last_peered":"2024-09-19T07:49:36.624093+0000","last_clean":"2024-09-19T07:49:36.624093+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:49:36.624093+0000","last_undegraded":"2024-09-19T07:49:36.624093+0000","last_fullsized":"2024-09-19T07:49:36.624093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589058+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:49:28.589058+0000","last_peered":"2024-09-19T07:49:28.589058+0000","last_clean":"2024-09-19T07:49:28.589058+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:49:28.589058+0000","last_undegraded":"2024-09-19T07:49:28.589058+0000","last_fullsized":"2024-09-19T07:49:28.589058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588467+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:49:28.588467+0000","last_peered":"2024-09-19T07:49:28.588467+0000","last_clean":"2024-09-19T07:49:28.588467+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:49:28.588467+0000","last_undegraded":"2024-09-19T07:49:28.588467+0000","last_fullsized":"2024-09-19T07:49:28.588467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:37.633473+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:49:37.633473+0000","last_peered":"2024-09-19T07:49:37.633473+0000","last_clean":"2024-09-19T07:49:37.633473+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:49:37.633473+0000","last_undegraded":"2024-09-19T07:49:37.633473+0000","last_fullsized":"2024-09-19T07:49:37.633473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583820+0000","last_change":"2024-09-19T07:49:27.590765+0000","last_active":"2024-09-19T07:49:28.583820+0000","last_peered":"2024-09-19T07:49:28.583820+0000","last_clean":"2024-09-19T07:49:28.583820+0000","last_became_active":"2024-09-19T07:49:27.590433+0000","last_became_peered":"2024-09-19T07:49:27.590433+0000","last_unstale":"2024-09-19T07:49:28.583820+0000","last_undegraded":"2024-09-19T07:49:28.583820+0000","last_fullsized":"2024-09-19T07:49:28.583820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:09.614365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.625036+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:49:36.625036+0000","last_peered":"2024-09-19T07:49:36.625036+0000","last_clean":"2024-09-19T07:49:36.625036+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:49:36.625036+0000","last_undegraded":"2024-09-19T07:49:36.625036+0000","last_fullsized":"2024-09-19T07:49:36.625036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.573881+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:49:28.573881+0000","last_peered":"2024-09-19T07:49:28.573881+0000","last_clean":"2024-09-19T07:49:28.573881+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:49:28.573881+0000","last_undegraded":"2024-09-19T07:49:28.573881+0000","last_fullsized":"2024-09-19T07:49:28.573881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:50:27.709415+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:50:27.709415+0000","last_peered":"2024-09-19T07:50:27.709415+0000","last_clean":"2024-09-19T07:50:27.709415+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:50:27.709415+0000","last_undegraded":"2024-09-19T07:50:27.709415+0000","last_fullsized":"2024-09-19T07:50:27.709415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589391+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:49:28.589391+0000","last_peered":"2024-09-19T07:49:28.589391+0000","last_clean":"2024-09-19T07:49:28.589391+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:49:28.589391+0000","last_undegraded":"2024-09-19T07:49:28.589391+0000","last_fullsized":"2024-09-19T07:49:28.589391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.589007+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:49:28.589007+0000","last_peered":"2024-09-19T07:49:28.589007+0000","last_clean":"2024-09-19T07:49:28.589007+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:49:28.589007+0000","last_undegraded":"2024-09-19T07:49:28.589007+0000","last_fullsized":"2024-09-19T07:49:28.589007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584283+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:49:28.584283+0000","last_peered":"2024-09-19T07:49:28.584283+0000","last_clean":"2024-09-19T07:49:28.584283+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:49:28.584283+0000","last_undegraded":"2024-09-19T07:49:28.584283+0000","last_fullsized":"2024-09-19T07:49:28.584283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.585005+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:49:28.585005+0000","last_peered":"2024-09-19T07:49:28.585005+0000","last_clean":"2024-09-19T07:49:28.585005+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:49:28.585005+0000","last_undegraded":"2024-09-19T07:49:28.585005+0000","last_fullsized":"2024-09-19T07:49:28.585005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:30.667533+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:49:30.667533+0000","last_peered":"2024-09-19T07:49:30.667533+0000","last_clean":"2024-09-19T07:49:30.667533+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:49:30.667533+0000","last_undegraded":"2024-09-19T07:49:30.667533+0000","last_fullsized":"2024-09-19T07:49:30.667533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617930+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:49:35.617930+0000","last_peered":"2024-09-19T07:49:35.617930+0000","last_clean":"2024-09-19T07:49:35.617930+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:49:35.617930+0000","last_undegraded":"2024-09-19T07:49:35.617930+0000","last_fullsized":"2024-09-19T07:49:35.617930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.574273+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:49:28.574273+0000","last_peered":"2024-09-19T07:49:28.574273+0000","last_clean":"2024-09-19T07:49:28.574273+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:49:28.574273+0000","last_undegraded":"2024-09-19T07:49:28.574273+0000","last_fullsized":"2024-09-19T07:49:28.574273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:51.582393+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:49:51.582393+0000","last_peered":"2024-09-19T07:49:51.582393+0000","last_clean":"2024-09-19T07:49:51.582393+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:49:51.582393+0000","last_undegraded":"2024-09-19T07:49:51.582393+0000","last_fullsized":"2024-09-19T07:49:51.582393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583086+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:49:28.583086+0000","last_peered":"2024-09-19T07:49:28.583086+0000","last_clean":"2024-09-19T07:49:28.583086+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:49:28.583086+0000","last_undegraded":"2024-09-19T07:49:28.583086+0000","last_fullsized":"2024-09-19T07:49:28.583086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.615957+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:49:35.615957+0000","last_peered":"2024-09-19T07:49:35.615957+0000","last_clean":"2024-09-19T07:49:35.615957+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:49:35.615957+0000","last_undegraded":"2024-09-19T07:49:35.615957+0000","last_fullsized":"2024-09-19T07:49:35.615957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586442+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:49:28.586442+0000","last_peered":"2024-09-19T07:49:28.586442+0000","last_clean":"2024-09-19T07:49:28.586442+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:49:28.586442+0000","last_undegraded":"2024-09-19T07:49:28.586442+0000","last_fullsized":"2024-09-19T07:49:28.586442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.616873+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:49:35.616873+0000","last_peered":"2024-09-19T07:49:35.616873+0000","last_clean":"2024-09-19T07:49:35.616873+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:49:35.616873+0000","last_undegraded":"2024-09-19T07:49:35.616873+0000","last_fullsized":"2024-09-19T07:49:35.616873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588048+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:49:28.588048+0000","last_peered":"2024-09-19T07:49:28.588048+0000","last_clean":"2024-09-19T07:49:28.588048+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:49:28.588048+0000","last_undegraded":"2024-09-19T07:49:28.588048+0000","last_fullsized":"2024-09-19T07:49:28.588048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.617633+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:49:35.617633+0000","last_peered":"2024-09-19T07:49:35.617633+0000","last_clean":"2024-09-19T07:49:35.617633+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:49:35.617633+0000","last_undegraded":"2024-09-19T07:49:35.617633+0000","last_fullsized":"2024-09-19T07:49:35.617633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.576519+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:49:28.576519+0000","last_peered":"2024-09-19T07:49:28.576519+0000","last_clean":"2024-09-19T07:49:28.576519+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:49:28.576519+0000","last_undegraded":"2024-09-19T07:49:28.576519+0000","last_fullsized":"2024-09-19T07:49:28.576519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584849+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:49:28.584849+0000","last_peered":"2024-09-19T07:49:28.584849+0000","last_clean":"2024-09-19T07:49:28.584849+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:49:28.584849+0000","last_undegraded":"2024-09-19T07:49:28.584849+0000","last_fullsized":"2024-09-19T07:49:28.584849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.582861+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:49:28.582861+0000","last_peered":"2024-09-19T07:49:28.582861+0000","last_clean":"2024-09-19T07:49:28.582861+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:49:28.582861+0000","last_undegraded":"2024-09-19T07:49:28.582861+0000","last_fullsized":"2024-09-19T07:49:28.582861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:35.619153+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:49:35.619153+0000","last_peered":"2024-09-19T07:49:35.619153+0000","last_clean":"2024-09-19T07:49:35.619153+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:49:35.619153+0000","last_undegraded":"2024-09-19T07:49:35.619153+0000","last_fullsized":"2024-09-19T07:49:35.619153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.588576+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:49:28.588576+0000","last_peered":"2024-09-19T07:49:28.588576+0000","last_clean":"2024-09-19T07:49:28.588576+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:49:28.588576+0000","last_undegraded":"2024-09-19T07:49:28.588576+0000","last_fullsized":"2024-09-19T07:49:28.588576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587226+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:49:28.587226+0000","last_peered":"2024-09-19T07:49:28.587226+0000","last_clean":"2024-09-19T07:49:28.587226+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:49:28.587226+0000","last_undegraded":"2024-09-19T07:49:28.587226+0000","last_fullsized":"2024-09-19T07:49:28.587226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.594832+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:49:28.594832+0000","last_peered":"2024-09-19T07:49:28.594832+0000","last_clean":"2024-09-19T07:49:28.594832+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:49:28.594832+0000","last_undegraded":"2024-09-19T07:49:28.594832+0000","last_fullsized":"2024-09-19T07:49:28.594832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.587575+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:49:28.587575+0000","last_peered":"2024-09-19T07:49:28.587575+0000","last_clean":"2024-09-19T07:49:28.587575+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:49:28.587575+0000","last_undegraded":"2024-09-19T07:49:28.587575+0000","last_fullsized":"2024-09-19T07:49:28.587575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624562+0000","last_change":"2024-09-19T07:49:25.574247+0000","last_active":"2024-09-19T07:49:36.624562+0000","last_peered":"2024-09-19T07:49:36.624562+0000","last_clean":"2024-09-19T07:49:36.624562+0000","last_became_active":"2024-09-19T07:49:25.573911+0000","last_became_peered":"2024-09-19T07:49:25.573911+0000","last_unstale":"2024-09-19T07:49:36.624562+0000","last_undegraded":"2024-09-19T07:49:36.624562+0000","last_fullsized":"2024-09-19T07:49:36.624562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:35.765779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.586434+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:49:28.586434+0000","last_peered":"2024-09-19T07:49:28.586434+0000","last_clean":"2024-09-19T07:49:28.586434+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:49:28.586434+0000","last_undegraded":"2024-09-19T07:49:28.586434+0000","last_fullsized":"2024-09-19T07:49:28.586434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.584596+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:49:28.584596+0000","last_peered":"2024-09-19T07:49:28.584596+0000","last_clean":"2024-09-19T07:49:28.584596+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:49:28.584596+0000","last_undegraded":"2024-09-19T07:49:28.584596+0000","last_fullsized":"2024-09-19T07:49:28.584596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:28.583193+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:49:28.583193+0000","last_peered":"2024-09-19T07:49:28.583193+0000","last_clean":"2024-09-19T07:49:28.583193+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:49:28.583193+0000","last_undegraded":"2024-09-19T07:49:28.583193+0000","last_fullsized":"2024-09-19T07:49:28.583193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T07:49:36.624915+0000","last_change":"2024-09-19T07:49:25.571029+0000","last_active":"2024-09-19T07:49:36.624915+0000","last_peered":"2024-09-19T07:49:36.624915+0000","last_clean":"2024-09-19T07:49:36.624915+0000","last_became_active":"2024-09-19T07:49:25.570685+0000","last_became_peered":"2024-09-19T07:49:25.570685+0000","last_unstale":"2024-09-19T07:49:36.624915+0000","last_undegraded":"2024-09-19T07:49:36.624915+0000","last_fullsized":"2024-09-19T07:49:36.624915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:54.896230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":344,"num_read_kb":239,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281526,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":424625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1075870,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":424861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":424781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1016713,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":424250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1016397,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":424687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":424561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":485550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":483807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":425521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:50:33.576 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:50:33.576 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T07:50:33.576 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T07:50:33.576 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T07:50:33.826 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:33.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:33.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-19T07:50:33.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:33 smithi076 ceph-mon[30930]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T07:50:34.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-19T07:50:34.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-09-19T07:50:34.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-19T07:50:34.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:33 smithi152 ceph-mon[35117]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-09-19T07:50:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: from='mgr.14150 172.21.15.76:0/3010647651' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-19T07:50:34.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:33 smithi137 ceph-mon[35309]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.316+0000 7fc1a77a7640 1 -- 172.21.15.76:0/2561018752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a010c190 msgr2=0x7fc1a010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.316+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/2561018752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a010c190 0x7fc1a010e620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc190009900 tx=0x7fc19002a480 comp rx=0 tx=0).stop 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.316+0000 7fc1a77a7640 1 -- 172.21.15.76:0/2561018752 shutdown_connections 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.316+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/2561018752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a010c190 0x7fc1a010e620 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.316+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/2561018752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1a0103710 0x7fc1a010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/2561018752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a0102df0 0x7fc1a01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- 172.21.15.76:0/2561018752 >> 172.21.15.76:0/2561018752 conn(0x7fc1a00fc7d0 msgr2=0x7fc1a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- 172.21.15.76:0/2561018752 shutdown_connections 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- 172.21.15.76:0/2561018752 wait complete. 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 Processor -- start 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- start start 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1a0102df0 0x7fc1a0100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 0x7fc1a0100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a010c190 0x7fc1a01014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0112150 con 0x7fc1a0103710 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a0111fd0 con 0x7fc1a010c190 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.317+0000 7fc1a77a7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a01122d0 con 0x7fc1a0102df0 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 0x7fc1a0100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 0x7fc1a0100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48690/0 (socket says 172.21.15.76:48690) 2024-09-19T07:50:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 -- 172.21.15.76:0/3161724644 learned_addr learned my addr 172.21.15.76:0/3161724644 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a5543640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1a0102df0 0x7fc1a0100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a5d44640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a010c190 0x7fc1a01014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 -- 172.21.15.76:0/3161724644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1a0102df0 msgr2=0x7fc1a0100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1a0102df0 0x7fc1a0100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 -- 172.21.15.76:0/3161724644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a010c190 msgr2=0x7fc1a01014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a010c190 0x7fc1a01014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 -- 172.21.15.76:0/3161724644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a01a69f0 con 0x7fc1a0103710 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a4d42640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 0x7fc1a0100f90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc19400ba50 tx=0x7fc19400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194019070 con 0x7fc1a0103710 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc19400cbe0 con 0x7fc1a0103710 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a01a6ce0 con 0x7fc1a0103710 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194007770 con 0x7fc1a0103710 2024-09-19T07:50:34.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.318+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a01a71c0 con 0x7fc1a0103710 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.319+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a01031d0 con 0x7fc1a0103710 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.321+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc19401c070 con 0x7fc1a0103710 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.321+0000 7fc19e7fc640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1880a3350 0x7fc1880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.321+0000 7fc1a5543640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1880a3350 0x7fc1880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.321+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fc1940cf490 con 0x7fc1a0103710 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.322+0000 7fc1a5543640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1880a3350 0x7fc1880a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc1980058c0 tx=0x7fc19800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:34.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.324+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc19409baf0 con 0x7fc1a0103710 2024-09-19T07:50:34.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.528+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc1a0101f80 con 0x7fc1a0103710 2024-09-19T07:50:34.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.528+0000 7fc19e7fc640 1 -- 172.21.15.76:0/3161724644 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc1a0101f80 con 0x7fc1a0103710 2024-09-19T07:50:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:34.529 INFO:teuthology.orchestra.run.smithi076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1880a3350 msgr2=0x7fc1880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1880a3350 0x7fc1880a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc1980058c0 tx=0x7fc19800a2d0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 msgr2=0x7fc1a0100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 0x7fc1a0100f90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc19400ba50 tx=0x7fc19400bf10 comp rx=0 tx=0).stop 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 shutdown_connections 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc1880a3350 0x7fc1880a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a010c190 0x7fc1a01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1a0103710 0x7fc1a0100f90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 --2- 172.21.15.76:0/3161724644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1a0102df0 0x7fc1a0100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:34.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.530+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 >> 172.21.15.76:0/3161724644 conn(0x7fc1a00fc7d0 msgr2=0x7fc1a00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:34.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.531+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 shutdown_connections 2024-09-19T07:50:34.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:34.531+0000 7fc1a77a7640 1 -- 172.21.15.76:0/3161724644 wait complete. 2024-09-19T07:50:34.839 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:34 smithi076 ceph-mon[30930]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:50:34.839 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:34 smithi076 ceph-mon[30930]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:50:34.839 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:34 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3161724644' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:50:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:34 smithi152 ceph-mon[35117]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:50:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:34 smithi152 ceph-mon[35117]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:50:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:34 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3161724644' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:50:35.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:34 smithi137 ceph-mon[35309]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:50:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:34 smithi137 ceph-mon[35309]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:50:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:34 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3161724644' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:50:35.176 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T07:50:35.177 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:50:35.424 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:35.812 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:35 smithi076 ceph-mon[30930]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 -- 172.21.15.76:0/1240890598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 msgr2=0x7ffae4100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 --2- 172.21.15.76:0/1240890598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4100530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009900 tx=0x7ffad402a410 comp rx=0 tx=0).stop 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 -- 172.21.15.76:0/1240890598 shutdown_connections 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 --2- 172.21.15.76:0/1240890598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae4100a70 0x7ffae410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 --2- 172.21.15.76:0/1240890598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4100530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 --2- 172.21.15.76:0/1240890598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffae4106ba0 0x7ffae4106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:35.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 -- 172.21.15.76:0/1240890598 >> 172.21.15.76:0/1240890598 conn(0x7ffae4077210 msgr2=0x7ffae40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 -- 172.21.15.76:0/1240890598 shutdown_connections 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.892+0000 7ffaebe17640 1 -- 172.21.15.76:0/1240890598 wait complete. 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 Processor -- start 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 -- start start 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae4100a70 0x7ffae4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffae4106ba0 0x7ffae419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4112270 con 0x7ffae41000d0 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41120f0 con 0x7ffae4106ba0 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaebe17640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41123f0 con 0x7ffae4100a70 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffae9bb3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffae9bb3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48704/0 (socket says 172.21.15.76:48704) 2024-09-19T07:50:35.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffae9bb3640 1 -- 172.21.15.76:0/4223574270 learned_addr learned my addr 172.21.15.76:0/4223574270 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.893+0000 7ffaea3b4640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffae4106ba0 0x7ffae419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae93b2640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae4100a70 0x7ffae4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae9bb3640 1 -- 172.21.15.76:0/4223574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae4100a70 msgr2=0x7ffae4198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae9bb3640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae4100a70 0x7ffae4198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae9bb3640 1 -- 172.21.15.76:0/4223574270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffae4106ba0 msgr2=0x7ffae419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae9bb3640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffae4106ba0 0x7ffae419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae9bb3640 1 -- 172.21.15.76:0/4223574270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae419d620 con 0x7ffae41000d0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffae9bb3640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4198670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffae000b4a0 tx=0x7ffae000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0014070 con 0x7ffae41000d0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae419d910 con 0x7ffae41000d0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffae0010b10 con 0x7ffae41000d0 2024-09-19T07:50:35.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0017d60 con 0x7ffae41000d0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.894+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae41a51f0 con 0x7ffae41000d0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.895+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae4100530 con 0x7ffae41000d0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.896+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffae0017070 con 0x7ffae41000d0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.897+0000 7ffadaffd640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ffad00a32d0 0x7ffad00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.897+0000 7ffae93b2640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ffad00a32d0 0x7ffad00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.897+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7ffae00cf0f0 con 0x7ffae41000d0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.897+0000 7ffae93b2640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ffad00a32d0 0x7ffad00a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffae40ff780 tx=0x7ffad4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:35.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:35.900+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffae009bda0 con 0x7ffae41000d0 2024-09-19T07:50:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:35 smithi152 ceph-mon[35117]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:36.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.099+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffae41999d0 con 0x7ffae41000d0 2024-09-19T07:50:36.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.099+0000 7ffadaffd640 1 -- 172.21.15.76:0/4223574270 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7ffae41999d0 con 0x7ffae41000d0 2024-09-19T07:50:36.099 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:36.100 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"btime":"2024-09-19T07:49:39:630718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:49:39.257174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:50:36.100 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ffad00a32d0 msgr2=0x7ffad00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ffad00a32d0 0x7ffad00a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffae40ff780 tx=0x7ffad4005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 msgr2=0x7ffae4198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4198670 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffae000b4a0 tx=0x7ffae000b960 comp rx=0 tx=0).stop 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 shutdown_connections 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ffad00a32d0 0x7ffad00a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffae4106ba0 0x7ffae419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae4100a70 0x7ffae4198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 --2- 172.21.15.76:0/4223574270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffae41000d0 0x7ffae4198670 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.101+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 >> 172.21.15.76:0/4223574270 conn(0x7ffae4077210 msgr2=0x7ffae4104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.102+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 shutdown_connections 2024-09-19T07:50:36.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:36.102+0000 7ffaebe17640 1 -- 172.21.15.76:0/4223574270 wait complete. 2024-09-19T07:50:36.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:35 smithi137 ceph-mon[35309]: pgmap v315: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:36.774 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:50:36.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:36 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/4223574270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:37.020 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:36 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/4223574270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:37.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:36 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/4223574270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 -- 172.21.15.76:0/2250709732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 msgr2=0x7f49401021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 --2- 172.21.15.76:0/2250709732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401021d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4930009900 tx=0x7f493002a410 comp rx=0 tx=0).stop 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 -- 172.21.15.76:0/2250709732 shutdown_connections 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 --2- 172.21.15.76:0/2250709732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4940106f20 0x7f494010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 --2- 172.21.15.76:0/2250709732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 0x7f49401067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 --2- 172.21.15.76:0/2250709732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401021d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 -- 172.21.15.76:0/2250709732 >> 172.21.15.76:0/2250709732 conn(0x7f49400fd8f0 msgr2=0x7f49400ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 -- 172.21.15.76:0/2250709732 shutdown_connections 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.512+0000 7f4945881640 1 -- 172.21.15.76:0/2250709732 wait complete. 2024-09-19T07:50:37.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.513+0000 7f4945881640 1 Processor -- start 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.513+0000 7f4945881640 1 -- start start 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 0x7f4940198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4940106f20 0x7f494019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4940112160 con 0x7f4940101df0 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4940111fe0 con 0x7f49401027a0 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49401122e0 con 0x7f4940106f20 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48718/0 (socket says 172.21.15.76:48718) 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 -- 172.21.15.76:0/3611476843 learned_addr learned my addr 172.21.15.76:0/3611476843 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493e7fc640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 0x7f4940198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:37.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 -- 172.21.15.76:0/3611476843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4940106f20 msgr2=0x7f494019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4940106f20 0x7f494019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 -- 172.21.15.76:0/3611476843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 msgr2=0x7f4940198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 0x7f4940198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 -- 172.21.15.76:0/3611476843 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494019d690 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493e7fc640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 0x7f4940198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f493effd640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401986e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4930006010 tx=0x7f49300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493003f030 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494019d920 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4930003d00 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4930035070 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.514+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49401a5260 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.515+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4940102250 con 0x7f4940101df0 2024-09-19T07:50:37.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.517+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4930042030 con 0x7f4940101df0 2024-09-19T07:50:37.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.518+0000 7f494487f640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f492c0a32d0 0x7f492c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:37.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.518+0000 7f493e7fc640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f492c0a32d0 0x7f492c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:37.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.518+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f49300f0780 con 0x7f4940101df0 2024-09-19T07:50:37.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.518+0000 7f493e7fc640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f492c0a32d0 0x7f492c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f49400ffe70 tx=0x7f4928008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:37.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.521+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49300bd2c0 con 0x7f4940101df0 2024-09-19T07:50:37.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.727+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f494010a100 con 0x7f4940101df0 2024-09-19T07:50:37.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.727+0000 7f494487f640 1 -- 172.21.15.76:0/3611476843 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f49300bcbc0 con 0x7f4940101df0 2024-09-19T07:50:37.728 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:37.728 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"btime":"2024-09-19T07:49:39:630718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:49:39.257174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:50:37.728 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.729+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f492c0a32d0 msgr2=0x7f492c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.729+0000 7f4945881640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f492c0a32d0 0x7f492c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f49400ffe70 tx=0x7f4928008040 comp rx=0 tx=0).stop 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 msgr2=0x7f49401986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401986e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4930006010 tx=0x7f49300042f0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 shutdown_connections 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4940106f20 0x7f494019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f492c0a32d0 0x7f492c0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49401027a0 0x7f4940198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 --2- 172.21.15.76:0/3611476843 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4940101df0 0x7f49401986e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 >> 172.21.15.76:0/3611476843 conn(0x7f49400fd8f0 msgr2=0x7f49400fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:37.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 shutdown_connections 2024-09-19T07:50:37.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:37.730+0000 7f4945881640 1 -- 172.21.15.76:0/3611476843 wait complete. 2024-09-19T07:50:37.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:37 smithi076 ceph-mon[30930]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:50:38.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:37 smithi152 ceph-mon[35117]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:50:38.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:37 smithi137 ceph-mon[35309]: pgmap v316: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:50:38.351 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:50:38.597 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:39.003 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:38 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3611476843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:39.004 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:38 smithi076 ceph-mon[30930]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:39.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:38 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3611476843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:38 smithi152 ceph-mon[35117]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:39.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 -- 172.21.15.76:0/1865480210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440106a80 msgr2=0x7fc440106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 --2- 172.21.15.76:0/1865480210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440106a80 0x7fc440106e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc430009930 tx=0x7fc43002a420 comp rx=0 tx=0).stop 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 -- 172.21.15.76:0/1865480210 shutdown_connections 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 --2- 172.21.15.76:0/1865480210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 0x7fc44010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 --2- 172.21.15.76:0/1865480210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc440100a80 0x7fc440100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 --2- 172.21.15.76:0/1865480210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440106a80 0x7fc440106e60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 -- 172.21.15.76:0/1865480210 >> 172.21.15.76:0/1865480210 conn(0x7fc4400fc7a0 msgr2=0x7fc4400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 -- 172.21.15.76:0/1865480210 shutdown_connections 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.082+0000 7fc44663d640 1 -- 172.21.15.76:0/1865480210 wait complete. 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 Processor -- start 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 -- start start 2024-09-19T07:50:39.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 0x7fc4400fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 0x7fc4400fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc440106a80 0x7fc4400fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc440110fe0 con 0x7fc440100a80 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc440110e60 con 0x7fc440101420 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc44663d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc440111160 con 0x7fc440106a80 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 0x7fc4400fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 0x7fc4400fcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48734/0 (socket says 172.21.15.76:48734) 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 -- 172.21.15.76:0/1174746011 learned_addr learned my addr 172.21.15.76:0/1174746011 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43f7fe640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 0x7fc4400fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc444bda640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc440106a80 0x7fc4400fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 -- 172.21.15.76:0/1174746011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc440106a80 msgr2=0x7fc4400fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:39.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc440106a80 0x7fc4400fd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 -- 172.21.15.76:0/1174746011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 msgr2=0x7fc4400fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 0x7fc4400fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43ffff640 1 -- 172.21.15.76:0/1174746011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4401a6ad0 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.083+0000 7fc43f7fe640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 0x7fc4400fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.084+0000 7fc43ffff640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 0x7fc4400fcd90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc430009230 tx=0x7fc430004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.084+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43003f030 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.084+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4401a6d60 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.084+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc430003af0 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.084+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430035070 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.084+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4401a71e0 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.085+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc440100ee0 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.086+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc430042030 con 0x7fc440100a80 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.086+0000 7fc43d7fa640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc42c0a32d0 0x7fc42c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:39.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.087+0000 7fc43f7fe640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc42c0a32d0 0x7fc42c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:39.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.087+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fc4300effd0 con 0x7fc440100a80 2024-09-19T07:50:39.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.087+0000 7fc43f7fe640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc42c0a32d0 0x7fc42c0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4400fe820 tx=0x7fc428008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:39.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.091+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4300bcb70 con 0x7fc440100a80 2024-09-19T07:50:39.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:38 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3611476843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:39.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:38 smithi137 ceph-mon[35309]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:39.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.258+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc440109a70 con 0x7fc440100a80 2024-09-19T07:50:39.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.260+0000 7fc43d7fa640 1 -- 172.21.15.76:0/1174746011 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22775 (secure 0 0 0) 0x7fc4300bc470 con 0x7fc440100a80 2024-09-19T07:50:39.260 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:39.260 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":84,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:50:34.014599+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:50:39.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc42c0a32d0 msgr2=0x7fc42c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc42c0a32d0 0x7fc42c0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4400fe820 tx=0x7fc428008040 comp rx=0 tx=0).stop 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 msgr2=0x7fc4400fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 0x7fc4400fcd90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc430009230 tx=0x7fc430004270 comp rx=0 tx=0).stop 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 shutdown_connections 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc440106a80 0x7fc4400fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc42c0a32d0 0x7fc42c0a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc440101420 0x7fc4400fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 --2- 172.21.15.76:0/1174746011 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc440100a80 0x7fc4400fcd90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 >> 172.21.15.76:0/1174746011 conn(0x7fc4400fc7a0 msgr2=0x7fc44006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.262+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 shutdown_connections 2024-09-19T07:50:39.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:39.263+0000 7fc44663d640 1 -- 172.21.15.76:0/1174746011 wait complete. 2024-09-19T07:50:39.871 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:50:40.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:39 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1174746011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:40.117 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:40.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:39 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1174746011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:40.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:39 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1174746011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.608+0000 7fabf20d9640 1 -- 172.21.15.76:0/1189808182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102ef0 msgr2=0x7fabec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.608+0000 7fabf20d9640 1 --2- 172.21.15.76:0/1189808182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102ef0 0x7fabec10da40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009ca0 tx=0x7fabe402a950 comp rx=0 tx=0).stop 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 -- 172.21.15.76:0/1189808182 shutdown_connections 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 --2- 172.21.15.76:0/1189808182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102ef0 0x7fabec10da40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 --2- 172.21.15.76:0/1189808182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec102570 0x7fabec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 --2- 172.21.15.76:0/1189808182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec100e20 0x7fabec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 -- 172.21.15.76:0/1189808182 >> 172.21.15.76:0/1189808182 conn(0x7fabec0fc7d0 msgr2=0x7fabec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 -- 172.21.15.76:0/1189808182 shutdown_connections 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 -- 172.21.15.76:0/1189808182 wait complete. 2024-09-19T07:50:40.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 Processor -- start 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 -- start start 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.609+0000 7fabf20d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec100e20 0x7fabec198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 0x7fabec198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec102ef0 0x7fabec19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fabec111160 con 0x7fabec102570 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabec110fe0 con 0x7fabec100e20 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fabec1112e0 con 0x7fabec102ef0 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 0x7fabec198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 0x7fabec198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48764/0 (socket says 172.21.15.76:48764) 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 -- 172.21.15.76:0/2050398945 learned_addr learned my addr 172.21.15.76:0/2050398945 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabebfff640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec102ef0 0x7fabec19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:40.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeb7fe640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec100e20 0x7fabec198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 -- 172.21.15.76:0/2050398945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec102ef0 msgr2=0x7fabec19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec102ef0 0x7fabec19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 -- 172.21.15.76:0/2050398945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec100e20 msgr2=0x7fabec198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec100e20 0x7fabec198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 -- 172.21.15.76:0/2050398945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec19d600 con 0x7fabec102570 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabebfff640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec102ef0 0x7fabec19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeb7fe640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec100e20 0x7fabec198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabeaffd640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 0x7fabec198b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fabe000b4a0 tx=0x7fabe000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0014070 con 0x7fabec102570 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec19d8f0 con 0x7fabec102570 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fabe0010b10 con 0x7fabec102570 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0017d60 con 0x7fabec102570 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.610+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec1a51d0 con 0x7fabec102570 2024-09-19T07:50:40.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.611+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec101200 con 0x7fabec102570 2024-09-19T07:50:40.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.612+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fabe0017070 con 0x7fabec102570 2024-09-19T07:50:40.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.613+0000 7fabe8ff9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fabd40a32d0 0x7fabd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:40.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.613+0000 7fabeb7fe640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fabd40a32d0 0x7fabd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:40.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.613+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fabe00cf1d0 con 0x7fabec102570 2024-09-19T07:50:40.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.613+0000 7fabeb7fe640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fabd40a32d0 0x7fabd40a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fabdc006fd0 tx=0x7fabdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:40.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.616+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabe009be80 con 0x7fabec102570 2024-09-19T07:50:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.823+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabec10a0a0 con 0x7fabec102570 2024-09-19T07:50:40.824 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:40 smithi076 ceph-mon[30930]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.824+0000 7fabe8ff9640 1 -- 172.21.15.76:0/2050398945 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7fabe009b780 con 0x7fabec102570 2024-09-19T07:50:40.825 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:40.825 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"btime":"2024-09-19T07:49:39:630718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:49:39.257174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:50:40.825 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:50:40.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fabd40a32d0 msgr2=0x7fabd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:40.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fabd40a32d0 0x7fabd40a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fabdc006fd0 tx=0x7fabdc008040 comp rx=0 tx=0).stop 2024-09-19T07:50:40.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 msgr2=0x7fabec198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:40.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 0x7fabec198b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fabe000b4a0 tx=0x7fabe000b960 comp rx=0 tx=0).stop 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 shutdown_connections 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec102ef0 0x7fabec19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fabec102570 0x7fabec198b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fabd40a32d0 0x7fabd40a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 --2- 172.21.15.76:0/2050398945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabec100e20 0x7fabec198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 >> 172.21.15.76:0/2050398945 conn(0x7fabec0fc7d0 msgr2=0x7fabec06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 shutdown_connections 2024-09-19T07:50:40.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:40.826+0000 7fabf20d9640 1 -- 172.21.15.76:0/2050398945 wait complete. 2024-09-19T07:50:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:40 smithi152 ceph-mon[35117]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:41.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:40 smithi137 ceph-mon[35309]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:41.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:49:28.218932+0000', 'modified': '2024-09-19T07:49:39.257174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24478, 'mds_1': 24458, 'mds_2': 24457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6833/4080590897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 4080590897}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 4080590897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/1714762912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1714762912}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1714762912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6835/266318645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 266318645}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 266318645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.152:6837/3136720511', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 3136720511}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3136720511}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.137:6839/1413757795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 1413757795}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 1413757795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6839/1843787894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 1843787894}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 1843787894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24478, 'qdb_cluster': [24457, 24458, 24478]} 2024-09-19T07:50:41.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:50:41.509 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T07:50:41.758 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:41.879 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:41 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2050398945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:42.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:41 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2050398945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:42.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:41 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2050398945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:42.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 -- 172.21.15.76:0/3214136995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8106a80 msgr2=0x7f80e8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/3214136995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8106a80 0x7f80e8106e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009930 tx=0x7f80d802a420 comp rx=0 tx=0).stop 2024-09-19T07:50:42.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 -- 172.21.15.76:0/3214136995 shutdown_connections 2024-09-19T07:50:42.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/3214136995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8101420 0x7f80e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/3214136995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8100a80 0x7f80e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/3214136995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8106a80 0x7f80e8106e60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 -- 172.21.15.76:0/3214136995 >> 172.21.15.76:0/3214136995 conn(0x7f80e80fc7a0 msgr2=0x7f80e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 -- 172.21.15.76:0/3214136995 shutdown_connections 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.239+0000 7f80ee5fa640 1 -- 172.21.15.76:0/3214136995 wait complete. 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 Processor -- start 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 -- start start 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 0x7f80e81975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8101420 0x7f80e8197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8106a80 0x7f80e819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8111060 con 0x7f80e8100a80 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8110ee0 con 0x7f80e8101420 2024-09-19T07:50:42.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80ee5fa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f80e81111e0 con 0x7f80e8106a80 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 0x7f80e81975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 0x7f80e81975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48782/0 (socket says 172.21.15.76:48782) 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.240+0000 7f80e7fff640 1 -- 172.21.15.76:0/490191610 learned_addr learned my addr 172.21.15.76:0/490191610 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80ecb97640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8106a80 0x7f80e819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e7fff640 1 -- 172.21.15.76:0/490191610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8106a80 msgr2=0x7f80e819be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e7fff640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8106a80 0x7f80e819be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e77fe640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8101420 0x7f80e8197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e7fff640 1 -- 172.21.15.76:0/490191610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8101420 msgr2=0x7f80e8197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e7fff640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8101420 0x7f80e8197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e7fff640 1 -- 172.21.15.76:0/490191610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e819c570 con 0x7f80e8100a80 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80ecb97640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8106a80 0x7f80e819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:42.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e7fff640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 0x7f80e81975c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009a50 tx=0x7f80d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e57fa640 1 -- 172.21.15.76:0/490191610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d803f030 con 0x7f80e8100a80 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e819c800 con 0x7f80e8100a80 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e57fa640 1 -- 172.21.15.76:0/490191610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80d8003af0 con 0x7f80e8100a80 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80e57fa640 1 -- 172.21.15.76:0/490191610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8035070 con 0x7f80e8100a80 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.241+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e81a4140 con 0x7f80e8100a80 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.243+0000 7f80e57fa640 1 -- 172.21.15.76:0/490191610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f80d8042030 con 0x7f80e8100a80 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 Processor -- start 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 -- start start 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b90375e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80e57fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f80d00a32d0 0x7f80d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b90382c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 0x564b903855a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564b902da090 con 0x564b903831b0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b90281a70 con 0x564b903763c0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80f09d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b902d6050 con 0x564b90375aa0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80ecb97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 0x564b903855a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80e7fff640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f80d00a32d0 0x7f80d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80ecb97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 0x564b903855a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48784/0 (socket says 172.21.15.76:48784) 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80ecb97640 1 -- 172.21.15.76:0/2096416488 learned_addr learned my addr 172.21.15.76:0/2096416488 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80e77fe640 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b90382c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80e57fa640 1 -- 172.21.15.76:0/490191610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f80d80f0440 con 0x7f80e8100a80 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b90375e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80ecb97640 1 -- 172.21.15.76:0/2096416488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 msgr2=0x564b90375e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.244+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b90375e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ecb97640 1 -- 172.21.15.76:0/2096416488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 msgr2=0x564b90382c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b90382c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ecb97640 1 -- 172.21.15.76:0/2096416488 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9028e130 con 0x564b903831b0 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80e7fff640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f80d00a32d0 0x7f80d00a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009900 tx=0x7f80d80a7040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 0x564b903855a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f80e0014850 tx=0x7f80e0008920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff7668636fc93f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ce7fc640 1 -- 172.21.15.76:0/2096416488 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e000fa80 con 0x564b903831b0 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ce7fc640 1 -- 172.21.15.76:0/2096416488 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e0018020 con 0x564b903831b0 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80ce7fc640 1 -- 172.21.15.76:0/2096416488 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e00113d0 con 0x564b903831b0 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80f09d3740 1 -- 172.21.15.76:0/2096416488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 msgr2=0x564b903855a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.245+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 0x564b903855a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f80e0014850 tx=0x7f80e0008920 comp rx=0 tx=0).stop 2024-09-19T07:50:42.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- 172.21.15.76:0/2096416488 shutdown_connections 2024-09-19T07:50:42.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903831b0 0x564b903855a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b90382c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2096416488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b90375e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- 172.21.15.76:0/2096416488 >> 172.21.15.76:0/2096416488 conn(0x564b90372170 msgr2=0x564b90372550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:42.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- 172.21.15.76:0/2096416488 shutdown_connections 2024-09-19T07:50:42.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- 172.21.15.76:0/2096416488 wait complete. 2024-09-19T07:50:42.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- start start 2024-09-19T07:50:42.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 Processor -- start 2024-09-19T07:50:42.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90382a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b9037fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90380340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564b90385ba0 con 0x564b90375aa0 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b90294f20 con 0x564b903763c0 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b90385d20 con 0x564b903831b0 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80f09d3740 10 client.0 _ll_register_callbacks cb 0x564b9025e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80ecb97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90382a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80ecb97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90382a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48794/0 (socket says 172.21.15.76:48794) 2024-09-19T07:50:42.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.246+0000 7f80ecb97640 1 -- 172.21.15.76:0/2831115064 learned_addr learned my addr 172.21.15.76:0/2831115064 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80e77fe640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b9037fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90380340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 -- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 msgr2=0x564b90380340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90380340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 -- 172.21.15.76:0/2831115064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 msgr2=0x564b9037fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b9037fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 -- 172.21.15.76:0/2831115064 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9004b2b0 con 0x564b90375aa0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90382a60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80e0010010 tx=0x7f80e0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a7881bff16810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80c77fe640 1 -- 172.21.15.76:0/2831115064 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e00127f0 con 0x564b90375aa0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80c77fe640 1 -- 172.21.15.76:0/2831115064 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f80e001d430 con 0x564b90375aa0 2024-09-19T07:50:42.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e0018020 con 0x564b90375aa0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80c77fe640 1 -- 172.21.15.76:0/2831115064 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80e0030070 con 0x564b90375aa0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80f09d3740 10 client.14958 fetch_fsmap learned FSMap version 24 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564b90391550 con 0x564b90375aa0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.247+0000 7f80c77fe640 1 -- 172.21.15.76:0/2831115064 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e0018020 con 0x564b90375aa0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80c77fe640 1 -- 172.21.15.76:0/2831115064 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f80e0010040 con 0x564b90375aa0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80f09d3740 10 client.14958 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80f09d3740 10 client.14958 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80f09d3740 20 client.14958 populate_metadata read hostname 'smithi076' 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b903936f0 0x564b90392950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80f09d3740 4 client.14958 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b902e7600 con 0x564b903936f0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.248+0000 7f80e77fe640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b903936f0 0x564b90392950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.249+0000 7f80e77fe640 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b903936f0 0x564b90392950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3939e6f72c1a01f server_cookie=dae9721abce23dd8 in_seq=0 out_seq=0 2024-09-19T07:50:42.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.249+0000 7f80c77fe640 10 client.14958 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.249+0000 7f80c77fe640 1 -- 172.21.15.76:0/2831115064 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b902e7600 con 0x564b903936f0 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.249+0000 7f80c77fe640 10 client.14958 handle_command_reply: tid=0 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.249+0000 7f80f09d3740 1 client.14958 shutdown 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 msgr2=0x564b90382a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90382a60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80e0010010 tx=0x7f80e0012bc0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 shutdown_connections 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b903936f0 0x564b90392950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90380340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b9037fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2831115064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90382a60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 >> 172.21.15.76:0/2831115064 conn(0x564b90372170 msgr2=0x564b90377ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80c77fe640 0 client.14958 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:50:42.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 shutdown_connections 2024-09-19T07:50:42.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 1 -- 172.21.15.76:0/2831115064 wait complete. 2024-09-19T07:50:42.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.250+0000 7f80f09d3740 20 client.14958 trim_cache size 0 max 16384 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.267+0000 7f80f09d3740 1 Processor -- start 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.267+0000 7f80f09d3740 1 -- start start 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90393020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b903936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90376a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80f09d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564b90392ea0 con 0x564b90375aa0 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80f09d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b90393570 con 0x564b903763c0 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80f09d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b90393c40 con 0x564b903831b0 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90393020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90393020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48806/0 (socket says 172.21.15.76:48806) 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 -- 172.21.15.76:0/2276524962 learned_addr learned my addr 172.21.15.76:0/2276524962 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:42.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80e77fe640 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b903936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 -- 172.21.15.76:0/2276524962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 msgr2=0x564b90376a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90376a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 -- 172.21.15.76:0/2276524962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 msgr2=0x564b903936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b903936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 -- 172.21.15.76:0/2276524962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9037e370 con 0x564b90375aa0 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80e77fe640 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b903936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80ecb97640 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90393020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80e00082c0 tx=0x7f80e0004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f982caae0d89725e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80cdffb640 1 -- 172.21.15.76:0/2276524962 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e000f6c0 con 0x564b90375aa0 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80cdffb640 1 -- 172.21.15.76:0/2276524962 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e0018070 con 0x564b90375aa0 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.268+0000 7f80cdffb640 1 -- 172.21.15.76:0/2276524962 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e001d430 con 0x564b90375aa0 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 -- 172.21.15.76:0/2276524962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 msgr2=0x564b90393020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90393020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80e00082c0 tx=0x7f80e0004a20 comp rx=0 tx=0).stop 2024-09-19T07:50:42.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 -- 172.21.15.76:0/2276524962 shutdown_connections 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b903831b0 0x564b90376a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903763c0 0x564b903936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 --2- 172.21.15.76:0/2276524962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b90375aa0 0x564b90393020 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 -- 172.21.15.76:0/2276524962 >> 172.21.15.76:0/2276524962 conn(0x564b90372170 msgr2=0x564b90372550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 -- 172.21.15.76:0/2276524962 shutdown_connections 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 -- 172.21.15.76:0/2276524962 wait complete. 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 -- start start 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.269+0000 7f80f09d3740 1 Processor -- start 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b9039d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 0x564b90395d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903831b0 0x564b90396300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564b903949e0 con 0x564b903763c0 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b90394310 con 0x564b903831b0 2024-09-19T07:50:42.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b903950b0 con 0x564b90375aa0 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 10 client.0 _ll_register_callbacks cb 0x7f80dc00a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 0x564b90395d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 0x564b90395d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48812/0 (socket says 172.21.15.76:48812) 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 -- 172.21.15.76:0/135218343 learned_addr learned my addr 172.21.15.76:0/135218343 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80ecb97640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903831b0 0x564b90396300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80ecb97640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b9039d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 -- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 msgr2=0x564b9039d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b9039d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 -- 172.21.15.76:0/135218343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903831b0 msgr2=0x564b90396300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903831b0 0x564b90396300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 -- 172.21.15.76:0/135218343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b90396b30 con 0x564b903763c0 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80ecb97640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b9039d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:42.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80e77fe640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 0x564b90395d60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x564b9037f690 tx=0x7f80dc00afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40490dbef727bd1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80c77fe640 1 -- 172.21.15.76:0/135218343 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc016c00 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80c77fe640 1 -- 172.21.15.76:0/135218343 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f80dc016da0 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.270+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e0018070 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80c77fe640 1 -- 172.21.15.76:0/135218343 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80dc02b050 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 10 client.14964 fetch_fsmap learned FSMap version 24 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564b903fce90 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80c77fe640 1 -- 172.21.15.76:0/135218343 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e0018070 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80c77fe640 1 -- 172.21.15.76:0/135218343 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f80dc0234f0 con 0x564b903763c0 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 10 client.14964 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 10 client.14964 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 20 client.14964 populate_metadata read hostname 'smithi076' 2024-09-19T07:50:42.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b90401a70 0x564b90400780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 4 client.14964 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "status"}) -- 0x564b902e1b10 con 0x564b90401a70 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.271+0000 7f80ecb97640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b90401a70 0x564b90400780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80c77fe640 10 client.14964 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80ecb97640 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b90401a70 0x564b90400780 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52e70e19b3027b81 server_cookie=d7e1e010fcf6e5d8 in_seq=0 out_seq=0 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80c77fe640 1 -- 172.21.15.76:0/135218343 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564b902e1b10 con 0x564b90401a70 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80c77fe640 10 client.14964 handle_command_reply: tid=0 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 client.14964 shutdown 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 msgr2=0x564b90395d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 0x564b90395d60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x564b9037f690 tx=0x7f80dc00afa0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 shutdown_connections 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564b90401a70 0x564b90400780 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b903831b0 0x564b90396300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b903763c0 0x564b90395d60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 --2- 172.21.15.76:0/135218343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b90375aa0 0x564b9039d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80c77fe640 0 client.14964 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 >> 172.21.15.76:0/135218343 conn(0x564b90372170 msgr2=0x564b9036ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 shutdown_connections 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 1 -- 172.21.15.76:0/135218343 wait complete. 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.272+0000 7f80f09d3740 20 client.14964 trim_cache size 0 max 16384 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:50:42.283 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 2, 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24457, 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 65.657163607000001, 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 84, 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 98.540577816999999 2024-09-19T07:50:42.284 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f80d00a32d0 msgr2=0x7f80d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f80d00a32d0 0x7f80d00a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009900 tx=0x7f80d80a7040 comp rx=0 tx=0).stop 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 msgr2=0x7f80e81975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 0x7f80e81975c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009a50 tx=0x7f80d8004270 comp rx=0 tx=0).stop 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 shutdown_connections 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80e8106a80 0x7f80e819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f80d00a32d0 0x7f80d00a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e8101420 0x7f80e8197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 --2- 172.21.15.76:0/490191610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80e8100a80 0x7f80e81975c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:42.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 >> 172.21.15.76:0/490191610 conn(0x7f80e80fc7a0 msgr2=0x7f80e80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:42.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 shutdown_connections 2024-09-19T07:50:42.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:42.273+0000 7f80ee5fa640 1 -- 172.21.15.76:0/490191610 wait complete. 2024-09-19T07:50:42.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:42 smithi076 ceph-mon[30930]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 60 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:42.985 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:50:43.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:42 smithi137 ceph-mon[35309]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 60 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:43.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:42 smithi152 ceph-mon[35117]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 60 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T07:50:43.233 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:43.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 -- 172.21.15.76:0/1119922468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604102790 msgr2=0x7f66041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 --2- 172.21.15.76:0/1119922468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604102790 0x7f66041067e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009900 tx=0x7f65f802a410 comp rx=0 tx=0).stop 2024-09-19T07:50:43.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 -- 172.21.15.76:0/1119922468 shutdown_connections 2024-09-19T07:50:43.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 --2- 172.21.15.76:0/1119922468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 0x7f660410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 --2- 172.21.15.76:0/1119922468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604102790 0x7f66041067e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 --2- 172.21.15.76:0/1119922468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6604101de0 0x7f66041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 -- 172.21.15.76:0/1119922468 >> 172.21.15.76:0/1119922468 conn(0x7f66040fd8c0 msgr2=0x7f66040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.693+0000 7f660a9ef640 1 -- 172.21.15.76:0/1119922468 shutdown_connections 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 -- 172.21.15.76:0/1119922468 wait complete. 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 Processor -- start 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 -- start start 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 0x7f6604198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6604102790 0x7f6604198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 0x7f660419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66041120d0 con 0x7f6604101de0 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6604111f50 con 0x7f6604102790 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.694+0000 7f660a9ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6604112250 con 0x7f6604106f10 2024-09-19T07:50:43.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 0x7f6604198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 0x7f6604198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39464/0 (socket says 172.21.15.76:39464) 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 -- 172.21.15.76:0/3673364348 learned_addr learned my addr 172.21.15.76:0/3673364348 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f66037fe640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6604102790 0x7f6604198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 0x7f660419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 -- 172.21.15.76:0/3673364348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 msgr2=0x7f660419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 0x7f660419ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 -- 172.21.15.76:0/3673364348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6604102790 msgr2=0x7f6604198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6604102790 0x7f6604198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 -- 172.21.15.76:0/3673364348 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660419d520 con 0x7f6604101de0 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 0x7f660419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f6603fff640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 0x7f6604198570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f65f400d950 tx=0x7f65f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f66017fa640 1 -- 172.21.15.76:0/3673364348 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4017070 con 0x7f6604101de0 2024-09-19T07:50:43.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f66017fa640 1 -- 172.21.15.76:0/3673364348 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65f4009c30 con 0x7f6604101de0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660419d810 con 0x7f6604101de0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f66017fa640 1 -- 172.21.15.76:0/3673364348 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f400f740 con 0x7f6604101de0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.695+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66041a50f0 con 0x7f6604101de0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.697+0000 7f66017fa640 1 -- 172.21.15.76:0/3673364348 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f65f4010a80 con 0x7f6604101de0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 Processor -- start 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 -- start start 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 0x55da54291db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f66017fa640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f65ec0a32d0 0x7f65ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542922f0 0x55da5429c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5429cbb0 0x55da5429efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55da541f8090 con 0x55da542919d0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da5419fa70 con 0x55da542922f0 2024-09-19T07:50:43.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f660cdc8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da541f4050 con 0x55da5429cbb0 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 0x55da54291db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 0x55da54291db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39480/0 (socket says 172.21.15.76:39480) 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6603fff640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f65ec0a32d0 0x7f65ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 -- 172.21.15.76:0/1884269871 learned_addr learned my addr 172.21.15.76:0/1884269871 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f66037fe640 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542922f0 0x55da5429c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 -- 172.21.15.76:0/1884269871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5429cbb0 msgr2=0x55da5429efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5429cbb0 0x55da5429efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 -- 172.21.15.76:0/1884269871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542922f0 msgr2=0x55da5429c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542922f0 0x55da5429c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f66017fa640 1 -- 172.21.15.76:0/3673364348 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f65f40cf710 con 0x7f6604101de0 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.698+0000 7f6608f8c640 1 -- 172.21.15.76:0/1884269871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da541ac130 con 0x55da542919d0 2024-09-19T07:50:43.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.699+0000 7f6608f8c640 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 0x55da54291db0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00e2e0 tx=0x7f65fc00e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6172c145e44b7ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.699+0000 7f6603fff640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f65ec0a32d0 0x7f65ec0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65f4097890 tx=0x7f65f406ea30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.699+0000 7f65ea7fc640 1 -- 172.21.15.76:0/1884269871 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc014070 con 0x55da542919d0 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.699+0000 7f65ea7fc640 1 -- 172.21.15.76:0/1884269871 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc010d00 con 0x55da542919d0 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.699+0000 7f65ea7fc640 1 -- 172.21.15.76:0/1884269871 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00fd40 con 0x55da542919d0 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 -- 172.21.15.76:0/1884269871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 msgr2=0x55da54291db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 0x55da54291db0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00e2e0 tx=0x7f65fc00e6e0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 -- 172.21.15.76:0/1884269871 shutdown_connections 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5429cbb0 0x55da5429efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542922f0 0x55da5429c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 --2- 172.21.15.76:0/1884269871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542919d0 0x55da54291db0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 -- 172.21.15.76:0/1884269871 >> 172.21.15.76:0/1884269871 conn(0x55da5428df60 msgr2=0x55da5428e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:43.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 -- 172.21.15.76:0/1884269871 shutdown_connections 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 -- 172.21.15.76:0/1884269871 wait complete. 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 -- start start 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.700+0000 7f660cdc8740 1 Processor -- start 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da5429c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da54299770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54299cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55da5429f780 con 0x55da542922f0 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da541b2f20 con 0x55da5429cbb0 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da5429f900 con 0x55da542919d0 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 10 client.0 _ll_register_callbacks cb 0x55da5417c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da54299770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da54299770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39488/0 (socket says 172.21.15.76:39488) 2024-09-19T07:50:43.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 -- 172.21.15.76:0/3629486695 learned_addr learned my addr 172.21.15.76:0/3629486695 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54299cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da5429c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 -- 172.21.15.76:0/3629486695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 msgr2=0x55da5429c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da5429c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 -- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 msgr2=0x55da54299cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54299cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 -- 172.21.15.76:0/3629486695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da53f692b0 con 0x55da542922f0 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54299cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f66037fe640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da54299770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009900 tx=0x7f65f80319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b888e43564607e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:43.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f65e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f65e37fe640 1 -- 172.21.15.76:0/3629486695 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8035040 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f65e37fe640 1 -- 172.21.15.76:0/3629486695 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f65f8004300 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc010d00 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.701+0000 7f65e37fe640 1 -- 172.21.15.76:0/3629486695 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f65f8005020 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 10 client.14976 fetch_fsmap learned FSMap version 24 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da542ab070 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f65e37fe640 1 -- 172.21.15.76:0/3629486695 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc010d00 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f65e37fe640 1 -- 172.21.15.76:0/3629486695 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f65f80035f0 con 0x55da542922f0 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 10 client.14976 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 10 client.14976 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 20 client.14976 populate_metadata read hostname 'smithi076' 2024-09-19T07:50:43.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da542ad670 0x55da542aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 4 client.14976 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da54205600 con 0x55da542ad670 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.702+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da542ad670 0x55da542aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f6608f8c640 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da542ad670 0x55da542aeae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df5b90816b6d7f88 server_cookie=5aec8725d188e6d9 in_seq=0 out_seq=0 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f65e37fe640 10 client.14976 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f65e37fe640 1 -- 172.21.15.76:0/3629486695 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da54205600 con 0x55da542ad670 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f65e37fe640 10 client.14976 handle_command_reply: tid=0 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 client.14976 shutdown 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 msgr2=0x55da54299770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da54299770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009900 tx=0x7f65f80319b0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 shutdown_connections 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da542ad670 0x55da542aeae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54299cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da54299770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.703+0000 7f660cdc8740 1 --2- 172.21.15.76:0/3629486695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da5429c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.704+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 >> 172.21.15.76:0/3629486695 conn(0x55da5428df60 msgr2=0x55da54293c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:43.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.704+0000 7f65e37fe640 0 client.14976 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:50:43.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.704+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 shutdown_connections 2024-09-19T07:50:43.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.704+0000 7f660cdc8740 1 -- 172.21.15.76:0/3629486695 wait complete. 2024-09-19T07:50:43.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.704+0000 7f660cdc8740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T07:50:43.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 Processor -- start 2024-09-19T07:50:43.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 -- start start 2024-09-19T07:50:43.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542919d0 0x55da542acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542922f0 0x55da542ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 0x55da542969d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55da542ace20 con 0x55da5429cbb0 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da542ad4f0 con 0x55da542919d0 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f660cdc8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da542adbc0 con 0x55da542922f0 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f6608f8c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 0x55da542969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f6608f8c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 0x55da542969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39490/0 (socket says 172.21.15.76:39490) 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f6608f8c640 1 -- 172.21.15.76:0/523946209 learned_addr learned my addr 172.21.15.76:0/523946209 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.721+0000 7f6608f8c640 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542919d0 0x55da542acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f6608f8c640 1 -- 172.21.15.76:0/523946209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542922f0 msgr2=0x55da542ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f66037fe640 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542922f0 0x55da542ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f6608f8c640 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542922f0 0x55da542ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f6608f8c640 1 -- 172.21.15.76:0/523946209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542919d0 msgr2=0x55da542acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f6608f8c640 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542919d0 0x55da542acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f6608f8c640 1 -- 172.21.15.76:0/523946209 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da54292120 con 0x55da5429cbb0 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f6608f8c640 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 0x55da542969d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00f8f0 tx=0x7f65fc00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dfd04de64a86ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f65e9ffb640 1 -- 172.21.15.76:0/523946209 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc02e070 con 0x55da5429cbb0 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f65e9ffb640 1 -- 172.21.15.76:0/523946209 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc00f6d0 con 0x55da5429cbb0 2024-09-19T07:50:43.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.722+0000 7f65e9ffb640 1 -- 172.21.15.76:0/523946209 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc014040 con 0x55da5429cbb0 2024-09-19T07:50:43.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 -- 172.21.15.76:0/523946209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 msgr2=0x55da542969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 0x55da542969d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00f8f0 tx=0x7f65fc00f920 comp rx=0 tx=0).stop 2024-09-19T07:50:43.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 -- 172.21.15.76:0/523946209 shutdown_connections 2024-09-19T07:50:43.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5429cbb0 0x55da542969d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542922f0 0x55da542ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 --2- 172.21.15.76:0/523946209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da542919d0 0x55da542acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 -- 172.21.15.76:0/523946209 >> 172.21.15.76:0/523946209 conn(0x55da5428df60 msgr2=0x55da54298040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 -- 172.21.15.76:0/523946209 shutdown_connections 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 -- 172.21.15.76:0/523946209 wait complete. 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 -- start start 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.723+0000 7f660cdc8740 1 Processor -- start 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da542afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da542b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54315d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55da542ae960 con 0x55da542922f0 2024-09-19T07:50:43.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da542ae290 con 0x55da5429cbb0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da542af030 con 0x55da542919d0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 10 client.0 _ll_register_callbacks cb 0x7f65f8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da542b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da542b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39492/0 (socket says 172.21.15.76:39492) 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f6608f8c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54315d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 -- 172.21.15.76:0/2665976459 learned_addr learned my addr 172.21.15.76:0/2665976459 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f6608f8c640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da542afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 -- 172.21.15.76:0/2665976459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 msgr2=0x55da542afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da542afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 -- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 msgr2=0x55da54315d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54315d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 -- 172.21.15.76:0/2665976459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da542b0c30 con 0x55da542922f0 2024-09-19T07:50:43.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f6608f8c640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da542afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f66037fe640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da542b0340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f65f8003b80 tx=0x7f65f802ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77465ae57b11d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f65e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f65e37fe640 1 -- 172.21.15.76:0/2665976459 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8056070 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f65e37fe640 1 -- 172.21.15.76:0/2665976459 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f65f8003e00 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.724+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc00f6d0 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f65e37fe640 1 -- 172.21.15.76:0/2665976459 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f65f8035040 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da543173e0 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f65e37fe640 1 -- 172.21.15.76:0/2665976459 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc00f6d0 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f65e37fe640 1 -- 172.21.15.76:0/2665976459 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f65f8004830 con 0x55da542922f0 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 10 client.14982 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 20 client.14982 populate_metadata read hostname 'smithi076' 2024-09-19T07:50:43.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da5431be90 0x55da5431aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 4 client.14982 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "status"}) -- 0x55da541ffb10 con 0x55da5431be90 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.725+0000 7f6608f8c640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da5431be90 0x55da5431aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f6608f8c640 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da5431be90 0x55da5431aba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1def77b33179d4bf server_cookie=2fd333026627ba94 in_seq=0 out_seq=0 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f65e37fe640 10 client.14982 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f65e37fe640 1 -- 172.21.15.76:0/2665976459 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55da541ffb10 con 0x55da5431be90 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f65e37fe640 10 client.14982 handle_command_reply: tid=0 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 client.14982 shutdown 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 msgr2=0x55da542b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da542b0340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f65f8003b80 tx=0x7f65f802ab10 comp rx=0 tx=0).stop 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 shutdown_connections 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55da5431be90 0x55da5431aba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5429cbb0 0x55da54315d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da542922f0 0x55da542b0340 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f65e37fe640 0 client.14982 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 --2- 172.21.15.76:0/2665976459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da542919d0 0x55da542afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 >> 172.21.15.76:0/2665976459 conn(0x55da5428df60 msgr2=0x55da5428d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 shutdown_connections 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 1 -- 172.21.15.76:0/2665976459 wait complete. 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.726+0000 7f660cdc8740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:50:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 1, 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24458, 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 68.117624953000004, 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 84, 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 85.987175320000006 2024-09-19T07:50:43.735 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:50:43.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f65ec0a32d0 msgr2=0x7f65ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f65ec0a32d0 0x7f65ec0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65f4097890 tx=0x7f65f406ea30 comp rx=0 tx=0).stop 2024-09-19T07:50:43.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 msgr2=0x7f6604198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 0x7f6604198570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f65f400d950 tx=0x7f65f400de10 comp rx=0 tx=0).stop 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 shutdown_connections 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6604106f10 0x7f660419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f65ec0a32d0 0x7f65ec0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6604102790 0x7f6604198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 --2- 172.21.15.76:0/3673364348 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6604101de0 0x7f6604198570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 >> 172.21.15.76:0/3673364348 conn(0x7f66040fd8c0 msgr2=0x7f66040fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 shutdown_connections 2024-09-19T07:50:43.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:43.727+0000 7f660a9ef640 1 -- 172.21.15.76:0/3673364348 wait complete. 2024-09-19T07:50:44.423 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:50:44.667 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:45.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 -- 172.21.15.76:0/3847069085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290101450 msgr2=0x7f2290105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 --2- 172.21.15.76:0/3847069085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290101450 0x7f2290105920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2280009900 tx=0x7f228002a470 comp rx=0 tx=0).stop 2024-09-19T07:50:45.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 -- 172.21.15.76:0/3847069085 shutdown_connections 2024-09-19T07:50:45.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 --2- 172.21.15.76:0/3847069085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2290105f40 0x7f22901063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 --2- 172.21.15.76:0/3847069085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290101450 0x7f2290105920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 --2- 172.21.15.76:0/3847069085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2290100b30 0x7f2290100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 -- 172.21.15.76:0/3847069085 >> 172.21.15.76:0/3847069085 conn(0x7f22900fc7a0 msgr2=0x7f22900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 -- 172.21.15.76:0/3847069085 shutdown_connections 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.163+0000 7f22976bb640 1 -- 172.21.15.76:0/3847069085 wait complete. 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 Processor -- start 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 -- start start 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 0x7f22901a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2290101450 0x7f22901a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2290105f40 0x7f229019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f22901186a0 con 0x7f2290100b30 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2290118520 con 0x7f2290101450 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f22976bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2290118820 con 0x7f2290105f40 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2295457640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 0x7f22901a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2295457640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 0x7f22901a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39518/0 (socket says 172.21.15.76:39518) 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2295457640 1 -- 172.21.15.76:0/1197658195 learned_addr learned my addr 172.21.15.76:0/1197658195 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2294c56640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2290101450 0x7f22901a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2295c58640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2290105f40 0x7f229019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2295457640 1 -- 172.21.15.76:0/1197658195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2290105f40 msgr2=0x7f229019ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.164+0000 7f2295457640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2290105f40 0x7f229019ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f2295457640 1 -- 172.21.15.76:0/1197658195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2290101450 msgr2=0x7f22901a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f2295457640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2290101450 0x7f22901a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f2295457640 1 -- 172.21.15.76:0/1197658195 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229019f150 con 0x7f2290100b30 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f2295457640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 0x7f22901a4860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f228c00d950 tx=0x7f228c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f22867fc640 1 -- 172.21.15.76:0/1197658195 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c017070 con 0x7f2290100b30 2024-09-19T07:50:45.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f22867fc640 1 -- 172.21.15.76:0/1197658195 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f228c009c30 con 0x7f2290100b30 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229019f440 con 0x7f2290100b30 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f22867fc640 1 -- 172.21.15.76:0/1197658195 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c00f740 con 0x7f2290100b30 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.165+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22901ab730 con 0x7f2290100b30 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.167+0000 7f22867fc640 1 -- 172.21.15.76:0/1197658195 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f228c010a80 con 0x7f2290100b30 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 Processor -- start 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 -- start start 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e37810ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378118670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37811afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e378074090 con 0x55e378118bb0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e37801ba70 con 0x55e37810d9d0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2299a94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e378070050 con 0x55e37810e2f0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2294c56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37811afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2294c56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37811afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39522/0 (socket says 172.21.15.76:39522) 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2294c56640 1 -- 172.21.15.76:0/282134791 learned_addr learned my addr 172.21.15.76:0/282134791 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f22867fc640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f227c0a3350 0x7f227c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2295c58640 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e37810ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.168+0000 7f2295457640 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378118670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2295c58640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f227c0a3350 0x7f227c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2294c56640 1 -- 172.21.15.76:0/282134791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 msgr2=0x55e378118670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2294c56640 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378118670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2294c56640 1 -- 172.21.15.76:0/282134791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 msgr2=0x55e37810ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2294c56640 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e37810ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2294c56640 1 -- 172.21.15.76:0/282134791 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e378028130 con 0x55e378118bb0 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f22867fc640 1 -- 172.21.15.76:0/1197658195 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f228c0cf700 con 0x7f2290100b30 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2294c56640 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37811afa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2280009900 tx=0x7f2280031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621d57b5605ea634 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f2295c58640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f227c0a3350 0x7f227c0a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2288005cc0 tx=0x7f2288004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f227b7fe640 1 -- 172.21.15.76:0/282134791 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280040070 con 0x55e378118bb0 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f227b7fe640 1 -- 172.21.15.76:0/282134791 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2280005020 con 0x55e378118bb0 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.169+0000 7f227b7fe640 1 -- 172.21.15.76:0/282134791 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280035040 con 0x55e378118bb0 2024-09-19T07:50:45.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 -- 172.21.15.76:0/282134791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 msgr2=0x55e37811afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37811afa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2280009900 tx=0x7f2280031530 comp rx=0 tx=0).stop 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 -- 172.21.15.76:0/282134791 shutdown_connections 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37811afa0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378118670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 --2- 172.21.15.76:0/282134791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e37810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 -- 172.21.15.76:0/282134791 >> 172.21.15.76:0/282134791 conn(0x55e378109f60 msgr2=0x55e37810a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 -- 172.21.15.76:0/282134791 shutdown_connections 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 -- 172.21.15.76:0/282134791 wait complete. 2024-09-19T07:50:45.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 -- start start 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.170+0000 7f2299a94740 1 Processor -- start 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810d9d0 0x55e3781183f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 0x55e378115740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378115c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e37811b780 con 0x55e37810e2f0 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e37802ef20 con 0x55e378118bb0 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e37811b900 con 0x55e37810d9d0 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 10 client.0 _ll_register_callbacks cb 0x55e377ff8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 0x55e378115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 0x55e378115740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39524/0 (socket says 172.21.15.76:39524) 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 -- 172.21.15.76:0/3936582719 learned_addr learned my addr 172.21.15.76:0/3936582719 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2295c58640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2295457640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810d9d0 0x55e3781183f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 -- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810d9d0 msgr2=0x55e3781183f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810d9d0 0x55e3781183f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 -- 172.21.15.76:0/3936582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 msgr2=0x55e378115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 -- 172.21.15.76:0/3936582719 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e377de52b0 con 0x55e37810e2f0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2295457640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810d9d0 0x55e3781183f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2295c58640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2294c56640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 0x55e378115740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f22800315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1967769ec99c02ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2278ff9640 1 -- 172.21.15.76:0/3936582719 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280040030 con 0x55e37810e2f0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2278ff9640 1 -- 172.21.15.76:0/3936582719 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f2280004050 con 0x55e37810e2f0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2280005020 con 0x55e37810e2f0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.171+0000 7f2278ff9640 1 -- 172.21.15.76:0/3936582719 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2280035040 con 0x55e37810e2f0 2024-09-19T07:50:45.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 10 client.14994 fetch_fsmap learned FSMap version 24 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e378127040 con 0x55e37810e2f0 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2278ff9640 1 -- 172.21.15.76:0/3936582719 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2280005020 con 0x55e37810e2f0 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2278ff9640 1 -- 172.21.15.76:0/3936582719 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2280003a60 con 0x55e37810e2f0 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 10 client.14994 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 10 client.14994 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 20 client.14994 populate_metadata read hostname 'smithi076' 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378129190 0x55e37812a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 4 client.14994 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e378081600 con 0x55e378129190 2024-09-19T07:50:45.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.172+0000 7f2295457640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378129190 0x55e37812a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.173+0000 7f2278ff9640 10 client.14994 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.173+0000 7f2295457640 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378129190 0x55e37812a600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6c115cca1fabb43 server_cookie=24d28c1de2904218 in_seq=0 out_seq=0 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.173+0000 7f2278ff9640 1 -- 172.21.15.76:0/3936582719 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e378081600 con 0x55e378129190 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.173+0000 7f2278ff9640 10 client.14994 handle_command_reply: tid=0 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.173+0000 7f2299a94740 1 client.14994 shutdown 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 msgr2=0x55e378115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 0x55e378115740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f22800315a0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 shutdown_connections 2024-09-19T07:50:45.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378129190 0x55e37812a600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810e2f0 0x55e378115740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2278ff9640 0 client.14994 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 --2- 172.21.15.76:0/3936582719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810d9d0 0x55e3781183f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 >> 172.21.15.76:0/3936582719 conn(0x55e378109f60 msgr2=0x55e37810fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 shutdown_connections 2024-09-19T07:50:45.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 1 -- 172.21.15.76:0/3936582719 wait complete. 2024-09-19T07:50:45.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.174+0000 7f2299a94740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T07:50:45.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.191+0000 7f2299a94740 1 Processor -- start 2024-09-19T07:50:45.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 -- start start 2024-09-19T07:50:45.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 0x55e37812a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e3781129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378112f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e378128940 con 0x55e37810d9d0 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e378129010 con 0x55e378118bb0 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2299a94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e3781296e0 con 0x55e37810e2f0 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 0x55e37812a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 0x55e37812a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39538/0 (socket says 172.21.15.76:39538) 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 -- 172.21.15.76:0/2546219884 learned_addr learned my addr 172.21.15.76:0/2546219884 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 -- 172.21.15.76:0/2546219884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 msgr2=0x55e3781129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e3781129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 -- 172.21.15.76:0/2546219884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 msgr2=0x55e378112f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 -- 172.21.15.76:0/2546219884 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e378118760 con 0x55e37810d9d0 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f2295457640 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 0x55e37812a600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f228c0965e0 tx=0x7f228c06e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c539e141a109e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f227affd640 1 -- 172.21.15.76:0/2546219884 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c020040 con 0x55e37810d9d0 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f227affd640 1 -- 172.21.15.76:0/2546219884 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f228c0a47b0 con 0x55e37810d9d0 2024-09-19T07:50:45.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.192+0000 7f227affd640 1 -- 172.21.15.76:0/2546219884 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c086040 con 0x55e37810d9d0 2024-09-19T07:50:45.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 -- 172.21.15.76:0/2546219884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 msgr2=0x55e37812a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 0x55e37812a600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f228c0965e0 tx=0x7f228c06e9c0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 -- 172.21.15.76:0/2546219884 shutdown_connections 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e378118bb0 0x55e378112f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e3781129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 --2- 172.21.15.76:0/2546219884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e37810d9d0 0x55e37812a600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 -- 172.21.15.76:0/2546219884 >> 172.21.15.76:0/2546219884 conn(0x55e378109f60 msgr2=0x55e378115000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 -- 172.21.15.76:0/2546219884 shutdown_connections 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 -- 172.21.15.76:0/2546219884 wait complete. 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.193+0000 7f2299a94740 1 -- start start 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 Processor -- start 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e3781328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378132e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37812dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e37812a480 con 0x55e378118bb0 2024-09-19T07:50:45.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e378129db0 con 0x55e37810d9d0 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e37812ab50 con 0x55e37810e2f0 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2299a94740 10 client.0 _ll_register_callbacks cb 0x7f228800b500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37812dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37812dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39554/0 (socket says 172.21.15.76:39554) 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 -- 172.21.15.76:0/3210789343 learned_addr learned my addr 172.21.15.76:0/3210789343 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295457640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e3781328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2294c56640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 -- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 msgr2=0x55e378132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378132e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 -- 172.21.15.76:0/3210789343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 msgr2=0x55e3781328d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e3781328d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.194+0000 7f2295c58640 1 -- 172.21.15.76:0/3210789343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37812e570 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2295c58640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37812dd70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2288011f90 tx=0x7f228800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e3755de6e09a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2278ff9640 1 -- 172.21.15.76:0/3210789343 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288021070 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2278ff9640 1 -- 172.21.15.76:0/3210789343 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f2288014250 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c0a47b0 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2278ff9640 1 -- 172.21.15.76:0/3210789343 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2288004b20 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 10 client.15000 fetch_fsmap learned FSMap version 24 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e378193340 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2278ff9640 1 -- 172.21.15.76:0/3210789343 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f228c0a47b0 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2278ff9640 1 -- 172.21.15.76:0/3210789343 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2288013460 con 0x55e378118bb0 2024-09-19T07:50:45.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 10 client.15000 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 10 client.15000 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 20 client.15000 populate_metadata read hostname 'smithi076' 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378197f60 0x55e378196c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 4 client.15000 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.195+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "status"}) -- 0x55e37807bb10 con 0x55e378197f60 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2295457640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378197f60 0x55e378196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:45.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2278ff9640 10 client.15000 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2295457640 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378197f60 0x55e378196c70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3986dbe0a3b4c0b server_cookie=e23d83a8602ac0c3 in_seq=0 out_seq=0 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2278ff9640 1 -- 172.21.15.76:0/3210789343 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e37807bb10 con 0x55e378197f60 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2278ff9640 10 client.15000 handle_command_reply: tid=0 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 client.15000 shutdown 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 msgr2=0x55e37812dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37812dd70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2288011f90 tx=0x7f228800bbd0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 shutdown_connections 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e378197f60 0x55e378196c70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e378118bb0 0x55e37812dd70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e37810e2f0 0x55e378132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 --2- 172.21.15.76:0/3210789343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e37810d9d0 0x55e3781328d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.196+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 >> 172.21.15.76:0/3210789343 conn(0x55e378109f60 msgr2=0x55e378114030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f2278ff9640 0 client.15000 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 shutdown_connections 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f2299a94740 1 -- 172.21.15.76:0/3210789343 wait complete. 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f2299a94740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24478, 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:50:45.204 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 76.623907145000004, 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 84, 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 96.232687549000005 2024-09-19T07:50:45.205 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f227c0a3350 msgr2=0x7f227c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f227c0a3350 0x7f227c0a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2288005cc0 tx=0x7f2288004ab0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 msgr2=0x7f22901a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 0x7f22901a4860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f228c00d950 tx=0x7f228c00de10 comp rx=0 tx=0).stop 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 shutdown_connections 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2290105f40 0x7f229019ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f227c0a3350 0x7f227c0a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2290101450 0x7f22901a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 --2- 172.21.15.76:0/1197658195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2290100b30 0x7f22901a4860 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:45.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 >> 172.21.15.76:0/1197658195 conn(0x7f22900fc7a0 msgr2=0x7f22901038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:45.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 shutdown_connections 2024-09-19T07:50:45.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:45.197+0000 7f22976bb640 1 -- 172.21.15.76:0/1197658195 wait complete. 2024-09-19T07:50:45.848 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:45 smithi076 ceph-mon[30930]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 54 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:45.874 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T07:50:45.874 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:50:45.888 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:50:45.888 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T07:50:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:45 smithi152 ceph-mon[35117]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 54 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:46.134 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:46.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:45 smithi137 ceph-mon[35309]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 54 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:46.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 -- 172.21.15.76:0/2535450265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc01026a0 msgr2=0x7f2fc0104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/2535450265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc01026a0 0x7f2fc0104a90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009900 tx=0x7f2fb002a410 comp rx=0 tx=0).stop 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 -- 172.21.15.76:0/2535450265 shutdown_connections 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/2535450265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0107900 0x7f2fc0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/2535450265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc0104fd0 0x7f2fc01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/2535450265 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc01026a0 0x7f2fc0104a90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 -- 172.21.15.76:0/2535450265 >> 172.21.15.76:0/2535450265 conn(0x7f2fc00fc2a0 msgr2=0x7f2fc00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 -- 172.21.15.76:0/2535450265 shutdown_connections 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 -- 172.21.15.76:0/2535450265 wait complete. 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 Processor -- start 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.659+0000 7f2fc5f20640 1 -- start start 2024-09-19T07:50:46.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc01026a0 0x7f2fc0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0104fd0 0x7f2fc0198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 0x7f2fc019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc010dad0 con 0x7f2fc0107900 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc010d950 con 0x7f2fc01026a0 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc010dc50 con 0x7f2fc0104fd0 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 0x7f2fc019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 0x7f2fc019f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39570/0 (socket says 172.21.15.76:39570) 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 -- 172.21.15.76:0/3996843833 learned_addr learned my addr 172.21.15.76:0/3996843833 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbf7fe640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc01026a0 0x7f2fc0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fb7fff640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0104fd0 0x7f2fc0198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 -- 172.21.15.76:0/3996843833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0104fd0 msgr2=0x7f2fc0198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:46.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0104fd0 0x7f2fc0198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 -- 172.21.15.76:0/3996843833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc01026a0 msgr2=0x7f2fc0198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc01026a0 0x7f2fc0198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 -- 172.21.15.76:0/3996843833 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc019fd70 con 0x7f2fc0107900 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbf7fe640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc01026a0 0x7f2fc0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbffff640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 0x7f2fc019f700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800b970 tx=0x7f2fb800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8019070 con 0x7f2fc0107900 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc01a0060 con 0x7f2fc0107900 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2fb800cb40 con 0x7f2fc0107900 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80076e0 con 0x7f2fc0107900 2024-09-19T07:50:46.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.660+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc01a0620 con 0x7f2fc0107900 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.661+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc00fdd90 con 0x7f2fc0107900 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.663+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2fb801c070 con 0x7f2fc0107900 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.663+0000 7f2fbd7fa640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2fac0a3300 0x7f2fac0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.663+0000 7f2fbf7fe640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2fac0a3300 0x7f2fac0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.663+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f2fb80cf440 con 0x7f2fc0107900 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.664+0000 7f2fbf7fe640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2fac0a3300 0x7f2fac0a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0000c00 tx=0x7f2fb0031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:46.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.667+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fb809c0f0 con 0x7f2fc0107900 2024-09-19T07:50:46.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.849+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2fc0062630 con 0x7f2fac0a3300 2024-09-19T07:50:46.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.850+0000 7f2fbd7fa640 1 -- 172.21.15.76:0/3996843833 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2fc0062630 con 0x7f2fac0a3300 2024-09-19T07:50:46.851 INFO:teuthology.orchestra.run.smithi076.stdout:Backend: cephadm 2024-09-19T07:50:46.852 INFO:teuthology.orchestra.run.smithi076.stdout:Available: Yes 2024-09-19T07:50:46.852 INFO:teuthology.orchestra.run.smithi076.stdout:Paused: No 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2fac0a3300 msgr2=0x7f2fac0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2fac0a3300 0x7f2fac0a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0000c00 tx=0x7f2fb0031640 comp rx=0 tx=0).stop 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 msgr2=0x7f2fc019f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 0x7f2fc019f700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800b970 tx=0x7f2fb800be30 comp rx=0 tx=0).stop 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 shutdown_connections 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fc0107900 0x7f2fc019f700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0104fd0 0x7f2fc0198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2fac0a3300 0x7f2fac0a57c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 --2- 172.21.15.76:0/3996843833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc01026a0 0x7f2fc0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:46.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 >> 172.21.15.76:0/3996843833 conn(0x7f2fc00fc2a0 msgr2=0x7f2fc0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:46.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 shutdown_connections 2024-09-19T07:50:46.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:46.853+0000 7f2fc5f20640 1 -- 172.21.15.76:0/3996843833 wait complete. 2024-09-19T07:50:47.521 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T07:50:47.773 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:47.894 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:47 smithi076 ceph-mon[30930]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:47.992 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:47 smithi152 ceph-mon[35117]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:47 smithi137 ceph-mon[35309]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:48.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.251+0000 7f99d93f4640 1 -- 172.21.15.76:0/2151934555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 msgr2=0x7f99d4100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:48.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.251+0000 7f99d93f4640 1 --2- 172.21.15.76:0/2151934555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d4100b00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009ca0 tx=0x7f99cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- 172.21.15.76:0/2151934555 shutdown_connections 2024-09-19T07:50:48.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 --2- 172.21.15.76:0/2151934555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d4100b00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 --2- 172.21.15.76:0/2151934555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 0x7f99d4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 --2- 172.21.15.76:0/2151934555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99d4102190 0x7f99d4102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- 172.21.15.76:0/2151934555 >> 172.21.15.76:0/2151934555 conn(0x7f99d40fba40 msgr2=0x7f99d40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- 172.21.15.76:0/2151934555 shutdown_connections 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- 172.21.15.76:0/2151934555 wait complete. 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 Processor -- start 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- start start 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 0x7f99d419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99d4102190 0x7f99d41a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f99d410fbe0 con 0x7f99d4100650 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99d410fa60 con 0x7f99d40ffc90 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.252+0000 7f99d93f4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f99d410fd60 con 0x7f99d4102190 2024-09-19T07:50:48.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39600/0 (socket says 172.21.15.76:39600) 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 -- 172.21.15.76:0/1918994082 learned_addr learned my addr 172.21.15.76:0/1918994082 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d37fe640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99d4102190 0x7f99d41a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d2ffd640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 0x7f99d419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 -- 172.21.15.76:0/1918994082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99d4102190 msgr2=0x7f99d41a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99d4102190 0x7f99d41a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 -- 172.21.15.76:0/1918994082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 msgr2=0x7f99d419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 0x7f99d419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 -- 172.21.15.76:0/1918994082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41a1de0 con 0x7f99d4100650 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d2ffd640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 0x7f99d419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d27fc640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d419a6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c970 tx=0x7f99bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004220 con 0x7f99d4100650 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d41a20d0 con 0x7f99d4100650 2024-09-19T07:50:48.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99bc0043c0 con 0x7f99d4100650 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00f6b0 con 0x7f99d4100650 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.253+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d41a2660 con 0x7f99d4100650 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.254+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d410bab0 con 0x7f99d4100650 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.256+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f99bc0037a0 con 0x7f99d4100650 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.256+0000 7f99cbfff640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99c00a3300 0x7f99c00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.256+0000 7f99d2ffd640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99c00a3300 0x7f99c00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.256+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f99bc0cfbf0 con 0x7f99d4100650 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.257+0000 7f99d2ffd640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99c00a3300 0x7f99c00a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99c40058c0 tx=0x7f99c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:48.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.259+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99bc014030 con 0x7f99d4100650 2024-09-19T07:50:48.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.435+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f99d4062630 con 0x7f99c00a3300 2024-09-19T07:50:48.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.447+0000 7f99cbfff640 1 -- 172.21.15.76:0/1918994082 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f99d4062630 con 0x7f99c00a3300 2024-09-19T07:50:48.448 INFO:teuthology.orchestra.run.smithi076.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.a smithi076 running (93s) 16s ago 93s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 dd7a2276da06 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.b smithi137 running (91s) 23s ago 90s 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 98e77d667f46 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.c smithi152 running (105s) 23s ago 104s 20.3M - 19.1.1-361-g2f599a46 d2baa855c067 650a4bf9e603 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.d smithi076 running (113s) 16s ago 112s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 3bfeb1ee1123 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.e smithi137 running (110s) 23s ago 109s 13.6M - 19.1.1-361-g2f599a46 d2baa855c067 c777e08e6409 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.f smithi152 running (107s) 23s ago 107s 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 d14f998bad9f 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.g smithi076 running (97s) 16s ago 96s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 cd8bc9220e93 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.h smithi137 running (102s) 23s ago 102s 19.0M - 19.1.1-361-g2f599a46 d2baa855c067 5ef98c5b0787 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.i smithi152 running (99s) 23s ago 99s 28.8M - 19.1.1-361-g2f599a46 d2baa855c067 7345404ec292 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.j smithi076 running (116s) 16s ago 116s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 fbf07994bb88 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.k smithi137 running (119s) 23s ago 119s 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 2c6a50bb65ee 2024-09-19T07:50:48.449 INFO:teuthology.orchestra.run.smithi076.stdout:mds.l smithi152 running (2m) 23s ago 2m 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 8ce106d30132 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:mgr.x smithi076 *:9283,8765 running (8m) 16s ago 8m 509M - 19.1.1-361-g2f599a46 d2baa855c067 908fb35e2429 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:mgr.y smithi137 *:8443,8765 running (7m) 23s ago 7m 446M - 19.1.1-361-g2f599a46 d2baa855c067 d279e1f75a21 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:mgr.z smithi152 *:8443,8765 running (7m) 23s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 521a32d8bae8 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:mon.a smithi076 running (8m) 16s ago 9m 51.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 b15b079e9d65 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:mon.b smithi137 running (7m) 23s ago 7m 39.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 6e749eac1ee6 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:mon.c smithi152 running (7m) 23s ago 7m 42.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 f8f909920519 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.0 smithi076 running (7m) 16s ago 7m 58.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4613b48cc2f9 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.1 smithi137 running (6m) 23s ago 6m 59.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 58250fad7216 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.2 smithi152 running (6m) 23s ago 6m 57.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6009e2c85a58 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.3 smithi076 running (5m) 16s ago 5m 54.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 fc156a72790e 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.4 smithi137 running (5m) 23s ago 5m 52.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e5215e76a168 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.5 smithi152 running (4m) 23s ago 4m 46.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 59eec485f61f 2024-09-19T07:50:48.450 INFO:teuthology.orchestra.run.smithi076.stdout:osd.6 smithi076 running (4m) 16s ago 4m 51.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 3de33611bd14 2024-09-19T07:50:48.451 INFO:teuthology.orchestra.run.smithi076.stdout:osd.7 smithi137 running (4m) 23s ago 4m 46.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 9a8fbfb4ed3d 2024-09-19T07:50:48.451 INFO:teuthology.orchestra.run.smithi076.stdout:osd.8 smithi152 running (3m) 23s ago 3m 43.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 d362635c1bde 2024-09-19T07:50:48.451 INFO:teuthology.orchestra.run.smithi076.stdout:osd.9 smithi076 running (3m) 16s ago 3m 51.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 2ba626e62d07 2024-09-19T07:50:48.451 INFO:teuthology.orchestra.run.smithi076.stdout:osd.10 smithi137 running (2m) 23s ago 2m 44.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a8f6d408d032 2024-09-19T07:50:48.451 INFO:teuthology.orchestra.run.smithi076.stdout:osd.11 smithi152 running (2m) 23s ago 2m 51.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 c1c5ba687de3 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99c00a3300 msgr2=0x7f99c00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99c00a3300 0x7f99c00a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99c40058c0 tx=0x7f99c4005850 comp rx=0 tx=0).stop 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 msgr2=0x7f99d419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d419a6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c970 tx=0x7f99bc00ce30 comp rx=0 tx=0).stop 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 shutdown_connections 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99d4102190 0x7f99d41a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f99d4100650 0x7f99d419a6f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f99c00a3300 0x7f99c00a57c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 --2- 172.21.15.76:0/1918994082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99d40ffc90 0x7f99d419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.449+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 >> 172.21.15.76:0/1918994082 conn(0x7f99d40fba40 msgr2=0x7f99d40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.450+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 shutdown_connections 2024-09-19T07:50:48.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:48.450+0000 7f99d93f4640 1 -- 172.21.15.76:0/1918994082 wait complete. 2024-09-19T07:50:48.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:48 smithi076 ceph-mon[30930]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:49.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:48 smithi152 ceph-mon[35117]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:49.148 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T07:50:49.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:48 smithi137 ceph-mon[35309]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:49.396 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:49.775 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:49 smithi076 ceph-mon[30930]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:49.776 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:49 smithi076 ceph-mon[30930]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:49.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 -- 172.21.15.76:0/4000734175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c102e00 msgr2=0x7f435c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:49.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 --2- 172.21.15.76:0/4000734175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c102e00 0x7f435c103280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f434c009900 tx=0x7f434c02a410 comp rx=0 tx=0).stop 2024-09-19T07:50:49.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 -- 172.21.15.76:0/4000734175 shutdown_connections 2024-09-19T07:50:49.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 --2- 172.21.15.76:0/4000734175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f435c1037c0 0x7f435c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 --2- 172.21.15.76:0/4000734175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c102e00 0x7f435c103280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 --2- 172.21.15.76:0/4000734175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f435c101c00 0x7f435c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 -- 172.21.15.76:0/4000734175 >> 172.21.15.76:0/4000734175 conn(0x7f435c0fd390 msgr2=0x7f435c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 -- 172.21.15.76:0/4000734175 shutdown_connections 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.854+0000 7f436467f640 1 -- 172.21.15.76:0/4000734175 wait complete. 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 Processor -- start 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 -- start start 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f435c101c00 0x7f435c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f435c102e00 0x7f435c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 0x7f435c19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10da20 con 0x7f435c1037c0 2024-09-19T07:50:49.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10d8a0 con 0x7f435c102e00 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436467f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10dba0 con 0x7f435c101c00 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 0x7f435c19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 0x7f435c19f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39630/0 (socket says 172.21.15.76:39630) 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 -- 172.21.15.76:0/2256445854 learned_addr learned my addr 172.21.15.76:0/2256445854 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f436241b640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f435c101c00 0x7f435c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 -- 172.21.15.76:0/2256445854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f435c101c00 msgr2=0x7f435c197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f435c101c00 0x7f435c197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 -- 172.21.15.76:0/2256445854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f435c102e00 msgr2=0x7f435c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f435c102e00 0x7f435c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 -- 172.21.15.76:0/2256445854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c19fc10 con 0x7f435c1037c0 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.855+0000 7f4362c1c640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 0x7f435c19f5a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f435400b970 tx=0x7f435400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.856+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354019070 con 0x7f435c1037c0 2024-09-19T07:50:49.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.856+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f435400cb40 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.856+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c19ff00 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.856+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354007700 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.856+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1a0490 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.857+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c108ed0 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.858+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f435401c070 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.858+0000 7f43537fe640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f43480a3300 0x7f43480a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.858+0000 7f436241b640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f43480a3300 0x7f43480a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.858+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f43540cef50 con 0x7f435c1037c0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.859+0000 7f436241b640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f43480a3300 0x7f43480a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43580058c0 tx=0x7f4358005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:49.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:49.862+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f435409bc00 con 0x7f435c1037c0 2024-09-19T07:50:50.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.038+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f435c062630 con 0x7f43480a3300 2024-09-19T07:50:50.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.044+0000 7f43537fe640 1 -- 172.21.15.76:0/2256445854 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f435c062630 con 0x7f43480a3300 2024-09-19T07:50:50.045 INFO:teuthology.orchestra.run.smithi076.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T07:50:50.045 INFO:teuthology.orchestra.run.smithi076.stdout:mds.all 12/12 25s ago 2m smithi076=a;smithi076=d;smithi076=g;smithi076=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi152=c;smithi152=f;smithi152=i;smithi152=l;count:12 2024-09-19T07:50:50.045 INFO:teuthology.orchestra.run.smithi076.stdout:mgr 3/3 25s ago 7m smithi076=x;smithi137=y;smithi152=z;count:3 2024-09-19T07:50:50.045 INFO:teuthology.orchestra.run.smithi076.stdout:mon 3/3 25s ago 7m smithi076:172.21.15.76=a;smithi137:172.21.15.137=b;smithi152:172.21.15.152=c;count:3 2024-09-19T07:50:50.046 INFO:teuthology.orchestra.run.smithi076.stdout:osd 12 25s ago - 2024-09-19T07:50:50.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f43480a3300 msgr2=0x7f43480a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:50.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f43480a3300 0x7f43480a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43580058c0 tx=0x7f4358005850 comp rx=0 tx=0).stop 2024-09-19T07:50:50.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 msgr2=0x7f435c19f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:50.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 0x7f435c19f5a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f435400b970 tx=0x7f435400be30 comp rx=0 tx=0).stop 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 shutdown_connections 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f435c1037c0 0x7f435c19f5a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f43480a3300 0x7f43480a57c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f435c102e00 0x7f435c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 --2- 172.21.15.76:0/2256445854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f435c101c00 0x7f435c197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 >> 172.21.15.76:0/2256445854 conn(0x7f435c0fd390 msgr2=0x7f435c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 shutdown_connections 2024-09-19T07:50:50.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:50.047+0000 7f436467f640 1 -- 172.21.15.76:0/2256445854 wait complete. 2024-09-19T07:50:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:49 smithi152 ceph-mon[35117]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:50.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:49 smithi152 ceph-mon[35117]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:50.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:49 smithi137 ceph-mon[35309]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:50.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:49 smithi137 ceph-mon[35309]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T07:50:50.712 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T07:50:50.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:50 smithi076 ceph-mon[30930]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:50.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:50 smithi076 ceph-mon[30930]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:50.959 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:51.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:50 smithi152 ceph-mon[35117]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:50 smithi152 ceph-mon[35117]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:51.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:50 smithi137 ceph-mon[35309]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:50 smithi137 ceph-mon[35309]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.459+0000 7fa504581640 1 -- 172.21.15.76:0/4082689214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc107900 msgr2=0x7fa4fc109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.459+0000 7fa504581640 1 --2- 172.21.15.76:0/4082689214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc107900 0x7fa4fc109d50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009ca0 tx=0x7fa4f402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- 172.21.15.76:0/4082689214 shutdown_connections 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 --2- 172.21.15.76:0/4082689214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc107900 0x7fa4fc109d50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 --2- 172.21.15.76:0/4082689214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4fc104fd0 0x7fa4fc1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 --2- 172.21.15.76:0/4082689214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- 172.21.15.76:0/4082689214 >> 172.21.15.76:0/4082689214 conn(0x7fa4fc0fc2a0 msgr2=0x7fa4fc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:51.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- 172.21.15.76:0/4082689214 shutdown_connections 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- 172.21.15.76:0/4082689214 wait complete. 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 Processor -- start 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- start start 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc104fd0 0x7fa4fc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4fc107900 0x7fa4fc19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc10d9d0 con 0x7fa4fc1026a0 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc10d850 con 0x7fa4fc107900 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa504581640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc10db50 con 0x7fa4fc104fd0 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa50231d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa50231d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39646/0 (socket says 172.21.15.76:39646) 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.460+0000 7fa50231d640 1 -- 172.21.15.76:0/1406598394 learned_addr learned my addr 172.21.15.76:0/1406598394 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa502b1e640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4fc107900 0x7fa4fc19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:51.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa501b1c640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc104fd0 0x7fa4fc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa50231d640 1 -- 172.21.15.76:0/1406598394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc104fd0 msgr2=0x7fa4fc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa50231d640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc104fd0 0x7fa4fc198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa50231d640 1 -- 172.21.15.76:0/1406598394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4fc107900 msgr2=0x7fa4fc19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa50231d640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4fc107900 0x7fa4fc19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa50231d640 1 -- 172.21.15.76:0/1406598394 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc19fb10 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa50231d640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc197ee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00d950 tx=0x7fa4ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4ec009c30 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00f740 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc19fe00 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.461+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc1a0250 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.462+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc0fdd90 con 0x7fa4fc1026a0 2024-09-19T07:50:51.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.463+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa4ec010a80 con 0x7fa4fc1026a0 2024-09-19T07:50:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.464+0000 7fa4f37fe640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4e80a3300 0x7fa4e80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.464+0000 7fa501b1c640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4e80a3300 0x7fa4e80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.464+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fa4ec0cf7b0 con 0x7fa4fc1026a0 2024-09-19T07:50:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.465+0000 7fa501b1c640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4e80a3300 0x7fa4e80a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc199400 tx=0x7fa4f8005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.469+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4ec09c350 con 0x7fa4fc1026a0 2024-09-19T07:50:51.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.639+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fa4fc062630 con 0x7fa4e80a3300 2024-09-19T07:50:51.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.641+0000 7fa4f37fe640 1 -- 172.21.15.76:0/1406598394 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fa4fc062630 con 0x7fa4e80a3300 2024-09-19T07:50:51.641 INFO:teuthology.orchestra.run.smithi076.stdout:HOST ADDR LABELS STATUS 2024-09-19T07:50:51.641 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 172.21.15.76 2024-09-19T07:50:51.641 INFO:teuthology.orchestra.run.smithi076.stdout:smithi137 172.21.15.137 2024-09-19T07:50:51.641 INFO:teuthology.orchestra.run.smithi076.stdout:smithi152 172.21.15.152 2024-09-19T07:50:51.641 INFO:teuthology.orchestra.run.smithi076.stdout:3 hosts in cluster 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4e80a3300 msgr2=0x7fa4e80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4e80a3300 0x7fa4e80a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc199400 tx=0x7fa4f8005cc0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 msgr2=0x7fa4fc197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc197ee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00d950 tx=0x7fa4ec00de10 comp rx=0 tx=0).stop 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 shutdown_connections 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4e80a3300 0x7fa4e80a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4fc107900 0x7fa4fc19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc104fd0 0x7fa4fc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 --2- 172.21.15.76:0/1406598394 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4fc1026a0 0x7fa4fc197ee0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 >> 172.21.15.76:0/1406598394 conn(0x7fa4fc0fc2a0 msgr2=0x7fa4fc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 shutdown_connections 2024-09-19T07:50:51.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:51.644+0000 7fa504581640 1 -- 172.21.15.76:0/1406598394 wait complete. 2024-09-19T07:50:51.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:51 smithi076 ceph-mon[30930]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:52.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:51 smithi152 ceph-mon[35117]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:52.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:51 smithi137 ceph-mon[35309]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:52.263 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T07:50:52.509 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:52.922 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:52 smithi076 ceph-mon[30930]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 -- 172.21.15.76:0/1590689259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8100ad0 msgr2=0x7f04f8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1590689259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8100ad0 0x7f04f8100ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009900 tx=0x7f04e802a410 comp rx=0 tx=0).stop 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 -- 172.21.15.76:0/1590689259 shutdown_connections 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1590689259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f8102690 0x7f04f8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1590689259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f8101cd0 0x7f04f8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1590689259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8100ad0 0x7f04f8100ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 -- 172.21.15.76:0/1590689259 >> 172.21.15.76:0/1590689259 conn(0x7f04f80fc280 msgr2=0x7f04f80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 -- 172.21.15.76:0/1590689259 shutdown_connections 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 -- 172.21.15.76:0/1590689259 wait complete. 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.002+0000 7f04fd25f640 1 Processor -- start 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 -- start start 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f8100ad0 0x7f04f819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 0x7f04f819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f8102690 0x7f04f81a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04f810da80 con 0x7f04f8101cd0 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04f810d900 con 0x7f04f8100ad0 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04fd25f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04f810dc00 con 0x7f04f8102690 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 0x7f04f819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 0x7f04f819a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39668/0 (socket says 172.21.15.76:39668) 2024-09-19T07:50:53.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 -- 172.21.15.76:0/1127948028 learned_addr learned my addr 172.21.15.76:0/1127948028 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f6d9d640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f8100ad0 0x7f04f819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f759e640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f8102690 0x7f04f81a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 -- 172.21.15.76:0/1127948028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f8102690 msgr2=0x7f04f81a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f8102690 0x7f04f81a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 -- 172.21.15.76:0/1127948028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f8100ad0 msgr2=0x7f04f819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f8100ad0 0x7f04f819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 -- 172.21.15.76:0/1127948028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f81a1fa0 con 0x7f04f8101cd0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.003+0000 7f04f659c640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 0x7f04f819a8b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00b4a0 tx=0x7f04ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.004+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec014070 con 0x7f04f8101cd0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.004+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f81a2290 con 0x7f04f8101cd0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.004+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04ec010b10 con 0x7f04f8101cd0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.004+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec017d60 con 0x7f04f8101cd0 2024-09-19T07:50:53.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.004+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f81a28a0 con 0x7f04f8101cd0 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.005+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f81a2b60 con 0x7f04f8101cd0 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.006+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f04ec017070 con 0x7f04f8101cd0 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.007+0000 7f04dffff640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04e00a3300 0x7f04e00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.007+0000 7f04f6d9d640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04e00a3300 0x7f04e00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.007+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f04ec0cecc0 con 0x7f04f8101cd0 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.007+0000 7f04f6d9d640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04e00a3300 0x7f04e00a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f04e8031570 tx=0x7f04e8031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:53.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.011+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04ec09b970 con 0x7f04f8101cd0 2024-09-19T07:50:53.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:52 smithi152 ceph-mon[35117]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:53.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:52 smithi137 ceph-mon[35309]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:53.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.184+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 --> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f04f8108c10 con 0x7f04e00a3300 2024-09-19T07:50:53.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.185+0000 7f04dffff640 1 -- 172.21.15.76:0/1127948028 <== mgr.14150 v2:172.21.15.76:6800/1377496784 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f04f8108c10 con 0x7f04e00a3300 2024-09-19T07:50:53.185 INFO:teuthology.orchestra.run.smithi076.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T07:50:53.185 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400U4400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T07:50:53.185 INFO:teuthology.orchestra.run.smithi076.stdout:smithi137 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233004A400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T07:50:53.186 INFO:teuthology.orchestra.run.smithi076.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.187+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04e00a3300 msgr2=0x7f04e00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.187+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04e00a3300 0x7f04e00a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f04e8031570 tx=0x7f04e8031640 comp rx=0 tx=0).stop 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.187+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 msgr2=0x7f04f819a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.187+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 0x7f04f819a8b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00b4a0 tx=0x7f04ec00b960 comp rx=0 tx=0).stop 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 shutdown_connections 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f8102690 0x7f04f81a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04f8101cd0 0x7f04f819a8b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f04e00a3300 0x7f04e00a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 --2- 172.21.15.76:0/1127948028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f8100ad0 0x7f04f819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:53.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 >> 172.21.15.76:0/1127948028 conn(0x7f04f80fc280 msgr2=0x7f04f81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:53.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 shutdown_connections 2024-09-19T07:50:53.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:53.188+0000 7f04fd25f640 1 -- 172.21.15.76:0/1127948028 wait complete. 2024-09-19T07:50:53.878 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:53 smithi076 ceph-mon[30930]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:53.906 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:50:53.919 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:50:53.920 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T07:50:54.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:53 smithi152 ceph-mon[35117]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:54.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:53 smithi137 ceph-mon[35309]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:50:54.165 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:54.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 -- 172.21.15.76:0/1188015081 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 msgr2=0x7f8ddc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 --2- 172.21.15.76:0/1188015081 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc100ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009900 tx=0x7f8dcc02a410 comp rx=0 tx=0).stop 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 -- 172.21.15.76:0/1188015081 shutdown_connections 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 --2- 172.21.15.76:0/1188015081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 0x7f8ddc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 --2- 172.21.15.76:0/1188015081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ddc101cd0 0x7f8ddc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 --2- 172.21.15.76:0/1188015081 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc100ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 -- 172.21.15.76:0/1188015081 >> 172.21.15.76:0/1188015081 conn(0x7f8ddc0fc280 msgr2=0x7f8ddc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 -- 172.21.15.76:0/1188015081 shutdown_connections 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.689+0000 7f8de15f3640 1 -- 172.21.15.76:0/1188015081 wait complete. 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 Processor -- start 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 -- start start 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ddc101cd0 0x7f8ddc198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:54.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 0x7f8ddc19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc10c890 con 0x7f8ddc100ad0 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc10c710 con 0x7f8ddc102690 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8de15f3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc10ca10 con 0x7f8ddc101cd0 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8ddaffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8ddaffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38944/0 (socket says 172.21.15.76:38944) 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.690+0000 7f8ddaffd640 1 -- 172.21.15.76:0/3163434519 learned_addr learned my addr 172.21.15.76:0/3163434519 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddaffd640 1 -- 172.21.15.76:0/3163434519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ddc101cd0 msgr2=0x7f8ddc198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddaffd640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ddc101cd0 0x7f8ddc198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddaffd640 1 -- 172.21.15.76:0/3163434519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 msgr2=0x7f8ddc19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddb7fe640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 0x7f8ddc19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddaffd640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 0x7f8ddc19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddaffd640 1 -- 172.21.15.76:0/3163434519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc19fc00 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddb7fe640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 0x7f8ddc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8ddaffd640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc197fd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc005ab0 tx=0x7f8dcc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc03f030 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8dcc003d00 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc19fe90 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc035070 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.691+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc1a02e0 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.692+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc1a05d0 con 0x7f8ddc100ad0 2024-09-19T07:50:54.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.693+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8dcc042030 con 0x7f8ddc100ad0 2024-09-19T07:50:54.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.694+0000 7f8dd8ff9640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8dc80a3300 0x7f8dc80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:54.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.694+0000 7f8dd27fc640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8dc80a3300 0x7f8dc80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:54.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.694+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f8dcc0f0350 con 0x7f8ddc100ad0 2024-09-19T07:50:54.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.694+0000 7f8dd27fc640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8dc80a3300 0x7f8dc80a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4005fd0 tx=0x7f8dc4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:54.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.697+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dcc0bcef0 con 0x7f8ddc100ad0 2024-09-19T07:50:54.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.903+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8ddc1a08c0 con 0x7f8ddc100ad0 2024-09-19T07:50:54.903 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:54 smithi076 ceph-mon[30930]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:54.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.903+0000 7f8dd8ff9640 1 -- 172.21.15.76:0/3163434519 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3089 (secure 0 0 0) 0x7f8dcc0bc7f0 con 0x7f8ddc100ad0 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:e24 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:btime 2024-09-19T07:49:39:630718+0000 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:legacy client fscid: 1 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:fs_name cephfs 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:epoch 24 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:created 2024-09-19T07:49:28.218932+0000 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:modified 2024-09-19T07:49:39.257174+0000 2024-09-19T07:50:54.904 INFO:teuthology.orchestra.run.smithi076.stdout:tableserver 0 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:root 0 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:session_timeout 300 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:session_autoclose 300 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:max_file_size 1099511627776 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:max_xattr_size 65536 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:required_client_features {} 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:last_failure 0 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:last_failure_osd_epoch 0 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:max_mds 3 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:in 0,1,2 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:up {0=24478,1=24458,2=24457} 2024-09-19T07:50:54.905 INFO:teuthology.orchestra.run.smithi076.stdout:failed 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:damaged 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:stopped 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:data_pools [3] 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:metadata_pool 2 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:inline_data disabled 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:balancer 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:bal_rank_mask -1 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:standby_count_wanted 0 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:qdb_cluster leader: 24478 members: 24457,24458,24478 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.i{0:24478} state up:active seq 6 addr [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.f{0:24451} state up:standby-replay seq 1 addr [v2:172.21.15.152:6834/266318645,v1:172.21.15.152:6835/266318645] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b{1:24458} state up:active seq 6 addr [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.906 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.h{1:24422} state up:standby-replay seq 1 addr [v2:172.21.15.137:6836/1714762912,v1:172.21.15.137:6837/1714762912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.c{2:24457} state up:active seq 10 addr [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.l{2:24412} state up:standby-replay seq 1 addr [v2:172.21.15.152:6832/4080590897,v1:172.21.15.152:6833/4080590897] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:Standby daemons: 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.76:6834/1242982400,v1:172.21.15.76:6835/1242982400] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.76:6836/3127929213,v1:172.21.15.76:6837/3127929213] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.g{-1:14595} state up:standby seq 1 addr [v2:172.21.15.76:6838/654330768,v1:172.21.15.76:6839/654330768] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a{-1:14601} state up:standby seq 1 addr [v2:172.21.15.76:6840/57923082,v1:172.21.15.76:6841/57923082] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.k{-1:24368} state up:standby seq 1 addr [v2:172.21.15.137:6832/4027949156,v1:172.21.15.137:6833/4027949156] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.907 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.e{-1:24395} state up:standby seq 1 addr [v2:172.21.15.137:6834/1108325659,v1:172.21.15.137:6835/1108325659] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:50:54.908 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:50:54.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8dc80a3300 msgr2=0x7f8dc80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:54.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8dc80a3300 0x7f8dc80a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4005fd0 tx=0x7f8dc4005850 comp rx=0 tx=0).stop 2024-09-19T07:50:54.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 msgr2=0x7f8ddc197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc197fd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc005ab0 tx=0x7f8dcc0042f0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 shutdown_connections 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8dc80a3300 0x7f8dc80a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ddc102690 0x7f8ddc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ddc101cd0 0x7f8ddc198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 --2- 172.21.15.76:0/3163434519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ddc100ad0 0x7f8ddc197fd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:54.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 >> 172.21.15.76:0/3163434519 conn(0x7f8ddc0fc280 msgr2=0x7f8ddc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:54.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 shutdown_connections 2024-09-19T07:50:54.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:54.906+0000 7f8de15f3640 1 -- 172.21.15.76:0/3163434519 wait complete. 2024-09-19T07:50:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:54 smithi152 ceph-mon[35117]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:55.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:54 smithi137 ceph-mon[35309]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:50:55.569 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T07:50:55.819 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:56.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:55 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3163434519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:50:56.073 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:55 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3163434519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:50:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:55 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3163434519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:50:56.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.264+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/907969639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 msgr2=0x7f3bf0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:56.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.264+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/907969639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf0108f60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009ca0 tx=0x7f3be802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/907969639 shutdown_connections 2024-09-19T07:50:56.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/907969639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf0108f60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/907969639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0101d10 0x7f3bf0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/907969639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf0100b10 0x7f3bf0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/907969639 >> 172.21.15.76:0/907969639 conn(0x7f3bf00fc2a0 msgr2=0x7f3bf00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/907969639 shutdown_connections 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/907969639 wait complete. 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 Processor -- start 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.265+0000 7f3bf4f0c640 1 -- start start 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0100b10 0x7f3bf010b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf0101d10 0x7f3bf0109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf010a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf010dad0 con 0x7f3bf01026d0 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf010d950 con 0x7f3bf0100b10 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf010dc50 con 0x7f3bf0101d10 2024-09-19T07:50:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf010a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf010a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38964/0 (socket says 172.21.15.76:38964) 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 -- 172.21.15.76:0/758248648 learned_addr learned my addr 172.21.15.76:0/758248648 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bee59c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0100b10 0x7f3bf010b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bedd9b640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf0101d10 0x7f3bf0109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 -- 172.21.15.76:0/758248648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf0101d10 msgr2=0x7f3bf0109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf0101d10 0x7f3bf0109ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 -- 172.21.15.76:0/758248648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0100b10 msgr2=0x7f3bf010b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0100b10 0x7f3bf010b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 -- 172.21.15.76:0/758248648 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf010a8e0 con 0x7f3bf01026d0 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bee59c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0100b10 0x7f3bf010b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3beed9d640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf010a020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009dc0 tx=0x7f3be802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be802fe40 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf01a2230 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3be8030ac0 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8046bb0 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.266+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf01a2810 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.267+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf0107f10 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.269+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3be8030c70 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.270+0000 7f3be77fe640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3bdc0a32d0 0x7f3bdc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.270+0000 7f3bee59c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3bdc0a32d0 0x7f3bdc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.270+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f3be80f1360 con 0x7f3bf01026d0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.271+0000 7f3bee59c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3bdc0a32d0 0x7f3bdc0a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0101b70 tx=0x7f3bd8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:56.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.273+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3be80be010 con 0x7f3bf01026d0 2024-09-19T07:50:56.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.439+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f3bf0062df0 con 0x7f3bf01026d0 2024-09-19T07:50:56.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.440+0000 7f3be77fe640 1 -- 172.21.15.76:0/758248648 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5340 (secure 0 0 0) 0x7f3be80bd910 con 0x7f3bf01026d0 2024-09-19T07:50:56.440 INFO:teuthology.orchestra.run.smithi076.stdout:epoch 84 2024-09-19T07:50:56.440 INFO:teuthology.orchestra.run.smithi076.stdout:fsid 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:created 2024-09-19T07:41:37.923757+0000 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:modified 2024-09-19T07:50:34.014599+0000 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:crush_version 26 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:full_ratio 0.95 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:backfillfull_ratio 0.9 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:nearfull_ratio 0.85 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:require_min_compat_client luminous 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:min_compat_client luminous 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:require_osd_release squid 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:stretch_mode_enabled false 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T07:50:56.441 INFO:teuthology.orchestra.run.smithi076.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:max_osd 12 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6802/3678505020,v1:172.21.15.76:6803/3678505020] [v2:172.21.15.76:6804/3678505020,v1:172.21.15.76:6805/3678505020] exists,up bbcd7216-2e99-403b-b350-f556959ce4af 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6800/943192386,v1:172.21.15.137:6801/943192386] [v2:172.21.15.137:6802/943192386,v1:172.21.15.137:6803/943192386] exists,up b6e0be59-8380-49cd-a4af-bd63b01ea789 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6800/3696302179,v1:172.21.15.152:6801/3696302179] [v2:172.21.15.152:6802/3696302179,v1:172.21.15.152:6803/3696302179] exists,up d9a747d3-c188-4867-979e-0bda4e6c30c9 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6810/1561520625,v1:172.21.15.76:6811/1561520625] [v2:172.21.15.76:6812/1561520625,v1:172.21.15.76:6813/1561520625] exists,up a6ebdf0e-f8b8-473b-919a-2f129822ad89 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.4 up in weight 1 up_from 33 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6808/2368598531,v1:172.21.15.137:6809/2368598531] [v2:172.21.15.137:6810/2368598531,v1:172.21.15.137:6811/2368598531] exists,up d3915b62-fdff-42fc-a586-f5ec5d2aba91 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6808/1589616787,v1:172.21.15.152:6809/1589616787] [v2:172.21.15.152:6810/1589616787,v1:172.21.15.152:6811/1589616787] exists,up dd332d73-a236-4f57-81a1-c971286b9034 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.6 up in weight 1 up_from 45 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6818/3902035917,v1:172.21.15.76:6819/3902035917] [v2:172.21.15.76:6820/3902035917,v1:172.21.15.76:6821/3902035917] exists,up a799bfc9-78c1-4d99-b9f5-4a80371e957e 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.7 up in weight 1 up_from 49 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6816/3569961551,v1:172.21.15.137:6817/3569961551] [v2:172.21.15.137:6818/3569961551,v1:172.21.15.137:6819/3569961551] exists,up 2f89e262-1002-4e2c-b312-aead48b74d7e 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.8 up in weight 1 up_from 56 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6816/2407728016,v1:172.21.15.152:6817/2407728016] [v2:172.21.15.152:6818/2407728016,v1:172.21.15.152:6819/2407728016] exists,up 799b54bb-4284-41b5-8cc1-d139b9dae6d2 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6826/356414316,v1:172.21.15.76:6827/356414316] [v2:172.21.15.76:6828/356414316,v1:172.21.15.76:6829/356414316] exists,up 156eab9f-4c2f-4ff4-b26b-f9100ca01236 2024-09-19T07:50:56.442 INFO:teuthology.orchestra.run.smithi076.stdout:osd.10 up in weight 1 up_from 69 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6824/3618747545,v1:172.21.15.137:6825/3618747545] [v2:172.21.15.137:6826/3618747545,v1:172.21.15.137:6827/3618747545] exists,up 167970e0-dbe5-4fed-91bd-df956725da30 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6824/4215098574,v1:172.21.15.152:6825/4215098574] [v2:172.21.15.152:6826/4215098574,v1:172.21.15.152:6827/4215098574] exists,up 09775c03-0d7f-4443-99af-1ccf1bb95342 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 2.16 [2,4] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 2.1d [2,4] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 2.1f [8,1] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.2 [3,9] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.11 [5,9] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.1b [4,7] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.27 [4,6] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.2a [3,8] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_upmap_items 3.31 [4,8] 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/2956537166 expires 2024-09-20T07:42:32.492367+0000 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6800/1863850030 expires 2024-09-20T07:42:32.492367+0000 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6801/1863850030 expires 2024-09-20T07:42:32.492367+0000 2024-09-19T07:50:56.443 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/1478676464 expires 2024-09-20T07:42:09.273307+0000 2024-09-19T07:50:56.444 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/3080154999 expires 2024-09-20T07:42:09.273307+0000 2024-09-19T07:50:56.444 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/2035316692 expires 2024-09-20T07:42:32.492367+0000 2024-09-19T07:50:56.444 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/921925698 expires 2024-09-20T07:42:09.273307+0000 2024-09-19T07:50:56.444 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6801/2265753650 expires 2024-09-20T07:42:09.273307+0000 2024-09-19T07:50:56.444 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:0/3431326120 expires 2024-09-20T07:42:32.492367+0000 2024-09-19T07:50:56.444 INFO:teuthology.orchestra.run.smithi076.stdout:blocklist 172.21.15.76:6800/2265753650 expires 2024-09-20T07:42:09.273307+0000 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.442+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3bdc0a32d0 msgr2=0x7f3bdc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.442+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3bdc0a32d0 0x7f3bdc0a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0101b70 tx=0x7f3bd8008040 comp rx=0 tx=0).stop 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.442+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 msgr2=0x7f3bf010a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.442+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf010a020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009dc0 tx=0x7f3be802f840 comp rx=0 tx=0).stop 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 shutdown_connections 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf01026d0 0x7f3bf010a020 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf0101d10 0x7f3bf0109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f3bdc0a32d0 0x7f3bdc0a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 --2- 172.21.15.76:0/758248648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0100b10 0x7f3bf010b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 >> 172.21.15.76:0/758248648 conn(0x7f3bf00fc2a0 msgr2=0x7f3bf01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 shutdown_connections 2024-09-19T07:50:56.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:56.443+0000 7f3bf4f0c640 1 -- 172.21.15.76:0/758248648 wait complete. 2024-09-19T07:50:57.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:56 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/758248648' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:50:57.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:56 smithi152 ceph-mon[35117]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:57.108 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:56 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/758248648' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:50:57.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:56 smithi076 ceph-mon[30930]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:57.137 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T07:50:57.149 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:50:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:56 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/758248648' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:50:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:56 smithi137 ceph-mon[35309]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:50:57.395 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:57.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 -- 172.21.15.76:0/4117082868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 msgr2=0x7f8ea01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/4117082868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea01067e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009900 tx=0x7f8e9002a410 comp rx=0 tx=0).stop 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 -- 172.21.15.76:0/4117082868 shutdown_connections 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/4117082868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea0106f10 0x7f8ea010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/4117082868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea01067e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/4117082868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0101de0 0x7f8ea01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 -- 172.21.15.76:0/4117082868 >> 172.21.15.76:0/4117082868 conn(0x7f8ea00fd8c0 msgr2=0x7f8ea00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 -- 172.21.15.76:0/4117082868 shutdown_connections 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.919+0000 7f8ea82c1640 1 -- 172.21.15.76:0/4117082868 wait complete. 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 Processor -- start 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 -- start start 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea0101de0 0x7f8ea01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:57.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0106f10 0x7f8ea019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea01120d0 con 0x7f8ea0102790 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0111f50 con 0x7f8ea0101de0 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea82c1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0112250 con 0x7f8ea0106f10 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.920+0000 7f8ea585c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea0198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38980/0 (socket says 172.21.15.76:38980) 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 -- 172.21.15.76:0/1528955718 learned_addr learned my addr 172.21.15.76:0/1528955718 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea605d640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea0101de0 0x7f8ea01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea685e640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0106f10 0x7f8ea019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 -- 172.21.15.76:0/1528955718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0106f10 msgr2=0x7f8ea019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0106f10 0x7f8ea019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:57.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 -- 172.21.15.76:0/1528955718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea0101de0 msgr2=0x7f8ea01984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea0101de0 0x7f8ea01984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 -- 172.21.15.76:0/1528955718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea019d4a0 con 0x7f8ea0102790 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea685e640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0106f10 0x7f8ea019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea585c640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea0198a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006010 tx=0x7f8e900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9003f030 con 0x7f8ea0102790 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea019d730 con 0x7f8ea0102790 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e90003d00 con 0x7f8ea0102790 2024-09-19T07:50:57.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90035070 con 0x7f8ea0102790 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.921+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea01a5070 con 0x7f8ea0102790 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.922+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea01032c0 con 0x7f8ea0102790 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.923+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8e90042030 con 0x7f8ea0102790 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.924+0000 7f8e977fe640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e8c0a32d0 0x7f8e8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.924+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f8e900f0720 con 0x7f8ea0102790 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.924+0000 7f8ea605d640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e8c0a32d0 0x7f8e8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.924+0000 7f8ea605d640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e8c0a32d0 0x7f8e8c0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009890 tx=0x7f8e9c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:57.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:57.928+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e900bd2c0 con 0x7f8ea0102790 2024-09-19T07:50:58.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.131+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ea010a0f0 con 0x7f8ea0102790 2024-09-19T07:50:58.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.131+0000 7f8e977fe640 1 -- 172.21.15.76:0/1528955718 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7f8e900bcbc0 con 0x7f8ea0102790 2024-09-19T07:50:58.132 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:58.132 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"btime":"2024-09-19T07:49:39:630718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:49:39.257174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:50:58.132 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e8c0a32d0 msgr2=0x7f8e8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e8c0a32d0 0x7f8e8c0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009890 tx=0x7f8e9c008040 comp rx=0 tx=0).stop 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 msgr2=0x7f8ea0198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea0198a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006010 tx=0x7f8e900042f0 comp rx=0 tx=0).stop 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 shutdown_connections 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0106f10 0x7f8ea019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea0102790 0x7f8ea0198a30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f8e8c0a32d0 0x7f8e8c0a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 --2- 172.21.15.76:0/1528955718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea0101de0 0x7f8ea01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 >> 172.21.15.76:0/1528955718 conn(0x7f8ea00fd8c0 msgr2=0x7f8ea00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 shutdown_connections 2024-09-19T07:50:58.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:58.134+0000 7f8ea82c1640 1 -- 172.21.15.76:0/1528955718 wait complete. 2024-09-19T07:50:58.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:58 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1528955718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:58.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:58 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1528955718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:58.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:58 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1528955718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:50:58.885 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:50:59.133 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:50:59.455 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:50:59 smithi076 ceph-mon[30930]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:59.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:50:59 smithi152 ceph-mon[35117]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:59.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/2768701473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4106a80 msgr2=0x7fa4d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:59.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/2768701473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4106a80 0x7fa4d4106e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009930 tx=0x7fa4c402a420 comp rx=0 tx=0).stop 2024-09-19T07:50:59.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/2768701473 shutdown_connections 2024-09-19T07:50:59.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/2768701473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4101420 0x7fa4d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/2768701473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4d4100a80 0x7fa4d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/2768701473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4106a80 0x7fa4d4106e60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/2768701473 >> 172.21.15.76:0/2768701473 conn(0x7fa4d40fc7a0 msgr2=0x7fa4d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/2768701473 shutdown_connections 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.629+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/2768701473 wait complete. 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.630+0000 7fa4d8aa3640 1 Processor -- start 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.630+0000 7fa4d8aa3640 1 -- start start 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4100a80 0x7fa4d41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 0x7fa4d4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4d4106a80 0x7fa4d419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4110fe0 con 0x7fa4d4101420 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4110e60 con 0x7fa4d4100a80 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4111160 con 0x7fa4d4106a80 2024-09-19T07:50:59.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 0x7fa4d4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 0x7fa4d4198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39000/0 (socket says 172.21.15.76:39000) 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 -- 172.21.15.76:0/3634136426 learned_addr learned my addr 172.21.15.76:0/3634136426 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d259c640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4100a80 0x7fa4d41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d2d9d640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4d4106a80 0x7fa4d419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 -- 172.21.15.76:0/3634136426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4d4106a80 msgr2=0x7fa4d419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4d4106a80 0x7fa4d419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 -- 172.21.15.76:0/3634136426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4100a80 msgr2=0x7fa4d41985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4100a80 0x7fa4d41985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 -- 172.21.15.76:0/3634136426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d419d580 con 0x7fa4d4101420 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d259c640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4100a80 0x7fa4d41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4c9d9b640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 0x7fa4d4198b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00b4a0 tx=0x7fa4bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc014070 con 0x7fa4d4101420 2024-09-19T07:50:59.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4bc010b10 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d419d870 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc017d60 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.631+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d41a5150 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.632+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d4100ee0 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.634+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa4bc017070 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.634+0000 7fa4cbfff640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4c00a32d0 0x7fa4c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.634+0000 7fa4d259c640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4c00a32d0 0x7fa4c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.634+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fa4bc0cf1a0 con 0x7fa4d4101420 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.635+0000 7fa4d259c640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4c00a32d0 0x7fa4c00a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4000c00 tx=0x7fa4c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:50:59.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.637+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4bc09be50 con 0x7fa4d4101420 2024-09-19T07:50:59.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:50:59 smithi137 ceph-mon[35309]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:50:59.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.838+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4d4199930 con 0x7fa4d4101420 2024-09-19T07:50:59.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.839+0000 7fa4cbfff640 1 -- 172.21.15.76:0/3634136426 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11915 (secure 0 0 0) 0x7fa4d4199930 con 0x7fa4d4101420 2024-09-19T07:50:59.839 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:50:59.839 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":24,"btime":"2024-09-19T07:49:39:630718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:49:39.257174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:50:59.840 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 24 2024-09-19T07:50:59.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4c00a32d0 msgr2=0x7fa4c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:59.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4c00a32d0 0x7fa4c00a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4000c00 tx=0x7fa4c4005a20 comp rx=0 tx=0).stop 2024-09-19T07:50:59.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 msgr2=0x7fa4d4198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 0x7fa4d4198b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00b4a0 tx=0x7fa4bc00b960 comp rx=0 tx=0).stop 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 shutdown_connections 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4d4106a80 0x7fa4d419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa4d4101420 0x7fa4d4198b10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa4c00a32d0 0x7fa4c00a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 --2- 172.21.15.76:0/3634136426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4d4100a80 0x7fa4d41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.841+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 >> 172.21.15.76:0/3634136426 conn(0x7fa4d40fc7a0 msgr2=0x7fa4d406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.842+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 shutdown_connections 2024-09-19T07:50:59.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:50:59.842+0000 7fa4d8aa3640 1 -- 172.21.15.76:0/3634136426 wait complete. 2024-09-19T07:51:00.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:00 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3634136426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:00.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:00 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3634136426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:00.644 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:51:00.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:00 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3634136426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:00.900 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:01.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 -- 172.21.15.76:0/2590789143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102570 msgr2=0x7f357c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 --2- 172.21.15.76:0/2590789143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102570 0x7f357c1029b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3564009900 tx=0x7f356402a480 comp rx=0 tx=0).stop 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 -- 172.21.15.76:0/2590789143 shutdown_connections 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 --2- 172.21.15.76:0/2590789143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c102ef0 0x7f357c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 --2- 172.21.15.76:0/2590789143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102570 0x7f357c1029b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 --2- 172.21.15.76:0/2590789143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f357c100e20 0x7f357c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 -- 172.21.15.76:0/2590789143 >> 172.21.15.76:0/2590789143 conn(0x7f357c0fc7d0 msgr2=0x7f357c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 -- 172.21.15.76:0/2590789143 shutdown_connections 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 -- 172.21.15.76:0/2590789143 wait complete. 2024-09-19T07:51:01.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.445+0000 7f3582c95640 1 Processor -- start 2024-09-19T07:51:01.447 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:01 smithi076 ceph-mon[30930]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:51:01.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 -- start start 2024-09-19T07:51:01.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c100e20 0x7f357c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f357c102570 0x7f357c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 0x7f357c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f357c1110a0 con 0x7f357c102ef0 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f357c110f20 con 0x7f357c102570 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3582c95640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f357c111220 con 0x7f357c100e20 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 0x7f357c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 0x7f357c19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39024/0 (socket says 172.21.15.76:39024) 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 -- 172.21.15.76:0/86639339 learned_addr learned my addr 172.21.15.76:0/86639339 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3580a31640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c100e20 0x7f357c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f357bfff640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f357c102570 0x7f357c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 -- 172.21.15.76:0/86639339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c100e20 msgr2=0x7f357c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:01.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c100e20 0x7f357c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 -- 172.21.15.76:0/86639339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f357c102570 msgr2=0x7f357c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.446+0000 7f3581232640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f357c102570 0x7f357c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.447+0000 7f3581232640 1 -- 172.21.15.76:0/86639339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357c19d570 con 0x7f357c102ef0 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.447+0000 7f3581232640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 0x7f357c19ce90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e970 tx=0x7f356c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.447+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c00ccc0 con 0x7f357c102ef0 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.447+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f356c00ce60 con 0x7f357c102ef0 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.447+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357c19d860 con 0x7f357c102ef0 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.447+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c010690 con 0x7f357c102ef0 2024-09-19T07:51:01.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.448+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357c1a5140 con 0x7f357c102ef0 2024-09-19T07:51:01.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.449+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357c101200 con 0x7f357c102ef0 2024-09-19T07:51:01.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.450+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f356c0046c0 con 0x7f357c102ef0 2024-09-19T07:51:01.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.450+0000 7f3579ffb640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35680a32d0 0x7f35680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:01.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.450+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f356c0cfe70 con 0x7f357c102ef0 2024-09-19T07:51:01.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.450+0000 7f3580a31640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35680a32d0 0x7f35680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:01.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.451+0000 7f3580a31640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35680a32d0 0x7f35680a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3574005fd0 tx=0x7f3574009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:01.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.455+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f356c09ca10 con 0x7f357c102ef0 2024-09-19T07:51:01.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:01 smithi152 ceph-mon[35117]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:51:01.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.632+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f357c1a5310 con 0x7f357c102ef0 2024-09-19T07:51:01.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.634+0000 7f3579ffb640 1 -- 172.21.15.76:0/86639339 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22775 (secure 0 0 0) 0x7f356c09c310 con 0x7f357c102ef0 2024-09-19T07:51:01.634 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:01.634 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":84,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:50:34.014599+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35680a32d0 msgr2=0x7f35680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35680a32d0 0x7f35680a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3574005fd0 tx=0x7f3574009500 comp rx=0 tx=0).stop 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 msgr2=0x7f357c19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 0x7f357c19ce90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e970 tx=0x7f356c00ed70 comp rx=0 tx=0).stop 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 shutdown_connections 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f357c102ef0 0x7f357c19ce90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f35680a32d0 0x7f35680a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f357c102570 0x7f357c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 --2- 172.21.15.76:0/86639339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c100e20 0x7f357c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:01.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 >> 172.21.15.76:0/86639339 conn(0x7f357c0fc7d0 msgr2=0x7f357c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:01.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 shutdown_connections 2024-09-19T07:51:01.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:01.636+0000 7f3582c95640 1 -- 172.21.15.76:0/86639339 wait complete. 2024-09-19T07:51:01.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:01 smithi137 ceph-mon[35309]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:51:02.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:49:28.218932+0000', 'modified': '2024-09-19T07:49:39.257174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24478, 'mds_1': 24458, 'mds_2': 24457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6833/4080590897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 4080590897}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 4080590897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/1714762912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1714762912}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1714762912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6835/266318645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 266318645}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 266318645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.152:6837/3136720511', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 3136720511}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3136720511}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.137:6839/1413757795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 1413757795}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 1413757795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6839/1843787894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 1843787894}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 1843787894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24478, 'qdb_cluster': [24457, 24458, 24478]} 2024-09-19T07:51:02.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:51:02.399 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T07:51:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:02 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/86639339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:02.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:02 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/86639339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:02.670 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:02.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:02 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/86639339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:03.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 -- 172.21.15.76:0/21432609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff898100480 msgr2=0x7ff898100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 --2- 172.21.15.76:0/21432609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff898100480 0x7ff898100860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff888009900 tx=0x7ff88802a410 comp rx=0 tx=0).stop 2024-09-19T07:51:03.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 -- 172.21.15.76:0/21432609 shutdown_connections 2024-09-19T07:51:03.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 --2- 172.21.15.76:0/21432609 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8981055b0 0x7ff89810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 --2- 172.21.15.76:0/21432609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff898100e30 0x7ff898104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 --2- 172.21.15.76:0/21432609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff898100480 0x7ff898100860 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 -- 172.21.15.76:0/21432609 >> 172.21.15.76:0/21432609 conn(0x7ff898077210 msgr2=0x7ff8980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 -- 172.21.15.76:0/21432609 shutdown_connections 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.181+0000 7ff89c93b640 1 -- 172.21.15.76:0/21432609 wait complete. 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 Processor -- start 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 -- start start 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff898100480 0x7ff898198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff898100e30 0x7ff898198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 0x7ff89819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff898110770 con 0x7ff8981055b0 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff8981105f0 con 0x7ff898100e30 2024-09-19T07:51:03.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89c93b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff8981108f0 con 0x7ff898100480 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 0x7ff89819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 0x7ff89819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39042/0 (socket says 172.21.15.76:39042) 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 -- 172.21.15.76:0/1349644672 learned_addr learned my addr 172.21.15.76:0/1349644672 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff89659c640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff898100480 0x7ff898198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff88ffff640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff898100e30 0x7ff898198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 -- 172.21.15.76:0/1349644672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff898100480 msgr2=0x7ff898198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff898100480 0x7ff898198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 -- 172.21.15.76:0/1349644672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff898100e30 msgr2=0x7ff898198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff898100e30 0x7ff898198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.182+0000 7ff896d9d640 1 -- 172.21.15.76:0/1349644672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89819d540 con 0x7ff8981055b0 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.183+0000 7ff896d9d640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 0x7ff89819ce60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff89000b970 tx=0x7ff89000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.183+0000 7ff88f7fe640 1 -- 172.21.15.76:0/1349644672 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890019070 con 0x7ff8981055b0 2024-09-19T07:51:03.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.183+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89819d830 con 0x7ff8981055b0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.183+0000 7ff88f7fe640 1 -- 172.21.15.76:0/1349644672 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff89000cb40 con 0x7ff8981055b0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.183+0000 7ff88f7fe640 1 -- 172.21.15.76:0/1349644672 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8900076e0 con 0x7ff8981055b0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.183+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981a5110 con 0x7ff8981055b0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.185+0000 7ff88f7fe640 1 -- 172.21.15.76:0/1349644672 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff89001c070 con 0x7ff8981055b0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.185+0000 7ff89ed14740 1 Processor -- start 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.185+0000 7ff88f7fe640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff8840a32d0 0x7ff8840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff88ffff640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff8840a32d0 0x7ff8840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff88f7fe640 1 -- 172.21.15.76:0/1349644672 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7ff8900ceea0 con 0x7ff8981055b0 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 -- start start 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 0x55bcb1edfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1ee02f0 0x55bcb1eea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1eeabb0 0x55bcb1eecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1e46090 con 0x55bcb1edf9d0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1deda70 con 0x55bcb1ee02f0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89ed14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1e42050 con 0x55bcb1eeabb0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 0x55bcb1edfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 0x55bcb1edfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39056/0 (socket says 172.21.15.76:39056) 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff88ffff640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff8840a32d0 0x7ff8840a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff8980ff260 tx=0x7ff88000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 -- 172.21.15.76:0/2321114932 learned_addr learned my addr 172.21.15.76:0/2321114932 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff88ffff640 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1ee02f0 0x55bcb1eea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff896d9d640 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1eeabb0 0x55bcb1eecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 -- 172.21.15.76:0/2321114932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1eeabb0 msgr2=0x55bcb1eecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1eeabb0 0x55bcb1eecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 -- 172.21.15.76:0/2321114932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1ee02f0 msgr2=0x55bcb1eea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1ee02f0 0x55bcb1eea670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 -- 172.21.15.76:0/2321114932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcb1dfa130 con 0x55bcb1edf9d0 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.186+0000 7ff89659c640 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 0x55bcb1edfdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff888009900 tx=0x7ff888031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c73e3a586fee3c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff88cff9640 1 -- 172.21.15.76:0/2321114932 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888040070 con 0x55bcb1edf9d0 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff88cff9640 1 -- 172.21.15.76:0/2321114932 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff888005020 con 0x55bcb1edf9d0 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff88cff9640 1 -- 172.21.15.76:0/2321114932 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888035040 con 0x55bcb1edf9d0 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 -- 172.21.15.76:0/2321114932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 msgr2=0x55bcb1edfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 0x55bcb1edfdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff888009900 tx=0x7ff888031770 comp rx=0 tx=0).stop 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 -- 172.21.15.76:0/2321114932 shutdown_connections 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1eeabb0 0x55bcb1eecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1ee02f0 0x55bcb1eea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 --2- 172.21.15.76:0/2321114932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1edf9d0 0x55bcb1edfdb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 -- 172.21.15.76:0/2321114932 >> 172.21.15.76:0/2321114932 conn(0x55bcb1edbf60 msgr2=0x55bcb1edc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:03.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 -- 172.21.15.76:0/2321114932 shutdown_connections 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.187+0000 7ff89ed14740 1 -- 172.21.15.76:0/2321114932 wait complete. 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 -- start start 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 Processor -- start 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1eea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1ee76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1eed780 con 0x55bcb1ee02f0 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1e00f20 con 0x55bcb1eeabb0 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1eed900 con 0x55bcb1edf9d0 2024-09-19T07:51:03.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89ed14740 10 client.0 _ll_register_callbacks cb 0x55bcb1dca030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1ee76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1ee76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39064/0 (socket says 172.21.15.76:39064) 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 -- 172.21.15.76:0/3723530693 learned_addr learned my addr 172.21.15.76:0/3723530693 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89659c640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1eea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 -- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 msgr2=0x55bcb1eea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1eea390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 -- 172.21.15.76:0/3723530693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 msgr2=0x55bcb1ee7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff896d9d640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff88ffff640 1 -- 172.21.15.76:0/3723530693 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcb1bb72b0 con 0x55bcb1ee02f0 2024-09-19T07:51:03.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff89659c640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1eea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.188+0000 7ff896d9d640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1ee76e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff88001de30 tx=0x7ff880004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e7bfe8ac347c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff87dffb640 1 -- 172.21.15.76:0/3723530693 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880016070 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff87dffb640 1 -- 172.21.15.76:0/3723530693 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7ff880005220 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff888005020 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff87dffb640 1 -- 172.21.15.76:0/3723530693 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff880005420 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 10 client.15072 fetch_fsmap learned FSMap version 24 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bcb1ef9040 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff87dffb640 1 -- 172.21.15.76:0/3723530693 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff888005020 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff87dffb640 1 -- 172.21.15.76:0/3723530693 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff880024030 con 0x55bcb1ee02f0 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 10 client.15072 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:51:03.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 10 client.15072 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 20 client.15072 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1efb770 0x55bcb1efcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 4 client.15072 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.189+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcb1e53600 con 0x55bcb1efb770 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.190+0000 7ff89659c640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1efb770 0x55bcb1efcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.190+0000 7ff89659c640 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1efb770 0x55bcb1efcbe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8dc8983d21e5959c server_cookie=471d5e2e15b012d7 in_seq=0 out_seq=0 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.190+0000 7ff87dffb640 10 client.15072 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff87dffb640 1 -- 172.21.15.76:0/3723530693 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcb1e53600 con 0x55bcb1efb770 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff87dffb640 10 client.15072 handle_command_reply: tid=0 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 client.15072 shutdown 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 msgr2=0x55bcb1ee76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1ee76e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff88001de30 tx=0x7ff880004730 comp rx=0 tx=0).stop 2024-09-19T07:51:03.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 shutdown_connections 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1efb770 0x55bcb1efcbe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1ee76e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3723530693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1eea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 >> 172.21.15.76:0/3723530693 conn(0x55bcb1edbf60 msgr2=0x55bcb1ee1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff87dffb640 0 client.15072 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 shutdown_connections 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 1 -- 172.21.15.76:0/3723530693 wait complete. 2024-09-19T07:51:03.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.191+0000 7ff89ed14740 20 client.15072 trim_cache size 0 max 16384 2024-09-19T07:51:03.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.211+0000 7ff89ed14740 1 Processor -- start 2024-09-19T07:51:03.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.211+0000 7ff89ed14740 1 -- start start 2024-09-19T07:51:03.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff89ed14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1efaf20 con 0x55bcb1ee02f0 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff89ed14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1efb5f0 con 0x55bcb1eeabb0 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff89ed14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1efbcc0 con 0x55bcb1edf9d0 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:42028/0 (socket says 172.21.15.76:42028) 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.212+0000 7ff896d9d640 1 -- 172.21.15.76:0/3170007376 learned_addr learned my addr 172.21.15.76:0/3170007376 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:03.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.213+0000 7ff89659c640 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.213+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.214+0000 7ff88ffff640 1 -- 172.21.15.76:0/3170007376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 msgr2=0x55bcb1efb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.214+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.214+0000 7ff88ffff640 1 -- 172.21.15.76:0/3170007376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 msgr2=0x55bcb1ee6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.214+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.214+0000 7ff88ffff640 1 -- 172.21.15.76:0/3170007376 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcb1eed660 con 0x55bcb1ee02f0 2024-09-19T07:51:03.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.214+0000 7ff88ffff640 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efc510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff88001b7c0 tx=0x7ff88000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e032e794dd8663 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:03.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.216+0000 7ff88f7fe640 1 -- 172.21.15.76:0/1349644672 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff89000ccf0 con 0x7ff8981055b0 2024-09-19T07:51:03.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.216+0000 7ff87ffff640 1 -- 172.21.15.76:0/3170007376 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880034070 con 0x55bcb1ee02f0 2024-09-19T07:51:03.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff87ffff640 1 -- 172.21.15.76:0/3170007376 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff880010c90 con 0x55bcb1ee02f0 2024-09-19T07:51:03.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff87ffff640 1 -- 172.21.15.76:0/3170007376 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880004b20 con 0x55bcb1ee02f0 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 -- 172.21.15.76:0/3170007376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 msgr2=0x55bcb1efc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efc510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff88001b7c0 tx=0x7ff88000a860 comp rx=0 tx=0).stop 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 -- 172.21.15.76:0/3170007376 shutdown_connections 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1eeabb0 0x55bcb1ee6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efc510 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 --2- 172.21.15.76:0/3170007376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 -- 172.21.15.76:0/3170007376 >> 172.21.15.76:0/3170007376 conn(0x55bcb1edbf60 msgr2=0x55bcb1ee76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.217+0000 7ff89ed14740 1 -- 172.21.15.76:0/3170007376 shutdown_connections 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 -- 172.21.15.76:0/3170007376 wait complete. 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 -- start start 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 Processor -- start 2024-09-19T07:51:03.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 0x55bcb1efe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1efca60 con 0x55bcb1eeabb0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1efc390 con 0x55bcb1edf9d0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bcb1efd130 con 0x55bcb1ee02f0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff89ed14740 10 client.0 _ll_register_callbacks cb 0x7ff88000fbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 0x55bcb1efe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff896d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 0x55bcb1efe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39082/0 (socket says 172.21.15.76:39082) 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.218+0000 7ff896d9d640 1 -- 172.21.15.76:0/792490212 learned_addr learned my addr 172.21.15.76:0/792490212 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff88ffff640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89659c640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff896d9d640 1 -- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1ee02f0 msgr2=0x55bcb1efe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff896d9d640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff896d9d640 1 -- 172.21.15.76:0/792490212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1edf9d0 msgr2=0x55bcb1efdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff896d9d640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff896d9d640 1 -- 172.21.15.76:0/792490212 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcb1f6c680 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff896d9d640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 0x55bcb1efe860 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8900cc9c0 tx=0x7ff890091600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98227ea1a10094c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff87dffb640 1 -- 172.21.15.76:0/792490212 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89009b040 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff87dffb640 1 -- 172.21.15.76:0/792490212 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7ff89009a950 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff880010c90 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff87dffb640 1 -- 172.21.15.76:0/792490212 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff89009b2d0 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 10 client.15078 fetch_fsmap learned FSMap version 24 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bcb1f6d980 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff87dffb640 1 -- 172.21.15.76:0/792490212 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff880010c90 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff87dffb640 1 -- 172.21.15.76:0/792490212 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff8900a3c30 con 0x55bcb1eeabb0 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 10 client.15078 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:51:03.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 10 client.15078 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:51:03.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 20 client.15078 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:03.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.219+0000 7ff89ed14740 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1f72530 0x55bcb1f71240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:03.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff89ed14740 4 client.15078 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:51:03.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "status"}) -- 0x55bcb1e4db10 con 0x55bcb1f72530 2024-09-19T07:51:03.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff89659c640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1f72530 0x55bcb1f71240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff89659c640 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1f72530 0x55bcb1f71240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7544eb5a2a970cc server_cookie=8d39295492ae8c54 in_seq=0 out_seq=0 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff87dffb640 10 client.15078 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff87dffb640 1 -- 172.21.15.76:0/792490212 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bcb1e4db10 con 0x55bcb1f72530 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff87dffb640 10 client.15078 handle_command_reply: tid=0 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.220+0000 7ff89ed14740 1 client.15078 shutdown 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 msgr2=0x55bcb1efe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 0x55bcb1efe860 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8900cc9c0 tx=0x7ff890091600 comp rx=0 tx=0).stop 2024-09-19T07:51:03.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 shutdown_connections 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55bcb1f72530 0x55bcb1f71240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bcb1eeabb0 0x55bcb1efe860 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bcb1ee02f0 0x55bcb1efe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff87dffb640 0 client.15078 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 --2- 172.21.15.76:0/792490212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bcb1edf9d0 0x55bcb1efdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 >> 172.21.15.76:0/792490212 conn(0x55bcb1edbf60 msgr2=0x55bcb1ee5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 shutdown_connections 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 1 -- 172.21.15.76:0/792490212 wait complete. 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89ed14740 20 client.15078 trim_cache size 0 max 16384 2024-09-19T07:51:03.225 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 2, 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24457, 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 86.605635914999993, 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 84, 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 119.489050943 2024-09-19T07:51:03.226 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff8840a32d0 msgr2=0x7ff8840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff8840a32d0 0x7ff8840a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff8980ff260 tx=0x7ff88000a2d0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 msgr2=0x7ff89819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 0x7ff89819ce60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff89000b970 tx=0x7ff89000be30 comp rx=0 tx=0).stop 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 shutdown_connections 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff8981055b0 0x7ff89819ce60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7ff8840a32d0 0x7ff8840a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff898100e30 0x7ff898198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 --2- 172.21.15.76:0/1349644672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff898100480 0x7ff898198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:03.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 >> 172.21.15.76:0/1349644672 conn(0x7ff898077210 msgr2=0x7ff898107080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:03.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.221+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 shutdown_connections 2024-09-19T07:51:03.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:03.222+0000 7ff89c93b640 1 -- 172.21.15.76:0/1349644672 wait complete. 2024-09-19T07:51:03.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:03 smithi076 ceph-mon[30930]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:51:03.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:03 smithi152 ceph-mon[35117]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:51:03.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:03 smithi137 ceph-mon[35309]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:51:04.009 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:51:04.256 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:04.377 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:04 smithi076 ceph-mon[30930]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T07:51:04.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:04 smithi152 ceph-mon[35117]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T07:51:04.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:04 smithi137 ceph-mon[35309]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T07:51:04.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 -- 172.21.15.76:0/1843460061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370106f10 msgr2=0x7f537010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 --2- 172.21.15.76:0/1843460061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370106f10 0x7f537010ea90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5368009ca0 tx=0x7f536802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 -- 172.21.15.76:0/1843460061 shutdown_connections 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 --2- 172.21.15.76:0/1843460061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370106f10 0x7f537010ea90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 --2- 172.21.15.76:0/1843460061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5370102790 0x7f53701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 --2- 172.21.15.76:0/1843460061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5370101de0 0x7f53701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 -- 172.21.15.76:0/1843460061 >> 172.21.15.76:0/1843460061 conn(0x7f53700fd8c0 msgr2=0x7f53700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 -- 172.21.15.76:0/1843460061 shutdown_connections 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.725+0000 7f5374a70640 1 -- 172.21.15.76:0/1843460061 wait complete. 2024-09-19T07:51:04.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 Processor -- start 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 -- start start 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5370101de0 0x7f53701985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 0x7f5370198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5370106f10 0x7f537019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5370112150 con 0x7f5370102790 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5370111fd0 con 0x7f5370101de0 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f5374a70640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f53701122d0 con 0x7f5370106f10 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f536dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 0x7f5370198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f536dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 0x7f5370198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45370/0 (socket says 172.21.15.76:45370) 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f536dd9b640 1 -- 172.21.15.76:0/169145786 learned_addr learned my addr 172.21.15.76:0/169145786 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.726+0000 7f536ed9d640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5370106f10 0x7f537019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536e59c640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5370101de0 0x7f53701985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536dd9b640 1 -- 172.21.15.76:0/169145786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5370106f10 msgr2=0x7f537019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536dd9b640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5370106f10 0x7f537019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536dd9b640 1 -- 172.21.15.76:0/169145786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5370101de0 msgr2=0x7f53701985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536dd9b640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5370101de0 0x7f53701985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536dd9b640 1 -- 172.21.15.76:0/169145786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537019d5a0 con 0x7f5370102790 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f536dd9b640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 0x7f5370198b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f536000b4a0 tx=0x7f536000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f53677fe640 1 -- 172.21.15.76:0/169145786 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360014070 con 0x7f5370102790 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f53677fe640 1 -- 172.21.15.76:0/169145786 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5360010b10 con 0x7f5370102790 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537019d890 con 0x7f5370102790 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f53677fe640 1 -- 172.21.15.76:0/169145786 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360017d60 con 0x7f5370102790 2024-09-19T07:51:04.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.727+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53701a5170 con 0x7f5370102790 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.729+0000 7f53677fe640 1 -- 172.21.15.76:0/169145786 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5360017070 con 0x7f5370102790 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 Processor -- start 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 -- start start 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x555921122db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592112d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f53677fe640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f535c0a3240 0x7f535c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555921089090 con 0x5559211229d0 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555921030a70 con 0x55592112dbb0 2024-09-19T07:51:04.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f5376e49740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555921085050 con 0x5559211232f0 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f536ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x555921122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f536ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x555921122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45376/0 (socket says 172.21.15.76:45376) 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f536ed9d640 1 -- 172.21.15.76:0/478538500 learned_addr learned my addr 172.21.15.76:0/478538500 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f536ed9d640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f535c0a3240 0x7f535c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f536e59c640 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592112d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f53677fe640 1 -- 172.21.15.76:0/169145786 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f53600cedf0 con 0x7f5370102790 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.730+0000 7f536dd9b640 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 -- 172.21.15.76:0/478538500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 msgr2=0x55592112d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592112d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 -- 172.21.15.76:0/478538500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 msgr2=0x55592112ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 -- 172.21.15.76:0/478538500 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592103d130 con 0x5559211229d0 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x555921122db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5368031f80 tx=0x7f53680316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c358606cb1a5ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f536ed9d640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f535c0a3240 0x7f535c0a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5368005fe0 tx=0x7f5368048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f5364ff9640 1 -- 172.21.15.76:0/478538500 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368031de0 con 0x5559211229d0 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f5364ff9640 1 -- 172.21.15.76:0/478538500 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5368036040 con 0x5559211229d0 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.731+0000 7f5364ff9640 1 -- 172.21.15.76:0/478538500 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368004030 con 0x5559211229d0 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 -- 172.21.15.76:0/478538500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 msgr2=0x555921122db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x555921122db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5368031f80 tx=0x7f53680316b0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 -- 172.21.15.76:0/478538500 shutdown_connections 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592112d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 --2- 172.21.15.76:0/478538500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x555921122db0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 -- 172.21.15.76:0/478538500 >> 172.21.15.76:0/478538500 conn(0x55592111ef60 msgr2=0x55592111f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:04.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 -- 172.21.15.76:0/478538500 shutdown_connections 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 -- 172.21.15.76:0/478538500 wait complete. 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 -- start start 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.732+0000 7f5376e49740 1 Processor -- start 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592112d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559211232f0 0x55592112a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55592112dbb0 0x55592112ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555921130780 con 0x5559211229d0 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555921043f20 con 0x5559211232f0 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555921130900 con 0x55592112dbb0 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 10 client.0 _ll_register_callbacks cb 0x55592100d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592112d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592112d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45392/0 (socket says 172.21.15.76:45392) 2024-09-19T07:51:04.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 -- 172.21.15.76:0/1400929696 learned_addr learned my addr 172.21.15.76:0/1400929696 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536dd9b640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559211232f0 0x55592112a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536ed9d640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55592112dbb0 0x55592112ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 -- 172.21.15.76:0/1400929696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55592112dbb0 msgr2=0x55592112ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55592112dbb0 0x55592112ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 -- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559211232f0 msgr2=0x55592112a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559211232f0 0x55592112a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 -- 172.21.15.76:0/1400929696 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555920dfa2b0 con 0x5559211229d0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f536e59c640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592112d4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f535800f4c0 tx=0x7f535800f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e0d51208093d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5355ffb640 1 -- 172.21.15.76:0/1400929696 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358013850 con 0x5559211229d0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5355ffb640 1 -- 172.21.15.76:0/1400929696 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f53580139f0 con 0x5559211229d0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.733+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5368036040 con 0x5559211229d0 2024-09-19T07:51:04.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5355ffb640 1 -- 172.21.15.76:0/1400929696 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5358013bf0 con 0x5559211229d0 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 10 client.15090 fetch_fsmap learned FSMap version 24 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55592113c150 con 0x5559211229d0 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5355ffb640 1 -- 172.21.15.76:0/1400929696 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5368036040 con 0x5559211229d0 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5355ffb640 1 -- 172.21.15.76:0/1400929696 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f535801b490 con 0x5559211229d0 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 10 client.15090 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 10 client.15090 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 20 client.15090 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55592113e760 0x55592113fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 4 client.15090 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555921096600 con 0x55592113e760 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.734+0000 7f536dd9b640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55592113e760 0x55592113fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.735+0000 7f536dd9b640 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55592113e760 0x55592113fbd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18341f6c2b25f558 server_cookie=440bdd87bdcbac10 in_seq=0 out_seq=0 2024-09-19T07:51:04.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.735+0000 7f5355ffb640 10 client.15090 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.735+0000 7f5355ffb640 1 -- 172.21.15.76:0/1400929696 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555921096600 con 0x55592113e760 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.735+0000 7f5355ffb640 10 client.15090 handle_command_reply: tid=0 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.735+0000 7f5376e49740 1 client.15090 shutdown 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 msgr2=0x55592112d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592112d4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f535800f4c0 tx=0x7f535800f980 comp rx=0 tx=0).stop 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 shutdown_connections 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55592113e760 0x55592113fbd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55592112dbb0 0x55592112ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5355ffb640 0 client.15090 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559211232f0 0x55592112a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 --2- 172.21.15.76:0/1400929696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592112d4b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 >> 172.21.15.76:0/1400929696 conn(0x55592111ef60 msgr2=0x555921124c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:04.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 shutdown_connections 2024-09-19T07:51:04.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 1 -- 172.21.15.76:0/1400929696 wait complete. 2024-09-19T07:51:04.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.736+0000 7f5376e49740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 Processor -- start 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 -- start start 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592113fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592111f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55592113df10 con 0x5559211229d0 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55592113e5e0 con 0x55592112dbb0 2024-09-19T07:51:04.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.753+0000 7f5376e49740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55592113ecb0 con 0x5559211232f0 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592113fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592113fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45394/0 (socket says 172.21.15.76:45394) 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 -- 172.21.15.76:0/1589557611 learned_addr learned my addr 172.21.15.76:0/1589557611 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536ed9d640 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 -- 172.21.15.76:0/1589557611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 msgr2=0x55592111f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592111f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 -- 172.21.15.76:0/1589557611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 msgr2=0x55592112c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 -- 172.21.15.76:0/1589557611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592112d820 con 0x5559211229d0 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536ed9d640 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f536e59c640 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592113fbd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f535800b010 tx=0x7f535800a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d283dbf655bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f5357fff640 1 -- 172.21.15.76:0/1589557611 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358035070 con 0x5559211229d0 2024-09-19T07:51:04.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f5357fff640 1 -- 172.21.15.76:0/1589557611 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f535801bcf0 con 0x5559211229d0 2024-09-19T07:51:04.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.754+0000 7f5357fff640 1 -- 172.21.15.76:0/1589557611 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358005c20 con 0x5559211229d0 2024-09-19T07:51:04.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- 172.21.15.76:0/1589557611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 msgr2=0x55592113fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592113fbd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f535800b010 tx=0x7f535800a180 comp rx=0 tx=0).stop 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- 172.21.15.76:0/1589557611 shutdown_connections 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x55592112c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211232f0 0x55592111f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- 172.21.15.76:0/1589557611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211229d0 0x55592113fbd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- 172.21.15.76:0/1589557611 >> 172.21.15.76:0/1589557611 conn(0x55592111ef60 msgr2=0x55592112bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- 172.21.15.76:0/1589557611 shutdown_connections 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- 172.21.15.76:0/1589557611 wait complete. 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- start start 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 Processor -- start 2024-09-19T07:51:04.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211229d0 0x555921143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 0x555921144090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x5559211445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55592113fa50 con 0x5559211232f0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55592113f380 con 0x55592112dbb0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.755+0000 7f5376e49740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555921140120 con 0x5559211229d0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5376e49740 10 client.0 _ll_register_callbacks cb 0x7f535800a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 0x555921144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 0x555921144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45400/0 (socket says 172.21.15.76:45400) 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 -- 172.21.15.76:0/587530838 learned_addr learned my addr 172.21.15.76:0/587530838 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536ed9d640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x5559211445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536e59c640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211229d0 0x555921143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 -- 172.21.15.76:0/587530838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211229d0 msgr2=0x555921143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211229d0 0x555921143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 -- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 msgr2=0x5559211445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x5559211445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 -- 172.21.15.76:0/587530838 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559211a7e70 con 0x5559211232f0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536ed9d640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x5559211445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536e59c640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211229d0 0x555921143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f536dd9b640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 0x555921144090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f536009b380 tx=0x7f53600177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795611d41e02a9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5355ffb640 1 -- 172.21.15.76:0/587530838 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53600b4020 con 0x5559211232f0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5355ffb640 1 -- 172.21.15.76:0/587530838 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f5360099490 con 0x5559211232f0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535801bcf0 con 0x5559211232f0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5355ffb640 1 -- 172.21.15.76:0/587530838 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f536001e040 con 0x5559211232f0 2024-09-19T07:51:04.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5376e49740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.756+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5559211a9040 con 0x5559211232f0 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5355ffb640 1 -- 172.21.15.76:0/587530838 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f535801bcf0 con 0x5559211232f0 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5355ffb640 1 -- 172.21.15.76:0/587530838 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5360097a60 con 0x5559211232f0 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5376e49740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5376e49740 10 client.15096 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5376e49740 20 client.15096 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5376e49740 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5559211adbd0 0x5559211ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5376e49740 4 client.15096 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "status"}) -- 0x555921090b10 con 0x5559211adbd0 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f536e59c640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5559211adbd0 0x5559211ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f5355ffb640 10 client.15096 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:04.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.757+0000 7f536e59c640 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5559211adbd0 0x5559211ac8e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=268cb59ca59c3f94 server_cookie=479c368ca312fa2a in_seq=0 out_seq=0 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5355ffb640 1 -- 172.21.15.76:0/587530838 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555921090b10 con 0x5559211adbd0 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5355ffb640 10 client.15096 handle_command_reply: tid=0 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 client.15096 shutdown 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 msgr2=0x555921144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 0x555921144090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f536009b380 tx=0x7f53600177c0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 shutdown_connections 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5559211adbd0 0x5559211ac8e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55592112dbb0 0x5559211445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559211232f0 0x555921144090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 --2- 172.21.15.76:0/587530838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559211229d0 0x555921143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 >> 172.21.15.76:0/587530838 conn(0x55592111ef60 msgr2=0x55592111e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5355ffb640 0 client.15096 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 shutdown_connections 2024-09-19T07:51:04.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 1 -- 172.21.15.76:0/587530838 wait complete. 2024-09-19T07:51:04.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5376e49740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T07:51:04.768 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:04.768 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:51:04.768 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 1, 2024-09-19T07:51:04.768 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24458, 2024-09-19T07:51:04.768 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 89.149315118999994, 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 84, 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 107.018866691 2024-09-19T07:51:04.769 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f535c0a3240 msgr2=0x7f535c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5374a70640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f535c0a3240 0x7f535c0a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5368005fe0 tx=0x7f5368048000 comp rx=0 tx=0).stop 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 msgr2=0x7f5370198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5374a70640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 0x7f5370198b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f536000b4a0 tx=0x7f536000b960 comp rx=0 tx=0).stop 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 shutdown_connections 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.758+0000 7f5374a70640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5370106f10 0x7f537019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.759+0000 7f5374a70640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5370102790 0x7f5370198b30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.759+0000 7f5374a70640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f535c0a3240 0x7f535c0a5700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.759+0000 7f5374a70640 1 --2- 172.21.15.76:0/169145786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5370101de0 0x7f53701985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:04.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.759+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 >> 172.21.15.76:0/169145786 conn(0x7f53700fd8c0 msgr2=0x7f53700fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:04.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.759+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 shutdown_connections 2024-09-19T07:51:04.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:04.759+0000 7f5374a70640 1 -- 172.21.15.76:0/169145786 wait complete. 2024-09-19T07:51:05.418 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:51:05.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:05 smithi152 ceph-mon[35117]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:51:05.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:05 smithi137 ceph-mon[35309]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:51:05.664 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:05.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:05 smithi076 ceph-mon[30930]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:51:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.200+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/4036003783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a1410c180 msgr2=0x7f2a1410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.200+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/4036003783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a1410c180 0x7f2a1410e610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009900 tx=0x7f2a0c02a480 comp rx=0 tx=0).stop 2024-09-19T07:51:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/4036003783 shutdown_connections 2024-09-19T07:51:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/4036003783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a1410c180 0x7f2a1410e610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/4036003783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a14103700 0x7f2a1410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/4036003783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a14102de0 0x7f2a141031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/4036003783 >> 172.21.15.76:0/4036003783 conn(0x7f2a140fc7a0 msgr2=0x7f2a140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/4036003783 shutdown_connections 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/4036003783 wait complete. 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 Processor -- start 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 -- start start 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a14102de0 0x7f2a141984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 0x7f2a14198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.201+0000 7f2a1b0ad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a1410c180 0x7f2a1419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a1b0ad640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a14112090 con 0x7f2a14103700 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a1b0ad640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a14111f10 con 0x7f2a1410c180 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a1b0ad640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a14112210 con 0x7f2a14102de0 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 0x7f2a14198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 0x7f2a14198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45412/0 (socket says 172.21.15.76:45412) 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 -- 172.21.15.76:0/3317541660 learned_addr learned my addr 172.21.15.76:0/3317541660 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a18e49640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a14102de0 0x7f2a141984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a1964a640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a1410c180 0x7f2a1419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 -- 172.21.15.76:0/3317541660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a14102de0 msgr2=0x7f2a141984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a14102de0 0x7f2a141984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 -- 172.21.15.76:0/3317541660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a1410c180 msgr2=0x7f2a1419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a1410c180 0x7f2a1419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 -- 172.21.15.76:0/3317541660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1419d480 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a13fff640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 0x7f2a14198a10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c890 tx=0x7f29fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a11ffb640 1 -- 172.21.15.76:0/3317541660 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc004220 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a11ffb640 1 -- 172.21.15.76:0/3317541660 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29fc0043c0 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1419d770 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.202+0000 7f2a11ffb640 1 -- 172.21.15.76:0/3317541660 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc004b10 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.203+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a141a5050 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a11ffb640 1 -- 172.21.15.76:0/3317541660 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f29fc0051b0 con 0x7f2a14103700 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 Processor -- start 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 -- start start 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a11ffb640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2a000a32c0 0x7f2a000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ac890 0x5564535acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1964a640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2a000a32c0 0x7f2a000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 0x5564535be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556453513090 con 0x5564535bbfc0 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5564534baa70 con 0x5564535ad1b0 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.205+0000 7f2a1d486740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55645350f050 con 0x5564535ac890 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a11ffb640 1 -- 172.21.15.76:0/3317541660 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f29fc0cf8b0 con 0x7f2a14103700 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a1964a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 0x5564535be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a1964a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 0x5564535be3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45418/0 (socket says 172.21.15.76:45418) 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a1964a640 1 -- 172.21.15.76:0/3881273293 learned_addr learned my addr 172.21.15.76:0/3881273293 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ac890 0x5564535acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a13fff640 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a1964a640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2a000a32c0 0x7f2a000a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c033000 tx=0x7f2a0c031900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 -- 172.21.15.76:0/3881273293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 msgr2=0x5564535bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 -- 172.21.15.76:0/3881273293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 msgr2=0x5564535be3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 0x5564535be3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 -- 172.21.15.76:0/3881273293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564534c7130 con 0x5564535ac890 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a1964a640 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 0x5564535be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a18e49640 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ac890 0x5564535acc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400ae70 tx=0x7f2a0400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2944a1a48c8e94ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a0affd640 1 -- 172.21.15.76:0/3881273293 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04003b70 con 0x5564535ac890 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a0affd640 1 -- 172.21.15.76:0/3881273293 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a04003d10 con 0x5564535ac890 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.206+0000 7f2a0affd640 1 -- 172.21.15.76:0/3881273293 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04010b80 con 0x5564535ac890 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 -- 172.21.15.76:0/3881273293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ac890 msgr2=0x5564535acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ac890 0x5564535acc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400ae70 tx=0x7f2a0400f790 comp rx=0 tx=0).stop 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 -- 172.21.15.76:0/3881273293 shutdown_connections 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535bbfc0 0x5564535be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 --2- 172.21.15.76:0/3881273293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ac890 0x5564535acc70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 -- 172.21.15.76:0/3881273293 >> 172.21.15.76:0/3881273293 conn(0x5564535a8f60 msgr2=0x5564535a9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 -- 172.21.15.76:0/3881273293 shutdown_connections 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.207+0000 7f2a1d486740 1 -- 172.21.15.76:0/3881273293 wait complete. 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 -- start start 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 Processor -- start 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535bb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ad1b0 0x5564535b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535bbfc0 0x5564535b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5564535beb90 con 0x5564535ac890 2024-09-19T07:51:06.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5564534cdf20 con 0x5564535bbfc0 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5564535bed10 con 0x5564535ad1b0 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1d486740 10 client.0 _ll_register_callbacks cb 0x556453497030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535bb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45422/0 (socket says 172.21.15.76:45422) 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 -- 172.21.15.76:0/2280243917 learned_addr learned my addr 172.21.15.76:0/2280243917 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a13fff640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ad1b0 0x5564535b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a1964a640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535bbfc0 0x5564535b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 -- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ad1b0 msgr2=0x5564535b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ad1b0 0x5564535b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 -- 172.21.15.76:0/2280243917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535bbfc0 msgr2=0x5564535b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535bbfc0 0x5564535b8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.208+0000 7f2a18e49640 1 -- 172.21.15.76:0/2280243917 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564532842b0 con 0x5564535ac890 2024-09-19T07:51:06.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a18e49640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535bb700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400fc90 tx=0x7f2a04004cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2f71686cbfa045 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f29f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f29f3fff640 1 -- 172.21.15.76:0/2280243917 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04027020 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a04003d10 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f29f3fff640 1 -- 172.21.15.76:0/2280243917 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f2a04010a90 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f29f3fff640 1 -- 172.21.15.76:0/2280243917 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2a04032050 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 10 client.15108 fetch_fsmap learned FSMap version 24 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5564535ca3b0 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f29f3fff640 1 -- 172.21.15.76:0/2280243917 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a04003d10 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f29f3fff640 1 -- 172.21.15.76:0/2280243917 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2a04023470 con 0x5564535ac890 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 10 client.15108 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 10 client.15108 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:51:06.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 20 client.15108 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x5564535cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 4 client.15108 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.209+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556453520600 con 0x5564535cc5d0 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.210+0000 7f2a13fff640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x5564535cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.210+0000 7f29f3fff640 10 client.15108 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.210+0000 7f2a13fff640 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x5564535cda40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edcb1a8bab4ed4e0 server_cookie=def21dbf57390d08 in_seq=0 out_seq=0 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f29f3fff640 1 -- 172.21.15.76:0/2280243917 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556453520600 con 0x5564535cc5d0 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f29f3fff640 10 client.15108 handle_command_reply: tid=0 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 client.15108 shutdown 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 msgr2=0x5564535bb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535bb700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400fc90 tx=0x7f2a04004cd0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 shutdown_connections 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535bbfc0 0x5564535b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535ad1b0 0x5564535b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x5564535cda40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2280243917 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535bb700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f29f3fff640 0 client.15108 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:06.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 >> 172.21.15.76:0/2280243917 conn(0x5564535a8f60 msgr2=0x5564535aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:06.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 shutdown_connections 2024-09-19T07:51:06.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 1 -- 172.21.15.76:0/2280243917 wait complete. 2024-09-19T07:51:06.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.211+0000 7f2a1d486740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 Processor -- start 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 -- start start 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5564535cbd80 con 0x5564535ac890 2024-09-19T07:51:06.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5564535cc450 con 0x5564535ad1b0 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a1d486740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5564535ccb20 con 0x5564535bbfc0 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a18e49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a18e49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45428/0 (socket says 172.21.15.76:45428) 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.229+0000 7f2a18e49640 1 -- 172.21.15.76:0/2741028934 learned_addr learned my addr 172.21.15.76:0/2741028934 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a13fff640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a1964a640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a18e49640 1 -- 172.21.15.76:0/2741028934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 msgr2=0x5564535b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a18e49640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a18e49640 1 -- 172.21.15.76:0/2741028934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 msgr2=0x5564535b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a18e49640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a18e49640 1 -- 172.21.15.76:0/2741028934 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564535b9370 con 0x5564535ac890 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a13fff640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a1964a640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a18e49640 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535cda40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400a6e0 tx=0x7f2a0400a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9645e73835892585 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:06.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a0a7fc640 1 -- 172.21.15.76:0/2741028934 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04027040 con 0x5564535ac890 2024-09-19T07:51:06.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a0a7fc640 1 -- 172.21.15.76:0/2741028934 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a0403b070 con 0x5564535ac890 2024-09-19T07:51:06.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.230+0000 7f2a0a7fc640 1 -- 172.21.15.76:0/2741028934 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04018440 con 0x5564535ac890 2024-09-19T07:51:06.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- 172.21.15.76:0/2741028934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 msgr2=0x5564535cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535cda40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400a6e0 tx=0x7f2a0400a770 comp rx=0 tx=0).stop 2024-09-19T07:51:06.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- 172.21.15.76:0/2741028934 shutdown_connections 2024-09-19T07:51:06.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- 172.21.15.76:0/2741028934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535cda40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- 172.21.15.76:0/2741028934 >> 172.21.15.76:0/2741028934 conn(0x5564535a8f60 msgr2=0x5564535a3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- 172.21.15.76:0/2741028934 shutdown_connections 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- 172.21.15.76:0/2741028934 wait complete. 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- start start 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 Processor -- start 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535d6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5564535cd8c0 con 0x5564535ac890 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5564535cd1f0 con 0x5564535ad1b0 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.231+0000 7f2a1d486740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5564535cdf90 con 0x5564535bbfc0 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a1d486740 10 client.0 _ll_register_callbacks cb 0x7f2a0400acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535d6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45442/0 (socket says 172.21.15.76:45442) 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 -- 172.21.15.76:0/617071984 learned_addr learned my addr 172.21.15.76:0/617071984 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a1964a640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 -- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 msgr2=0x5564535b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 -- 172.21.15.76:0/617071984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 msgr2=0x5564535b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a13fff640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 -- 172.21.15.76:0/617071984 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564535b6200 con 0x5564535ac890 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a1964a640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a13fff640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a18e49640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535d6280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2a040236d0 tx=0x7f2a0400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5159561a40974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f29f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f29f3fff640 1 -- 172.21.15.76:0/617071984 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04027070 con 0x5564535ac890 2024-09-19T07:51:06.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f29f3fff640 1 -- 172.21.15.76:0/617071984 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f2a04010ca0 con 0x5564535ac890 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a0403b070 con 0x5564535ac890 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f29f3fff640 1 -- 172.21.15.76:0/617071984 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2a04023a30 con 0x5564535ac890 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a1d486740 10 client.15114 fetch_fsmap learned FSMap version 24 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.232+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5564535d4b40 con 0x5564535ac890 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f29f3fff640 1 -- 172.21.15.76:0/617071984 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a0403b070 con 0x5564535ac890 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f29f3fff640 1 -- 172.21.15.76:0/617071984 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2a04036430 con 0x5564535ac890 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a1d486740 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a1d486740 10 client.15114 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a1d486740 20 client.15114 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a1d486740 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x556453639f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a1d486740 4 client.15114 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "status"}) -- 0x55645351ab10 con 0x5564535cc5d0 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.233+0000 7f2a13fff640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x556453639f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a13fff640 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x556453639f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18577e524eef15f8 server_cookie=728431aabfa3e27 in_seq=0 out_seq=0 2024-09-19T07:51:06.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f29f3fff640 10 client.15114 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f29f3fff640 1 -- 172.21.15.76:0/617071984 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55645351ab10 con 0x5564535cc5d0 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f29f3fff640 10 client.15114 handle_command_reply: tid=0 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 client.15114 shutdown 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 msgr2=0x5564535d6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535d6280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2a040236d0 tx=0x7f2a0400fd10 comp rx=0 tx=0).stop 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 shutdown_connections 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5564535bbfc0 0x5564535b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5564535ad1b0 0x5564535b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5564535cc5d0 0x556453639f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 --2- 172.21.15.76:0/617071984 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5564535ac890 0x5564535d6280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f29f3fff640 0 client.15114 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 >> 172.21.15.76:0/617071984 conn(0x5564535a8f60 msgr2=0x5564535b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:06.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 shutdown_connections 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 1 -- 172.21.15.76:0/617071984 wait complete. 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.234+0000 7f2a1d486740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24478, 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:51:06.240 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 97.661420433000004, 2024-09-19T07:51:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 24, 2024-09-19T07:51:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 84, 2024-09-19T07:51:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T07:51:06.241 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 117.270199803 2024-09-19T07:51:06.241 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2a000a32c0 msgr2=0x7f2a000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2a000a32c0 0x7f2a000a5780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c033000 tx=0x7f2a0c031900 comp rx=0 tx=0).stop 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 msgr2=0x7f2a14198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 0x7f2a14198a10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c890 tx=0x7f29fc00cd50 comp rx=0 tx=0).stop 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 shutdown_connections 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f2a000a32c0 0x7f2a000a5780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a1410c180 0x7f2a1419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a14103700 0x7f2a14198a10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 --2- 172.21.15.76:0/3317541660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a14102de0 0x7f2a141984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:06.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 >> 172.21.15.76:0/3317541660 conn(0x7f2a140fc7a0 msgr2=0x7f2a140fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:06.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 shutdown_connections 2024-09-19T07:51:06.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:06.235+0000 7f2a1b0ad640 1 -- 172.21.15.76:0/3317541660 wait complete. 2024-09-19T07:51:07.023 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T07:51:07.037 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T07:51:07.037 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T07:51:07.038 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T07:51:07.038 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T07:51:07.038 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:51:07.039 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:51:07.039 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T07:51:07.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 -- 172.21.15.76:0/714082236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76541016e0 msgr2=0x7f7654108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 --2- 172.21.15.76:0/714082236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76541016e0 0x7f7654108f80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7644009900 tx=0x7f764402a410 comp rx=0 tx=0).stop 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 -- 172.21.15.76:0/714082236 shutdown_connections 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 --2- 172.21.15.76:0/714082236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76541016e0 0x7f7654108f80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 --2- 172.21.15.76:0/714082236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654100d20 0x7f76541011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 --2- 172.21.15.76:0/714082236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7654101ff0 0x7f76541023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 -- 172.21.15.76:0/714082236 >> 172.21.15.76:0/714082236 conn(0x7f76540fb980 msgr2=0x7f76540fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 -- 172.21.15.76:0/714082236 shutdown_connections 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.142+0000 7f765b359640 1 -- 172.21.15.76:0/714082236 wait complete. 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 Processor -- start 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 -- start start 2024-09-19T07:51:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 0x7f7654197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76541016e0 0x7f7654198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654101ff0 0x7f765419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f765410d950 con 0x7f7654100d20 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f765410d7d0 con 0x7f7654101ff0 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f765b359640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f765410dad0 con 0x7f76541016e0 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 0x7f7654197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 0x7f7654197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45456/0 (socket says 172.21.15.76:45456) 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 -- 172.21.15.76:0/2541891720 learned_addr learned my addr 172.21.15.76:0/2541891720 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76588f4640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76541016e0 0x7f7654198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76598f6640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654101ff0 0x7f765419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 -- 172.21.15.76:0/2541891720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76541016e0 msgr2=0x7f7654198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:07.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76541016e0 0x7f7654198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 -- 172.21.15.76:0/2541891720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654101ff0 msgr2=0x7f765419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654101ff0 0x7f765419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76590f5640 1 -- 172.21.15.76:0/2541891720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765419fa30 con 0x7f7654100d20 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.143+0000 7f76598f6640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654101ff0 0x7f765419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.144+0000 7f76590f5640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 0x7f7654197e10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c970 tx=0x7f764c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.144+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c004220 con 0x7f7654100d20 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.144+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f764c0043c0 con 0x7f7654100d20 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.144+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c00f6b0 con 0x7f7654100d20 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.144+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765419fd20 con 0x7f7654100d20 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.144+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76541a0200 con 0x7f7654100d20 2024-09-19T07:51:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.145+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7654107d90 con 0x7f7654100d20 2024-09-19T07:51:07.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.146+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f764c0037a0 con 0x7f7654100d20 2024-09-19T07:51:07.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.146+0000 7f76527fc640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f763c0a3370 0x7f763c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:07.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.146+0000 7f76588f4640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f763c0a3370 0x7f763c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:07.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.147+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f764c0cf670 con 0x7f7654100d20 2024-09-19T07:51:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.147+0000 7f76588f4640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f763c0a3370 0x7f763c0a5830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7654199320 tx=0x7f7648009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.151+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f764c014030 con 0x7f7654100d20 2024-09-19T07:51:07.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.362+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f7654062f30 con 0x7f7654100d20 2024-09-19T07:51:07.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.687+0000 7f76527fc640 1 -- 172.21.15.76:0/2541891720 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f764c003e40 con 0x7f7654100d20 2024-09-19T07:51:07.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.690+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f763c0a3370 msgr2=0x7f763c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:07.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.690+0000 7f765b359640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f763c0a3370 0x7f763c0a5830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7654199320 tx=0x7f7648009870 comp rx=0 tx=0).stop 2024-09-19T07:51:07.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.690+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 msgr2=0x7f7654197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:07.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.690+0000 7f765b359640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 0x7f7654197e10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c970 tx=0x7f764c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:51:07.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.691+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 shutdown_connections 2024-09-19T07:51:07.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.691+0000 7f765b359640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f763c0a3370 0x7f763c0a5830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.692+0000 7f765b359640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7654101ff0 0x7f765419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.692+0000 7f765b359640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76541016e0 0x7f7654198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.692+0000 7f765b359640 1 --2- 172.21.15.76:0/2541891720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7654100d20 0x7f7654197e10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:07.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.692+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 >> 172.21.15.76:0/2541891720 conn(0x7f76540fb980 msgr2=0x7f7654104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:07.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.692+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 shutdown_connections 2024-09-19T07:51:07.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:07.693+0000 7f765b359640 1 -- 172.21.15.76:0/2541891720 wait complete. 2024-09-19T07:51:07.708 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T07:51:07.735 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T07:51:07.735 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T07:51:07.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:07.735 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-09-19T07:51:07.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:07.753 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link delete ceph-brx 2024-09-19T07:51:07.821 INFO:teuthology.orchestra.run.smithi076.stderr:Cannot find device "ceph-brx" 2024-09-19T07:51:07.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:51:07.822 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T07:51:07.822 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T07:51:07.822 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:07.823 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T07:51:07.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:07 smithi076 ceph-mon[30930]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T07:51:07.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:07 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2541891720' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:51:07.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ignoring --setuser ceph since I am not root 2024-09-19T07:51:07.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ignoring --setgroup ceph since I am not root 2024-09-19T07:51:07.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:07.841+0000 7fd6780d7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:51:07.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:07.901+0000 7fd6780d7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:51:08.043 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-mon[35309]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T07:51:08.043 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2541891720' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:51:08.043 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: ignoring --setuser ceph since I am not root 2024-09-19T07:51:08.044 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: ignoring --setgroup ceph since I am not root 2024-09-19T07:51:08.044 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-mgr[36680]: -- 172.21.15.137:0/3991213996 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55845ee230e0 con 0x55845ee00800 2024-09-19T07:51:08.044 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:07.841+0000 7f7df1fd7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:51:08.044 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:07.897+0000 7f7df1fd7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:51:08.044 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.043+0000 7f7df1fd7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:51:08.046 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-mon[35117]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T07:51:08.046 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2541891720' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:51:08.046 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: ignoring --setuser ceph since I am not root 2024-09-19T07:51:08.046 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: ignoring --setgroup ceph since I am not root 2024-09-19T07:51:08.046 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-mgr[36927]: -- 172.21.15.152:0/3153510392 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca415b90e0 con 0x55ca41597400 2024-09-19T07:51:08.046 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:07.840+0000 7f34d59da040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:51:08.047 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:07.898+0000 7f34d59da040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:51:08.047 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.045+0000 7f34d59da040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:51:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:08.310 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.111+0000 7f34d59da040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:51:08.311 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.260+0000 7f34d59da040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:51:08.354 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:08.055+0000 7fd6780d7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:51:08.354 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:08.129+0000 7fd6780d7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:51:08.354 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:08.282+0000 7fd6780d7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:51:08.391 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.108+0000 7f7df1fd7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:51:08.391 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.252+0000 7f7df1fd7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:51:08.604 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:08.429+0000 7fd6780d7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:51:08.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 -- 172.21.15.76:0/3649690789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 msgr2=0x7fc62c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:08.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 --2- 172.21.15.76:0/3649690789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c1067e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc614009900 tx=0x7fc61402a410 comp rx=0 tx=0).stop 2024-09-19T07:51:08.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 -- 172.21.15.76:0/3649690789 shutdown_connections 2024-09-19T07:51:08.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 --2- 172.21.15.76:0/3649690789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc62c106f10 0x7fc62c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 --2- 172.21.15.76:0/3649690789 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c1067e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 --2- 172.21.15.76:0/3649690789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62c101de0 0x7fc62c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 -- 172.21.15.76:0/3649690789 >> 172.21.15.76:0/3649690789 conn(0x7fc62c0fd8c0 msgr2=0x7fc62c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 -- 172.21.15.76:0/3649690789 shutdown_connections 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.599+0000 7fc6319ec640 1 -- 172.21.15.76:0/3649690789 wait complete. 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 Processor -- start 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 -- start start 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62c101de0 0x7fc62c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc62c106f10 0x7fc62c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c112090 con 0x7fc62c102790 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c111f10 con 0x7fc62c101de0 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc6319ec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c112210 con 0x7fc62c106f10 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc623fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc623fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45500/0 (socket says 172.21.15.76:45500) 2024-09-19T07:51:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc623fff640 1 -- 172.21.15.76:0/526891074 learned_addr learned my addr 172.21.15.76:0/526891074 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc62affd640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62c101de0 0x7fc62c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.600+0000 7fc62b7fe640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc62c106f10 0x7fc62c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc623fff640 1 -- 172.21.15.76:0/526891074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc62c106f10 msgr2=0x7fc62c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc623fff640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc62c106f10 0x7fc62c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc623fff640 1 -- 172.21.15.76:0/526891074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62c101de0 msgr2=0x7fc62c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc623fff640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62c101de0 0x7fc62c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc623fff640 1 -- 172.21.15.76:0/526891074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c1a6990 con 0x7fc62c102790 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc623fff640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c074a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc614006010 tx=0x7fc6140040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61403f030 con 0x7fc62c102790 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc6140044c0 con 0x7fc62c102790 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c1a6c20 con 0x7fc62c102790 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614035070 con 0x7fc62c102790 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.601+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c1a7100 con 0x7fc62c102790 2024-09-19T07:51:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.602+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c1021c0 con 0x7fc62c102790 2024-09-19T07:51:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.603+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fc614042030 con 0x7fc62c102790 2024-09-19T07:51:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.604+0000 7fc6309ea640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 0x7fc6180a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.604+0000 7fc62affd640 1 -- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 msgr2=0x7fc6180a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.604+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fc6140efe50 con 0x7fc62c102790 2024-09-19T07:51:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.604+0000 7fc62affd640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 0x7fc6180a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:51:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.607+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc6140bc500 con 0x7fc62c102790 2024-09-19T07:51:08.653 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.391+0000 7f7df1fd7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:51:08.688 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.400+0000 7f34d59da040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:51:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.805+0000 7fc62affd640 1 -- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 msgr2=0x7fc6180a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.805+0000 7fc62affd640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 0x7fc6180a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:51:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.814+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc62c10a0f0 con 0x7fc62c102790 2024-09-19T07:51:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.814+0000 7fc6309ea640 1 -- 172.21.15.76:0/526891074 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fc6140c0800 con 0x7fc62c102790 2024-09-19T07:51:08.814 INFO:teuthology.orchestra.run.smithi076.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T07:51:08.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 msgr2=0x7fc6180a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:51:08.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 0x7fc6180a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 msgr2=0x7fc62c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:08.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c074a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc614006010 tx=0x7fc6140040c0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 shutdown_connections 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc62c106f10 0x7fc62c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc62c102790 0x7fc62c074a30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fc6180a3290 0x7fc6180a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 --2- 172.21.15.76:0/526891074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62c101de0 0x7fc62c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 >> 172.21.15.76:0/526891074 conn(0x7fc62c0fd8c0 msgr2=0x7fc62c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 shutdown_connections 2024-09-19T07:51:08.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:08.816+0000 7fc6319ec640 1 -- 172.21.15.76:0/526891074 wait complete. 2024-09-19T07:51:08.943 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2541891720' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:51:08.943 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-mon[35309]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T07:51:08.943 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.701+0000 7f7df1fd7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:51:08.943 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.761+0000 7f7df1fd7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:51:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2541891720' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:51:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-mon[30930]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T07:51:08.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:08.752+0000 7fd6780d7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:51:08.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:08.814+0000 7fd6780d7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:51:08.960 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2541891720' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:51:08.960 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-mon[35117]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T07:51:08.960 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.713+0000 7f34d59da040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:51:08.960 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.774+0000 7f34d59da040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:51:09.268 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:09.005+0000 7fd6780d7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:51:09.310 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:08.959+0000 7f34d59da040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:51:09.403 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:08.942+0000 7f7df1fd7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:51:09.605 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T07:51:09.605 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi076.front.sepia.ceph.com 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T07:51:09.606 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T07:51:09.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:09.606 DEBUG:teuthology.orchestra.run.smithi076:> ip addr 2024-09-19T07:51:09.623 INFO:teuthology.orchestra.run.smithi076.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T07:51:09.623 INFO:teuthology.orchestra.run.smithi076.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T07:51:09.623 INFO:teuthology.orchestra.run.smithi076.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T07:51:09.623 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:51:09.623 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 ::1/128 scope host 2024-09-19T07:51:09.623 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:66 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f0 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:67 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f1 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e0 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e1 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.21.15.76/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-09-19T07:51:09.624 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 fe80::ec4:7aff:fe8f:47e1/64 scope link noprefixroute 2024-09-19T07:51:09.625 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:51:09.625 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T07:51:09.625 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:51:09.625 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-09-19T07:51:09.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add name ceph-brx type bridge 2024-09-19T07:51:09.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr flush dev ceph-brx 2024-09-19T07:51:09.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set ceph-brx up 2024-09-19T07:51:09.626 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T07:51:09.626 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-09-19T07:51:09.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:51:09.825 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:09 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/526891074' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:51:09.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:09.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:09.833 DEBUG:teuthology.orchestra.run.smithi076:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T07:51:09.857 INFO:teuthology.orchestra.run.smithi076.stdout:1 2024-09-19T07:51:09.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:09.859 DEBUG:teuthology.orchestra.run.smithi076:> route 2024-09-19T07:51:09.929 INFO:teuthology.orchestra.run.smithi076.stdout:Kernel IP routing table 2024-09-19T07:51:09.930 INFO:teuthology.orchestra.run.smithi076.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T07:51:09.930 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T07:51:09.930 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T07:51:09.930 INFO:teuthology.orchestra.run.smithi076.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T07:51:09.930 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:51:09.930 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-09-19T07:51:09.930 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T07:51:09.931 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T07:51:09.931 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T07:51:09.931 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-09-19T07:51:10.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:51:10.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:09 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/526891074' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:51:10.061 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:09.840+0000 7f34d59da040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:51:10.061 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:09.907+0000 7f34d59da040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:51:10.148 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:09.928+0000 7fd6780d7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:51:10.148 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:09.999+0000 7fd6780d7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:51:10.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:09 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/526891074' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:51:10.154 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:09 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:09.818+0000 7f7df1fd7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:51:10.154 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:09 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:09.885+0000 7f7df1fd7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:51:10.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:10.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:10.234 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-09-19T07:51:10.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:10.250 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list-id 2024-09-19T07:51:10.307 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:51:10.307 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-09-19T07:51:10.307 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T07:51:10.307 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T07:51:10.307 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-09-19T07:51:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:51:10.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:10.426 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T07:51:10.426 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-09-19T07:51:10.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:51:10.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:10.559 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:51:10.559 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-09-19T07:51:10.559 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set brx.0 up 2024-09-19T07:51:10.559 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T07:51:10.559 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-09-19T07:51:10.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:51:10.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:10.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:51:10.638 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:10.667 INFO:teuthology.orchestra.run.smithi076.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T07:51:10.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:51:10.667 DEBUG:teuthology.orchestra.run.smithi076:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:10.722 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T07:51:10.722 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T07:51:10.722 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/6d8fa84e-4060-4069-bec6-a498c8a82e85 2024-09-19T07:51:10.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:10.723 DEBUG:teuthology.orchestra.run.smithi076:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/6d8fa84e-4060-4069-bec6-a498c8a82e85 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T07:51:10.819 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T07:51:10.820 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T07:51:10.820 INFO:teuthology.orchestra.run.smithi076.stdout:invalid new device string format 2024-09-19T07:51:10.839 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:10.583+0000 7f7df1fd7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:51:10.840 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:10.696+0000 7f7df1fd7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:51:10.877 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:10.617+0000 7f34d59da040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:51:10.877 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:10.733+0000 7f34d59da040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:51:10.947 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T07:51:10.947 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T07:51:10.947 INFO:teuthology.orchestra.run.smithi076.stdout:invalid new device string format 2024-09-19T07:51:10.947 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: resolved to: "172.21.15.76:3300,172.21.15.137:3300,172.21.15.152:3300" 2024-09-19T07:51:10.947 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.76:3300,172.21.15.137:3300,172.21.15.152:3300:/volumes/qa/sv_1/6d8fa84e-4060-4069-bec6-a498c8a82e85 2024-09-19T07:51:10.947 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=6aad871c-765a-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T07:51:10.948 INFO:teuthology.orchestra.run.smithi076.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T07:51:10.948 INFO:teuthology.orchestra.run.smithi076.stdout: You just mounted a file system that supports labels which does not 2024-09-19T07:51:10.949 INFO:teuthology.orchestra.run.smithi076.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T07:51:10.949 INFO:teuthology.orchestra.run.smithi076.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T07:51:10.949 INFO:teuthology.orchestra.run.smithi076.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T07:51:10.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T07:51:10.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:51:10.951 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:10.977 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:51:11.037 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:10.760+0000 7fd6780d7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:51:11.037 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:10.884+0000 7fd6780d7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:51:11.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:51:11.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:11.075 INFO:teuthology.orchestra.run.smithi076.stdout:client24743 2024-09-19T07:51:11.076 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:51:11.076 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:51:11.116 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:10.839+0000 7f7df1fd7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:51:11.116 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:10.900+0000 7f7df1fd7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:51:11.116 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.049+0000 7f7df1fd7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:51:11.116 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.116+0000 7f7df1fd7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:51:11.134 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:51:11.156 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:10.876+0000 7f34d59da040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:51:11.156 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:10.938+0000 7f34d59da040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:51:11.156 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.087+0000 7f34d59da040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:51:11.157 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.155+0000 7f34d59da040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:51:11.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:51:11.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:11.232 INFO:teuthology.orchestra.run.smithi076.stdout:client24743 2024-09-19T07:51:11.232 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:51:11.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:51:11.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:11.291 INFO:teuthology.orchestra.run.smithi076.stdout:client24743 2024-09-19T07:51:11.291 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6aad871c-765a-11ef-bceb-c7b262605968.client24743/status') 2024-09-19T07:51:11.334 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.036+0000 7fd6780d7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:51:11.335 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.101+0000 7fd6780d7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:51:11.335 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.262+0000 7fd6780d7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:51:11.335 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.334+0000 7fd6780d7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:51:11.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:51:11.350 INFO:teuthology.orchestra.run.smithi076.stdout:instance: client.24743 (3)172.21.15.76:0/1828996126 2024-09-19T07:51:11.350 INFO:teuthology.orchestra.run.smithi076.stdout:blocklisted: false 2024-09-19T07:51:11.351 INFO:teuthology.orchestra.run.smithi076.stderr:0+1 records in 2024-09-19T07:51:11.351 INFO:teuthology.orchestra.run.smithi076.stderr:0+1 records out 2024-09-19T07:51:11.351 INFO:teuthology.orchestra.run.smithi076.stderr:71 bytes copied, 2.2895e-05 s, 3.1 MB/s 2024-09-19T07:51:11.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:51:11.358 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:51:11.367 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:51:11.367 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:51:11.368 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T07:51:11.396 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.176+0000 7f7df1fd7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:51:11.396 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.332+0000 7f7df1fd7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:51:11.396 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.396+0000 7f7df1fd7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:51:11.439 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.215+0000 7f34d59da040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:51:11.440 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.374+0000 7f34d59da040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.470+0000 7fa5a8277640 1 -- 172.21.15.76:0/1595680714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0102600 msgr2=0x7fa5a0108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.470+0000 7fa5a8277640 1 --2- 172.21.15.76:0/1595680714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0102600 0x7fa5a0108e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa598009ca0 tx=0x7fa59802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 -- 172.21.15.76:0/1595680714 shutdown_connections 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 --2- 172.21.15.76:0/1595680714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0102600 0x7fa5a0108e90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 --2- 172.21.15.76:0/1595680714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a0101c40 0x7fa5a01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 --2- 172.21.15.76:0/1595680714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0100a50 0x7fa5a0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 -- 172.21.15.76:0/1595680714 >> 172.21.15.76:0/1595680714 conn(0x7fa5a00fc1b0 msgr2=0x7fa5a00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 -- 172.21.15.76:0/1595680714 shutdown_connections 2024-09-19T07:51:11.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 -- 172.21.15.76:0/1595680714 wait complete. 2024-09-19T07:51:11.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 Processor -- start 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.471+0000 7fa5a8277640 1 -- start start 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 0x7fa5a006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0101c40 0x7fa5a019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a0102600 0x7fa5a019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a010c830 con 0x7fa5a0100a50 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a010c6b0 con 0x7fa5a0102600 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a010c9b0 con 0x7fa5a0101c40 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 0x7fa5a006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 0x7fa5a006ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45522/0 (socket says 172.21.15.76:45522) 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 -- 172.21.15.76:0/2624059167 learned_addr learned my addr 172.21.15.76:0/2624059167 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:11.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6814640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a0102600 0x7fa5a019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a5812640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0101c40 0x7fa5a019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 -- 172.21.15.76:0/2624059167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0101c40 msgr2=0x7fa5a019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0101c40 0x7fa5a019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 -- 172.21.15.76:0/2624059167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a0102600 msgr2=0x7fa5a019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a0102600 0x7fa5a019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 -- 172.21.15.76:0/2624059167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a019fab0 con 0x7fa5a0100a50 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a5812640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0101c40 0x7fa5a019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a6013640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 0x7fa5a006ac30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00e9c0 tx=0x7fa59c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00cd80 con 0x7fa5a0100a50 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa59c0035f0 con 0x7fa5a0100a50 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a019fd40 con 0x7fa5a0100a50 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c010670 con 0x7fa5a0100a50 2024-09-19T07:51:11.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.472+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a01a01d0 con 0x7fa5a0100a50 2024-09-19T07:51:11.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.474+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a0107d10 con 0x7fa5a0100a50 2024-09-19T07:51:11.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.474+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fa59c0037a0 con 0x7fa5a0100a50 2024-09-19T07:51:11.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.475+0000 7fa5937fe640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 0x7fa58c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.475+0000 7fa5a5812640 1 -- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 msgr2=0x7fa58c0a5880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:11.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.476+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7fa59c0cfd70 con 0x7fa5a0100a50 2024-09-19T07:51:11.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.476+0000 7fa5a5812640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 0x7fa58c0a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:51:11.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.479+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa59c09ca10 con 0x7fa5a0100a50 2024-09-19T07:51:11.644 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.398+0000 7fd6780d7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:51:11.645 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.574+0000 7fd6780d7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:51:11.645 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.644+0000 7fd6780d7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:51:11.653 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.461+0000 7f7df1fd7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:51:11.653 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.543+0000 7f7df1fd7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:51:11.654 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.605+0000 7f7df1fd7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:51:11.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.677+0000 7fa5a5812640 1 -- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 msgr2=0x7fa58c0a5880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:11.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.677+0000 7fa5a5812640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 0x7fa58c0a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:51:11.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.702+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fa5a0062e90 con 0x7fa5a0100a50 2024-09-19T07:51:11.710 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.438+0000 7f34d59da040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:51:11.710 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.505+0000 7f34d59da040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:51:11.710 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.587+0000 7f34d59da040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:51:11.710 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.649+0000 7f34d59da040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:51:11.710 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:11.708+0000 7f34d59da040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:51:11.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.753+0000 7fa5937fe640 1 -- 172.21.15.76:0/2624059167 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fa59c09c310 con 0x7fa5a0100a50 2024-09-19T07:51:11.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 msgr2=0x7fa58c0a5880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:51:11.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 0x7fa58c0a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 msgr2=0x7fa5a006ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 0x7fa5a006ac30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00e9c0 tx=0x7fa59c00ee80 comp rx=0 tx=0).stop 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 shutdown_connections 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7fa58c0a33c0 0x7fa58c0a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a0102600 0x7fa5a019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5a0101c40 0x7fa5a019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 --2- 172.21.15.76:0/2624059167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5a0100a50 0x7fa5a006ac30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 >> 172.21.15.76:0/2624059167 conn(0x7fa5a00fc1b0 msgr2=0x7fa5a0104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 shutdown_connections 2024-09-19T07:51:11.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.756+0000 7fa5a8277640 1 -- 172.21.15.76:0/2624059167 wait complete. 2024-09-19T07:51:11.767 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T07:51:11.779 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T07:51:11.822 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T07:51:11.924 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2624059167' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T07:51:11.924 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.713+0000 7fd6780d7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:51:11.924 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.798+0000 7fd6780d7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:51:11.924 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.861+0000 7fd6780d7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:51:11.924 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:11.923+0000 7fd6780d7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 -- 172.21.15.76:0/4130172033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0102610 msgr2=0x7f60f0104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 --2- 172.21.15.76:0/4130172033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0102610 0x7f60f0104a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009900 tx=0x7f60ec02a410 comp rx=0 tx=0).stop 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 -- 172.21.15.76:0/4130172033 shutdown_connections 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 --2- 172.21.15.76:0/4130172033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60f0107870 0x7f60f0109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 --2- 172.21.15.76:0/4130172033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f0104f40 0x7f60f0107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 --2- 172.21.15.76:0/4130172033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0102610 0x7f60f0104a00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 -- 172.21.15.76:0/4130172033 >> 172.21.15.76:0/4130172033 conn(0x7f60f00fc170 msgr2=0x7f60f00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 -- 172.21.15.76:0/4130172033 shutdown_connections 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.925+0000 7f60f7728640 1 -- 172.21.15.76:0/4130172033 wait complete. 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 Processor -- start 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 -- start start 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f0102610 0x7f60f0197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60f0104f40 0x7f60f01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 0x7f60f019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f60f010d900 con 0x7f60f0107870 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60f010d780 con 0x7f60f0104f40 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f7728640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f60f010da80 con 0x7f60f0102610 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 0x7f60f019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 0x7f60f019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45532/0 (socket says 172.21.15.76:45532) 2024-09-19T07:51:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 -- 172.21.15.76:0/3540377076 learned_addr learned my addr 172.21.15.76:0/3540377076 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f4cc3640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60f0104f40 0x7f60f01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f54c4640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f0102610 0x7f60f0197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 -- 172.21.15.76:0/3540377076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f0102610 msgr2=0x7f60f0197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f0102610 0x7f60f0197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 -- 172.21.15.76:0/3540377076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60f0104f40 msgr2=0x7f60f01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60f0104f40 0x7f60f01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.926+0000 7f60f5cc5640 1 -- 172.21.15.76:0/3540377076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f019fba0 con 0x7f60f0107870 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.927+0000 7f60f5cc5640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 0x7f60f019f530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009c90 tx=0x7f60e800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.927+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8003b70 con 0x7f60f0107870 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.927+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f60e8003d10 con 0x7f60f0107870 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.927+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f019fe90 con 0x7f60f0107870 2024-09-19T07:51:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.927+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8010a20 con 0x7f60f0107870 2024-09-19T07:51:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.927+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f01a0300 con 0x7f60f0107870 2024-09-19T07:51:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.928+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f00fdc60 con 0x7f60f0107870 2024-09-19T07:51:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.929+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f60e8004020 con 0x7f60f0107870 2024-09-19T07:51:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.929+0000 7f60e67fc640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f60dc0a32a0 0x7f60dc0a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.930+0000 7f60f54c4640 1 -- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f60dc0a32a0 msgr2=0x7f60dc0a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.930+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f60e80cffd0 con 0x7f60f0107870 2024-09-19T07:51:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.930+0000 7f60f54c4640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f60dc0a32a0 0x7f60dc0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:51:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:11.934+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60e809ccd0 con 0x7f60f0107870 2024-09-19T07:51:12.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:11 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2624059167' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T07:51:12.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.105+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60f0062df0 con 0x7f60f0107870 2024-09-19T07:51:12.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.106+0000 7f60e67fc640 1 -- 172.21.15.76:0/3540377076 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22775 (secure 0 0 0) 0x7f60e8081910 con 0x7f60f0107870 2024-09-19T07:51:12.107 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:12.107 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":84,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:50:34.014599+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f60dc0a32a0 msgr2=0x7f60dc0a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f60dc0a32a0 0x7f60dc0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 msgr2=0x7f60f019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 0x7f60f019f530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009c90 tx=0x7f60e800c6a0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 shutdown_connections 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f60f0107870 0x7f60f019f530 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f60dc0a32a0 0x7f60dc0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60f0104f40 0x7f60f01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 --2- 172.21.15.76:0/3540377076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f0102610 0x7f60f0197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 >> 172.21.15.76:0/3540377076 conn(0x7f60f00fc170 msgr2=0x7f60f0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:12.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 shutdown_connections 2024-09-19T07:51:12.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.109+0000 7f60f7728640 1 -- 172.21.15.76:0/3540377076 wait complete. 2024-09-19T07:51:12.120 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:44:46.792310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:49:23.884114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:49:26.359069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:51:12.121 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T07:51:12.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2624059167' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T07:51:12.154 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:11.664+0000 7f7df1fd7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:51:12.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 -- 172.21.15.76:0/23433675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc01025b0 msgr2=0x7f7dc0108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 --2- 172.21.15.76:0/23433675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc01025b0 0x7f7dc0108e40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009ca0 tx=0x7f7db802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 -- 172.21.15.76:0/23433675 shutdown_connections 2024-09-19T07:51:12.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 --2- 172.21.15.76:0/23433675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc01025b0 0x7f7dc0108e40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 --2- 172.21.15.76:0/23433675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 --2- 172.21.15.76:0/23433675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dc0100a00 0x7f7dc0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 -- 172.21.15.76:0/23433675 >> 172.21.15.76:0/23433675 conn(0x7f7dc00fc140 msgr2=0x7f7dc00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 -- 172.21.15.76:0/23433675 shutdown_connections 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.225+0000 7f7dc648b640 1 -- 172.21.15.76:0/23433675 wait complete. 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 Processor -- start 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 -- start start 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dc0100a00 0x7f7dc0197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dc01025b0 0x7f7dc019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc010c830 con 0x7f7dc0101bf0 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc010c6b0 con 0x7f7dc01025b0 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc648b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc010c9b0 con 0x7f7dc0100a00 2024-09-19T07:51:12.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dbf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dbf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45554/0 (socket says 172.21.15.76:45554) 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dbf7fe640 1 -- 172.21.15.76:0/80268755 learned_addr learned my addr 172.21.15.76:0/80268755 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dbffff640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dc0100a00 0x7f7dc0197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.226+0000 7f7dc4a28640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dc01025b0 0x7f7dc019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbf7fe640 1 -- 172.21.15.76:0/80268755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dc0100a00 msgr2=0x7f7dc0197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbf7fe640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dc0100a00 0x7f7dc0197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbf7fe640 1 -- 172.21.15.76:0/80268755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dc01025b0 msgr2=0x7f7dc019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbf7fe640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dc01025b0 0x7f7dc019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbf7fe640 1 -- 172.21.15.76:0/80268755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc019fb70 con 0x7f7dc0101bf0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbf7fe640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0198500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e9f0 tx=0x7f7db400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400cd80 con 0x7f7dc0101bf0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7db4005520 con 0x7f7dc0101bf0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc019fe60 con 0x7f7dc0101bf0 2024-09-19T07:51:12.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4010690 con 0x7f7dc0101bf0 2024-09-19T07:51:12.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.227+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01a02d0 con 0x7f7dc0101bf0 2024-09-19T07:51:12.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.228+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc01a0560 con 0x7f7dc0101bf0 2024-09-19T07:51:12.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.229+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f7db40046c0 con 0x7f7dc0101bf0 2024-09-19T07:51:12.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.230+0000 7f7dbd7fa640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7da80a32a0 0x7f7da80a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.230+0000 7f7dbffff640 1 -- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7da80a32a0 msgr2=0x7f7da80a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:12.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.230+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f7db40cff50 con 0x7f7dc0101bf0 2024-09-19T07:51:12.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.230+0000 7f7dbffff640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7da80a32a0 0x7f7da80a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:51:12.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.233+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7db4054210 con 0x7f7dc0101bf0 2024-09-19T07:51:12.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.405+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7dc01a0730 con 0x7f7dc0101bf0 2024-09-19T07:51:12.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.405+0000 7f7dbd7fa640 1 -- 172.21.15.76:0/80268755 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f7db409cc50 con 0x7f7dc0101bf0 2024-09-19T07:51:12.405 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-09-19T07:51:12.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7da80a32a0 msgr2=0x7f7da80a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7da80a32a0 0x7f7da80a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 msgr2=0x7f7dc0198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0198500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e9f0 tx=0x7f7db400edf0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 shutdown_connections 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f7da80a32a0 0x7f7da80a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dc01025b0 0x7f7dc019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7dc0101bf0 0x7f7dc0198500 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 --2- 172.21.15.76:0/80268755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dc0100a00 0x7f7dc0197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 >> 172.21.15.76:0/80268755 conn(0x7f7dc00fc140 msgr2=0x7f7dc00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 shutdown_connections 2024-09-19T07:51:12.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.407+0000 7f7dc648b640 1 -- 172.21.15.76:0/80268755 wait complete. 2024-09-19T07:51:12.418 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T07:51:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 -- 172.21.15.76:0/665369149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02481025b0 msgr2=0x7f0248108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 --2- 172.21.15.76:0/665369149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02481025b0 0x7f0248108e40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0240009ca0 tx=0x7f024002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 -- 172.21.15.76:0/665369149 shutdown_connections 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 --2- 172.21.15.76:0/665369149 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02481025b0 0x7f0248108e40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 --2- 172.21.15.76:0/665369149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0248101bf0 0x7f0248102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 --2- 172.21.15.76:0/665369149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0248100a00 0x7f0248100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 -- 172.21.15.76:0/665369149 >> 172.21.15.76:0/665369149 conn(0x7f02480fc140 msgr2=0x7f02480fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 -- 172.21.15.76:0/665369149 shutdown_connections 2024-09-19T07:51:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.525+0000 7f024ca1e640 1 -- 172.21.15.76:0/665369149 wait complete. 2024-09-19T07:51:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 Processor -- start 2024-09-19T07:51:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 -- start start 2024-09-19T07:51:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 0x7f0248104990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0248101bf0 0x7f0248102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02481025b0 0x7f0248103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f024810c7a0 con 0x7f0248100a00 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f024810c620 con 0x7f0248101bf0 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024ca1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f024810c920 con 0x7f02481025b0 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 0x7f0248104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 0x7f0248104990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45568/0 (socket says 172.21.15.76:45568) 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f024659c640 1 -- 172.21.15.76:0/3530643990 learned_addr learned my addr 172.21.15.76:0/3530643990 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.526+0000 7f0246d9d640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02481025b0 0x7f0248103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f0245d9b640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0248101bf0 0x7f0248102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024659c640 1 -- 172.21.15.76:0/3530643990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02481025b0 msgr2=0x7f0248103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024659c640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02481025b0 0x7f0248103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024659c640 1 -- 172.21.15.76:0/3530643990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0248101bf0 msgr2=0x7f0248102fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024659c640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0248101bf0 0x7f0248102fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024659c640 1 -- 172.21.15.76:0/3530643990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0248103da0 con 0x7f0248100a00 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024659c640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 0x7f0248104990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f023800e9c0 tx=0x7f023800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023800cde0 con 0x7f0248100a00 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02481a1fe0 con 0x7f0248100a00 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0238010930 con 0x7f0248100a00 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238018a20 con 0x7f0248100a00 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.527+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02481a2440 con 0x7f0248100a00 2024-09-19T07:51:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.528+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02481a2730 con 0x7f0248100a00 2024-09-19T07:51:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.529+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f0238018c40 con 0x7f0248100a00 2024-09-19T07:51:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.530+0000 7f02377fe640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f02300a32a0 0x7f02300a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.530+0000 7f0245d9b640 1 -- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f02300a32a0 msgr2=0x7f02300a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.76:6800/1377496784 2024-09-19T07:51:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.530+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8269+0+0 (secure 0 0 0) 0x7f02380cfe60 con 0x7f0248100a00 2024-09-19T07:51:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.530+0000 7f0245d9b640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f02300a32a0 0x7f02300a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:51:12.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.534+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0238054210 con 0x7f0248100a00 2024-09-19T07:51:12.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.709+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02481a2900 con 0x7f0248100a00 2024-09-19T07:51:12.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.709+0000 7f02377fe640 1 -- 172.21.15.76:0/3530643990 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f023809cb60 con 0x7f0248100a00 2024-09-19T07:51:12.709 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f02300a32a0 msgr2=0x7f02300a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f02300a32a0 0x7f02300a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 msgr2=0x7f0248104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 0x7f0248104990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f023800e9c0 tx=0x7f023800ee80 comp rx=0 tx=0).stop 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 shutdown_connections 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02481025b0 0x7f0248103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:6800/1377496784,v1:172.21.15.76:6801/1377496784] conn(0x7f02300a32a0 0x7f02300a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0248101bf0 0x7f0248102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 --2- 172.21.15.76:0/3530643990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0248100a00 0x7f0248104990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 >> 172.21.15.76:0/3530643990 conn(0x7f02480fc140 msgr2=0x7f0248069470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 shutdown_connections 2024-09-19T07:51:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.712+0000 7f024ca1e640 1 -- 172.21.15.76:0/3530643990 wait complete. 2024-09-19T07:51:12.723 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T07:51:12.759 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z[36923]: 2024-09-19T07:51:12.503+0000 7f34d59da040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:51:12.760 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y[36676]: 2024-09-19T07:51:12.448+0000 7f7df1fd7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:51:12.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 -- 172.21.15.76:0/1084123201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5920100a30 msgr2=0x7f5920100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 --2- 172.21.15.76:0/1084123201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5920100a30 0x7f5920100e30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5910009900 tx=0x7f591002a410 comp rx=0 tx=0).stop 2024-09-19T07:51:12.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 -- 172.21.15.76:0/1084123201 shutdown_connections 2024-09-19T07:51:12.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 --2- 172.21.15.76:0/1084123201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59201025e0 0x7f5920108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 --2- 172.21.15.76:0/1084123201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5920101c20 0x7f59201020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 --2- 172.21.15.76:0/1084123201 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5920100a30 0x7f5920100e30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 -- 172.21.15.76:0/1084123201 >> 172.21.15.76:0/1084123201 conn(0x7f59200fc1b0 msgr2=0x7f59200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:12.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 -- 172.21.15.76:0/1084123201 shutdown_connections 2024-09-19T07:51:12.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 -- 172.21.15.76:0/1084123201 wait complete. 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.849+0000 7f592519f640 1 Processor -- start 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 -- start start 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5920100a30 0x7f592006aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5920101c20 0x7f592019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 0x7f592019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f592010c810 con 0x7f59201025e0 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f592010c690 con 0x7f5920100a30 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f592519f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f592010c990 con 0x7f5920101c20 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 0x7f592019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 0x7f592019f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45620/0 (socket says 172.21.15.76:45620) 2024-09-19T07:51:12.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 -- 172.21.15.76:0/122586612 learned_addr learned my addr 172.21.15.76:0/122586612 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591ed9d640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5920100a30 0x7f592006aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591e59c640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5920101c20 0x7f592019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 -- 172.21.15.76:0/122586612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5920101c20 msgr2=0x7f592019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5920101c20 0x7f592019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 -- 172.21.15.76:0/122586612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5920100a30 msgr2=0x7f592006aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5920100a30 0x7f592006aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.850+0000 7f591f59e640 1 -- 172.21.15.76:0/122586612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592019fbd0 con 0x7f59201025e0 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.851+0000 7f591f59e640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 0x7f592019f2c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f591800eaa0 tx=0x7f591800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.851+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591800cdb0 con 0x7f59201025e0 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.851+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592019fe60 con 0x7f59201025e0 2024-09-19T07:51:12.853 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.851+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5918004b20 con 0x7f59201025e0 2024-09-19T07:51:12.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.851+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918011760 con 0x7f59201025e0 2024-09-19T07:51:12.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.851+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59201a0320 con 0x7f59201025e0 2024-09-19T07:51:12.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.852+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5920107e20 con 0x7f59201025e0 2024-09-19T07:51:12.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.853+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7f5918011900 con 0x7f59201025e0 2024-09-19T07:51:12.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.854+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f59180cf8f0 con 0x7f59201025e0 2024-09-19T07:51:12.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:12.857+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5918016030 con 0x7f59201025e0 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2624059167' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3540377076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/80268755' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: Standby manager daemon y restarted 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: Standby manager daemon y started 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:51:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: Standby manager daemon z restarted 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: Standby manager daemon z started 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:51:13.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3530643990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2624059167' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3540377076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/80268755' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: Standby manager daemon y restarted 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: Standby manager daemon y started 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:51:13.065 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: Standby manager daemon z restarted 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: Standby manager daemon z started 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:51:13.066 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3530643990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:12.758+0000 7fd6780d7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2624059167' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3540377076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/80268755' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: Standby manager daemon y restarted 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: Standby manager daemon y started 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:51:13.067 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.137:0/3952087071' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: Standby manager daemon z restarted 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: Standby manager daemon z started 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='mgr.? 172.21.15.152:0/1795225921' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:51:13.068 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3530643990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.123+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f592002d9c0 con 0x7f59201025e0 2024-09-19T07:51:13.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.124+0000 7f5907fff640 1 -- 172.21.15.76:0/122586612 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f591809c320 con 0x7f59201025e0 2024-09-19T07:51:13.124 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 msgr2=0x7f592019f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 0x7f592019f2c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f591800eaa0 tx=0x7f591800ef60 comp rx=0 tx=0).stop 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 shutdown_connections 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f59201025e0 0x7f592019f2c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5920101c20 0x7f592019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 --2- 172.21.15.76:0/122586612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5920100a30 0x7f592006aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 >> 172.21.15.76:0/122586612 conn(0x7f59200fc1b0 msgr2=0x7f5920104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 shutdown_connections 2024-09-19T07:51:13.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.126+0000 7f592519f640 1 -- 172.21.15.76:0/122586612 wait complete. 2024-09-19T07:51:13.137 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T07:51:13.138 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:13.444 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.077+0000 7fd5df6e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.444 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.077+0000 7fd5df6e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.077+0000 7fd5df6e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.077+0000 7fd5df6e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.077+0000 7fd5df6e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.080+0000 7fd5e26ef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.080+0000 7fd5e26ef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.080+0000 7fd5e26ef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.080+0000 7fd5e26ef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.445 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:13.080+0000 7fd5e26ef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:51:13.866 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: Active manager daemon x restarted 2024-09-19T07:51:13.866 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: Activating manager daemon x 2024-09-19T07:51:13.866 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-19T07:51:13.866 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: mgrmap e21: x(active, starting, since 0.0109269s), standbys: z, y 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:51:13.867 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:51:13.868 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: Manager daemon x is now available 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:51:13.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:13 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/122586612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 -- 172.21.15.76:0/1684337177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 msgr2=0x7f021c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 --2- 172.21.15.76:0/1684337177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c101200 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0218009900 tx=0x7f021802a480 comp rx=0 tx=0).stop 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 -- 172.21.15.76:0/1684337177 shutdown_connections 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 --2- 172.21.15.76:0/1684337177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f021c102ef0 0x7f021c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 --2- 172.21.15.76:0/1684337177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f021c102570 0x7f021c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 --2- 172.21.15.76:0/1684337177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c101200 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 -- 172.21.15.76:0/1684337177 >> 172.21.15.76:0/1684337177 conn(0x7f021c0fc7d0 msgr2=0x7f021c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 -- 172.21.15.76:0/1684337177 shutdown_connections 2024-09-19T07:51:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.865+0000 7f02240ae640 1 -- 172.21.15.76:0/1684337177 wait complete. 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 Processor -- start 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 -- start start 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f021c102570 0x7f021c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f021c102ef0 0x7f021c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f021c1110e0 con 0x7f021c100e20 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f021c110f60 con 0x7f021c102ef0 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f02240ae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f021c111260 con 0x7f021c102570 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f0221e4a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f0221e4a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35672/0 (socket says 172.21.15.76:35672) 2024-09-19T07:51:13.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f0221e4a640 1 -- 172.21.15.76:0/2100406259 learned_addr learned my addr 172.21.15.76:0/2100406259 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f022264b640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f021c102ef0 0x7f021c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f0221649640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f021c102570 0x7f021c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f0221e4a640 1 -- 172.21.15.76:0/2100406259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f021c102570 msgr2=0x7f021c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.866+0000 7f0221e4a640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f021c102570 0x7f021c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f0221e4a640 1 -- 172.21.15.76:0/2100406259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f021c102ef0 msgr2=0x7f021c19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f0221e4a640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f021c102ef0 0x7f021c19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f0221e4a640 1 -- 172.21.15.76:0/2100406259 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c19d580 con 0x7f021c100e20 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f0221e4a640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c1985d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0218006010 tx=0x7f0218004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021803f030 con 0x7f021c100e20 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0218005500 con 0x7f021c100e20 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218035070 con 0x7f021c100e20 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c19d810 con 0x7f021c100e20 2024-09-19T07:51:13.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.867+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021c1a5150 con 0x7f021c100e20 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.868+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021c101200 con 0x7f021c100e20 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.870+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f0218042030 con 0x7f021c100e20 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.871+0000 7f020effd640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f02080a30b0 0x7f02080a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.871+0000 7f0221649640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f02080a30b0 0x7f02080a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.871+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f02180efb10 con 0x7f021c100e20 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.871+0000 7f0221649640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f02080a30b0 0x7f02080a5570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0210005fd0 tx=0x7f0210005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:13.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:13.875+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02180bca00 con 0x7f021c100e20 2024-09-19T07:51:14.036 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: Active manager daemon x restarted 2024-09-19T07:51:14.036 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: Activating manager daemon x 2024-09-19T07:51:14.036 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-19T07:51:14.036 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:51:14.036 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: mgrmap e21: x(active, starting, since 0.0109269s), standbys: z, y 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:51:14.037 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:51:14.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: Manager daemon x is now available 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:14.039 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:51:14.040 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:51:14.040 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:13 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/122586612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:51:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.095+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f021c1a5320 con 0x7f021c100e20 2024-09-19T07:51:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.096+0000 7f020effd640 1 -- 172.21.15.76:0/2100406259 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f02180bc300 con 0x7f021c100e20 2024-09-19T07:51:14.096 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: Active manager daemon x restarted 2024-09-19T07:51:14.096 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: Activating manager daemon x 2024-09-19T07:51:14.096 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-19T07:51:14.096 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: mgrmap e21: x(active, starting, since 0.0109269s), standbys: z, y 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:51:14.097 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:51:14.098 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:51:14.099 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:51:14.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: Manager daemon x is now available 2024-09-19T07:51:14.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:14.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:51:14.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:51:14.100 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:13 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/122586612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:51:14.100 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:14.100 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:14.101 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:14.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f02080a30b0 msgr2=0x7f02080a5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f02080a30b0 0x7f02080a5570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0210005fd0 tx=0x7f0210005850 comp rx=0 tx=0).stop 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 msgr2=0x7f021c1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c1985d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0218006010 tx=0x7f0218004c00 comp rx=0 tx=0).stop 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 shutdown_connections 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f02080a30b0 0x7f02080a5570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f021c102ef0 0x7f021c19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f021c102570 0x7f021c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 --2- 172.21.15.76:0/2100406259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f021c100e20 0x7f021c1985d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 >> 172.21.15.76:0/2100406259 conn(0x7f021c0fc7d0 msgr2=0x7f021c105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 shutdown_connections 2024-09-19T07:51:14.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:14.098+0000 7f02240ae640 1 -- 172.21.15.76:0/2100406259 wait complete. 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:14.421+0000 7fd5c60f7640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:51:14] ENGINE Error in HTTPServer.serve 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: Traceback (most recent call last): 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._connections.run(self.expiration_interval) 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._run(expiration_interval) 2024-09-19T07:51:14.579 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: s = self.context.wrap_socket( 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: return self.sslsocket_class._create( 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self.do_handshake() 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: self._sslobj.do_handshake() 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:51:14.580 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: mgrmap e22: x(active, since 1.01961s), standbys: z, y 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2100406259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: [19/Sep/2024:07:51:14] ENGINE Bus STARTING 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: [19/Sep/2024:07:51:14] ENGINE Serving on http://172.21.15.76:8765 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: [19/Sep/2024:07:51:14] ENGINE Serving on https://172.21.15.76:7150 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: [19/Sep/2024:07:51:14] ENGINE Bus STARTED 2024-09-19T07:51:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: [19/Sep/2024:07:51:14] ENGINE Error in HTTPServer.serve 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: Traceback (most recent call last): 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._run(expiration_interval) 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: s = self.context.wrap_socket( 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:51:14.945 INFO:journalctl@ceph.mon.a.smithi076.stdout: return self.sslsocket_class._create( 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout: self.do_handshake() 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout: self._sslobj.do_handshake() 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:14.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:14 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:15.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: mgrmap e22: x(active, since 1.01961s), standbys: z, y 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2100406259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: [19/Sep/2024:07:51:14] ENGINE Bus STARTING 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: [19/Sep/2024:07:51:14] ENGINE Serving on http://172.21.15.76:8765 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: [19/Sep/2024:07:51:14] ENGINE Serving on https://172.21.15.76:7150 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: [19/Sep/2024:07:51:14] ENGINE Bus STARTED 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: [19/Sep/2024:07:51:14] ENGINE Error in HTTPServer.serve 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout: Traceback (most recent call last): 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:51:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout: self._run(expiration_interval) 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: s = self.context.wrap_socket( 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: return self.sslsocket_class._create( 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: self.do_handshake() 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: self._sslobj.do_handshake() 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:51:15.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:15.063 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:14 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: mgrmap e22: x(active, since 1.01961s), standbys: z, y 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2100406259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: [19/Sep/2024:07:51:14] ENGINE Bus STARTING 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: [19/Sep/2024:07:51:14] ENGINE Serving on http://172.21.15.76:8765 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: [19/Sep/2024:07:51:14] ENGINE Serving on https://172.21.15.76:7150 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: [19/Sep/2024:07:51:14] ENGINE Bus STARTED 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: [19/Sep/2024:07:51:14] ENGINE Error in HTTPServer.serve 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout: Traceback (most recent call last): 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:51:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: self._run(expiration_interval) 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: s = self.context.wrap_socket( 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: return self.sslsocket_class._create( 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: self.do_handshake() 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:51:15.155 INFO:journalctl@ceph.mon.b.smithi137.stdout: self._sslobj.do_handshake() 2024-09-19T07:51:15.156 INFO:journalctl@ceph.mon.b.smithi137.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:51:15.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:15.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:14 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:15.424 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T07:51:15.424 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T07:51:15.424 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 -- 172.21.15.76:0/2100960821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37701025c0 msgr2=0x7f3770108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 --2- 172.21.15.76:0/2100960821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37701025c0 0x7f3770108e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3768009ca0 tx=0x7f376802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 -- 172.21.15.76:0/2100960821 shutdown_connections 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 --2- 172.21.15.76:0/2100960821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37701025c0 0x7f3770108e50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 --2- 172.21.15.76:0/2100960821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3770101c00 0x7f3770102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 --2- 172.21.15.76:0/2100960821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3770100a10 0x7f3770100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 -- 172.21.15.76:0/2100960821 >> 172.21.15.76:0/2100960821 conn(0x7f37700fc170 msgr2=0x7f37700fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:15.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 -- 172.21.15.76:0/2100960821 shutdown_connections 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.545+0000 7f3778742640 1 -- 172.21.15.76:0/2100960821 wait complete. 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 Processor -- start 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 -- start start 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 0x7f3770069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3770101c00 0x7f377019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37701025c0 0x7f377019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f377010c840 con 0x7f3770100a10 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f377010c6c0 con 0x7f3770101c00 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3778742640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f377010c9c0 con 0x7f37701025c0 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 0x7f3770069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 0x7f3770069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35694/0 (socket says 172.21.15.76:35694) 2024-09-19T07:51:15.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 -- 172.21.15.76:0/3874126139 learned_addr learned my addr 172.21.15.76:0/3874126139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3775cdd640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3770101c00 0x7f377019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f3776cdf640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37701025c0 0x7f377019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 -- 172.21.15.76:0/3874126139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37701025c0 msgr2=0x7f377019f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37701025c0 0x7f377019f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 -- 172.21.15.76:0/3874126139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3770101c00 msgr2=0x7f377019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3770101c00 0x7f377019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.546+0000 7f37764de640 1 -- 172.21.15.76:0/3874126139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377019fb10 con 0x7f3770100a10 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.547+0000 7f37764de640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 0x7f3770069ef0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e9c0 tx=0x7f376c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.547+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c00cd80 con 0x7f3770100a10 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.547+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377019fda0 con 0x7f3770100a10 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.547+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f376c0035f0 con 0x7f3770100a10 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.547+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c010670 con 0x7f3770100a10 2024-09-19T07:51:15.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.547+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37701a0210 con 0x7f3770100a10 2024-09-19T07:51:15.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.548+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3770107cd0 con 0x7f3770100a10 2024-09-19T07:51:15.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.549+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f376c0037a0 con 0x7f3770100a10 2024-09-19T07:51:15.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.550+0000 7f37677fe640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f375c0a33c0 0x7f375c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.550+0000 7f3775cdd640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f375c0a33c0 0x7f375c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.550+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f376c0d00b0 con 0x7f3770100a10 2024-09-19T07:51:15.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.550+0000 7f3775cdd640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f375c0a33c0 0x7f375c0a5880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3770069c60 tx=0x7f3760005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:15.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.554+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f376c09ca90 con 0x7f3770100a10 2024-09-19T07:51:15.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.748+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3770062630 con 0x7f375c0a33c0 2024-09-19T07:51:15.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.754+0000 7f37677fe640 1 -- 172.21.15.76:0/3874126139 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257988 (secure 0 0 0) 0x7f3770062630 con 0x7f375c0a33c0 2024-09-19T07:51:15.758 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:15.759 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:51:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f375c0a33c0 msgr2=0x7f375c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f375c0a33c0 0x7f375c0a5880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3770069c60 tx=0x7f3760005f90 comp rx=0 tx=0).stop 2024-09-19T07:51:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 msgr2=0x7f3770069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 0x7f3770069ef0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e9c0 tx=0x7f376c00ee80 comp rx=0 tx=0).stop 2024-09-19T07:51:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 shutdown_connections 2024-09-19T07:51:15.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f375c0a33c0 0x7f375c0a5880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37701025c0 0x7f377019f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3770101c00 0x7f377019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 --2- 172.21.15.76:0/3874126139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3770100a10 0x7f3770069ef0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.757+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 >> 172.21.15.76:0/3874126139 conn(0x7f37700fc170 msgr2=0x7f3770104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:15.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.758+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 shutdown_connections 2024-09-19T07:51:15.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.758+0000 7f3778742640 1 -- 172.21.15.76:0/3874126139 wait complete. 2024-09-19T07:51:15.770 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T07:51:14.791672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187221,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":844,"num_read_kb":582,"num_write":475,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381432,"kb_used_data":11360,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560392,"statfs":{"total":1151940427776,"available":1151549841408,"internally_reserved":0,"allocated":11632640,"data_stored":8531049,"data_compressed":259554,"data_compressed_allocated":344064,"data_compressed_original":3194880,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.990886"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073201+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:51:13.073201+0000","last_peered":"2024-09-19T07:51:13.073201+0000","last_clean":"2024-09-19T07:51:13.073201+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:51:13.073201+0000","last_undegraded":"2024-09-19T07:51:13.073201+0000","last_fullsized":"2024-09-19T07:51:13.073201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053081+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:51:13.053081+0000","last_peered":"2024-09-19T07:51:13.053081+0000","last_clean":"2024-09-19T07:51:13.053081+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:51:13.053081+0000","last_undegraded":"2024-09-19T07:51:13.053081+0000","last_fullsized":"2024-09-19T07:51:13.053081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052870+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:51:13.052870+0000","last_peered":"2024-09-19T07:51:13.052870+0000","last_clean":"2024-09-19T07:51:13.052870+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:51:13.052870+0000","last_undegraded":"2024-09-19T07:51:13.052870+0000","last_fullsized":"2024-09-19T07:51:13.052870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786281+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:51:12.786281+0000","last_peered":"2024-09-19T07:51:12.786281+0000","last_clean":"2024-09-19T07:51:12.786281+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:51:12.786281+0000","last_undegraded":"2024-09-19T07:51:12.786281+0000","last_fullsized":"2024-09-19T07:51:12.786281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885874+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:51:12.885874+0000","last_peered":"2024-09-19T07:51:12.885874+0000","last_clean":"2024-09-19T07:51:12.885874+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:51:12.885874+0000","last_undegraded":"2024-09-19T07:51:12.885874+0000","last_fullsized":"2024-09-19T07:51:12.885874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820633+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:51:12.820633+0000","last_peered":"2024-09-19T07:51:12.820633+0000","last_clean":"2024-09-19T07:51:12.820633+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:51:12.820633+0000","last_undegraded":"2024-09-19T07:51:12.820633+0000","last_fullsized":"2024-09-19T07:51:12.820633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085272+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:51:13.085272+0000","last_peered":"2024-09-19T07:51:13.085272+0000","last_clean":"2024-09-19T07:51:13.085272+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:51:13.085272+0000","last_undegraded":"2024-09-19T07:51:13.085272+0000","last_fullsized":"2024-09-19T07:51:13.085272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886640+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:51:12.886640+0000","last_peered":"2024-09-19T07:51:12.886640+0000","last_clean":"2024-09-19T07:51:12.886640+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:51:12.886640+0000","last_undegraded":"2024-09-19T07:51:12.886640+0000","last_fullsized":"2024-09-19T07:51:12.886640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779282+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:51:12.779282+0000","last_peered":"2024-09-19T07:51:12.779282+0000","last_clean":"2024-09-19T07:51:12.779282+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:51:12.779282+0000","last_undegraded":"2024-09-19T07:51:12.779282+0000","last_fullsized":"2024-09-19T07:51:12.779282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820979+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:51:12.820979+0000","last_peered":"2024-09-19T07:51:12.820979+0000","last_clean":"2024-09-19T07:51:12.820979+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:51:12.820979+0000","last_undegraded":"2024-09-19T07:51:12.820979+0000","last_fullsized":"2024-09-19T07:51:12.820979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085724+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:51:13.085724+0000","last_peered":"2024-09-19T07:51:13.085724+0000","last_clean":"2024-09-19T07:51:13.085724+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:51:13.085724+0000","last_undegraded":"2024-09-19T07:51:13.085724+0000","last_fullsized":"2024-09-19T07:51:13.085724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786352+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:51:12.786352+0000","last_peered":"2024-09-19T07:51:12.786352+0000","last_clean":"2024-09-19T07:51:12.786352+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:51:12.786352+0000","last_undegraded":"2024-09-19T07:51:12.786352+0000","last_fullsized":"2024-09-19T07:51:12.786352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777843+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:51:12.777843+0000","last_peered":"2024-09-19T07:51:12.777843+0000","last_clean":"2024-09-19T07:51:12.777843+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:51:12.777843+0000","last_undegraded":"2024-09-19T07:51:12.777843+0000","last_fullsized":"2024-09-19T07:51:12.777843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052179+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:51:13.052179+0000","last_peered":"2024-09-19T07:51:13.052179+0000","last_clean":"2024-09-19T07:51:13.052179+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:51:13.052179+0000","last_undegraded":"2024-09-19T07:51:13.052179+0000","last_fullsized":"2024-09-19T07:51:13.052179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.051887+0000","last_change":"2024-09-19T07:50:34.028760+0000","last_active":"2024-09-19T07:51:13.051887+0000","last_peered":"2024-09-19T07:51:13.051887+0000","last_clean":"2024-09-19T07:51:13.051887+0000","last_became_active":"2024-09-19T07:50:34.028384+0000","last_became_peered":"2024-09-19T07:50:34.028384+0000","last_unstale":"2024-09-19T07:51:13.051887+0000","last_undegraded":"2024-09-19T07:51:13.051887+0000","last_fullsized":"2024-09-19T07:51:13.051887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:00.072227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778575+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:51:12.778575+0000","last_peered":"2024-09-19T07:51:12.778575+0000","last_clean":"2024-09-19T07:51:12.778575+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:51:12.778575+0000","last_undegraded":"2024-09-19T07:51:12.778575+0000","last_fullsized":"2024-09-19T07:51:12.778575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073263+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:51:13.073263+0000","last_peered":"2024-09-19T07:51:13.073263+0000","last_clean":"2024-09-19T07:51:13.073263+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:51:13.073263+0000","last_undegraded":"2024-09-19T07:51:13.073263+0000","last_fullsized":"2024-09-19T07:51:13.073263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884084+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:51:12.884084+0000","last_peered":"2024-09-19T07:51:12.884084+0000","last_clean":"2024-09-19T07:51:12.884084+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:51:12.884084+0000","last_undegraded":"2024-09-19T07:51:12.884084+0000","last_fullsized":"2024-09-19T07:51:12.884084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779398+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:51:12.779398+0000","last_peered":"2024-09-19T07:51:12.779398+0000","last_clean":"2024-09-19T07:51:12.779398+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:51:12.779398+0000","last_undegraded":"2024-09-19T07:51:12.779398+0000","last_fullsized":"2024-09-19T07:51:12.779398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777912+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:51:12.777912+0000","last_peered":"2024-09-19T07:51:12.777912+0000","last_clean":"2024-09-19T07:51:12.777912+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:51:12.777912+0000","last_undegraded":"2024-09-19T07:51:12.777912+0000","last_fullsized":"2024-09-19T07:51:12.777912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778712+0000","last_change":"2024-09-19T07:50:34.030741+0000","last_active":"2024-09-19T07:51:12.778712+0000","last_peered":"2024-09-19T07:51:12.778712+0000","last_clean":"2024-09-19T07:51:12.778712+0000","last_became_active":"2024-09-19T07:50:34.030300+0000","last_became_peered":"2024-09-19T07:50:34.030300+0000","last_unstale":"2024-09-19T07:51:12.778712+0000","last_undegraded":"2024-09-19T07:51:12.778712+0000","last_fullsized":"2024-09-19T07:51:12.778712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:30.131138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886659+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:51:12.886659+0000","last_peered":"2024-09-19T07:51:12.886659+0000","last_clean":"2024-09-19T07:51:12.886659+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:51:12.886659+0000","last_undegraded":"2024-09-19T07:51:12.886659+0000","last_fullsized":"2024-09-19T07:51:12.886659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897046+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:51:12.897046+0000","last_peered":"2024-09-19T07:51:12.897046+0000","last_clean":"2024-09-19T07:51:12.897046+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:51:12.897046+0000","last_undegraded":"2024-09-19T07:51:12.897046+0000","last_fullsized":"2024-09-19T07:51:12.897046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886916+0000","last_change":"2024-09-19T07:50:34.028762+0000","last_active":"2024-09-19T07:51:12.886916+0000","last_peered":"2024-09-19T07:51:12.886916+0000","last_clean":"2024-09-19T07:51:12.886916+0000","last_became_active":"2024-09-19T07:50:34.028343+0000","last_became_peered":"2024-09-19T07:50:34.028343+0000","last_unstale":"2024-09-19T07:51:12.886916+0000","last_undegraded":"2024-09-19T07:51:12.886916+0000","last_fullsized":"2024-09-19T07:51:12.886916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:08.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779564+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:51:12.779564+0000","last_peered":"2024-09-19T07:51:12.779564+0000","last_clean":"2024-09-19T07:51:12.779564+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:51:12.779564+0000","last_undegraded":"2024-09-19T07:51:12.779564+0000","last_fullsized":"2024-09-19T07:51:12.779564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072980+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:51:13.072980+0000","last_peered":"2024-09-19T07:51:13.072980+0000","last_clean":"2024-09-19T07:51:13.072980+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:51:13.072980+0000","last_undegraded":"2024-09-19T07:51:13.072980+0000","last_fullsized":"2024-09-19T07:51:13.072980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778090+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:51:12.778090+0000","last_peered":"2024-09-19T07:51:12.778090+0000","last_clean":"2024-09-19T07:51:12.778090+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:51:12.778090+0000","last_undegraded":"2024-09-19T07:51:12.778090+0000","last_fullsized":"2024-09-19T07:51:12.778090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052432+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:51:13.052432+0000","last_peered":"2024-09-19T07:51:13.052432+0000","last_clean":"2024-09-19T07:51:13.052432+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:51:13.052432+0000","last_undegraded":"2024-09-19T07:51:13.052432+0000","last_fullsized":"2024-09-19T07:51:13.052432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779132+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:51:12.779132+0000","last_peered":"2024-09-19T07:51:12.779132+0000","last_clean":"2024-09-19T07:51:12.779132+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:51:12.779132+0000","last_undegraded":"2024-09-19T07:51:12.779132+0000","last_fullsized":"2024-09-19T07:51:12.779132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779167+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:51:12.779167+0000","last_peered":"2024-09-19T07:51:12.779167+0000","last_clean":"2024-09-19T07:51:12.779167+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:51:12.779167+0000","last_undegraded":"2024-09-19T07:51:12.779167+0000","last_fullsized":"2024-09-19T07:51:12.779167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:50:34.028399+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:50:34.027948+0000","last_became_peered":"2024-09-19T07:50:34.027948+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:36.822727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885803+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:51:12.885803+0000","last_peered":"2024-09-19T07:51:12.885803+0000","last_clean":"2024-09-19T07:51:12.885803+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:51:12.885803+0000","last_undegraded":"2024-09-19T07:51:12.885803+0000","last_fullsized":"2024-09-19T07:51:12.885803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.768983+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:13.768983+0000","last_peered":"2024-09-19T07:51:13.768983+0000","last_clean":"2024-09-19T07:51:13.768983+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:51:13.768983+0000","last_undegraded":"2024-09-19T07:51:13.768983+0000","last_fullsized":"2024-09-19T07:51:13.768983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897140+0000","last_change":"2024-09-19T07:50:34.026626+0000","last_active":"2024-09-19T07:51:12.897140+0000","last_peered":"2024-09-19T07:51:12.897140+0000","last_clean":"2024-09-19T07:51:12.897140+0000","last_became_active":"2024-09-19T07:50:34.026058+0000","last_became_peered":"2024-09-19T07:50:34.026058+0000","last_unstale":"2024-09-19T07:51:12.897140+0000","last_undegraded":"2024-09-19T07:51:12.897140+0000","last_fullsized":"2024-09-19T07:51:12.897140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:22.700331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820706+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:51:12.820706+0000","last_peered":"2024-09-19T07:51:12.820706+0000","last_clean":"2024-09-19T07:51:12.820706+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:51:12.820706+0000","last_undegraded":"2024-09-19T07:51:12.820706+0000","last_fullsized":"2024-09-19T07:51:12.820706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777625+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:51:12.777625+0000","last_peered":"2024-09-19T07:51:12.777625+0000","last_clean":"2024-09-19T07:51:12.777625+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:51:12.777625+0000","last_undegraded":"2024-09-19T07:51:12.777625+0000","last_fullsized":"2024-09-19T07:51:12.777625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886790+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:51:12.886790+0000","last_peered":"2024-09-19T07:51:12.886790+0000","last_clean":"2024-09-19T07:51:12.886790+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:51:12.886790+0000","last_undegraded":"2024-09-19T07:51:12.886790+0000","last_fullsized":"2024-09-19T07:51:12.886790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897268+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:51:12.897268+0000","last_peered":"2024-09-19T07:51:12.897268+0000","last_clean":"2024-09-19T07:51:12.897268+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:51:12.897268+0000","last_undegraded":"2024-09-19T07:51:12.897268+0000","last_fullsized":"2024-09-19T07:51:12.897268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883449+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:51:12.883449+0000","last_peered":"2024-09-19T07:51:12.883449+0000","last_clean":"2024-09-19T07:51:12.883449+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:51:12.883449+0000","last_undegraded":"2024-09-19T07:51:12.883449+0000","last_fullsized":"2024-09-19T07:51:12.883449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820984+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:51:12.820984+0000","last_peered":"2024-09-19T07:51:12.820984+0000","last_clean":"2024-09-19T07:51:12.820984+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:51:12.820984+0000","last_undegraded":"2024-09-19T07:51:12.820984+0000","last_fullsized":"2024-09-19T07:51:12.820984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779095+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:51:12.779095+0000","last_peered":"2024-09-19T07:51:12.779095+0000","last_clean":"2024-09-19T07:51:12.779095+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:51:12.779095+0000","last_undegraded":"2024-09-19T07:51:12.779095+0000","last_fullsized":"2024-09-19T07:51:12.779095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085762+0000","last_change":"2024-09-19T07:50:34.356734+0000","last_active":"2024-09-19T07:51:13.085762+0000","last_peered":"2024-09-19T07:51:13.085762+0000","last_clean":"2024-09-19T07:51:13.085762+0000","last_became_active":"2024-09-19T07:50:34.350578+0000","last_became_peered":"2024-09-19T07:50:34.350578+0000","last_unstale":"2024-09-19T07:51:13.085762+0000","last_undegraded":"2024-09-19T07:51:13.085762+0000","last_fullsized":"2024-09-19T07:51:13.085762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:57.110465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053636+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:51:13.053636+0000","last_peered":"2024-09-19T07:51:13.053636+0000","last_clean":"2024-09-19T07:51:13.053636+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:51:13.053636+0000","last_undegraded":"2024-09-19T07:51:13.053636+0000","last_fullsized":"2024-09-19T07:51:13.053636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897310+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:51:12.897310+0000","last_peered":"2024-09-19T07:51:12.897310+0000","last_clean":"2024-09-19T07:51:12.897310+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:51:12.897310+0000","last_undegraded":"2024-09-19T07:51:12.897310+0000","last_fullsized":"2024-09-19T07:51:12.897310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778760+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:51:12.778760+0000","last_peered":"2024-09-19T07:51:12.778760+0000","last_clean":"2024-09-19T07:51:12.778760+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:51:12.778760+0000","last_undegraded":"2024-09-19T07:51:12.778760+0000","last_fullsized":"2024-09-19T07:51:12.778760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.768998+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:51:13.768998+0000","last_peered":"2024-09-19T07:51:13.768998+0000","last_clean":"2024-09-19T07:51:13.768998+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:51:13.768998+0000","last_undegraded":"2024-09-19T07:51:13.768998+0000","last_fullsized":"2024-09-19T07:51:13.768998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":168,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885917+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:51:12.885917+0000","last_peered":"2024-09-19T07:51:12.885917+0000","last_clean":"2024-09-19T07:51:12.885917+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:51:12.885917+0000","last_undegraded":"2024-09-19T07:51:12.885917+0000","last_fullsized":"2024-09-19T07:51:12.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779272+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:12.779272+0000","last_peered":"2024-09-19T07:51:12.779272+0000","last_clean":"2024-09-19T07:51:12.779272+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:51:12.779272+0000","last_undegraded":"2024-09-19T07:51:12.779272+0000","last_fullsized":"2024-09-19T07:51:12.779272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777765+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:51:12.777765+0000","last_peered":"2024-09-19T07:51:12.777765+0000","last_clean":"2024-09-19T07:51:12.777765+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:51:12.777765+0000","last_undegraded":"2024-09-19T07:51:12.777765+0000","last_fullsized":"2024-09-19T07:51:12.777765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897105+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:51:12.897105+0000","last_peered":"2024-09-19T07:51:12.897105+0000","last_clean":"2024-09-19T07:51:12.897105+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:51:12.897105+0000","last_undegraded":"2024-09-19T07:51:12.897105+0000","last_fullsized":"2024-09-19T07:51:12.897105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085518+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:51:13.085518+0000","last_peered":"2024-09-19T07:51:13.085518+0000","last_clean":"2024-09-19T07:51:13.085518+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:51:13.085518+0000","last_undegraded":"2024-09-19T07:51:13.085518+0000","last_fullsized":"2024-09-19T07:51:13.085518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.788097+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:51:13.788097+0000","last_peered":"2024-09-19T07:51:13.788097+0000","last_clean":"2024-09-19T07:51:13.788097+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:51:13.788097+0000","last_undegraded":"2024-09-19T07:51:13.788097+0000","last_fullsized":"2024-09-19T07:51:13.788097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085252+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:51:13.085252+0000","last_peered":"2024-09-19T07:51:13.085252+0000","last_clean":"2024-09-19T07:51:13.085252+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:51:13.085252+0000","last_undegraded":"2024-09-19T07:51:13.085252+0000","last_fullsized":"2024-09-19T07:51:13.085252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884108+0000","last_change":"2024-09-19T07:50:34.349498+0000","last_active":"2024-09-19T07:51:12.884108+0000","last_peered":"2024-09-19T07:51:12.884108+0000","last_clean":"2024-09-19T07:51:12.884108+0000","last_became_active":"2024-09-19T07:50:34.349238+0000","last_became_peered":"2024-09-19T07:50:34.349238+0000","last_unstale":"2024-09-19T07:51:12.884108+0000","last_undegraded":"2024-09-19T07:51:12.884108+0000","last_fullsized":"2024-09-19T07:51:12.884108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:40.879641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885913+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:51:12.885913+0000","last_peered":"2024-09-19T07:51:12.885913+0000","last_clean":"2024-09-19T07:51:12.885913+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:51:12.885913+0000","last_undegraded":"2024-09-19T07:51:12.885913+0000","last_fullsized":"2024-09-19T07:51:12.885913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073006+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:51:13.073006+0000","last_peered":"2024-09-19T07:51:13.073006+0000","last_clean":"2024-09-19T07:51:13.073006+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:51:13.073006+0000","last_undegraded":"2024-09-19T07:51:13.073006+0000","last_fullsized":"2024-09-19T07:51:13.073006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778040+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:51:12.778040+0000","last_peered":"2024-09-19T07:51:12.778040+0000","last_clean":"2024-09-19T07:51:12.778040+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:51:12.778040+0000","last_undegraded":"2024-09-19T07:51:12.778040+0000","last_fullsized":"2024-09-19T07:51:12.778040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085798+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:51:13.085798+0000","last_peered":"2024-09-19T07:51:13.085798+0000","last_clean":"2024-09-19T07:51:13.085798+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:51:13.085798+0000","last_undegraded":"2024-09-19T07:51:13.085798+0000","last_fullsized":"2024-09-19T07:51:13.085798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.022869+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:51:13.022869+0000","last_peered":"2024-09-19T07:51:13.022869+0000","last_clean":"2024-09-19T07:51:13.022869+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:51:13.022869+0000","last_undegraded":"2024-09-19T07:51:13.022869+0000","last_fullsized":"2024-09-19T07:51:13.022869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085413+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:51:13.085413+0000","last_peered":"2024-09-19T07:51:13.085413+0000","last_clean":"2024-09-19T07:51:13.085413+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:51:13.085413+0000","last_undegraded":"2024-09-19T07:51:13.085413+0000","last_fullsized":"2024-09-19T07:51:13.085413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779460+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:51:12.779460+0000","last_peered":"2024-09-19T07:51:12.779460+0000","last_clean":"2024-09-19T07:51:12.779460+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:51:12.779460+0000","last_undegraded":"2024-09-19T07:51:12.779460+0000","last_fullsized":"2024-09-19T07:51:12.779460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085732+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:51:13.085732+0000","last_peered":"2024-09-19T07:51:13.085732+0000","last_clean":"2024-09-19T07:51:13.085732+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:51:13.085732+0000","last_undegraded":"2024-09-19T07:51:13.085732+0000","last_fullsized":"2024-09-19T07:51:13.085732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085402+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:51:13.085402+0000","last_peered":"2024-09-19T07:51:13.085402+0000","last_clean":"2024-09-19T07:51:13.085402+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:51:13.085402+0000","last_undegraded":"2024-09-19T07:51:13.085402+0000","last_fullsized":"2024-09-19T07:51:13.085402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786233+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:51:12.786233+0000","last_peered":"2024-09-19T07:51:12.786233+0000","last_clean":"2024-09-19T07:51:12.786233+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:51:12.786233+0000","last_undegraded":"2024-09-19T07:51:12.786233+0000","last_fullsized":"2024-09-19T07:51:12.786233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883560+0000","last_change":"2024-09-19T07:50:34.028464+0000","last_active":"2024-09-19T07:51:12.883560+0000","last_peered":"2024-09-19T07:51:12.883560+0000","last_clean":"2024-09-19T07:51:12.883560+0000","last_became_active":"2024-09-19T07:50:34.028078+0000","last_became_peered":"2024-09-19T07:50:34.028078+0000","last_unstale":"2024-09-19T07:51:12.883560+0000","last_undegraded":"2024-09-19T07:51:12.883560+0000","last_fullsized":"2024-09-19T07:51:12.883560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:33.498575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085358+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:51:13.085358+0000","last_peered":"2024-09-19T07:51:13.085358+0000","last_clean":"2024-09-19T07:51:13.085358+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:51:13.085358+0000","last_undegraded":"2024-09-19T07:51:13.085358+0000","last_fullsized":"2024-09-19T07:51:13.085358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777583+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:51:12.777583+0000","last_peered":"2024-09-19T07:51:12.777583+0000","last_clean":"2024-09-19T07:51:12.777583+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:51:12.777583+0000","last_undegraded":"2024-09-19T07:51:12.777583+0000","last_fullsized":"2024-09-19T07:51:12.777583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085819+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:51:13.085819+0000","last_peered":"2024-09-19T07:51:13.085819+0000","last_clean":"2024-09-19T07:51:13.085819+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:51:13.085819+0000","last_undegraded":"2024-09-19T07:51:13.085819+0000","last_fullsized":"2024-09-19T07:51:13.085819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897052+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:51:12.897052+0000","last_peered":"2024-09-19T07:51:12.897052+0000","last_clean":"2024-09-19T07:51:12.897052+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:51:12.897052+0000","last_undegraded":"2024-09-19T07:51:12.897052+0000","last_fullsized":"2024-09-19T07:51:12.897052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085545+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:51:13.085545+0000","last_peered":"2024-09-19T07:51:13.085545+0000","last_clean":"2024-09-19T07:51:13.085545+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:51:13.085545+0000","last_undegraded":"2024-09-19T07:51:13.085545+0000","last_fullsized":"2024-09-19T07:51:13.085545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820738+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:51:12.820738+0000","last_peered":"2024-09-19T07:51:12.820738+0000","last_clean":"2024-09-19T07:51:12.820738+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:51:12.820738+0000","last_undegraded":"2024-09-19T07:51:12.820738+0000","last_fullsized":"2024-09-19T07:51:12.820738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884217+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:51:12.884217+0000","last_peered":"2024-09-19T07:51:12.884217+0000","last_clean":"2024-09-19T07:51:12.884217+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:51:12.884217+0000","last_undegraded":"2024-09-19T07:51:12.884217+0000","last_fullsized":"2024-09-19T07:51:12.884217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820842+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:51:12.820842+0000","last_peered":"2024-09-19T07:51:12.820842+0000","last_clean":"2024-09-19T07:51:12.820842+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:51:12.820842+0000","last_undegraded":"2024-09-19T07:51:12.820842+0000","last_fullsized":"2024-09-19T07:51:12.820842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886077+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:51:12.886077+0000","last_peered":"2024-09-19T07:51:12.886077+0000","last_clean":"2024-09-19T07:51:12.886077+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:51:12.886077+0000","last_undegraded":"2024-09-19T07:51:12.886077+0000","last_fullsized":"2024-09-19T07:51:12.886077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778175+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:51:12.778175+0000","last_peered":"2024-09-19T07:51:12.778175+0000","last_clean":"2024-09-19T07:51:12.778175+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:51:12.778175+0000","last_undegraded":"2024-09-19T07:51:12.778175+0000","last_fullsized":"2024-09-19T07:51:12.778175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'49","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.032938+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:51:13.032938+0000","last_peered":"2024-09-19T07:51:13.032938+0000","last_clean":"2024-09-19T07:51:13.032938+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:51:13.032938+0000","last_undegraded":"2024-09-19T07:51:13.032938+0000","last_fullsized":"2024-09-19T07:51:13.032938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887028+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:51:12.887028+0000","last_peered":"2024-09-19T07:51:12.887028+0000","last_clean":"2024-09-19T07:51:12.887028+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:51:12.887028+0000","last_undegraded":"2024-09-19T07:51:12.887028+0000","last_fullsized":"2024-09-19T07:51:12.887028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786476+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:51:12.786476+0000","last_peered":"2024-09-19T07:51:12.786476+0000","last_clean":"2024-09-19T07:51:12.786476+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:51:12.786476+0000","last_undegraded":"2024-09-19T07:51:12.786476+0000","last_fullsized":"2024-09-19T07:51:12.786476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053199+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:51:13.053199+0000","last_peered":"2024-09-19T07:51:13.053199+0000","last_clean":"2024-09-19T07:51:13.053199+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:51:13.053199+0000","last_undegraded":"2024-09-19T07:51:13.053199+0000","last_fullsized":"2024-09-19T07:51:13.053199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778663+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:51:12.778663+0000","last_peered":"2024-09-19T07:51:12.778663+0000","last_clean":"2024-09-19T07:51:12.778663+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:51:12.778663+0000","last_undegraded":"2024-09-19T07:51:12.778663+0000","last_fullsized":"2024-09-19T07:51:12.778663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886882+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:51:12.886882+0000","last_peered":"2024-09-19T07:51:12.886882+0000","last_clean":"2024-09-19T07:51:12.886882+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:51:12.886882+0000","last_undegraded":"2024-09-19T07:51:12.886882+0000","last_fullsized":"2024-09-19T07:51:12.886882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073002+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:51:13.073002+0000","last_peered":"2024-09-19T07:51:13.073002+0000","last_clean":"2024-09-19T07:51:13.073002+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:51:13.073002+0000","last_undegraded":"2024-09-19T07:51:13.073002+0000","last_fullsized":"2024-09-19T07:51:13.073002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779211+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:51:12.779211+0000","last_peered":"2024-09-19T07:51:12.779211+0000","last_clean":"2024-09-19T07:51:12.779211+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:51:12.779211+0000","last_undegraded":"2024-09-19T07:51:12.779211+0000","last_fullsized":"2024-09-19T07:51:12.779211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887345+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:51:12.887345+0000","last_peered":"2024-09-19T07:51:12.887345+0000","last_clean":"2024-09-19T07:51:12.887345+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:51:12.887345+0000","last_undegraded":"2024-09-19T07:51:12.887345+0000","last_fullsized":"2024-09-19T07:51:12.887345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885828+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:51:12.885828+0000","last_peered":"2024-09-19T07:51:12.885828+0000","last_clean":"2024-09-19T07:51:12.885828+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:51:12.885828+0000","last_undegraded":"2024-09-19T07:51:12.885828+0000","last_fullsized":"2024-09-19T07:51:12.885828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085403+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:51:13.085403+0000","last_peered":"2024-09-19T07:51:13.085403+0000","last_clean":"2024-09-19T07:51:13.085403+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:51:13.085403+0000","last_undegraded":"2024-09-19T07:51:13.085403+0000","last_fullsized":"2024-09-19T07:51:13.085403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897311+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:51:12.897311+0000","last_peered":"2024-09-19T07:51:12.897311+0000","last_clean":"2024-09-19T07:51:12.897311+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:51:12.897311+0000","last_undegraded":"2024-09-19T07:51:12.897311+0000","last_fullsized":"2024-09-19T07:51:12.897311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886120+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:51:12.886120+0000","last_peered":"2024-09-19T07:51:12.886120+0000","last_clean":"2024-09-19T07:51:12.886120+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:51:12.886120+0000","last_undegraded":"2024-09-19T07:51:12.886120+0000","last_fullsized":"2024-09-19T07:51:12.886120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778673+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:51:12.778673+0000","last_peered":"2024-09-19T07:51:12.778673+0000","last_clean":"2024-09-19T07:51:12.778673+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:51:12.778673+0000","last_undegraded":"2024-09-19T07:51:12.778673+0000","last_fullsized":"2024-09-19T07:51:12.778673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886035+0000","last_change":"2024-09-19T07:50:34.354839+0000","last_active":"2024-09-19T07:51:12.886035+0000","last_peered":"2024-09-19T07:51:12.886035+0000","last_clean":"2024-09-19T07:51:12.886035+0000","last_became_active":"2024-09-19T07:50:34.350424+0000","last_became_peered":"2024-09-19T07:50:34.350424+0000","last_unstale":"2024-09-19T07:51:12.886035+0000","last_undegraded":"2024-09-19T07:51:12.886035+0000","last_fullsized":"2024-09-19T07:51:12.886035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:36.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053516+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:51:13.053516+0000","last_peered":"2024-09-19T07:51:13.053516+0000","last_clean":"2024-09-19T07:51:13.053516+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:51:13.053516+0000","last_undegraded":"2024-09-19T07:51:13.053516+0000","last_fullsized":"2024-09-19T07:51:13.053516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887230+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:51:12.887230+0000","last_peered":"2024-09-19T07:51:12.887230+0000","last_clean":"2024-09-19T07:51:12.887230+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:51:12.887230+0000","last_undegraded":"2024-09-19T07:51:12.887230+0000","last_fullsized":"2024-09-19T07:51:12.887230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886656+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:51:12.886656+0000","last_peered":"2024-09-19T07:51:12.886656+0000","last_clean":"2024-09-19T07:51:12.886656+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:51:12.886656+0000","last_undegraded":"2024-09-19T07:51:12.886656+0000","last_fullsized":"2024-09-19T07:51:12.886656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884312+0000","last_change":"2024-09-19T07:50:34.034480+0000","last_active":"2024-09-19T07:51:12.884312+0000","last_peered":"2024-09-19T07:51:12.884312+0000","last_clean":"2024-09-19T07:51:12.884312+0000","last_became_active":"2024-09-19T07:50:34.027982+0000","last_became_peered":"2024-09-19T07:50:34.027982+0000","last_unstale":"2024-09-19T07:51:12.884312+0000","last_undegraded":"2024-09-19T07:51:12.884312+0000","last_fullsized":"2024-09-19T07:51:12.884312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:40.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596619,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":708,"num_read_kb":463,"num_write":292,"num_write_kb":1435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1789857,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":450902,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":1240856,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":844354,"data_compressed":27820,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":441491,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1034146,"data_compressed":41576,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":450527,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1175201,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":451357,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":975654,"data_compressed":33976,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":512525,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":502238,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":451798,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134396,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":200051,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:51:15.775 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:51:15.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 -- 172.21.15.76:0/1908542859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0101c20 msgr2=0x7f2ad01020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 --2- 172.21.15.76:0/1908542859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0101c20 0x7f2ad01020a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a410 comp rx=0 tx=0).stop 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 -- 172.21.15.76:0/1908542859 shutdown_connections 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 --2- 172.21.15.76:0/1908542859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ad01025e0 0x7f2ad0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 --2- 172.21.15.76:0/1908542859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0101c20 0x7f2ad01020a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 --2- 172.21.15.76:0/1908542859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad0100a30 0x7f2ad0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 -- 172.21.15.76:0/1908542859 >> 172.21.15.76:0/1908542859 conn(0x7f2ad00fc1b0 msgr2=0x7f2ad00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.918+0000 7f2ad560a640 1 -- 172.21.15.76:0/1908542859 shutdown_connections 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 -- 172.21.15.76:0/1908542859 wait complete. 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 Processor -- start 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 -- start start 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 0x7f2ad006ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ad0101c20 0x7f2ad019f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad01025e0 0x7f2ad01a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010c860 con 0x7f2ad0100a30 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010c6e0 con 0x7f2ad0101c20 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ad560a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010c9e0 con 0x7f2ad01025e0 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 0x7f2ad006ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 0x7f2ad006ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35710/0 (socket says 172.21.15.76:35710) 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2aceffd640 1 -- 172.21.15.76:0/733734292 learned_addr learned my addr 172.21.15.76:0/733734292 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2acf7fe640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad01025e0 0x7f2ad01a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.919+0000 7f2ac7fff640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ad0101c20 0x7f2ad019f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2aceffd640 1 -- 172.21.15.76:0/733734292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad01025e0 msgr2=0x7f2ad01a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2aceffd640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad01025e0 0x7f2ad01a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2aceffd640 1 -- 172.21.15.76:0/733734292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ad0101c20 msgr2=0x7f2ad019f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2aceffd640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ad0101c20 0x7f2ad019f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2aceffd640 1 -- 172.21.15.76:0/733734292 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01a1da0 con 0x7f2ad0100a30 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2aceffd640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 0x7f2ad006ab50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e9c0 tx=0x7f2ac000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000cd80 con 0x7f2ad0100a30 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2ac00035f0 con 0x7f2ad0100a30 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad01a1fd0 con 0x7f2ad0100a30 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0010670 con 0x7f2ad0100a30 2024-09-19T07:51:15.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.920+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a2440 con 0x7f2ad0100a30 2024-09-19T07:51:15.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.921+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad0107dd0 con 0x7f2ad0100a30 2024-09-19T07:51:15.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.922+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f2ac00037a0 con 0x7f2ad0100a30 2024-09-19T07:51:15.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.923+0000 7f2accff9640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2abc0a33f0 0x7f2abc0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:15.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.923+0000 7f2ac7fff640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2abc0a33f0 0x7f2abc0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:15.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.923+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2ac00d0040 con 0x7f2ad0100a30 2024-09-19T07:51:15.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.924+0000 7f2ac7fff640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2abc0a33f0 0x7f2abc0a58b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8005ab0 tx=0x7f2ab8005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:15.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:15.928+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ac009ca20 con 0x7f2ad0100a30 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: Unable to set osd_memory_target on smithi137 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-19T07:51:16.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:15 smithi152 ceph-mon[35117]: Unable to set osd_memory_target on smithi152 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T07:51:16.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.103+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ad0062630 con 0x7f2abc0a33f0 2024-09-19T07:51:16.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.110+0000 7f2accff9640 1 -- 172.21.15.76:0/733734292 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257988 (secure 0 0 0) 0x7f2ad0062630 con 0x7f2abc0a33f0 2024-09-19T07:51:16.113 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:16.114 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2abc0a33f0 msgr2=0x7f2abc0a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2abc0a33f0 0x7f2abc0a58b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8005ab0 tx=0x7f2ab8005a20 comp rx=0 tx=0).stop 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 msgr2=0x7f2ad006ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 0x7f2ad006ab50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e9c0 tx=0x7f2ac000ee80 comp rx=0 tx=0).stop 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 shutdown_connections 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2abc0a33f0 0x7f2abc0a58b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad01025e0 0x7f2ad01a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ad0101c20 0x7f2ad019f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 --2- 172.21.15.76:0/733734292 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ad0100a30 0x7f2ad006ab50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 >> 172.21.15.76:0/733734292 conn(0x7f2ad00fc1b0 msgr2=0x7f2ad0104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:16.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 shutdown_connections 2024-09-19T07:51:16.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.113+0000 7f2ad560a640 1 -- 172.21.15.76:0/733734292 wait complete. 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: Unable to set osd_memory_target on smithi137 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-19T07:51:16.125 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:15 smithi076 ceph-mon[30930]: Unable to set osd_memory_target on smithi152 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T07:51:16.126 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T07:51:14.791672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187221,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":844,"num_read_kb":582,"num_write":475,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381432,"kb_used_data":11360,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560392,"statfs":{"total":1151940427776,"available":1151549841408,"internally_reserved":0,"allocated":11632640,"data_stored":8531049,"data_compressed":259554,"data_compressed_allocated":344064,"data_compressed_original":3194880,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.990886"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073201+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:51:13.073201+0000","last_peered":"2024-09-19T07:51:13.073201+0000","last_clean":"2024-09-19T07:51:13.073201+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:51:13.073201+0000","last_undegraded":"2024-09-19T07:51:13.073201+0000","last_fullsized":"2024-09-19T07:51:13.073201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053081+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:51:13.053081+0000","last_peered":"2024-09-19T07:51:13.053081+0000","last_clean":"2024-09-19T07:51:13.053081+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:51:13.053081+0000","last_undegraded":"2024-09-19T07:51:13.053081+0000","last_fullsized":"2024-09-19T07:51:13.053081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052870+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:51:13.052870+0000","last_peered":"2024-09-19T07:51:13.052870+0000","last_clean":"2024-09-19T07:51:13.052870+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:51:13.052870+0000","last_undegraded":"2024-09-19T07:51:13.052870+0000","last_fullsized":"2024-09-19T07:51:13.052870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786281+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:51:12.786281+0000","last_peered":"2024-09-19T07:51:12.786281+0000","last_clean":"2024-09-19T07:51:12.786281+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:51:12.786281+0000","last_undegraded":"2024-09-19T07:51:12.786281+0000","last_fullsized":"2024-09-19T07:51:12.786281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885874+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:51:12.885874+0000","last_peered":"2024-09-19T07:51:12.885874+0000","last_clean":"2024-09-19T07:51:12.885874+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:51:12.885874+0000","last_undegraded":"2024-09-19T07:51:12.885874+0000","last_fullsized":"2024-09-19T07:51:12.885874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820633+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:51:12.820633+0000","last_peered":"2024-09-19T07:51:12.820633+0000","last_clean":"2024-09-19T07:51:12.820633+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:51:12.820633+0000","last_undegraded":"2024-09-19T07:51:12.820633+0000","last_fullsized":"2024-09-19T07:51:12.820633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085272+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:51:13.085272+0000","last_peered":"2024-09-19T07:51:13.085272+0000","last_clean":"2024-09-19T07:51:13.085272+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:51:13.085272+0000","last_undegraded":"2024-09-19T07:51:13.085272+0000","last_fullsized":"2024-09-19T07:51:13.085272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886640+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:51:12.886640+0000","last_peered":"2024-09-19T07:51:12.886640+0000","last_clean":"2024-09-19T07:51:12.886640+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:51:12.886640+0000","last_undegraded":"2024-09-19T07:51:12.886640+0000","last_fullsized":"2024-09-19T07:51:12.886640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779282+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:51:12.779282+0000","last_peered":"2024-09-19T07:51:12.779282+0000","last_clean":"2024-09-19T07:51:12.779282+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:51:12.779282+0000","last_undegraded":"2024-09-19T07:51:12.779282+0000","last_fullsized":"2024-09-19T07:51:12.779282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820979+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:51:12.820979+0000","last_peered":"2024-09-19T07:51:12.820979+0000","last_clean":"2024-09-19T07:51:12.820979+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:51:12.820979+0000","last_undegraded":"2024-09-19T07:51:12.820979+0000","last_fullsized":"2024-09-19T07:51:12.820979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085724+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:51:13.085724+0000","last_peered":"2024-09-19T07:51:13.085724+0000","last_clean":"2024-09-19T07:51:13.085724+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:51:13.085724+0000","last_undegraded":"2024-09-19T07:51:13.085724+0000","last_fullsized":"2024-09-19T07:51:13.085724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786352+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:51:12.786352+0000","last_peered":"2024-09-19T07:51:12.786352+0000","last_clean":"2024-09-19T07:51:12.786352+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:51:12.786352+0000","last_undegraded":"2024-09-19T07:51:12.786352+0000","last_fullsized":"2024-09-19T07:51:12.786352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777843+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:51:12.777843+0000","last_peered":"2024-09-19T07:51:12.777843+0000","last_clean":"2024-09-19T07:51:12.777843+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:51:12.777843+0000","last_undegraded":"2024-09-19T07:51:12.777843+0000","last_fullsized":"2024-09-19T07:51:12.777843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052179+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:51:13.052179+0000","last_peered":"2024-09-19T07:51:13.052179+0000","last_clean":"2024-09-19T07:51:13.052179+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:51:13.052179+0000","last_undegraded":"2024-09-19T07:51:13.052179+0000","last_fullsized":"2024-09-19T07:51:13.052179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.051887+0000","last_change":"2024-09-19T07:50:34.028760+0000","last_active":"2024-09-19T07:51:13.051887+0000","last_peered":"2024-09-19T07:51:13.051887+0000","last_clean":"2024-09-19T07:51:13.051887+0000","last_became_active":"2024-09-19T07:50:34.028384+0000","last_became_peered":"2024-09-19T07:50:34.028384+0000","last_unstale":"2024-09-19T07:51:13.051887+0000","last_undegraded":"2024-09-19T07:51:13.051887+0000","last_fullsized":"2024-09-19T07:51:13.051887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:00.072227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778575+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:51:12.778575+0000","last_peered":"2024-09-19T07:51:12.778575+0000","last_clean":"2024-09-19T07:51:12.778575+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:51:12.778575+0000","last_undegraded":"2024-09-19T07:51:12.778575+0000","last_fullsized":"2024-09-19T07:51:12.778575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073263+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:51:13.073263+0000","last_peered":"2024-09-19T07:51:13.073263+0000","last_clean":"2024-09-19T07:51:13.073263+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:51:13.073263+0000","last_undegraded":"2024-09-19T07:51:13.073263+0000","last_fullsized":"2024-09-19T07:51:13.073263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884084+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:51:12.884084+0000","last_peered":"2024-09-19T07:51:12.884084+0000","last_clean":"2024-09-19T07:51:12.884084+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:51:12.884084+0000","last_undegraded":"2024-09-19T07:51:12.884084+0000","last_fullsized":"2024-09-19T07:51:12.884084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779398+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:51:12.779398+0000","last_peered":"2024-09-19T07:51:12.779398+0000","last_clean":"2024-09-19T07:51:12.779398+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:51:12.779398+0000","last_undegraded":"2024-09-19T07:51:12.779398+0000","last_fullsized":"2024-09-19T07:51:12.779398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777912+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:51:12.777912+0000","last_peered":"2024-09-19T07:51:12.777912+0000","last_clean":"2024-09-19T07:51:12.777912+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:51:12.777912+0000","last_undegraded":"2024-09-19T07:51:12.777912+0000","last_fullsized":"2024-09-19T07:51:12.777912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778712+0000","last_change":"2024-09-19T07:50:34.030741+0000","last_active":"2024-09-19T07:51:12.778712+0000","last_peered":"2024-09-19T07:51:12.778712+0000","last_clean":"2024-09-19T07:51:12.778712+0000","last_became_active":"2024-09-19T07:50:34.030300+0000","last_became_peered":"2024-09-19T07:50:34.030300+0000","last_unstale":"2024-09-19T07:51:12.778712+0000","last_undegraded":"2024-09-19T07:51:12.778712+0000","last_fullsized":"2024-09-19T07:51:12.778712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:30.131138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886659+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:51:12.886659+0000","last_peered":"2024-09-19T07:51:12.886659+0000","last_clean":"2024-09-19T07:51:12.886659+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:51:12.886659+0000","last_undegraded":"2024-09-19T07:51:12.886659+0000","last_fullsized":"2024-09-19T07:51:12.886659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897046+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:51:12.897046+0000","last_peered":"2024-09-19T07:51:12.897046+0000","last_clean":"2024-09-19T07:51:12.897046+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:51:12.897046+0000","last_undegraded":"2024-09-19T07:51:12.897046+0000","last_fullsized":"2024-09-19T07:51:12.897046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886916+0000","last_change":"2024-09-19T07:50:34.028762+0000","last_active":"2024-09-19T07:51:12.886916+0000","last_peered":"2024-09-19T07:51:12.886916+0000","last_clean":"2024-09-19T07:51:12.886916+0000","last_became_active":"2024-09-19T07:50:34.028343+0000","last_became_peered":"2024-09-19T07:50:34.028343+0000","last_unstale":"2024-09-19T07:51:12.886916+0000","last_undegraded":"2024-09-19T07:51:12.886916+0000","last_fullsized":"2024-09-19T07:51:12.886916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:08.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779564+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:51:12.779564+0000","last_peered":"2024-09-19T07:51:12.779564+0000","last_clean":"2024-09-19T07:51:12.779564+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:51:12.779564+0000","last_undegraded":"2024-09-19T07:51:12.779564+0000","last_fullsized":"2024-09-19T07:51:12.779564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072980+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:51:13.072980+0000","last_peered":"2024-09-19T07:51:13.072980+0000","last_clean":"2024-09-19T07:51:13.072980+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:51:13.072980+0000","last_undegraded":"2024-09-19T07:51:13.072980+0000","last_fullsized":"2024-09-19T07:51:13.072980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778090+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:51:12.778090+0000","last_peered":"2024-09-19T07:51:12.778090+0000","last_clean":"2024-09-19T07:51:12.778090+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:51:12.778090+0000","last_undegraded":"2024-09-19T07:51:12.778090+0000","last_fullsized":"2024-09-19T07:51:12.778090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052432+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:51:13.052432+0000","last_peered":"2024-09-19T07:51:13.052432+0000","last_clean":"2024-09-19T07:51:13.052432+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:51:13.052432+0000","last_undegraded":"2024-09-19T07:51:13.052432+0000","last_fullsized":"2024-09-19T07:51:13.052432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779132+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:51:12.779132+0000","last_peered":"2024-09-19T07:51:12.779132+0000","last_clean":"2024-09-19T07:51:12.779132+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:51:12.779132+0000","last_undegraded":"2024-09-19T07:51:12.779132+0000","last_fullsized":"2024-09-19T07:51:12.779132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779167+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:51:12.779167+0000","last_peered":"2024-09-19T07:51:12.779167+0000","last_clean":"2024-09-19T07:51:12.779167+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:51:12.779167+0000","last_undegraded":"2024-09-19T07:51:12.779167+0000","last_fullsized":"2024-09-19T07:51:12.779167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:50:34.028399+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:50:34.027948+0000","last_became_peered":"2024-09-19T07:50:34.027948+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:36.822727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885803+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:51:12.885803+0000","last_peered":"2024-09-19T07:51:12.885803+0000","last_clean":"2024-09-19T07:51:12.885803+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:51:12.885803+0000","last_undegraded":"2024-09-19T07:51:12.885803+0000","last_fullsized":"2024-09-19T07:51:12.885803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.768983+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:13.768983+0000","last_peered":"2024-09-19T07:51:13.768983+0000","last_clean":"2024-09-19T07:51:13.768983+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:51:13.768983+0000","last_undegraded":"2024-09-19T07:51:13.768983+0000","last_fullsized":"2024-09-19T07:51:13.768983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897140+0000","last_change":"2024-09-19T07:50:34.026626+0000","last_active":"2024-09-19T07:51:12.897140+0000","last_peered":"2024-09-19T07:51:12.897140+0000","last_clean":"2024-09-19T07:51:12.897140+0000","last_became_active":"2024-09-19T07:50:34.026058+0000","last_became_peered":"2024-09-19T07:50:34.026058+0000","last_unstale":"2024-09-19T07:51:12.897140+0000","last_undegraded":"2024-09-19T07:51:12.897140+0000","last_fullsized":"2024-09-19T07:51:12.897140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:22.700331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820706+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:51:12.820706+0000","last_peered":"2024-09-19T07:51:12.820706+0000","last_clean":"2024-09-19T07:51:12.820706+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:51:12.820706+0000","last_undegraded":"2024-09-19T07:51:12.820706+0000","last_fullsized":"2024-09-19T07:51:12.820706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777625+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:51:12.777625+0000","last_peered":"2024-09-19T07:51:12.777625+0000","last_clean":"2024-09-19T07:51:12.777625+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:51:12.777625+0000","last_undegraded":"2024-09-19T07:51:12.777625+0000","last_fullsized":"2024-09-19T07:51:12.777625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886790+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:51:12.886790+0000","last_peered":"2024-09-19T07:51:12.886790+0000","last_clean":"2024-09-19T07:51:12.886790+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:51:12.886790+0000","last_undegraded":"2024-09-19T07:51:12.886790+0000","last_fullsized":"2024-09-19T07:51:12.886790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897268+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:51:12.897268+0000","last_peered":"2024-09-19T07:51:12.897268+0000","last_clean":"2024-09-19T07:51:12.897268+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:51:12.897268+0000","last_undegraded":"2024-09-19T07:51:12.897268+0000","last_fullsized":"2024-09-19T07:51:12.897268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883449+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:51:12.883449+0000","last_peered":"2024-09-19T07:51:12.883449+0000","last_clean":"2024-09-19T07:51:12.883449+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:51:12.883449+0000","last_undegraded":"2024-09-19T07:51:12.883449+0000","last_fullsized":"2024-09-19T07:51:12.883449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820984+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:51:12.820984+0000","last_peered":"2024-09-19T07:51:12.820984+0000","last_clean":"2024-09-19T07:51:12.820984+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:51:12.820984+0000","last_undegraded":"2024-09-19T07:51:12.820984+0000","last_fullsized":"2024-09-19T07:51:12.820984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779095+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:51:12.779095+0000","last_peered":"2024-09-19T07:51:12.779095+0000","last_clean":"2024-09-19T07:51:12.779095+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:51:12.779095+0000","last_undegraded":"2024-09-19T07:51:12.779095+0000","last_fullsized":"2024-09-19T07:51:12.779095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085762+0000","last_change":"2024-09-19T07:50:34.356734+0000","last_active":"2024-09-19T07:51:13.085762+0000","last_peered":"2024-09-19T07:51:13.085762+0000","last_clean":"2024-09-19T07:51:13.085762+0000","last_became_active":"2024-09-19T07:50:34.350578+0000","last_became_peered":"2024-09-19T07:50:34.350578+0000","last_unstale":"2024-09-19T07:51:13.085762+0000","last_undegraded":"2024-09-19T07:51:13.085762+0000","last_fullsized":"2024-09-19T07:51:13.085762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:57.110465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053636+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:51:13.053636+0000","last_peered":"2024-09-19T07:51:13.053636+0000","last_clean":"2024-09-19T07:51:13.053636+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:51:13.053636+0000","last_undegraded":"2024-09-19T07:51:13.053636+0000","last_fullsized":"2024-09-19T07:51:13.053636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897310+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:51:12.897310+0000","last_peered":"2024-09-19T07:51:12.897310+0000","last_clean":"2024-09-19T07:51:12.897310+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:51:12.897310+0000","last_undegraded":"2024-09-19T07:51:12.897310+0000","last_fullsized":"2024-09-19T07:51:12.897310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778760+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:51:12.778760+0000","last_peered":"2024-09-19T07:51:12.778760+0000","last_clean":"2024-09-19T07:51:12.778760+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:51:12.778760+0000","last_undegraded":"2024-09-19T07:51:12.778760+0000","last_fullsized":"2024-09-19T07:51:12.778760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.768998+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:51:13.768998+0000","last_peered":"2024-09-19T07:51:13.768998+0000","last_clean":"2024-09-19T07:51:13.768998+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:51:13.768998+0000","last_undegraded":"2024-09-19T07:51:13.768998+0000","last_fullsized":"2024-09-19T07:51:13.768998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":168,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885917+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:51:12.885917+0000","last_peered":"2024-09-19T07:51:12.885917+0000","last_clean":"2024-09-19T07:51:12.885917+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:51:12.885917+0000","last_undegraded":"2024-09-19T07:51:12.885917+0000","last_fullsized":"2024-09-19T07:51:12.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779272+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:12.779272+0000","last_peered":"2024-09-19T07:51:12.779272+0000","last_clean":"2024-09-19T07:51:12.779272+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:51:12.779272+0000","last_undegraded":"2024-09-19T07:51:12.779272+0000","last_fullsized":"2024-09-19T07:51:12.779272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777765+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:51:12.777765+0000","last_peered":"2024-09-19T07:51:12.777765+0000","last_clean":"2024-09-19T07:51:12.777765+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:51:12.777765+0000","last_undegraded":"2024-09-19T07:51:12.777765+0000","last_fullsized":"2024-09-19T07:51:12.777765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897105+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:51:12.897105+0000","last_peered":"2024-09-19T07:51:12.897105+0000","last_clean":"2024-09-19T07:51:12.897105+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:51:12.897105+0000","last_undegraded":"2024-09-19T07:51:12.897105+0000","last_fullsized":"2024-09-19T07:51:12.897105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085518+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:51:13.085518+0000","last_peered":"2024-09-19T07:51:13.085518+0000","last_clean":"2024-09-19T07:51:13.085518+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:51:13.085518+0000","last_undegraded":"2024-09-19T07:51:13.085518+0000","last_fullsized":"2024-09-19T07:51:13.085518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.788097+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:51:13.788097+0000","last_peered":"2024-09-19T07:51:13.788097+0000","last_clean":"2024-09-19T07:51:13.788097+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:51:13.788097+0000","last_undegraded":"2024-09-19T07:51:13.788097+0000","last_fullsized":"2024-09-19T07:51:13.788097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085252+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:51:13.085252+0000","last_peered":"2024-09-19T07:51:13.085252+0000","last_clean":"2024-09-19T07:51:13.085252+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:51:13.085252+0000","last_undegraded":"2024-09-19T07:51:13.085252+0000","last_fullsized":"2024-09-19T07:51:13.085252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884108+0000","last_change":"2024-09-19T07:50:34.349498+0000","last_active":"2024-09-19T07:51:12.884108+0000","last_peered":"2024-09-19T07:51:12.884108+0000","last_clean":"2024-09-19T07:51:12.884108+0000","last_became_active":"2024-09-19T07:50:34.349238+0000","last_became_peered":"2024-09-19T07:50:34.349238+0000","last_unstale":"2024-09-19T07:51:12.884108+0000","last_undegraded":"2024-09-19T07:51:12.884108+0000","last_fullsized":"2024-09-19T07:51:12.884108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:40.879641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885913+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:51:12.885913+0000","last_peered":"2024-09-19T07:51:12.885913+0000","last_clean":"2024-09-19T07:51:12.885913+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:51:12.885913+0000","last_undegraded":"2024-09-19T07:51:12.885913+0000","last_fullsized":"2024-09-19T07:51:12.885913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073006+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:51:13.073006+0000","last_peered":"2024-09-19T07:51:13.073006+0000","last_clean":"2024-09-19T07:51:13.073006+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:51:13.073006+0000","last_undegraded":"2024-09-19T07:51:13.073006+0000","last_fullsized":"2024-09-19T07:51:13.073006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778040+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:51:12.778040+0000","last_peered":"2024-09-19T07:51:12.778040+0000","last_clean":"2024-09-19T07:51:12.778040+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:51:12.778040+0000","last_undegraded":"2024-09-19T07:51:12.778040+0000","last_fullsized":"2024-09-19T07:51:12.778040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085798+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:51:13.085798+0000","last_peered":"2024-09-19T07:51:13.085798+0000","last_clean":"2024-09-19T07:51:13.085798+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:51:13.085798+0000","last_undegraded":"2024-09-19T07:51:13.085798+0000","last_fullsized":"2024-09-19T07:51:13.085798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.022869+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:51:13.022869+0000","last_peered":"2024-09-19T07:51:13.022869+0000","last_clean":"2024-09-19T07:51:13.022869+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:51:13.022869+0000","last_undegraded":"2024-09-19T07:51:13.022869+0000","last_fullsized":"2024-09-19T07:51:13.022869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085413+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:51:13.085413+0000","last_peered":"2024-09-19T07:51:13.085413+0000","last_clean":"2024-09-19T07:51:13.085413+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:51:13.085413+0000","last_undegraded":"2024-09-19T07:51:13.085413+0000","last_fullsized":"2024-09-19T07:51:13.085413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779460+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:51:12.779460+0000","last_peered":"2024-09-19T07:51:12.779460+0000","last_clean":"2024-09-19T07:51:12.779460+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:51:12.779460+0000","last_undegraded":"2024-09-19T07:51:12.779460+0000","last_fullsized":"2024-09-19T07:51:12.779460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085732+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:51:13.085732+0000","last_peered":"2024-09-19T07:51:13.085732+0000","last_clean":"2024-09-19T07:51:13.085732+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:51:13.085732+0000","last_undegraded":"2024-09-19T07:51:13.085732+0000","last_fullsized":"2024-09-19T07:51:13.085732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085402+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:51:13.085402+0000","last_peered":"2024-09-19T07:51:13.085402+0000","last_clean":"2024-09-19T07:51:13.085402+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:51:13.085402+0000","last_undegraded":"2024-09-19T07:51:13.085402+0000","last_fullsized":"2024-09-19T07:51:13.085402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786233+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:51:12.786233+0000","last_peered":"2024-09-19T07:51:12.786233+0000","last_clean":"2024-09-19T07:51:12.786233+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:51:12.786233+0000","last_undegraded":"2024-09-19T07:51:12.786233+0000","last_fullsized":"2024-09-19T07:51:12.786233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883560+0000","last_change":"2024-09-19T07:50:34.028464+0000","last_active":"2024-09-19T07:51:12.883560+0000","last_peered":"2024-09-19T07:51:12.883560+0000","last_clean":"2024-09-19T07:51:12.883560+0000","last_became_active":"2024-09-19T07:50:34.028078+0000","last_became_peered":"2024-09-19T07:50:34.028078+0000","last_unstale":"2024-09-19T07:51:12.883560+0000","last_undegraded":"2024-09-19T07:51:12.883560+0000","last_fullsized":"2024-09-19T07:51:12.883560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:33.498575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085358+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:51:13.085358+0000","last_peered":"2024-09-19T07:51:13.085358+0000","last_clean":"2024-09-19T07:51:13.085358+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:51:13.085358+0000","last_undegraded":"2024-09-19T07:51:13.085358+0000","last_fullsized":"2024-09-19T07:51:13.085358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777583+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:51:12.777583+0000","last_peered":"2024-09-19T07:51:12.777583+0000","last_clean":"2024-09-19T07:51:12.777583+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:51:12.777583+0000","last_undegraded":"2024-09-19T07:51:12.777583+0000","last_fullsized":"2024-09-19T07:51:12.777583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085819+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:51:13.085819+0000","last_peered":"2024-09-19T07:51:13.085819+0000","last_clean":"2024-09-19T07:51:13.085819+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:51:13.085819+0000","last_undegraded":"2024-09-19T07:51:13.085819+0000","last_fullsized":"2024-09-19T07:51:13.085819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897052+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:51:12.897052+0000","last_peered":"2024-09-19T07:51:12.897052+0000","last_clean":"2024-09-19T07:51:12.897052+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:51:12.897052+0000","last_undegraded":"2024-09-19T07:51:12.897052+0000","last_fullsized":"2024-09-19T07:51:12.897052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085545+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:51:13.085545+0000","last_peered":"2024-09-19T07:51:13.085545+0000","last_clean":"2024-09-19T07:51:13.085545+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:51:13.085545+0000","last_undegraded":"2024-09-19T07:51:13.085545+0000","last_fullsized":"2024-09-19T07:51:13.085545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820738+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:51:12.820738+0000","last_peered":"2024-09-19T07:51:12.820738+0000","last_clean":"2024-09-19T07:51:12.820738+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:51:12.820738+0000","last_undegraded":"2024-09-19T07:51:12.820738+0000","last_fullsized":"2024-09-19T07:51:12.820738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884217+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:51:12.884217+0000","last_peered":"2024-09-19T07:51:12.884217+0000","last_clean":"2024-09-19T07:51:12.884217+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:51:12.884217+0000","last_undegraded":"2024-09-19T07:51:12.884217+0000","last_fullsized":"2024-09-19T07:51:12.884217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820842+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:51:12.820842+0000","last_peered":"2024-09-19T07:51:12.820842+0000","last_clean":"2024-09-19T07:51:12.820842+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:51:12.820842+0000","last_undegraded":"2024-09-19T07:51:12.820842+0000","last_fullsized":"2024-09-19T07:51:12.820842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886077+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:51:12.886077+0000","last_peered":"2024-09-19T07:51:12.886077+0000","last_clean":"2024-09-19T07:51:12.886077+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:51:12.886077+0000","last_undegraded":"2024-09-19T07:51:12.886077+0000","last_fullsized":"2024-09-19T07:51:12.886077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778175+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:51:12.778175+0000","last_peered":"2024-09-19T07:51:12.778175+0000","last_clean":"2024-09-19T07:51:12.778175+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:51:12.778175+0000","last_undegraded":"2024-09-19T07:51:12.778175+0000","last_fullsized":"2024-09-19T07:51:12.778175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'49","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.032938+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:51:13.032938+0000","last_peered":"2024-09-19T07:51:13.032938+0000","last_clean":"2024-09-19T07:51:13.032938+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:51:13.032938+0000","last_undegraded":"2024-09-19T07:51:13.032938+0000","last_fullsized":"2024-09-19T07:51:13.032938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887028+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:51:12.887028+0000","last_peered":"2024-09-19T07:51:12.887028+0000","last_clean":"2024-09-19T07:51:12.887028+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:51:12.887028+0000","last_undegraded":"2024-09-19T07:51:12.887028+0000","last_fullsized":"2024-09-19T07:51:12.887028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786476+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:51:12.786476+0000","last_peered":"2024-09-19T07:51:12.786476+0000","last_clean":"2024-09-19T07:51:12.786476+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:51:12.786476+0000","last_undegraded":"2024-09-19T07:51:12.786476+0000","last_fullsized":"2024-09-19T07:51:12.786476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053199+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:51:13.053199+0000","last_peered":"2024-09-19T07:51:13.053199+0000","last_clean":"2024-09-19T07:51:13.053199+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:51:13.053199+0000","last_undegraded":"2024-09-19T07:51:13.053199+0000","last_fullsized":"2024-09-19T07:51:13.053199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778663+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:51:12.778663+0000","last_peered":"2024-09-19T07:51:12.778663+0000","last_clean":"2024-09-19T07:51:12.778663+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:51:12.778663+0000","last_undegraded":"2024-09-19T07:51:12.778663+0000","last_fullsized":"2024-09-19T07:51:12.778663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886882+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:51:12.886882+0000","last_peered":"2024-09-19T07:51:12.886882+0000","last_clean":"2024-09-19T07:51:12.886882+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:51:12.886882+0000","last_undegraded":"2024-09-19T07:51:12.886882+0000","last_fullsized":"2024-09-19T07:51:12.886882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073002+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:51:13.073002+0000","last_peered":"2024-09-19T07:51:13.073002+0000","last_clean":"2024-09-19T07:51:13.073002+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:51:13.073002+0000","last_undegraded":"2024-09-19T07:51:13.073002+0000","last_fullsized":"2024-09-19T07:51:13.073002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779211+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:51:12.779211+0000","last_peered":"2024-09-19T07:51:12.779211+0000","last_clean":"2024-09-19T07:51:12.779211+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:51:12.779211+0000","last_undegraded":"2024-09-19T07:51:12.779211+0000","last_fullsized":"2024-09-19T07:51:12.779211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887345+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:51:12.887345+0000","last_peered":"2024-09-19T07:51:12.887345+0000","last_clean":"2024-09-19T07:51:12.887345+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:51:12.887345+0000","last_undegraded":"2024-09-19T07:51:12.887345+0000","last_fullsized":"2024-09-19T07:51:12.887345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885828+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:51:12.885828+0000","last_peered":"2024-09-19T07:51:12.885828+0000","last_clean":"2024-09-19T07:51:12.885828+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:51:12.885828+0000","last_undegraded":"2024-09-19T07:51:12.885828+0000","last_fullsized":"2024-09-19T07:51:12.885828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085403+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:51:13.085403+0000","last_peered":"2024-09-19T07:51:13.085403+0000","last_clean":"2024-09-19T07:51:13.085403+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:51:13.085403+0000","last_undegraded":"2024-09-19T07:51:13.085403+0000","last_fullsized":"2024-09-19T07:51:13.085403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897311+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:51:12.897311+0000","last_peered":"2024-09-19T07:51:12.897311+0000","last_clean":"2024-09-19T07:51:12.897311+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:51:12.897311+0000","last_undegraded":"2024-09-19T07:51:12.897311+0000","last_fullsized":"2024-09-19T07:51:12.897311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886120+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:51:12.886120+0000","last_peered":"2024-09-19T07:51:12.886120+0000","last_clean":"2024-09-19T07:51:12.886120+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:51:12.886120+0000","last_undegraded":"2024-09-19T07:51:12.886120+0000","last_fullsized":"2024-09-19T07:51:12.886120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778673+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:51:12.778673+0000","last_peered":"2024-09-19T07:51:12.778673+0000","last_clean":"2024-09-19T07:51:12.778673+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:51:12.778673+0000","last_undegraded":"2024-09-19T07:51:12.778673+0000","last_fullsized":"2024-09-19T07:51:12.778673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886035+0000","last_change":"2024-09-19T07:50:34.354839+0000","last_active":"2024-09-19T07:51:12.886035+0000","last_peered":"2024-09-19T07:51:12.886035+0000","last_clean":"2024-09-19T07:51:12.886035+0000","last_became_active":"2024-09-19T07:50:34.350424+0000","last_became_peered":"2024-09-19T07:50:34.350424+0000","last_unstale":"2024-09-19T07:51:12.886035+0000","last_undegraded":"2024-09-19T07:51:12.886035+0000","last_fullsized":"2024-09-19T07:51:12.886035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:36.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053516+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:51:13.053516+0000","last_peered":"2024-09-19T07:51:13.053516+0000","last_clean":"2024-09-19T07:51:13.053516+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:51:13.053516+0000","last_undegraded":"2024-09-19T07:51:13.053516+0000","last_fullsized":"2024-09-19T07:51:13.053516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887230+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:51:12.887230+0000","last_peered":"2024-09-19T07:51:12.887230+0000","last_clean":"2024-09-19T07:51:12.887230+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:51:12.887230+0000","last_undegraded":"2024-09-19T07:51:12.887230+0000","last_fullsized":"2024-09-19T07:51:12.887230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886656+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:51:12.886656+0000","last_peered":"2024-09-19T07:51:12.886656+0000","last_clean":"2024-09-19T07:51:12.886656+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:51:12.886656+0000","last_undegraded":"2024-09-19T07:51:12.886656+0000","last_fullsized":"2024-09-19T07:51:12.886656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884312+0000","last_change":"2024-09-19T07:50:34.034480+0000","last_active":"2024-09-19T07:51:12.884312+0000","last_peered":"2024-09-19T07:51:12.884312+0000","last_clean":"2024-09-19T07:51:12.884312+0000","last_became_active":"2024-09-19T07:50:34.027982+0000","last_became_peered":"2024-09-19T07:50:34.027982+0000","last_unstale":"2024-09-19T07:51:12.884312+0000","last_undegraded":"2024-09-19T07:51:12.884312+0000","last_fullsized":"2024-09-19T07:51:12.884312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:40.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596619,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":708,"num_read_kb":463,"num_write":292,"num_write_kb":1435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1789857,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":450902,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":1240856,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":844354,"data_compressed":27820,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":441491,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1034146,"data_compressed":41576,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":450527,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1175201,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":451357,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":975654,"data_compressed":33976,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":512525,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":502238,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":451798,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134396,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":200051,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:51:16.130 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T07:51:16.130 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:51:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:51:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-09-19T07:51:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: Unable to set osd_memory_target on smithi137 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-19T07:51:16.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:15 smithi137 ceph-mon[35309]: Unable to set osd_memory_target on smithi152 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T07:51:16.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 -- 172.21.15.76:0/2376106026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad41001b0 msgr2=0x7f5ad41005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/2376106026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad41001b0 0x7f5ad41005b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009900 tx=0x7f5ac402a410 comp rx=0 tx=0).stop 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 -- 172.21.15.76:0/2376106026 shutdown_connections 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/2376106026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad4101d60 0x7f5ad41085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/2376106026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad41013a0 0x7f5ad4101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/2376106026 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad41001b0 0x7f5ad41005b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 -- 172.21.15.76:0/2376106026 >> 172.21.15.76:0/2376106026 conn(0x7f5ad40fb950 msgr2=0x7f5ad40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 -- 172.21.15.76:0/2376106026 shutdown_connections 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.270+0000 7f5ad8a23640 1 -- 172.21.15.76:0/2376106026 wait complete. 2024-09-19T07:51:16.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 Processor -- start 2024-09-19T07:51:16.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 -- start start 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad41001b0 0x7f5ad4197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad41013a0 0x7f5ad4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 0x7f5ad419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad410c810 con 0x7f5ad4101d60 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad410c690 con 0x7f5ad41013a0 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad8a23640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad410c990 con 0x7f5ad41001b0 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 0x7f5ad419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 0x7f5ad419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35728/0 (socket says 172.21.15.76:35728) 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad2d9d640 1 -- 172.21.15.76:0/4172035800 learned_addr learned my addr 172.21.15.76:0/4172035800 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5ad259c640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad41001b0 0x7f5ad4197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.271+0000 7f5acbfff640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad41013a0 0x7f5ad4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:16.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad259c640 1 -- 172.21.15.76:0/4172035800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad41013a0 msgr2=0x7f5ad4198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad259c640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad41013a0 0x7f5ad4198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad259c640 1 -- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 msgr2=0x7f5ad419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad259c640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 0x7f5ad419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad259c640 1 -- 172.21.15.76:0/4172035800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad419fb60 con 0x7f5ad41001b0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad2d9d640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 0x7f5ad419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad259c640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad41001b0 0x7f5ad4197f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009230 tx=0x7f5ac40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac403f070 con 0x7f5ad41001b0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad419fdf0 con 0x7f5ad41001b0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ac403b460 con 0x7f5ad41001b0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4035070 con 0x7f5ad41001b0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.272+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41a0250 con 0x7f5ad41001b0 2024-09-19T07:51:16.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.273+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad41a0480 con 0x7f5ad41001b0 2024-09-19T07:51:16.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.274+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f5ac403b610 con 0x7f5ad41001b0 2024-09-19T07:51:16.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.275+0000 7f5acb7fe640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ac00a33c0 0x7f5ac00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:16.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.275+0000 7f5acbfff640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ac00a33c0 0x7f5ac00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:16.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.275+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f5ac40f0360 con 0x7f5ad41001b0 2024-09-19T07:51:16.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.276+0000 7f5acbfff640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ac00a33c0 0x7f5ac00a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4199450 tx=0x7f5abc00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:16.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.278+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ac40bc690 con 0x7f5ad41001b0 2024-09-19T07:51:16.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.449+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ad4062630 con 0x7f5ac00a33c0 2024-09-19T07:51:16.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.456+0000 7f5acb7fe640 1 -- 172.21.15.76:0/4172035800 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257988 (secure 0 0 0) 0x7f5ad4062630 con 0x7f5ac00a33c0 2024-09-19T07:51:16.459 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:16.460 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:51:16.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ac00a33c0 msgr2=0x7f5ac00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ac00a33c0 0x7f5ac00a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4199450 tx=0x7f5abc00b390 comp rx=0 tx=0).stop 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad41001b0 msgr2=0x7f5ad4197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad41001b0 0x7f5ad4197f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009230 tx=0x7f5ac40042f0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 shutdown_connections 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ac00a33c0 0x7f5ac00a5880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ad4101d60 0x7f5ad419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad41013a0 0x7f5ad4198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 --2- 172.21.15.76:0/4172035800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ad41001b0 0x7f5ad4197f40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 >> 172.21.15.76:0/4172035800 conn(0x7f5ad40fb950 msgr2=0x7f5ad40fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 shutdown_connections 2024-09-19T07:51:16.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:16.459+0000 7f5ad8a23640 1 -- 172.21.15.76:0/4172035800 wait complete. 2024-09-19T07:51:16.471 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T07:51:14.791672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187221,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":844,"num_read_kb":582,"num_write":475,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381432,"kb_used_data":11360,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560392,"statfs":{"total":1151940427776,"available":1151549841408,"internally_reserved":0,"allocated":11632640,"data_stored":8531049,"data_compressed":259554,"data_compressed_allocated":344064,"data_compressed_original":3194880,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.990886"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073201+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:51:13.073201+0000","last_peered":"2024-09-19T07:51:13.073201+0000","last_clean":"2024-09-19T07:51:13.073201+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:51:13.073201+0000","last_undegraded":"2024-09-19T07:51:13.073201+0000","last_fullsized":"2024-09-19T07:51:13.073201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053081+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:51:13.053081+0000","last_peered":"2024-09-19T07:51:13.053081+0000","last_clean":"2024-09-19T07:51:13.053081+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:51:13.053081+0000","last_undegraded":"2024-09-19T07:51:13.053081+0000","last_fullsized":"2024-09-19T07:51:13.053081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052870+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:51:13.052870+0000","last_peered":"2024-09-19T07:51:13.052870+0000","last_clean":"2024-09-19T07:51:13.052870+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:51:13.052870+0000","last_undegraded":"2024-09-19T07:51:13.052870+0000","last_fullsized":"2024-09-19T07:51:13.052870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786281+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:51:12.786281+0000","last_peered":"2024-09-19T07:51:12.786281+0000","last_clean":"2024-09-19T07:51:12.786281+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:51:12.786281+0000","last_undegraded":"2024-09-19T07:51:12.786281+0000","last_fullsized":"2024-09-19T07:51:12.786281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885874+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:51:12.885874+0000","last_peered":"2024-09-19T07:51:12.885874+0000","last_clean":"2024-09-19T07:51:12.885874+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:51:12.885874+0000","last_undegraded":"2024-09-19T07:51:12.885874+0000","last_fullsized":"2024-09-19T07:51:12.885874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820633+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:51:12.820633+0000","last_peered":"2024-09-19T07:51:12.820633+0000","last_clean":"2024-09-19T07:51:12.820633+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:51:12.820633+0000","last_undegraded":"2024-09-19T07:51:12.820633+0000","last_fullsized":"2024-09-19T07:51:12.820633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085272+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:51:13.085272+0000","last_peered":"2024-09-19T07:51:13.085272+0000","last_clean":"2024-09-19T07:51:13.085272+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:51:13.085272+0000","last_undegraded":"2024-09-19T07:51:13.085272+0000","last_fullsized":"2024-09-19T07:51:13.085272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886640+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:51:12.886640+0000","last_peered":"2024-09-19T07:51:12.886640+0000","last_clean":"2024-09-19T07:51:12.886640+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:51:12.886640+0000","last_undegraded":"2024-09-19T07:51:12.886640+0000","last_fullsized":"2024-09-19T07:51:12.886640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779282+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:51:12.779282+0000","last_peered":"2024-09-19T07:51:12.779282+0000","last_clean":"2024-09-19T07:51:12.779282+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:51:12.779282+0000","last_undegraded":"2024-09-19T07:51:12.779282+0000","last_fullsized":"2024-09-19T07:51:12.779282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820979+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:51:12.820979+0000","last_peered":"2024-09-19T07:51:12.820979+0000","last_clean":"2024-09-19T07:51:12.820979+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:51:12.820979+0000","last_undegraded":"2024-09-19T07:51:12.820979+0000","last_fullsized":"2024-09-19T07:51:12.820979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085724+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:51:13.085724+0000","last_peered":"2024-09-19T07:51:13.085724+0000","last_clean":"2024-09-19T07:51:13.085724+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:51:13.085724+0000","last_undegraded":"2024-09-19T07:51:13.085724+0000","last_fullsized":"2024-09-19T07:51:13.085724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786352+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:51:12.786352+0000","last_peered":"2024-09-19T07:51:12.786352+0000","last_clean":"2024-09-19T07:51:12.786352+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:51:12.786352+0000","last_undegraded":"2024-09-19T07:51:12.786352+0000","last_fullsized":"2024-09-19T07:51:12.786352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777843+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:51:12.777843+0000","last_peered":"2024-09-19T07:51:12.777843+0000","last_clean":"2024-09-19T07:51:12.777843+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:51:12.777843+0000","last_undegraded":"2024-09-19T07:51:12.777843+0000","last_fullsized":"2024-09-19T07:51:12.777843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052179+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:51:13.052179+0000","last_peered":"2024-09-19T07:51:13.052179+0000","last_clean":"2024-09-19T07:51:13.052179+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:51:13.052179+0000","last_undegraded":"2024-09-19T07:51:13.052179+0000","last_fullsized":"2024-09-19T07:51:13.052179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.051887+0000","last_change":"2024-09-19T07:50:34.028760+0000","last_active":"2024-09-19T07:51:13.051887+0000","last_peered":"2024-09-19T07:51:13.051887+0000","last_clean":"2024-09-19T07:51:13.051887+0000","last_became_active":"2024-09-19T07:50:34.028384+0000","last_became_peered":"2024-09-19T07:50:34.028384+0000","last_unstale":"2024-09-19T07:51:13.051887+0000","last_undegraded":"2024-09-19T07:51:13.051887+0000","last_fullsized":"2024-09-19T07:51:13.051887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:00.072227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778575+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:51:12.778575+0000","last_peered":"2024-09-19T07:51:12.778575+0000","last_clean":"2024-09-19T07:51:12.778575+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:51:12.778575+0000","last_undegraded":"2024-09-19T07:51:12.778575+0000","last_fullsized":"2024-09-19T07:51:12.778575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073263+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:51:13.073263+0000","last_peered":"2024-09-19T07:51:13.073263+0000","last_clean":"2024-09-19T07:51:13.073263+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:51:13.073263+0000","last_undegraded":"2024-09-19T07:51:13.073263+0000","last_fullsized":"2024-09-19T07:51:13.073263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884084+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:51:12.884084+0000","last_peered":"2024-09-19T07:51:12.884084+0000","last_clean":"2024-09-19T07:51:12.884084+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:51:12.884084+0000","last_undegraded":"2024-09-19T07:51:12.884084+0000","last_fullsized":"2024-09-19T07:51:12.884084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779398+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:51:12.779398+0000","last_peered":"2024-09-19T07:51:12.779398+0000","last_clean":"2024-09-19T07:51:12.779398+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:51:12.779398+0000","last_undegraded":"2024-09-19T07:51:12.779398+0000","last_fullsized":"2024-09-19T07:51:12.779398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777912+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:51:12.777912+0000","last_peered":"2024-09-19T07:51:12.777912+0000","last_clean":"2024-09-19T07:51:12.777912+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:51:12.777912+0000","last_undegraded":"2024-09-19T07:51:12.777912+0000","last_fullsized":"2024-09-19T07:51:12.777912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778712+0000","last_change":"2024-09-19T07:50:34.030741+0000","last_active":"2024-09-19T07:51:12.778712+0000","last_peered":"2024-09-19T07:51:12.778712+0000","last_clean":"2024-09-19T07:51:12.778712+0000","last_became_active":"2024-09-19T07:50:34.030300+0000","last_became_peered":"2024-09-19T07:50:34.030300+0000","last_unstale":"2024-09-19T07:51:12.778712+0000","last_undegraded":"2024-09-19T07:51:12.778712+0000","last_fullsized":"2024-09-19T07:51:12.778712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:30.131138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886659+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:51:12.886659+0000","last_peered":"2024-09-19T07:51:12.886659+0000","last_clean":"2024-09-19T07:51:12.886659+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:51:12.886659+0000","last_undegraded":"2024-09-19T07:51:12.886659+0000","last_fullsized":"2024-09-19T07:51:12.886659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897046+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:51:12.897046+0000","last_peered":"2024-09-19T07:51:12.897046+0000","last_clean":"2024-09-19T07:51:12.897046+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:51:12.897046+0000","last_undegraded":"2024-09-19T07:51:12.897046+0000","last_fullsized":"2024-09-19T07:51:12.897046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886916+0000","last_change":"2024-09-19T07:50:34.028762+0000","last_active":"2024-09-19T07:51:12.886916+0000","last_peered":"2024-09-19T07:51:12.886916+0000","last_clean":"2024-09-19T07:51:12.886916+0000","last_became_active":"2024-09-19T07:50:34.028343+0000","last_became_peered":"2024-09-19T07:50:34.028343+0000","last_unstale":"2024-09-19T07:51:12.886916+0000","last_undegraded":"2024-09-19T07:51:12.886916+0000","last_fullsized":"2024-09-19T07:51:12.886916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:08.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779564+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:51:12.779564+0000","last_peered":"2024-09-19T07:51:12.779564+0000","last_clean":"2024-09-19T07:51:12.779564+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:51:12.779564+0000","last_undegraded":"2024-09-19T07:51:12.779564+0000","last_fullsized":"2024-09-19T07:51:12.779564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072980+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:51:13.072980+0000","last_peered":"2024-09-19T07:51:13.072980+0000","last_clean":"2024-09-19T07:51:13.072980+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:51:13.072980+0000","last_undegraded":"2024-09-19T07:51:13.072980+0000","last_fullsized":"2024-09-19T07:51:13.072980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778090+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:51:12.778090+0000","last_peered":"2024-09-19T07:51:12.778090+0000","last_clean":"2024-09-19T07:51:12.778090+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:51:12.778090+0000","last_undegraded":"2024-09-19T07:51:12.778090+0000","last_fullsized":"2024-09-19T07:51:12.778090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052432+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:51:13.052432+0000","last_peered":"2024-09-19T07:51:13.052432+0000","last_clean":"2024-09-19T07:51:13.052432+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:51:13.052432+0000","last_undegraded":"2024-09-19T07:51:13.052432+0000","last_fullsized":"2024-09-19T07:51:13.052432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779132+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:51:12.779132+0000","last_peered":"2024-09-19T07:51:12.779132+0000","last_clean":"2024-09-19T07:51:12.779132+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:51:12.779132+0000","last_undegraded":"2024-09-19T07:51:12.779132+0000","last_fullsized":"2024-09-19T07:51:12.779132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779167+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:51:12.779167+0000","last_peered":"2024-09-19T07:51:12.779167+0000","last_clean":"2024-09-19T07:51:12.779167+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:51:12.779167+0000","last_undegraded":"2024-09-19T07:51:12.779167+0000","last_fullsized":"2024-09-19T07:51:12.779167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:50:34.028399+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:50:34.027948+0000","last_became_peered":"2024-09-19T07:50:34.027948+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:36.822727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885803+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:51:12.885803+0000","last_peered":"2024-09-19T07:51:12.885803+0000","last_clean":"2024-09-19T07:51:12.885803+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:51:12.885803+0000","last_undegraded":"2024-09-19T07:51:12.885803+0000","last_fullsized":"2024-09-19T07:51:12.885803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.768983+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:13.768983+0000","last_peered":"2024-09-19T07:51:13.768983+0000","last_clean":"2024-09-19T07:51:13.768983+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:51:13.768983+0000","last_undegraded":"2024-09-19T07:51:13.768983+0000","last_fullsized":"2024-09-19T07:51:13.768983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897140+0000","last_change":"2024-09-19T07:50:34.026626+0000","last_active":"2024-09-19T07:51:12.897140+0000","last_peered":"2024-09-19T07:51:12.897140+0000","last_clean":"2024-09-19T07:51:12.897140+0000","last_became_active":"2024-09-19T07:50:34.026058+0000","last_became_peered":"2024-09-19T07:50:34.026058+0000","last_unstale":"2024-09-19T07:51:12.897140+0000","last_undegraded":"2024-09-19T07:51:12.897140+0000","last_fullsized":"2024-09-19T07:51:12.897140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:22.700331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820706+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:51:12.820706+0000","last_peered":"2024-09-19T07:51:12.820706+0000","last_clean":"2024-09-19T07:51:12.820706+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:51:12.820706+0000","last_undegraded":"2024-09-19T07:51:12.820706+0000","last_fullsized":"2024-09-19T07:51:12.820706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777625+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:51:12.777625+0000","last_peered":"2024-09-19T07:51:12.777625+0000","last_clean":"2024-09-19T07:51:12.777625+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:51:12.777625+0000","last_undegraded":"2024-09-19T07:51:12.777625+0000","last_fullsized":"2024-09-19T07:51:12.777625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886790+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:51:12.886790+0000","last_peered":"2024-09-19T07:51:12.886790+0000","last_clean":"2024-09-19T07:51:12.886790+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:51:12.886790+0000","last_undegraded":"2024-09-19T07:51:12.886790+0000","last_fullsized":"2024-09-19T07:51:12.886790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897268+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:51:12.897268+0000","last_peered":"2024-09-19T07:51:12.897268+0000","last_clean":"2024-09-19T07:51:12.897268+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:51:12.897268+0000","last_undegraded":"2024-09-19T07:51:12.897268+0000","last_fullsized":"2024-09-19T07:51:12.897268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883449+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:51:12.883449+0000","last_peered":"2024-09-19T07:51:12.883449+0000","last_clean":"2024-09-19T07:51:12.883449+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:51:12.883449+0000","last_undegraded":"2024-09-19T07:51:12.883449+0000","last_fullsized":"2024-09-19T07:51:12.883449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820984+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:51:12.820984+0000","last_peered":"2024-09-19T07:51:12.820984+0000","last_clean":"2024-09-19T07:51:12.820984+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:51:12.820984+0000","last_undegraded":"2024-09-19T07:51:12.820984+0000","last_fullsized":"2024-09-19T07:51:12.820984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779095+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:51:12.779095+0000","last_peered":"2024-09-19T07:51:12.779095+0000","last_clean":"2024-09-19T07:51:12.779095+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:51:12.779095+0000","last_undegraded":"2024-09-19T07:51:12.779095+0000","last_fullsized":"2024-09-19T07:51:12.779095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085762+0000","last_change":"2024-09-19T07:50:34.356734+0000","last_active":"2024-09-19T07:51:13.085762+0000","last_peered":"2024-09-19T07:51:13.085762+0000","last_clean":"2024-09-19T07:51:13.085762+0000","last_became_active":"2024-09-19T07:50:34.350578+0000","last_became_peered":"2024-09-19T07:50:34.350578+0000","last_unstale":"2024-09-19T07:51:13.085762+0000","last_undegraded":"2024-09-19T07:51:13.085762+0000","last_fullsized":"2024-09-19T07:51:13.085762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:57.110465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053636+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:51:13.053636+0000","last_peered":"2024-09-19T07:51:13.053636+0000","last_clean":"2024-09-19T07:51:13.053636+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:51:13.053636+0000","last_undegraded":"2024-09-19T07:51:13.053636+0000","last_fullsized":"2024-09-19T07:51:13.053636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897310+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:51:12.897310+0000","last_peered":"2024-09-19T07:51:12.897310+0000","last_clean":"2024-09-19T07:51:12.897310+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:51:12.897310+0000","last_undegraded":"2024-09-19T07:51:12.897310+0000","last_fullsized":"2024-09-19T07:51:12.897310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778760+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:51:12.778760+0000","last_peered":"2024-09-19T07:51:12.778760+0000","last_clean":"2024-09-19T07:51:12.778760+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:51:12.778760+0000","last_undegraded":"2024-09-19T07:51:12.778760+0000","last_fullsized":"2024-09-19T07:51:12.778760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.768998+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:51:13.768998+0000","last_peered":"2024-09-19T07:51:13.768998+0000","last_clean":"2024-09-19T07:51:13.768998+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:51:13.768998+0000","last_undegraded":"2024-09-19T07:51:13.768998+0000","last_fullsized":"2024-09-19T07:51:13.768998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":168,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885917+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:51:12.885917+0000","last_peered":"2024-09-19T07:51:12.885917+0000","last_clean":"2024-09-19T07:51:12.885917+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:51:12.885917+0000","last_undegraded":"2024-09-19T07:51:12.885917+0000","last_fullsized":"2024-09-19T07:51:12.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779272+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:12.779272+0000","last_peered":"2024-09-19T07:51:12.779272+0000","last_clean":"2024-09-19T07:51:12.779272+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:51:12.779272+0000","last_undegraded":"2024-09-19T07:51:12.779272+0000","last_fullsized":"2024-09-19T07:51:12.779272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777765+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:51:12.777765+0000","last_peered":"2024-09-19T07:51:12.777765+0000","last_clean":"2024-09-19T07:51:12.777765+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:51:12.777765+0000","last_undegraded":"2024-09-19T07:51:12.777765+0000","last_fullsized":"2024-09-19T07:51:12.777765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897105+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:51:12.897105+0000","last_peered":"2024-09-19T07:51:12.897105+0000","last_clean":"2024-09-19T07:51:12.897105+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:51:12.897105+0000","last_undegraded":"2024-09-19T07:51:12.897105+0000","last_fullsized":"2024-09-19T07:51:12.897105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085518+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:51:13.085518+0000","last_peered":"2024-09-19T07:51:13.085518+0000","last_clean":"2024-09-19T07:51:13.085518+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:51:13.085518+0000","last_undegraded":"2024-09-19T07:51:13.085518+0000","last_fullsized":"2024-09-19T07:51:13.085518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.788097+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:51:13.788097+0000","last_peered":"2024-09-19T07:51:13.788097+0000","last_clean":"2024-09-19T07:51:13.788097+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:51:13.788097+0000","last_undegraded":"2024-09-19T07:51:13.788097+0000","last_fullsized":"2024-09-19T07:51:13.788097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085252+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:51:13.085252+0000","last_peered":"2024-09-19T07:51:13.085252+0000","last_clean":"2024-09-19T07:51:13.085252+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:51:13.085252+0000","last_undegraded":"2024-09-19T07:51:13.085252+0000","last_fullsized":"2024-09-19T07:51:13.085252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884108+0000","last_change":"2024-09-19T07:50:34.349498+0000","last_active":"2024-09-19T07:51:12.884108+0000","last_peered":"2024-09-19T07:51:12.884108+0000","last_clean":"2024-09-19T07:51:12.884108+0000","last_became_active":"2024-09-19T07:50:34.349238+0000","last_became_peered":"2024-09-19T07:50:34.349238+0000","last_unstale":"2024-09-19T07:51:12.884108+0000","last_undegraded":"2024-09-19T07:51:12.884108+0000","last_fullsized":"2024-09-19T07:51:12.884108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:40.879641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885913+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:51:12.885913+0000","last_peered":"2024-09-19T07:51:12.885913+0000","last_clean":"2024-09-19T07:51:12.885913+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:51:12.885913+0000","last_undegraded":"2024-09-19T07:51:12.885913+0000","last_fullsized":"2024-09-19T07:51:12.885913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073006+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:51:13.073006+0000","last_peered":"2024-09-19T07:51:13.073006+0000","last_clean":"2024-09-19T07:51:13.073006+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:51:13.073006+0000","last_undegraded":"2024-09-19T07:51:13.073006+0000","last_fullsized":"2024-09-19T07:51:13.073006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778040+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:51:12.778040+0000","last_peered":"2024-09-19T07:51:12.778040+0000","last_clean":"2024-09-19T07:51:12.778040+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:51:12.778040+0000","last_undegraded":"2024-09-19T07:51:12.778040+0000","last_fullsized":"2024-09-19T07:51:12.778040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085798+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:51:13.085798+0000","last_peered":"2024-09-19T07:51:13.085798+0000","last_clean":"2024-09-19T07:51:13.085798+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:51:13.085798+0000","last_undegraded":"2024-09-19T07:51:13.085798+0000","last_fullsized":"2024-09-19T07:51:13.085798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.022869+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:51:13.022869+0000","last_peered":"2024-09-19T07:51:13.022869+0000","last_clean":"2024-09-19T07:51:13.022869+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:51:13.022869+0000","last_undegraded":"2024-09-19T07:51:13.022869+0000","last_fullsized":"2024-09-19T07:51:13.022869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085413+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:51:13.085413+0000","last_peered":"2024-09-19T07:51:13.085413+0000","last_clean":"2024-09-19T07:51:13.085413+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:51:13.085413+0000","last_undegraded":"2024-09-19T07:51:13.085413+0000","last_fullsized":"2024-09-19T07:51:13.085413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779460+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:51:12.779460+0000","last_peered":"2024-09-19T07:51:12.779460+0000","last_clean":"2024-09-19T07:51:12.779460+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:51:12.779460+0000","last_undegraded":"2024-09-19T07:51:12.779460+0000","last_fullsized":"2024-09-19T07:51:12.779460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085732+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:51:13.085732+0000","last_peered":"2024-09-19T07:51:13.085732+0000","last_clean":"2024-09-19T07:51:13.085732+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:51:13.085732+0000","last_undegraded":"2024-09-19T07:51:13.085732+0000","last_fullsized":"2024-09-19T07:51:13.085732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085402+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:51:13.085402+0000","last_peered":"2024-09-19T07:51:13.085402+0000","last_clean":"2024-09-19T07:51:13.085402+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:51:13.085402+0000","last_undegraded":"2024-09-19T07:51:13.085402+0000","last_fullsized":"2024-09-19T07:51:13.085402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786233+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:51:12.786233+0000","last_peered":"2024-09-19T07:51:12.786233+0000","last_clean":"2024-09-19T07:51:12.786233+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:51:12.786233+0000","last_undegraded":"2024-09-19T07:51:12.786233+0000","last_fullsized":"2024-09-19T07:51:12.786233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883560+0000","last_change":"2024-09-19T07:50:34.028464+0000","last_active":"2024-09-19T07:51:12.883560+0000","last_peered":"2024-09-19T07:51:12.883560+0000","last_clean":"2024-09-19T07:51:12.883560+0000","last_became_active":"2024-09-19T07:50:34.028078+0000","last_became_peered":"2024-09-19T07:50:34.028078+0000","last_unstale":"2024-09-19T07:51:12.883560+0000","last_undegraded":"2024-09-19T07:51:12.883560+0000","last_fullsized":"2024-09-19T07:51:12.883560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:33.498575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085358+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:51:13.085358+0000","last_peered":"2024-09-19T07:51:13.085358+0000","last_clean":"2024-09-19T07:51:13.085358+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:51:13.085358+0000","last_undegraded":"2024-09-19T07:51:13.085358+0000","last_fullsized":"2024-09-19T07:51:13.085358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777583+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:51:12.777583+0000","last_peered":"2024-09-19T07:51:12.777583+0000","last_clean":"2024-09-19T07:51:12.777583+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:51:12.777583+0000","last_undegraded":"2024-09-19T07:51:12.777583+0000","last_fullsized":"2024-09-19T07:51:12.777583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085819+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:51:13.085819+0000","last_peered":"2024-09-19T07:51:13.085819+0000","last_clean":"2024-09-19T07:51:13.085819+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:51:13.085819+0000","last_undegraded":"2024-09-19T07:51:13.085819+0000","last_fullsized":"2024-09-19T07:51:13.085819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897052+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:51:12.897052+0000","last_peered":"2024-09-19T07:51:12.897052+0000","last_clean":"2024-09-19T07:51:12.897052+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:51:12.897052+0000","last_undegraded":"2024-09-19T07:51:12.897052+0000","last_fullsized":"2024-09-19T07:51:12.897052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085545+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:51:13.085545+0000","last_peered":"2024-09-19T07:51:13.085545+0000","last_clean":"2024-09-19T07:51:13.085545+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:51:13.085545+0000","last_undegraded":"2024-09-19T07:51:13.085545+0000","last_fullsized":"2024-09-19T07:51:13.085545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820738+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:51:12.820738+0000","last_peered":"2024-09-19T07:51:12.820738+0000","last_clean":"2024-09-19T07:51:12.820738+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:51:12.820738+0000","last_undegraded":"2024-09-19T07:51:12.820738+0000","last_fullsized":"2024-09-19T07:51:12.820738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884217+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:51:12.884217+0000","last_peered":"2024-09-19T07:51:12.884217+0000","last_clean":"2024-09-19T07:51:12.884217+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:51:12.884217+0000","last_undegraded":"2024-09-19T07:51:12.884217+0000","last_fullsized":"2024-09-19T07:51:12.884217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820842+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:51:12.820842+0000","last_peered":"2024-09-19T07:51:12.820842+0000","last_clean":"2024-09-19T07:51:12.820842+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:51:12.820842+0000","last_undegraded":"2024-09-19T07:51:12.820842+0000","last_fullsized":"2024-09-19T07:51:12.820842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886077+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:51:12.886077+0000","last_peered":"2024-09-19T07:51:12.886077+0000","last_clean":"2024-09-19T07:51:12.886077+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:51:12.886077+0000","last_undegraded":"2024-09-19T07:51:12.886077+0000","last_fullsized":"2024-09-19T07:51:12.886077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778175+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:51:12.778175+0000","last_peered":"2024-09-19T07:51:12.778175+0000","last_clean":"2024-09-19T07:51:12.778175+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:51:12.778175+0000","last_undegraded":"2024-09-19T07:51:12.778175+0000","last_fullsized":"2024-09-19T07:51:12.778175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'49","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.032938+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:51:13.032938+0000","last_peered":"2024-09-19T07:51:13.032938+0000","last_clean":"2024-09-19T07:51:13.032938+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:51:13.032938+0000","last_undegraded":"2024-09-19T07:51:13.032938+0000","last_fullsized":"2024-09-19T07:51:13.032938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887028+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:51:12.887028+0000","last_peered":"2024-09-19T07:51:12.887028+0000","last_clean":"2024-09-19T07:51:12.887028+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:51:12.887028+0000","last_undegraded":"2024-09-19T07:51:12.887028+0000","last_fullsized":"2024-09-19T07:51:12.887028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786476+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:51:12.786476+0000","last_peered":"2024-09-19T07:51:12.786476+0000","last_clean":"2024-09-19T07:51:12.786476+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:51:12.786476+0000","last_undegraded":"2024-09-19T07:51:12.786476+0000","last_fullsized":"2024-09-19T07:51:12.786476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053199+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:51:13.053199+0000","last_peered":"2024-09-19T07:51:13.053199+0000","last_clean":"2024-09-19T07:51:13.053199+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:51:13.053199+0000","last_undegraded":"2024-09-19T07:51:13.053199+0000","last_fullsized":"2024-09-19T07:51:13.053199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778663+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:51:12.778663+0000","last_peered":"2024-09-19T07:51:12.778663+0000","last_clean":"2024-09-19T07:51:12.778663+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:51:12.778663+0000","last_undegraded":"2024-09-19T07:51:12.778663+0000","last_fullsized":"2024-09-19T07:51:12.778663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886882+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:51:12.886882+0000","last_peered":"2024-09-19T07:51:12.886882+0000","last_clean":"2024-09-19T07:51:12.886882+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:51:12.886882+0000","last_undegraded":"2024-09-19T07:51:12.886882+0000","last_fullsized":"2024-09-19T07:51:12.886882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073002+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:51:13.073002+0000","last_peered":"2024-09-19T07:51:13.073002+0000","last_clean":"2024-09-19T07:51:13.073002+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:51:13.073002+0000","last_undegraded":"2024-09-19T07:51:13.073002+0000","last_fullsized":"2024-09-19T07:51:13.073002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779211+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:51:12.779211+0000","last_peered":"2024-09-19T07:51:12.779211+0000","last_clean":"2024-09-19T07:51:12.779211+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:51:12.779211+0000","last_undegraded":"2024-09-19T07:51:12.779211+0000","last_fullsized":"2024-09-19T07:51:12.779211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887345+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:51:12.887345+0000","last_peered":"2024-09-19T07:51:12.887345+0000","last_clean":"2024-09-19T07:51:12.887345+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:51:12.887345+0000","last_undegraded":"2024-09-19T07:51:12.887345+0000","last_fullsized":"2024-09-19T07:51:12.887345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885828+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:51:12.885828+0000","last_peered":"2024-09-19T07:51:12.885828+0000","last_clean":"2024-09-19T07:51:12.885828+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:51:12.885828+0000","last_undegraded":"2024-09-19T07:51:12.885828+0000","last_fullsized":"2024-09-19T07:51:12.885828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085403+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:51:13.085403+0000","last_peered":"2024-09-19T07:51:13.085403+0000","last_clean":"2024-09-19T07:51:13.085403+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:51:13.085403+0000","last_undegraded":"2024-09-19T07:51:13.085403+0000","last_fullsized":"2024-09-19T07:51:13.085403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897311+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:51:12.897311+0000","last_peered":"2024-09-19T07:51:12.897311+0000","last_clean":"2024-09-19T07:51:12.897311+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:51:12.897311+0000","last_undegraded":"2024-09-19T07:51:12.897311+0000","last_fullsized":"2024-09-19T07:51:12.897311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886120+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:51:12.886120+0000","last_peered":"2024-09-19T07:51:12.886120+0000","last_clean":"2024-09-19T07:51:12.886120+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:51:12.886120+0000","last_undegraded":"2024-09-19T07:51:12.886120+0000","last_fullsized":"2024-09-19T07:51:12.886120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778673+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:51:12.778673+0000","last_peered":"2024-09-19T07:51:12.778673+0000","last_clean":"2024-09-19T07:51:12.778673+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:51:12.778673+0000","last_undegraded":"2024-09-19T07:51:12.778673+0000","last_fullsized":"2024-09-19T07:51:12.778673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886035+0000","last_change":"2024-09-19T07:50:34.354839+0000","last_active":"2024-09-19T07:51:12.886035+0000","last_peered":"2024-09-19T07:51:12.886035+0000","last_clean":"2024-09-19T07:51:12.886035+0000","last_became_active":"2024-09-19T07:50:34.350424+0000","last_became_peered":"2024-09-19T07:50:34.350424+0000","last_unstale":"2024-09-19T07:51:12.886035+0000","last_undegraded":"2024-09-19T07:51:12.886035+0000","last_fullsized":"2024-09-19T07:51:12.886035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:36.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053516+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:51:13.053516+0000","last_peered":"2024-09-19T07:51:13.053516+0000","last_clean":"2024-09-19T07:51:13.053516+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:51:13.053516+0000","last_undegraded":"2024-09-19T07:51:13.053516+0000","last_fullsized":"2024-09-19T07:51:13.053516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887230+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:51:12.887230+0000","last_peered":"2024-09-19T07:51:12.887230+0000","last_clean":"2024-09-19T07:51:12.887230+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:51:12.887230+0000","last_undegraded":"2024-09-19T07:51:12.887230+0000","last_fullsized":"2024-09-19T07:51:12.887230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886656+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:51:12.886656+0000","last_peered":"2024-09-19T07:51:12.886656+0000","last_clean":"2024-09-19T07:51:12.886656+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:51:12.886656+0000","last_undegraded":"2024-09-19T07:51:12.886656+0000","last_fullsized":"2024-09-19T07:51:12.886656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884312+0000","last_change":"2024-09-19T07:50:34.034480+0000","last_active":"2024-09-19T07:51:12.884312+0000","last_peered":"2024-09-19T07:51:12.884312+0000","last_clean":"2024-09-19T07:51:12.884312+0000","last_became_active":"2024-09-19T07:50:34.027982+0000","last_became_peered":"2024-09-19T07:50:34.027982+0000","last_unstale":"2024-09-19T07:51:12.884312+0000","last_undegraded":"2024-09-19T07:51:12.884312+0000","last_fullsized":"2024-09-19T07:51:12.884312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:40.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596619,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":708,"num_read_kb":463,"num_write":292,"num_write_kb":1435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1789857,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":450902,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":1240856,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":844354,"data_compressed":27820,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":441491,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1034146,"data_compressed":41576,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":450527,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1175201,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":451357,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":975654,"data_compressed":33976,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":512525,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":502238,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":451798,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134396,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":200051,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:51:16.475 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:16.774 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:17.108 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.108 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.108 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi076 to 176.0M 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: Unable to set osd_memory_target on smithi076 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:51:17.109 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:16 smithi076 ceph-mon[30930]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:51:17.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi076 to 176.0M 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: Unable to set osd_memory_target on smithi076 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:51:17.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:16 smithi137 ceph-mon[35309]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:51:17.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi076 to 176.0M 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: Unable to set osd_memory_target on smithi076 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: Updating smithi076:/etc/ceph/ceph.conf 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-19T07:51:17.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:16 smithi152 ceph-mon[35117]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-19T07:51:17.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 -- 172.21.15.76:0/138292430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 msgr2=0x7f2fe8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 --2- 172.21.15.76:0/138292430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8101200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009900 tx=0x7f2fe402a480 comp rx=0 tx=0).stop 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 -- 172.21.15.76:0/138292430 shutdown_connections 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 --2- 172.21.15.76:0/138292430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 0x7f2fe810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 --2- 172.21.15.76:0/138292430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe8102570 0x7f2fe81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 --2- 172.21.15.76:0/138292430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8101200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 -- 172.21.15.76:0/138292430 >> 172.21.15.76:0/138292430 conn(0x7f2fe80fc7d0 msgr2=0x7f2fe80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 -- 172.21.15.76:0/138292430 shutdown_connections 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.346+0000 7f2fef445640 1 -- 172.21.15.76:0/138292430 wait complete. 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 Processor -- start 2024-09-19T07:51:17.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 -- start start 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe8102570 0x7f2fe8198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 0x7f2fe819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8112170 con 0x7f2fe8100e20 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8111ff0 con 0x7f2fe8102ef0 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fef445640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81122f0 con 0x7f2fe8102570 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fed1e1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fed1e1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35758/0 (socket says 172.21.15.76:35758) 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fed1e1640 1 -- 172.21.15.76:0/3326043224 learned_addr learned my addr 172.21.15.76:0/3326043224 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.347+0000 7f2fec9e0640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe8102570 0x7f2fe8198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:17.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed9e2640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 0x7f2fe819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed1e1640 1 -- 172.21.15.76:0/3326043224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe8102570 msgr2=0x7f2fe8198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed1e1640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe8102570 0x7f2fe8198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed1e1640 1 -- 172.21.15.76:0/3326043224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 msgr2=0x7f2fe819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed1e1640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 0x7f2fe819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed1e1640 1 -- 172.21.15.76:0/3326043224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe819d4f0 con 0x7f2fe8100e20 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed9e2640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 0x7f2fe819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fed1e1640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8198540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006010 tx=0x7f2fe40049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe403f030 con 0x7f2fe8100e20 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2fe4004dd0 con 0x7f2fe8100e20 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.348+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe819d780 con 0x7f2fe8100e20 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.349+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4035070 con 0x7f2fe8100e20 2024-09-19T07:51:17.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.349+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe81a50c0 con 0x7f2fe8100e20 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.350+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe8101200 con 0x7f2fe8100e20 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.351+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f2fe4042030 con 0x7f2fe8100e20 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.352+0000 7f2fde7fc640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2fd40a33b0 0x7f2fd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.352+0000 7f2fec9e0640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2fd40a33b0 0x7f2fd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.353+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2fe40efd40 con 0x7f2fe8100e20 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.353+0000 7f2fec9e0640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2fd40a33b0 0x7f2fd40a5870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80ffe10 tx=0x7f2fd8005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:17.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.357+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fe40bc720 con 0x7f2fe8100e20 2024-09-19T07:51:17.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.527+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2fe40ed710 con 0x7f2fe8100e20 2024-09-19T07:51:17.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.604+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fe81a5290 con 0x7f2fe8100e20 2024-09-19T07:51:17.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.605+0000 7f2fde7fc640 1 -- 172.21.15.76:0/3326043224 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f2fe40ac650 con 0x7f2fe8100e20 2024-09-19T07:51:17.605 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:17.606 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:17.606 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:17.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2fd40a33b0 msgr2=0x7f2fd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:17.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2fd40a33b0 0x7f2fd40a5870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80ffe10 tx=0x7f2fd8005f90 comp rx=0 tx=0).stop 2024-09-19T07:51:17.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 msgr2=0x7f2fe8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:17.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8198540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006010 tx=0x7f2fe40049d0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 shutdown_connections 2024-09-19T07:51:17.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2fd40a33b0 0x7f2fd40a5870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe8102ef0 0x7f2fe819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe8102570 0x7f2fe8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 --2- 172.21.15.76:0/3326043224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2fe8100e20 0x7f2fe8198540 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:17.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 >> 172.21.15.76:0/3326043224 conn(0x7f2fe80fc7d0 msgr2=0x7f2fe80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:17.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 shutdown_connections 2024-09-19T07:51:17.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:17.607+0000 7f2fef445640 1 -- 172.21.15.76:0/3326043224 wait complete. 2024-09-19T07:51:18.394 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:51:18.644 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:18.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:51:18.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3326043224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:18.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:18.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:18.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:18.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:18 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3326043224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:18.812 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:18.813 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:18 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:51:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:51:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi076:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: Updating smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3326043224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:18.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:18.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:18 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.179+0000 7f0560735640 1 -- 172.21.15.76:0/1683032373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558102ef0 msgr2=0x7f055810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.179+0000 7f0560735640 1 --2- 172.21.15.76:0/1683032373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558102ef0 0x7f055810da40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0550009900 tx=0x7f055002a480 comp rx=0 tx=0).stop 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- 172.21.15.76:0/1683032373 shutdown_connections 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 --2- 172.21.15.76:0/1683032373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558102ef0 0x7f055810da40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 --2- 172.21.15.76:0/1683032373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0558102570 0x7f05581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 --2- 172.21.15.76:0/1683032373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0558100e20 0x7f0558101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- 172.21.15.76:0/1683032373 >> 172.21.15.76:0/1683032373 conn(0x7f05580fc7d0 msgr2=0x7f05580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- 172.21.15.76:0/1683032373 shutdown_connections 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- 172.21.15.76:0/1683032373 wait complete. 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 Processor -- start 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- start start 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 0x7f05581985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0558102570 0x7f0558198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0558102ef0 0x7f055819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05581110e0 con 0x7f0558100e20 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0558110f60 con 0x7f0558102570 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.180+0000 7f0560735640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0558111260 con 0x7f0558102ef0 2024-09-19T07:51:19.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 0x7f05581985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 0x7f05581985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35768/0 (socket says 172.21.15.76:35768) 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 -- 172.21.15.76:0/330020562 learned_addr learned my addr 172.21.15.76:0/330020562 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055dcd0640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0558102570 0x7f0558198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055ecd2640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0558102ef0 0x7f055819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 -- 172.21.15.76:0/330020562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0558102ef0 msgr2=0x7f055819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0558102ef0 0x7f055819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 -- 172.21.15.76:0/330020562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0558102570 msgr2=0x7f0558198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0558102570 0x7f0558198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 -- 172.21.15.76:0/330020562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055819d580 con 0x7f0558100e20 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f055e4d1640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 0x7f05581985d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f054800cce0 tx=0x7f054800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548004b20 con 0x7f0558100e20 2024-09-19T07:51:19.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055819d870 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0548004cc0 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054800f870 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.181+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05581a5150 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.182+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0558101200 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.183+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f054800fa10 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.184+0000 7f05577fe640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05400a3440 0x7f05400a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.184+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f05480d03c0 con 0x7f0558100e20 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.184+0000 7f055dcd0640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05400a3440 0x7f05400a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.185+0000 7f055dcd0640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05400a3440 0x7f05400a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05580fef00 tx=0x7f054c008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.187+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0548014030 con 0x7f0558100e20 2024-09-19T07:51:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.356+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f055810a0a0 con 0x7f0558100e20 2024-09-19T07:51:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.358+0000 7f05577fe640 1 -- 172.21.15.76:0/330020562 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23153 (secure 0 0 0) 0x7f054809cc30 con 0x7f0558100e20 2024-09-19T07:51:19.359 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:19.360 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":85,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:51:12.773711+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1524312740":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3175575583":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1359391390":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/2768770565":"2024-09-20T07:51:12.773685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:51:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05400a3440 msgr2=0x7f05400a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05400a3440 0x7f05400a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05580fef00 tx=0x7f054c008040 comp rx=0 tx=0).stop 2024-09-19T07:51:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 msgr2=0x7f05581985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 0x7f05581985d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f054800cce0 tx=0x7f054800a620 comp rx=0 tx=0).stop 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 shutdown_connections 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05400a3440 0x7f05400a5900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0558102ef0 0x7f055819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0558102570 0x7f0558198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 --2- 172.21.15.76:0/330020562 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0558100e20 0x7f05581985d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.360+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 >> 172.21.15.76:0/330020562 conn(0x7f05580fc7d0 msgr2=0x7f055806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.361+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 shutdown_connections 2024-09-19T07:51:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:19.361+0000 7f0560735640 1 -- 172.21.15.76:0/330020562 wait complete. 2024-09-19T07:51:19.681 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:19 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/330020562' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:19.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:19 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/330020562' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:19.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:19 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/330020562' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:20.088 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T07:51:20.088 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:51:20.098 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:51:20.098 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:51:20.098 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T07:51:20.099 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T07:51:20.099 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:51:20.099 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:51:20.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 -- 172.21.15.76:0/3660931122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 msgr2=0x7f2a8010d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 --2- 172.21.15.76:0/3660931122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a8010d7d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009ca0 tx=0x7f2a7802a950 comp rx=0 tx=0).stop 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 -- 172.21.15.76:0/3660931122 shutdown_connections 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 --2- 172.21.15.76:0/3660931122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a8010d7d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 --2- 172.21.15.76:0/3660931122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a801016d0 0x7f2a80101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 --2- 172.21.15.76:0/3660931122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a80105af0 0x7f2a80105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 -- 172.21.15.76:0/3660931122 >> 172.21.15.76:0/3660931122 conn(0x7f2a80075ec0 msgr2=0x7f2a800762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 -- 172.21.15.76:0/3660931122 shutdown_connections 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.205+0000 7f2a85311640 1 -- 172.21.15.76:0/3660931122 wait complete. 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 Processor -- start 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 -- start start 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a801016d0 0x7f2a80199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a80199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a80105af0 0x7f2a801a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80110f00 con 0x7f2a80102050 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80110d80 con 0x7f2a801016d0 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.206+0000 7f2a85311640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80111080 con 0x7f2a80105af0 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a80199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a80199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35778/0 (socket says 172.21.15.76:35778) 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 -- 172.21.15.76:0/2647126823 learned_addr learned my addr 172.21.15.76:0/2647126823 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7effd640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a801016d0 0x7f2a80199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7f7fe640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a80105af0 0x7f2a801a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 -- 172.21.15.76:0/2647126823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a80105af0 msgr2=0x7f2a801a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a80105af0 0x7f2a801a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 -- 172.21.15.76:0/2647126823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a801016d0 msgr2=0x7f2a80199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a801016d0 0x7f2a80199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 -- 172.21.15.76:0/2647126823 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a801a4700 con 0x7f2a80102050 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7f7fe640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a80105af0 0x7f2a801a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a7e7fc640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a80199680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400d770 tx=0x7f2a7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74017070 con 0x7f2a80102050 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a801a48d0 con 0x7f2a80102050 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a74005520 con 0x7f2a80102050 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74010460 con 0x7f2a80102050 2024-09-19T07:51:20.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.207+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a801a4da0 con 0x7f2a80102050 2024-09-19T07:51:20.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.208+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a80101b10 con 0x7f2a80102050 2024-09-19T07:51:20.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.210+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2a74004ea0 con 0x7f2a80102050 2024-09-19T07:51:20.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.210+0000 7f2a67fff640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a680a3500 0x7f2a680a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.210+0000 7f2a7effd640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a680a3500 0x7f2a680a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.210+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2a740cfe00 con 0x7f2a80102050 2024-09-19T07:51:20.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.211+0000 7f2a7effd640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a680a3500 0x7f2a680a59c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000bb60 tx=0x7f2a7000b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.213+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a7409c670 con 0x7f2a80102050 2024-09-19T07:51:20.357 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:20.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.395+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f2a801a5110 con 0x7f2a80102050 2024-09-19T07:51:20.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.399+0000 7f2a67fff640 1 -- 172.21.15.76:0/2647126823 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f2a7409bf70 con 0x7f2a80102050 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.401+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a680a3500 msgr2=0x7f2a680a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.401+0000 7f2a85311640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a680a3500 0x7f2a680a59c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000bb60 tx=0x7f2a7000b390 comp rx=0 tx=0).stop 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.401+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 msgr2=0x7f2a80199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.401+0000 7f2a85311640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a80199680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400d770 tx=0x7f2a7400dc30 comp rx=0 tx=0).stop 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 shutdown_connections 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a680a3500 0x7f2a680a59c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a80105af0 0x7f2a801a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a80102050 0x7f2a80199680 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 --2- 172.21.15.76:0/2647126823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a801016d0 0x7f2a80199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 >> 172.21.15.76:0/2647126823 conn(0x7f2a80075ec0 msgr2=0x7f2a800fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 shutdown_connections 2024-09-19T07:51:20.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.402+0000 7f2a85311640 1 -- 172.21.15.76:0/2647126823 wait complete. 2024-09-19T07:51:20.414 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T07:51:20.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 -- 172.21.15.76:0/2095819704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 msgr2=0x7fced8100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 --2- 172.21.15.76:0/2095819704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8100e10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009930 tx=0x7fcecc02a420 comp rx=0 tx=0).stop 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 -- 172.21.15.76:0/2095819704 shutdown_connections 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 --2- 172.21.15.76:0/2095819704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fced8101350 0x7fced810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 --2- 172.21.15.76:0/2095819704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8100e10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 --2- 172.21.15.76:0/2095819704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced81069c0 0x7fced8106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 -- 172.21.15.76:0/2095819704 >> 172.21.15.76:0/2095819704 conn(0x7fced8077990 msgr2=0x7fced80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 -- 172.21.15.76:0/2095819704 shutdown_connections 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.516+0000 7fcede4b7640 1 -- 172.21.15.76:0/2095819704 wait complete. 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 Processor -- start 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 -- start start 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8101350 0x7fced8199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fced81069c0 0x7fced81a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fced8110f20 con 0x7fced81009b0 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fced8110da0 con 0x7fced8101350 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcede4b7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fced81110a0 con 0x7fced81069c0 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fced7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fced7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35806/0 (socket says 172.21.15.76:35806) 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fced7fff640 1 -- 172.21.15.76:0/1044531438 learned_addr learned my addr 172.21.15.76:0/1044531438 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fcedca54640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fced81069c0 0x7fced81a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.517+0000 7fced77fe640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8101350 0x7fced8199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced7fff640 1 -- 172.21.15.76:0/1044531438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fced81069c0 msgr2=0x7fced81a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced7fff640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fced81069c0 0x7fced81a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced7fff640 1 -- 172.21.15.76:0/1044531438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8101350 msgr2=0x7fced8199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced7fff640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8101350 0x7fced8199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced7fff640 1 -- 172.21.15.76:0/1044531438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced81a4800 con 0x7fced81009b0 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced7fff640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8199240 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcec800d950 tx=0x7fcec800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8017070 con 0x7fced81009b0 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcec8009c30 con 0x7fced81009b0 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced81a49d0 con 0x7fced81009b0 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800f740 con 0x7fced81009b0 2024-09-19T07:51:20.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.518+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81a4ef0 con 0x7fced81009b0 2024-09-19T07:51:20.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.519+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced8100e10 con 0x7fced81009b0 2024-09-19T07:51:20.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.520+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fcec8010a80 con 0x7fced81009b0 2024-09-19T07:51:20.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.520+0000 7fced57fa640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcec00a3500 0x7fcec00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.521+0000 7fced77fe640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcec00a3500 0x7fcec00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.521+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fcec80cfaa0 con 0x7fced81009b0 2024-09-19T07:51:20.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.521+0000 7fced77fe640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcec00a3500 0x7fcec00a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.525+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcec8009de0 con 0x7fced81009b0 2024-09-19T07:51:20.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:20 smithi076 ceph-mon[30930]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 820 B/s rd, 0 op/s 2024-09-19T07:51:20.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:20 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2647126823' entity='client.admin' 2024-09-19T07:51:20.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:20 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:20.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:20 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:20.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:20 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:20.679 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:20 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.698+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fced81a50c0 con 0x7fced81009b0 2024-09-19T07:51:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.702+0000 7fced57fa640 1 -- 172.21.15.76:0/1044531438 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7fcec809c310 con 0x7fced81009b0 2024-09-19T07:51:20.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcec00a3500 msgr2=0x7fcec00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcec00a3500 0x7fcec00a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc005a20 comp rx=0 tx=0).stop 2024-09-19T07:51:20.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 msgr2=0x7fced8199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8199240 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcec800d950 tx=0x7fcec800de10 comp rx=0 tx=0).stop 2024-09-19T07:51:20.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 shutdown_connections 2024-09-19T07:51:20.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcec00a3500 0x7fcec00a59c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fced81069c0 0x7fced81a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8101350 0x7fced8199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 --2- 172.21.15.76:0/1044531438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fced81009b0 0x7fced8199240 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.704+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 >> 172.21.15.76:0/1044531438 conn(0x7fced8077990 msgr2=0x7fced8103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.705+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 shutdown_connections 2024-09-19T07:51:20.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.705+0000 7fcede4b7640 1 -- 172.21.15.76:0/1044531438 wait complete. 2024-09-19T07:51:20.718 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T07:51:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:20 smithi152 ceph-mon[35117]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 820 B/s rd, 0 op/s 2024-09-19T07:51:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:20 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2647126823' entity='client.admin' 2024-09-19T07:51:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:20 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:20 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:20 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:20.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:20 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:20.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 -- 172.21.15.76:0/4268079743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc001069f0 msgr2=0x7fbc00106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 --2- 172.21.15.76:0/4268079743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc001069f0 0x7fbc00106dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009930 tx=0x7fbbf002a420 comp rx=0 tx=0).stop 2024-09-19T07:51:20.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 -- 172.21.15.76:0/4268079743 shutdown_connections 2024-09-19T07:51:20.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 --2- 172.21.15.76:0/4268079743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc00101380 0x7fbc0010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 --2- 172.21.15.76:0/4268079743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001009e0 0x7fbc00100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 --2- 172.21.15.76:0/4268079743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc001069f0 0x7fbc00106dd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 -- 172.21.15.76:0/4268079743 >> 172.21.15.76:0/4268079743 conn(0x7fbc000fc6c0 msgr2=0x7fbc000feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 -- 172.21.15.76:0/4268079743 shutdown_connections 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.823+0000 7fbc05d31640 1 -- 172.21.15.76:0/4268079743 wait complete. 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 Processor -- start 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 -- start start 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc001009e0 0x7fbc00197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 0x7fbc001978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001069f0 0x7fbc0019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00110f50 con 0x7fbc00101380 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00110dd0 con 0x7fbc001069f0 2024-09-19T07:51:20.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbc05d31640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001110d0 con 0x7fbc001009e0 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 0x7fbc001978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 0x7fbc001978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35826/0 (socket says 172.21.15.76:35826) 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 -- 172.21.15.76:0/2210898372 learned_addr learned my addr 172.21.15.76:0/2210898372 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbff7fe640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc001009e0 0x7fbc00197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbfffff640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001069f0 0x7fbc0019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 -- 172.21.15.76:0/2210898372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc001009e0 msgr2=0x7fbc00197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc001009e0 0x7fbc00197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 -- 172.21.15.76:0/2210898372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001069f0 msgr2=0x7fbc0019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001069f0 0x7fbc0019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbf7fff640 1 -- 172.21.15.76:0/2210898372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0019c360 con 0x7fbc00101380 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.824+0000 7fbbfffff640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001069f0 0x7fbc0019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.825+0000 7fbbf7fff640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 0x7fbc001978b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800d950 tx=0x7fbbe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.825+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8017070 con 0x7fbc00101380 2024-09-19T07:51:20.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.825+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbbe8009c30 con 0x7fbc00101380 2024-09-19T07:51:20.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.825+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0019c650 con 0x7fbc00101380 2024-09-19T07:51:20.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.825+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800f740 con 0x7fbc00101380 2024-09-19T07:51:20.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.825+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc001a3ee0 con 0x7fbc00101380 2024-09-19T07:51:20.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.826+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc00100e40 con 0x7fbc00101380 2024-09-19T07:51:20.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.827+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fbbe8010a80 con 0x7fbc00101380 2024-09-19T07:51:20.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.828+0000 7fbbfd7fa640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbbec0a3580 0x7fbbec0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.828+0000 7fbbff7fe640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbbec0a3580 0x7fbbec0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.828+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fbbe80cfad0 con 0x7fbc00101380 2024-09-19T07:51:20.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.828+0000 7fbbff7fe640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbbec0a3580 0x7fbbec0a5a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009900 tx=0x7fbbf00058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.832+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbbe8009de0 con 0x7fbc00101380 2024-09-19T07:51:20.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 -- 172.21.15.76:0/3154106880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 msgr2=0x7fb9c8106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3154106880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c8106e50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009890 tx=0x7fb9c402a380 comp rx=0 tx=0).stop 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 -- 172.21.15.76:0/3154106880 shutdown_connections 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3154106880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9c8101410 0x7fb9c810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3154106880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c8100a70 0x7fb9c8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3154106880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c8106e50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 -- 172.21.15.76:0/3154106880 >> 172.21.15.76:0/3154106880 conn(0x7fb9c80fc790 msgr2=0x7fb9c80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.876+0000 7fb9cedca640 1 -- 172.21.15.76:0/3154106880 shutdown_connections 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 -- 172.21.15.76:0/3154106880 wait complete. 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 Processor -- start 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 -- start start 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c8100a70 0x7fb9c8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9c8101410 0x7fb9c8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8110f90 con 0x7fb9c8106a70 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8110e10 con 0x7fb9c8101410 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cedca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c8111110 con 0x7fb9c8100a70 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cd367640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cd367640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35840/0 (socket says 172.21.15.76:35840) 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.877+0000 7fb9cd367640 1 -- 172.21.15.76:0/3696885571 learned_addr learned my addr 172.21.15.76:0/3696885571 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c8100a70 0x7fb9c8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9bffff640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9c8101410 0x7fb9c8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cd367640 1 -- 172.21.15.76:0/3696885571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c8100a70 msgr2=0x7fb9c8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cd367640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c8100a70 0x7fb9c8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cd367640 1 -- 172.21.15.76:0/3696885571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9c8101410 msgr2=0x7fb9c8198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cd367640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9c8101410 0x7fb9c8198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cd367640 1 -- 172.21.15.76:0/3696885571 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c819d540 con 0x7fb9c8106a70 2024-09-19T07:51:20.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cd367640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c819ce60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000eb10 tx=0x7fb9c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9bdffb640 1 -- 172.21.15.76:0/3696885571 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0004b20 con 0x7fb9c8106a70 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9bdffb640 1 -- 172.21.15.76:0/3696885571 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9c0004cc0 con 0x7fb9c8106a70 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c819d830 con 0x7fb9c8106a70 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9bdffb640 1 -- 172.21.15.76:0/3696885571 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c00107f0 con 0x7fb9c8106a70 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.878+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c81a5110 con 0x7fb9c8106a70 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.881+0000 7fb9bdffb640 1 -- 172.21.15.76:0/3696885571 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fb9c0005020 con 0x7fb9c8106a70 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.881+0000 7fb9d11a3740 1 Processor -- start 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 -- start start 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb15f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb20800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb23130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b9ca7b280 con 0x562b9cb15b60 2024-09-19T07:51:20.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562b9ca22b10 con 0x562b9cb16480 2024-09-19T07:51:20.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562b9ca77240 con 0x562b9cb20d40 2024-09-19T07:51:20.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bdffb640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb9b00a3440 0x7fb9b00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb15f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb15f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35850/0 (socket says 172.21.15.76:35850) 2024-09-19T07:51:20.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 -- 172.21.15.76:0/2059901712 learned_addr learned my addr 172.21.15.76:0/2059901712 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb20800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9cd367640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb9b00a3440 0x7fb9b00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bdffb640 1 -- 172.21.15.76:0/3696885571 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fb9c00d0490 con 0x7fb9c8106a70 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb23130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 -- 172.21.15.76:0/2059901712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 msgr2=0x562b9cb23130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb23130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 -- 172.21.15.76:0/2059901712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 msgr2=0x562b9cb20800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb20800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.882+0000 7fb9bffff640 1 -- 172.21.15.76:0/2059901712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9ca2f1f0 con 0x562b9cb15b60 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9bffff640 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb15f40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009df0 tx=0x7fb9b8009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1030b9439f70d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9cd367640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb9b00a3440 0x7fb9b00a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00cdb80 tx=0x7fb9c0023040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9aeffd640 1 -- 172.21.15.76:0/2059901712 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8023070 con 0x562b9cb15b60 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9aeffd640 1 -- 172.21.15.76:0/2059901712 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9b801e8d0 con 0x562b9cb15b60 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9aeffd640 1 -- 172.21.15.76:0/2059901712 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8003b10 con 0x562b9cb15b60 2024-09-19T07:51:20.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9d11a3740 1 -- 172.21.15.76:0/2059901712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 msgr2=0x562b9cb15f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.883+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb15f40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009df0 tx=0x7fb9b8009790 comp rx=0 tx=0).stop 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- 172.21.15.76:0/2059901712 shutdown_connections 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb23130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb20800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/2059901712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb15f40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- 172.21.15.76:0/2059901712 >> 172.21.15.76:0/2059901712 conn(0x562b9cb120f0 msgr2=0x562b9cb124d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- 172.21.15.76:0/2059901712 shutdown_connections 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- 172.21.15.76:0/2059901712 wait complete. 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- start start 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 Processor -- start 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb15b60 0x562b9cb1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 0x562b9cb1e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb20d40 0x562b9cb1e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b9cb23910 con 0x562b9cb16480 2024-09-19T07:51:20.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562b9ca35f10 con 0x562b9cb20d40 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562b9cb23a90 con 0x562b9cb15b60 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.884+0000 7fb9d11a3740 10 client.0 _ll_register_callbacks cb 0x562b9c9fea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 0x562b9cb1e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 0x562b9cb1e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35862/0 (socket says 172.21.15.76:35862) 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb15b60 0x562b9cb1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 -- 172.21.15.76:0/589806167 learned_addr learned my addr 172.21.15.76:0/589806167 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9bffff640 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb20d40 0x562b9cb1e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 -- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb15b60 msgr2=0x562b9cb1dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb15b60 0x562b9cb1dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 -- 172.21.15.76:0/589806167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb20d40 msgr2=0x562b9cb1e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb20d40 0x562b9cb1e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 -- 172.21.15.76:0/589806167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9c7ec6a0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 0x562b9cb1e130 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb9c402a8a0 tx=0x7fb9c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a643ed40d5a83b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9a7fff640 1 -- 172.21.15.76:0/589806167 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4037040 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b801e8d0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.885+0000 7fb9a7fff640 1 -- 172.21.15.76:0/589806167 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fb9c40307c0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9a7fff640 1 -- 172.21.15.76:0/589806167 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9c40309c0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 10 client.15282 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b9cb2f4e0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9a7fff640 1 -- 172.21.15.76:0/589806167 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9b801e8d0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9a7fff640 1 -- 172.21.15.76:0/589806167 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9c40035f0 con 0x562b9cb16480 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 10 client.15282 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 20 client.15282 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:20.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb30b30 0x562b9cb32f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 4 client.15282 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b9ca887f0 con 0x562b9cb30b30 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.886+0000 7fb9bffff640 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb30b30 0x562b9cb32f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.887+0000 7fb9bffff640 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb30b30 0x562b9cb32f20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28cb6f47e4c0aff5 server_cookie=5f1bf2734b26980b in_seq=0 out_seq=0 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.887+0000 7fb9a7fff640 10 client.15282 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.887+0000 7fb9a7fff640 1 -- 172.21.15.76:0/589806167 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b9ca887f0 con 0x562b9cb30b30 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.887+0000 7fb9a7fff640 10 client.15282 handle_command_reply: tid=0 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.887+0000 7fb9d11a3740 1 client.15282 shutdown 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 msgr2=0x562b9cb1e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 0x562b9cb1e130 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb9c402a8a0 tx=0x7fb9c4004270 comp rx=0 tx=0).stop 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 shutdown_connections 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb20d40 0x562b9cb1e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb30b30 0x562b9cb32f20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb16480 0x562b9cb1e130 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/589806167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb15b60 0x562b9cb1dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 >> 172.21.15.76:0/589806167 conn(0x562b9cb120f0 msgr2=0x562b9cb17e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9a7fff640 0 client.15282 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 shutdown_connections 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 1 -- 172.21.15.76:0/589806167 wait complete. 2024-09-19T07:51:20.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.888+0000 7fb9d11a3740 20 client.15282 trim_cache size 0 max 16384 2024-09-19T07:51:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:20 smithi137 ceph-mon[35309]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 820 B/s rd, 0 op/s 2024-09-19T07:51:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:20 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2647126823' entity='client.admin' 2024-09-19T07:51:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:20 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:20 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:20 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:20 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:20.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 Processor -- start 2024-09-19T07:51:20.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 -- start start 2024-09-19T07:51:20.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb1fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb38580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81ae0c0 con 0x562b9cb15b60 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81ab990 con 0x562b9cb16480 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a97e0 con 0x562b9cb20d40 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb1e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35866/0 (socket says 172.21.15.76:35866) 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.905+0000 7fb9bffff640 1 -- 172.21.15.76:0/1446035781 learned_addr learned my addr 172.21.15.76:0/1446035781 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9bffff640 1 -- 172.21.15.76:0/1446035781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 msgr2=0x562b9cb38580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb1fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9bffff640 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb38580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9bffff640 1 -- 172.21.15.76:0/1446035781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 msgr2=0x562b9cb1fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9bffff640 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb1fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9bffff640 1 -- 172.21.15.76:0/1446035781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9cb162b0 con 0x562b9cb15b60 2024-09-19T07:51:20.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9bffff640 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb1e4c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8000c00 tx=0x7fb9b8003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc57ca9bde123a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9ae7fc640 1 -- 172.21.15.76:0/1446035781 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8034070 con 0x562b9cb15b60 2024-09-19T07:51:20.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9ae7fc640 1 -- 172.21.15.76:0/1446035781 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9b8024040 con 0x562b9cb15b60 2024-09-19T07:51:20.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.906+0000 7fb9ae7fc640 1 -- 172.21.15.76:0/1446035781 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8023040 con 0x562b9cb15b60 2024-09-19T07:51:20.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 -- 172.21.15.76:0/1446035781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 msgr2=0x562b9cb1e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb1e4c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8000c00 tx=0x7fb9b8003690 comp rx=0 tx=0).stop 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 -- 172.21.15.76:0/1446035781 shutdown_connections 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb20d40 0x562b9cb38580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb16480 0x562b9cb1fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/1446035781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb15b60 0x562b9cb1e4c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 -- 172.21.15.76:0/1446035781 >> 172.21.15.76:0/1446035781 conn(0x562b9cb120f0 msgr2=0x562b9cb1f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 -- 172.21.15.76:0/1446035781 shutdown_connections 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.907+0000 7fb9d11a3740 1 -- 172.21.15.76:0/1446035781 wait complete. 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 -- start start 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 Processor -- start 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb15b60 0x562b9cb1acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb16480 0x562b9cb1b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb20d40 0x562b9cb1b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81a9e50 con 0x562b9cb20d40 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81ab2c0 con 0x562b9cb15b60 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.908+0000 7fb9d11a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c81aa520 con 0x562b9cb16480 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9d11a3740 10 client.0 _ll_register_callbacks cb 0x7fb9b8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb20d40 0x562b9cb1b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb16480 0x562b9cb1b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb20d40 0x562b9cb1b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35878/0 (socket says 172.21.15.76:35878) 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9bffff640 1 -- 172.21.15.76:0/3108726109 learned_addr learned my addr 172.21.15.76:0/3108726109 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9bffff640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb15b60 0x562b9cb1acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 -- 172.21.15.76:0/3108726109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb15b60 msgr2=0x562b9cb1acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb15b60 0x562b9cb1acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 -- 172.21.15.76:0/3108726109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb20d40 msgr2=0x562b9cb1b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb20d40 0x562b9cb1b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 -- 172.21.15.76:0/3108726109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9cb9a600 con 0x562b9cb16480 2024-09-19T07:51:20.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9bffff640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb15b60 0x562b9cb1acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9ccb66640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb16480 0x562b9cb1b200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x562b9cb1f1a0 tx=0x7fb9c4005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f14f53675b1009 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.909+0000 7fb9a7fff640 1 -- 172.21.15.76:0/3108726109 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4037040 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9a7fff640 1 -- 172.21.15.76:0/3108726109 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fb9c40305c0 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b8024040 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9a7fff640 1 -- 172.21.15.76:0/3108726109 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9c4003e50 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 10 client.24898 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b9cb9b920 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9a7fff640 1 -- 172.21.15.76:0/3108726109 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9c4038040 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9a7fff640 1 -- 172.21.15.76:0/3108726109 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9c4004bc0 con 0x562b9cb16480 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 10 client.24898 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 10 client.24898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:51:20.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 20 client.24898 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:20.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb9c060 0x562b9cb9e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:20.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 4 client.24898 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:51:20.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.910+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fb9b8024040 con 0x562b9cb9c060 2024-09-19T07:51:20.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.911+0000 7fb9bffff640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb9c060 0x562b9cb9e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:20.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.911+0000 7fb9bffff640 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb9c060 0x562b9cb9e480 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=882d8ce8ac480bef server_cookie=cf7367cf057e541e in_seq=0 out_seq=0 2024-09-19T07:51:20.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.911+0000 7fb9a7fff640 10 client.24898 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:20.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9a7fff640 1 -- 172.21.15.76:0/3108726109 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fb9b8024040 con 0x562b9cb9c060 2024-09-19T07:51:20.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9a7fff640 10 client.24898 handle_command_reply: tid=0 2024-09-19T07:51:20.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 client.24898 shutdown 2024-09-19T07:51:20.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb16480 msgr2=0x562b9cb1b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb16480 0x562b9cb1b200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x562b9cb1f1a0 tx=0x7fb9c4005b00 comp rx=0 tx=0).stop 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 shutdown_connections 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b9cb9c060 0x562b9cb9e480 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b9cb20d40 0x562b9cb1b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b9cb16480 0x562b9cb1b200 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 --2- 172.21.15.76:0/3108726109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b9cb15b60 0x562b9cb1acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 >> 172.21.15.76:0/3108726109 conn(0x562b9cb120f0 msgr2=0x562b9cb11270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9a7fff640 0 client.24898 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 shutdown_connections 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.912+0000 7fb9d11a3740 1 -- 172.21.15.76:0/3108726109 wait complete. 2024-09-19T07:51:20.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9d11a3740 20 client.24898 trim_cache size 0 max 16384 2024-09-19T07:51:20.919 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:20.919 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:51:20.919 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "16d20776-045b-4d91-94be-efea40b5015e", 2024-09-19T07:51:20.919 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:51:20.919 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:20.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb9b00a3440 msgr2=0x7fb9b00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb9b00a3440 0x7fb9b00a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00cdb80 tx=0x7fb9c0023040 comp rx=0 tx=0).stop 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 msgr2=0x7fb9c819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c819ce60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000eb10 tx=0x7fb9c000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 shutdown_connections 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb9b00a3440 0x7fb9b00a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb9c8106a70 0x7fb9c819ce60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9c8101410 0x7fb9c8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 --2- 172.21.15.76:0/3696885571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c8100a70 0x7fb9c8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.913+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 >> 172.21.15.76:0/3696885571 conn(0x7fb9c80fc790 msgr2=0x7fb9c806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.914+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 shutdown_connections 2024-09-19T07:51:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:20.914+0000 7fb9cedca640 1 -- 172.21.15.76:0/3696885571 wait complete. 2024-09-19T07:51:21.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.011+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fbc001a41e0 con 0x7fbc00101380 2024-09-19T07:51:21.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.015+0000 7fbbfd7fa640 1 -- 172.21.15.76:0/2210898372 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7fbbe809c340 con 0x7fbc00101380 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.017+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbbec0a3580 msgr2=0x7fbbec0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.017+0000 7fbc05d31640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbbec0a3580 0x7fbbec0a5a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009900 tx=0x7fbbf00058d0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.017+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 msgr2=0x7fbc001978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.017+0000 7fbc05d31640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 0x7fbc001978b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800d950 tx=0x7fbbe800de10 comp rx=0 tx=0).stop 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 shutdown_connections 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbbec0a3580 0x7fbbec0a5a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc001069f0 0x7fbc0019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc00101380 0x7fbc001978b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 --2- 172.21.15.76:0/2210898372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc001009e0 0x7fbc00197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 >> 172.21.15.76:0/2210898372 conn(0x7fbc000fc6c0 msgr2=0x7fbc000fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 shutdown_connections 2024-09-19T07:51:21.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.018+0000 7fbc05d31640 1 -- 172.21.15.76:0/2210898372 wait complete. 2024-09-19T07:51:21.031 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T07:51:21.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 -- 172.21.15.76:0/3545118667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 msgr2=0x7f2db8101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 --2- 172.21.15.76:0/3545118667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db8101f30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009930 tx=0x7f2da002a420 comp rx=0 tx=0).stop 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 -- 172.21.15.76:0/3545118667 shutdown_connections 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 --2- 172.21.15.76:0/3545118667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2db8102470 0x7f2db810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 --2- 172.21.15.76:0/3545118667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db8101f30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 --2- 172.21.15.76:0/3545118667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 0x7f2db8107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 -- 172.21.15.76:0/3545118667 >> 172.21.15.76:0/3545118667 conn(0x7f2db80fd7d0 msgr2=0x7f2db80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 -- 172.21.15.76:0/3545118667 shutdown_connections 2024-09-19T07:51:21.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.133+0000 7f2dbca96640 1 -- 172.21.15.76:0/3545118667 wait complete. 2024-09-19T07:51:21.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.134+0000 7f2dbca96640 1 Processor -- start 2024-09-19T07:51:21.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.134+0000 7f2dbca96640 1 -- start start 2024-09-19T07:51:21.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2db8102470 0x7f2db8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 0x7f2db819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8112040 con 0x7f2db8101ad0 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8111ec0 con 0x7f2db8107b70 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2db81121c0 con 0x7f2db8102470 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db81983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35906/0 (socket says 172.21.15.76:35906) 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 -- 172.21.15.76:0/1140094444 learned_addr learned my addr 172.21.15.76:0/1140094444 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dadd9b640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2db8102470 0x7f2db8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db6d9d640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 0x7f2db819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 -- 172.21.15.76:0/1140094444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2db8102470 msgr2=0x7f2db8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2db8102470 0x7f2db8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 -- 172.21.15.76:0/1140094444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 msgr2=0x7f2db819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 0x7f2db819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 -- 172.21.15.76:0/1140094444 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db819d3e0 con 0x7f2db8101ad0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db6d9d640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 0x7f2db819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2db659c640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db81983f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c920 tx=0x7f2da800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8007c70 con 0x7f2db8101ad0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db819d6d0 con 0x7f2db8101ad0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2da8007e10 con 0x7f2db8101ad0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8018940 con 0x7f2db8101ad0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.135+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db81a4f60 con 0x7f2db8101ad0 2024-09-19T07:51:21.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.136+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db8101f30 con 0x7f2db8101ad0 2024-09-19T07:51:21.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.138+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2da8018b00 con 0x7f2db8101ad0 2024-09-19T07:51:21.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.138+0000 7f2daffff640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2da40a3500 0x7f2da40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.139+0000 7f2dadd9b640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2da40a3500 0x7f2da40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.139+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2da80d0220 con 0x7f2db8101ad0 2024-09-19T07:51:21.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.139+0000 7f2dadd9b640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2da40a3500 0x7f2da40a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009900 tx=0x7f2da00058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:21.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.141+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2da8014030 con 0x7f2db8101ad0 2024-09-19T07:51:21.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.335+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f2db80fe480 con 0x7f2da40a3500 2024-09-19T07:51:21.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.398+0000 7f2daffff640 1 -- 172.21.15.76:0/1140094444 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2db80fe480 con 0x7f2da40a3500 2024-09-19T07:51:21.400 INFO:teuthology.orchestra.run.smithi076.stdout:Schedule set for path / 2024-09-19T07:51:21.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2da40a3500 msgr2=0x7f2da40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2da40a3500 0x7f2da40a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009900 tx=0x7f2da00058d0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 msgr2=0x7f2db81983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db81983f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c920 tx=0x7f2da800cde0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 shutdown_connections 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2da40a3500 0x7f2da40a59c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2db8107b70 0x7f2db819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2db8102470 0x7f2db8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 --2- 172.21.15.76:0/1140094444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db8101ad0 0x7f2db81983f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.400+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 >> 172.21.15.76:0/1140094444 conn(0x7f2db80fd7d0 msgr2=0x7f2db80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.401+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 shutdown_connections 2024-09-19T07:51:21.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.401+0000 7f2dbca96640 1 -- 172.21.15.76:0/1140094444 wait complete. 2024-09-19T07:51:21.412 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T07:51:21.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 -- 172.21.15.76:0/2584123621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1069c0 msgr2=0x7feacc106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 --2- 172.21.15.76:0/2584123621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1069c0 0x7feacc106da0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feab4009930 tx=0x7feab402a420 comp rx=0 tx=0).stop 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 -- 172.21.15.76:0/2584123621 shutdown_connections 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 --2- 172.21.15.76:0/2584123621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc101350 0x7feacc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 --2- 172.21.15.76:0/2584123621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feacc1009b0 0x7feacc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 --2- 172.21.15.76:0/2584123621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1069c0 0x7feacc106da0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 -- 172.21.15.76:0/2584123621 >> 172.21.15.76:0/2584123621 conn(0x7feacc077990 msgr2=0x7feacc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 -- 172.21.15.76:0/2584123621 shutdown_connections 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.516+0000 7fead0de8640 1 -- 172.21.15.76:0/2584123621 wait complete. 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 Processor -- start 2024-09-19T07:51:21.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 -- start start 2024-09-19T07:51:21.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 0x7feacc10e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feacc101350 0x7feacc10e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc1069c0 0x7feacc10ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feacc112010 con 0x7feacc1009b0 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feacc111e90 con 0x7feacc101350 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7fead0de8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feacc112190 con 0x7feacc1069c0 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 0x7feacc10e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 0x7feacc10e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35924/0 (socket says 172.21.15.76:35924) 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 -- 172.21.15.76:0/1940082045 learned_addr learned my addr 172.21.15.76:0/1940082045 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feacad9d640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc1069c0 0x7feacc10ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 -- 172.21.15.76:0/1940082045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc1069c0 msgr2=0x7feacc10ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc1069c0 0x7feacc10ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 -- 172.21.15.76:0/1940082045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feacc101350 msgr2=0x7feacc10e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feac9d9b640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feacc101350 0x7feacc10e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feacc101350 0x7feacc10e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 -- 172.21.15.76:0/1940082045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feacc1a6950 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feacad9d640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc1069c0 0x7feacc10ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.517+0000 7feaca59c640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 0x7feacc10e310 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feab4009230 tx=0x7feab4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.518+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab403f030 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.518+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feab4003af0 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.518+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feacc1a6be0 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.518+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4035070 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.518+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feacc1a7120 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.519+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feacc100e10 con 0x7feacc1009b0 2024-09-19T07:51:21.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.520+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7feab4042030 con 0x7feacc1009b0 2024-09-19T07:51:21.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.520+0000 7feac37fe640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feab80a3580 0x7feab80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.520+0000 7feac9d9b640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feab80a3580 0x7feab80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.520+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7feab40f0350 con 0x7feacc1009b0 2024-09-19T07:51:21.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.521+0000 7feac9d9b640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feab80a3580 0x7feab80a5a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feacc10fda0 tx=0x7feabc005c60 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:21.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.524+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feab40bcc80 con 0x7feacc1009b0 2024-09-19T07:51:21.615 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:51:21.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.720+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7feacc103f50 con 0x7feab80a3580 2024-09-19T07:51:21.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.784+0000 7feac37fe640 1 -- 172.21.15.76:0/1940082045 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7feacc103f50 con 0x7feab80a3580 2024-09-19T07:51:21.786 INFO:teuthology.orchestra.run.smithi076.stdout:Retention added to path / 2024-09-19T07:51:21.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feab80a3580 msgr2=0x7feab80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feab80a3580 0x7feab80a5a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feacc10fda0 tx=0x7feabc005c60 comp rx=0 tx=0).stop 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 msgr2=0x7feacc10e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 0x7feacc10e310 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feab4009230 tx=0x7feab4004270 comp rx=0 tx=0).stop 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 shutdown_connections 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feab80a3580 0x7feab80a5a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feacc1069c0 0x7feacc10ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feacc101350 0x7feacc10e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 --2- 172.21.15.76:0/1940082045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feacc1009b0 0x7feacc10e310 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 >> 172.21.15.76:0/1940082045 conn(0x7feacc077990 msgr2=0x7feacc1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.786+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 shutdown_connections 2024-09-19T07:51:21.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.787+0000 7fead0de8640 1 -- 172.21.15.76:0/1940082045 wait complete. 2024-09-19T07:51:21.798 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T07:51:21.877 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 -- 172.21.15.76:0/1248942369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 msgr2=0x7f4de8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1248942369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de8106da0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009930 tx=0x7f4ddc02a420 comp rx=0 tx=0).stop 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 -- 172.21.15.76:0/1248942369 shutdown_connections 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1248942369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4de8101350 0x7f4de810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1248942369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de81009b0 0x7f4de8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1248942369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de8106da0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.906+0000 7f4dee19f640 1 -- 172.21.15.76:0/1248942369 >> 172.21.15.76:0/1248942369 conn(0x7f4de8077990 msgr2=0x7f4de80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.907+0000 7f4dee19f640 1 -- 172.21.15.76:0/1248942369 shutdown_connections 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.907+0000 7f4dee19f640 1 -- 172.21.15.76:0/1248942369 wait complete. 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.907+0000 7f4dee19f640 1 Processor -- start 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.907+0000 7f4dee19f640 1 -- start start 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.907+0000 7f4dee19f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4de81009b0 0x7f4de81972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.907+0000 7f4dee19f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de8101350 0x7f4de8197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4dee19f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4dee19f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4de8110f20 con 0x7f4de81069c0 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4dee19f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4de8110da0 con 0x7f4de8101350 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4dee19f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81110a0 con 0x7f4de81009b0 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35940/0 (socket says 172.21.15.76:35940) 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 -- 172.21.15.76:0/1283424601 learned_addr learned my addr 172.21.15.76:0/1283424601 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de77fe640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4de81009b0 0x7f4de81972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de6ffd640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de8101350 0x7f4de8197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 -- 172.21.15.76:0/1283424601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4de81009b0 msgr2=0x7f4de81972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4de81009b0 0x7f4de81972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 -- 172.21.15.76:0/1283424601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de8101350 msgr2=0x7f4de8197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de8101350 0x7f4de8197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 -- 172.21.15.76:0/1283424601 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de819c2e0 con 0x7f4de81069c0 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de7fff640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de819bbb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4de000cad0 tx=0x7f4de000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de000ae20 con 0x7f4de81069c0 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4de0004b20 con 0x7f4de81069c0 2024-09-19T07:51:21.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de819c5d0 con 0x7f4de81069c0 2024-09-19T07:51:21.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de000f780 con 0x7f4de81069c0 2024-09-19T07:51:21.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.908+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de81a3e60 con 0x7f4de81069c0 2024-09-19T07:51:21.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.909+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de8100e10 con 0x7f4de81069c0 2024-09-19T07:51:21.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.911+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f4de0004cd0 con 0x7f4de81069c0 2024-09-19T07:51:21.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.911+0000 7f4de4ff9640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dd00a3500 0x7f4dd00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:21.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.911+0000 7f4de77fe640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dd00a3500 0x7f4dd00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:21.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.911+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f4de00cff00 con 0x7f4de81069c0 2024-09-19T07:51:21.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.912+0000 7f4de77fe640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dd00a3500 0x7f4dd00a59c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc000c00 tx=0x7f4ddc0095f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:21.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:21.915+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4de0014030 con 0x7f4de81069c0 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1044531438' entity='client.admin' 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:51:21.998 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:51:21.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2210898372' entity='client.admin' 2024-09-19T07:51:21.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:21.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:21.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:21.999 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:21 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1044531438' entity='client.admin' 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2210898372' entity='client.admin' 2024-09-19T07:51:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:22.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:22.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:22.062 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:21 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:22.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.108+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f4de8103d30 con 0x7f4dd00a3500 2024-09-19T07:51:22.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.116+0000 7f4de4ff9640 1 -- 172.21.15.76:0/1283424601 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f4de8103d30 con 0x7f4dd00a3500 2024-09-19T07:51:22.117 INFO:teuthology.orchestra.run.smithi076.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T07:51:21", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.118+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dd00a3500 msgr2=0x7f4dd00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.118+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dd00a3500 0x7f4dd00a59c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc000c00 tx=0x7f4ddc0095f0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.118+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 msgr2=0x7f4de819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.118+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de819bbb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4de000cad0 tx=0x7f4de000cf90 comp rx=0 tx=0).stop 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 shutdown_connections 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dd00a3500 0x7f4dd00a59c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4de81069c0 0x7f4de819bbb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4de8101350 0x7f4de8197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 --2- 172.21.15.76:0/1283424601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4de81009b0 0x7f4de81972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 >> 172.21.15.76:0/1283424601 conn(0x7f4de8077990 msgr2=0x7f4de8103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 shutdown_connections 2024-09-19T07:51:22.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.119+0000 7f4dee19f640 1 -- 172.21.15.76:0/1283424601 wait complete. 2024-09-19T07:51:22.131 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T07:51:22.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1044531438' entity='client.admin' 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2210898372' entity='client.admin' 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:51:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:21 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 -- 172.21.15.76:0/3863205468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77341069c0 msgr2=0x7f7734106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 --2- 172.21.15.76:0/3863205468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77341069c0 0x7f7734106da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7724009930 tx=0x7f772402a420 comp rx=0 tx=0).stop 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 -- 172.21.15.76:0/3863205468 shutdown_connections 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 --2- 172.21.15.76:0/3863205468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7734101350 0x7f773410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 --2- 172.21.15.76:0/3863205468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 0x7f7734100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 --2- 172.21.15.76:0/3863205468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77341069c0 0x7f7734106da0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 -- 172.21.15.76:0/3863205468 >> 172.21.15.76:0/3863205468 conn(0x7f7734077990 msgr2=0x7f77340fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 -- 172.21.15.76:0/3863205468 shutdown_connections 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 -- 172.21.15.76:0/3863205468 wait complete. 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 Processor -- start 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.238+0000 7f773913b640 1 -- start start 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 0x7f7734198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 0x7f7734198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77341069c0 0x7f773419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7734112010 con 0x7f7734101350 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7734111e90 con 0x7f77341009b0 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7734112190 con 0x7f77341069c0 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 0x7f7734198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 0x7f7734198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35956/0 (socket says 172.21.15.76:35956) 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 -- 172.21.15.76:0/2237883223 learned_addr learned my addr 172.21.15.76:0/2237883223 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f7732d9d640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 0x7f7734198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773359e640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77341069c0 0x7f773419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 -- 172.21.15.76:0/2237883223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77341069c0 msgr2=0x7f773419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77341069c0 0x7f773419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 -- 172.21.15.76:0/2237883223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 msgr2=0x7f7734198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 0x7f7734198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 -- 172.21.15.76:0/2237883223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773419d440 con 0x7f7734101350 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f7732d9d640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 0x7f7734198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f772bfff640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 0x7f7734198990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f771c00d950 tx=0x7f771c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c017030 con 0x7f7734101350 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f771c004020 con 0x7f7734101350 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c004a00 con 0x7f7734101350 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773419d730 con 0x7f7734101350 2024-09-19T07:51:22.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.239+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77341a4fc0 con 0x7f7734101350 2024-09-19T07:51:22.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.240+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7734100e10 con 0x7f7734101350 2024-09-19T07:51:22.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.241+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f771c0041d0 con 0x7f7734101350 2024-09-19T07:51:22.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.242+0000 7f7730d99640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77200a3500 0x7f77200a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.243+0000 7f7732d9d640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77200a3500 0x7f77200a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.243+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f771c0cf940 con 0x7f7734101350 2024-09-19T07:51:22.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.243+0000 7f7732d9d640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77200a3500 0x7f77200a59c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7724000c00 tx=0x7f7724032c80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.247+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f771c09c1b0 con 0x7f7734101350 2024-09-19T07:51:22.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- 172.21.15.76:0/3662396713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0106f40 msgr2=0x7f46b010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- 172.21.15.76:0/3662396713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0106f40 0x7f46b010eac0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009ca0 tx=0x7f46a802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- 172.21.15.76:0/3662396713 shutdown_connections 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- 172.21.15.76:0/3662396713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0106f40 0x7f46b010eac0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- 172.21.15.76:0/3662396713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b01027c0 0x7f46b0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- 172.21.15.76:0/3662396713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b0101e10 0x7f46b01021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- 172.21.15.76:0/3662396713 >> 172.21.15.76:0/3662396713 conn(0x7f46b00fd8d0 msgr2=0x7f46b00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- 172.21.15.76:0/3662396713 shutdown_connections 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- 172.21.15.76:0/3662396713 wait complete. 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 Processor -- start 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- start start 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 0x7f46b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b01027c0 0x7f46b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b0106f40 0x7f46b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01120c0 con 0x7f46b0101e10 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0111f40 con 0x7f46b01027c0 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.399+0000 7f46b6b46640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0112240 con 0x7f46b0106f40 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 0x7f46b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 0x7f46b00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35982/0 (socket says 172.21.15.76:35982) 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 -- 172.21.15.76:0/92681923 learned_addr learned my addr 172.21.15.76:0/92681923 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b50e3640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b0106f40 0x7f46b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 -- 172.21.15.76:0/92681923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b0106f40 msgr2=0x7f46b0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b0106f40 0x7f46b0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 -- 172.21.15.76:0/92681923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b01027c0 msgr2=0x7f46b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46affff640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b01027c0 0x7f46b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b01027c0 0x7f46b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 -- 172.21.15.76:0/92681923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b01a68f0 con 0x7f46b0101e10 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b50e3640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b0106f40 0x7f46b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46affff640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b01027c0 0x7f46b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:22.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b48e2640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 0x7f46b00744f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f46a400c920 tx=0x7f46a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46adffb640 1 -- 172.21.15.76:0/92681923 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4007c70 con 0x7f46b0101e10 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46adffb640 1 -- 172.21.15.76:0/92681923 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f46a4007e10 con 0x7f46b0101e10 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b01a6be0 con 0x7f46b0101e10 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.400+0000 7f46adffb640 1 -- 172.21.15.76:0/92681923 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4018940 con 0x7f46b0101e10 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.401+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b01a7120 con 0x7f46b0101e10 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46adffb640 1 -- 172.21.15.76:0/92681923 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f46a4018b20 con 0x7f46b0101e10 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 Processor -- start 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 -- start start 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46adffb640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46a00a3440 0x7f46a00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf644a0 0x559ebaf64880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 0x559ebaf6f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 0x559ebaf71a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559ebaeca2e0 con 0x559ebaf64dc0 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46adffb640 1 -- 172.21.15.76:0/92681923 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f46a40d0110 con 0x7f46b0101e10 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559ebae71ce0 con 0x559ebaf6f680 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.403+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ebaec62a0 con 0x559ebaf644a0 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 0x559ebaf6f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 0x559ebaf6f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35992/0 (socket says 172.21.15.76:35992) 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 -- 172.21.15.76:0/3810350219 learned_addr learned my addr 172.21.15.76:0/3810350219 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46b50e3640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46a00a3440 0x7f46a00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf644a0 0x559ebaf64880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 -- 172.21.15.76:0/3810350219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf644a0 msgr2=0x559ebaf64880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf644a0 0x559ebaf64880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 -- 172.21.15.76:0/3810350219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 msgr2=0x559ebaf71a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 0x559ebaf71a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 -- 172.21.15.76:0/3810350219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebae56440 con 0x559ebaf64dc0 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46affff640 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 0x559ebaf6f140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f469c00bac0 tx=0x7f469c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9d6fc8e1b8e74d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f46b50e3640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46a00a3440 0x7f46a00a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x559ebaf61db0 tx=0x7f46a802f410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f469affd640 1 -- 172.21.15.76:0/3810350219 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c017420 con 0x559ebaf64dc0 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f469affd640 1 -- 172.21.15.76:0/3810350219 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f469c017ac0 con 0x559ebaf64dc0 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.404+0000 7f469affd640 1 -- 172.21.15.76:0/3810350219 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c00fc30 con 0x559ebaf64dc0 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3810350219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 msgr2=0x559ebaf6f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 0x559ebaf6f140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f469c00bac0 tx=0x7f469c00bf80 comp rx=0 tx=0).stop 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3810350219 shutdown_connections 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 0x559ebaf71a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf64dc0 0x559ebaf6f140 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3810350219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf644a0 0x559ebaf64880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3810350219 >> 172.21.15.76:0/3810350219 conn(0x559ebaf60a30 msgr2=0x559ebaf60e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3810350219 shutdown_connections 2024-09-19T07:51:22.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3810350219 wait complete. 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.405+0000 7f46b8f1f740 1 -- start start 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 Processor -- start 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf6eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf64dc0 0x559ebaf6c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 0x559ebaf6c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559ebaf72250 con 0x559ebaf644a0 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559ebae85050 con 0x559ebaf6f680 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ebaf723d0 con 0x559ebaf64dc0 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b8f1f740 10 client.0 _ll_register_callbacks cb 0x559ebaec5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf6eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf6eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35994/0 (socket says 172.21.15.76:35994) 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 -- 172.21.15.76:0/3943094709 learned_addr learned my addr 172.21.15.76:0/3943094709 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46affff640 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf64dc0 0x559ebaf6c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 -- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf64dc0 msgr2=0x559ebaf6c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf64dc0 0x559ebaf6c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 -- 172.21.15.76:0/3943094709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 msgr2=0x559ebaf6c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 0x559ebaf6c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.406+0000 7f46b48e2640 1 -- 172.21.15.76:0/3943094709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebac3b3c0 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf6eee0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f46a4098c50 tx=0x7f46a409c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f06de4e9bbf21ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f468ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f468ffff640 1 -- 172.21.15.76:0/3943094709 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a40b4020 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f468ffff640 1 -- 172.21.15.76:0/3943094709 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f46a40b5220 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f469c017ac0 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f468ffff640 1 -- 172.21.15.76:0/3943094709 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46a4018e10 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 10 client.15324 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ebaf7dbd0 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f468ffff640 1 -- 172.21.15.76:0/3943094709 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f469c017ac0 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f468ffff640 1 -- 172.21.15.76:0/3943094709 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46a40a0190 con 0x559ebaf644a0 2024-09-19T07:51:22.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 10 client.15324 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 10 client.15324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 20 client.15324 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf7f080 0x559ebaf814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 4 client.15324 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.407+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ebaed7850 con 0x559ebaf7f080 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.408+0000 7f46affff640 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf7f080 0x559ebaf814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.408+0000 7f46affff640 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf7f080 0x559ebaf814d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30768150a6999e6 server_cookie=77e1afb1a426a2ab in_seq=0 out_seq=0 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.408+0000 7f468ffff640 10 client.15324 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f468ffff640 1 -- 172.21.15.76:0/3943094709 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ebaed7850 con 0x559ebaf7f080 2024-09-19T07:51:22.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f468ffff640 10 client.15324 handle_command_reply: tid=0 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 client.15324 shutdown 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 msgr2=0x559ebaf6eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf6eee0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f46a4098c50 tx=0x7f46a409c340 comp rx=0 tx=0).stop 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 shutdown_connections 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf6f680 0x559ebaf6c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf64dc0 0x559ebaf6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf7f080 0x559ebaf814d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3943094709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf6eee0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f468ffff640 0 client.15324 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 >> 172.21.15.76:0/3943094709 conn(0x559ebaf60a30 msgr2=0x559ebaf66710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 shutdown_connections 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3943094709 wait complete. 2024-09-19T07:51:22.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.409+0000 7f46b8f1f740 20 client.15324 trim_cache size 0 max 16384 2024-09-19T07:51:22.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.426+0000 7f46b8f1f740 1 Processor -- start 2024-09-19T07:51:22.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.426+0000 7f46b8f1f740 1 -- start start 2024-09-19T07:51:22.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf5fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf86d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf87290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01b2320 con 0x559ebaf644a0 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01afbf0 con 0x559ebaf64dc0 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01ada20 con 0x559ebaf60a30 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf86d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf86d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36010/0 (socket says 172.21.15.76:36010) 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b48e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf5fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 -- 172.21.15.76:0/2039659854 learned_addr learned my addr 172.21.15.76:0/2039659854 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b50e3640 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf87290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 -- 172.21.15.76:0/2039659854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 msgr2=0x559ebaf5fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf5fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 -- 172.21.15.76:0/2039659854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 msgr2=0x559ebaf87290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf87290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 -- 172.21.15.76:0/2039659854 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebaf60860 con 0x559ebaf644a0 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46b50e3640 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf87290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f46affff640 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf86d50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f469c00d7d0 tx=0x7f469c00f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8037d2a2a0ee5989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.427+0000 7f469a7fc640 1 -- 172.21.15.76:0/2039659854 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c02f070 con 0x559ebaf644a0 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f469a7fc640 1 -- 172.21.15.76:0/2039659854 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f469c00fd00 con 0x559ebaf644a0 2024-09-19T07:51:22.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f469a7fc640 1 -- 172.21.15.76:0/2039659854 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c027070 con 0x559ebaf644a0 2024-09-19T07:51:22.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 -- 172.21.15.76:0/2039659854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 msgr2=0x559ebaf86d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf86d50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f469c00d7d0 tx=0x7f469c00f6f0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 -- 172.21.15.76:0/2039659854 shutdown_connections 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf87290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf86d50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/2039659854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf5fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 -- 172.21.15.76:0/2039659854 >> 172.21.15.76:0/2039659854 conn(0x559ebaf6c830 msgr2=0x559ebaf5f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 -- 172.21.15.76:0/2039659854 shutdown_connections 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.428+0000 7f46b8f1f740 1 -- 172.21.15.76:0/2039659854 wait complete. 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 -- start start 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 Processor -- start 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf77d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf75110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf75650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01ae0b0 con 0x559ebaf644a0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01af520 con 0x559ebaf64dc0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01ae780 con 0x559ebaf60a30 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b8f1f740 10 client.0 _ll_register_callbacks cb 0x7f46a400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf75110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf75110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36014/0 (socket says 172.21.15.76:36014) 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46affff640 1 -- 172.21.15.76:0/3422855316 learned_addr learned my addr 172.21.15.76:0/3422855316 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf77d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.429+0000 7f46b50e3640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf75650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46affff640 1 -- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 msgr2=0x559ebaf77d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46affff640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf77d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46affff640 1 -- 172.21.15.76:0/3422855316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 msgr2=0x559ebaf75650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46affff640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf75650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46affff640 1 -- 172.21.15.76:0/3422855316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebaf75e50 con 0x559ebaf644a0 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46b50e3640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf75650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:22.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46affff640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf75110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f469c0294d0 tx=0x7f469c00d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f50182b69bf850 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f468ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f468ffff640 1 -- 172.21.15.76:0/3422855316 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c02f070 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f468ffff640 1 -- 172.21.15.76:0/3422855316 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f469c00fa00 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f469c00fd00 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f468ffff640 1 -- 172.21.15.76:0/3422855316 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f469c027040 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46b8f1f740 10 client.15330 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ebafe9d10 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.430+0000 7f468ffff640 1 -- 172.21.15.76:0/3422855316 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f469c00fd00 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f468ffff640 1 -- 172.21.15.76:0/3422855316 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f469c005020 con 0x559ebaf644a0 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b8f1f740 10 client.15330 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b8f1f740 10 client.15330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b8f1f740 20 client.15330 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf6f680 0x559ebafec190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b8f1f740 4 client.15330 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:51:22.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ebaed1d60 con 0x559ebaf6f680 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.431+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf6f680 0x559ebafec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b48e2640 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf6f680 0x559ebafec190 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c053d0fe7c48dac server_cookie=48a036c27a56acd1 in_seq=0 out_seq=0 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f468ffff640 10 client.15330 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f468ffff640 1 -- 172.21.15.76:0/3422855316 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559ebaed1d60 con 0x559ebaf6f680 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f468ffff640 10 client.15330 handle_command_reply: tid=0 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 client.15330 shutdown 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 msgr2=0x559ebaf75110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf75110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f469c0294d0 tx=0x7f469c00d880 comp rx=0 tx=0).stop 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 shutdown_connections 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559ebaf64dc0 0x559ebaf75650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559ebaf6f680 0x559ebafec190 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f468ffff640 0 client.15330 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559ebaf644a0 0x559ebaf75110 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 --2- 172.21.15.76:0/3422855316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ebaf60a30 0x559ebaf77d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 >> 172.21.15.76:0/3422855316 conn(0x559ebaf6c830 msgr2=0x559ebaf5fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 shutdown_connections 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 1 -- 172.21.15.76:0/3422855316 wait complete. 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.432+0000 7f46b8f1f740 20 client.15330 trim_cache size 0 max 16384 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout: "16d20776-045b-4d91-94be-efea40b5015e": { 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "16d20776-045b-4d91-94be-efea40b5015e", 2024-09-19T07:51:22.438 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:51:22.439 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:22.439 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:22.439 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:22.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46a00a3440 msgr2=0x7f46a00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46a00a3440 0x7f46a00a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x559ebaf61db0 tx=0x7f46a802f410 comp rx=0 tx=0).stop 2024-09-19T07:51:22.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 msgr2=0x7f46b00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 0x7f46b00744f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f46a400c920 tx=0x7f46a400cde0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 shutdown_connections 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46a00a3440 0x7f46a00a5900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46b0106f40 0x7f46b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46b01027c0 0x7f46b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 --2- 172.21.15.76:0/92681923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f46b0101e10 0x7f46b00744f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 >> 172.21.15.76:0/92681923 conn(0x7f46b00fd8d0 msgr2=0x7f46b00ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 shutdown_connections 2024-09-19T07:51:22.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.433+0000 7f46b6b46640 1 -- 172.21.15.76:0/92681923 wait complete. 2024-09-19T07:51:22.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.445+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7734103eb0 con 0x7f77200a3500 2024-09-19T07:51:22.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.452+0000 7f7730d99640 1 -- 172.21.15.76:0/2237883223 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7734103eb0 con 0x7f77200a3500 2024-09-19T07:51:22.453 INFO:teuthology.orchestra.run.smithi076.stdout:/ 1m 6m3h 2024-09-19T07:51:22.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77200a3500 msgr2=0x7f77200a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77200a3500 0x7f77200a59c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7724000c00 tx=0x7f7724032c80 comp rx=0 tx=0).stop 2024-09-19T07:51:22.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 msgr2=0x7f7734198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:22.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 0x7f7734198990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f771c00d950 tx=0x7f771c00de10 comp rx=0 tx=0).stop 2024-09-19T07:51:22.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 shutdown_connections 2024-09-19T07:51:22.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77200a3500 0x7f77200a59c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77341069c0 0x7f773419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7734101350 0x7f7734198990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 --2- 172.21.15.76:0/2237883223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77341009b0 0x7f7734198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:22.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 >> 172.21.15.76:0/2237883223 conn(0x7f7734077990 msgr2=0x7f77341037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:22.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 shutdown_connections 2024-09-19T07:51:22.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:22.454+0000 7f773913b640 1 -- 172.21.15.76:0/2237883223 wait complete. 2024-09-19T07:51:22.467 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T07:51:22.493 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T07:51:22.503 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T07:51:22.547 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:51:22.547 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:51:22.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:22 smithi076 ceph-mon[30930]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-19T07:51:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:22 smithi076 ceph-mon[30930]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:22 smithi076 ceph-mon[30930]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:23.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:22 smithi152 ceph-mon[35117]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-19T07:51:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:22 smithi152 ceph-mon[35117]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:22 smithi152 ceph-mon[35117]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:22 smithi137 ceph-mon[35309]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-19T07:51:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:22 smithi137 ceph-mon[35309]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:23.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:22 smithi137 ceph-mon[35309]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:23.212 INFO:tasks.cephfs.filesystem:scrub status for tag:16d20776-045b-4d91-94be-efea40b5015e - {'path': '/', 'tag': '16d20776-045b-4d91-94be-efea40b5015e', 'options': 'recursive,force'} 2024-09-19T07:51:23.331 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:23.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 -- 172.21.15.76:0/467145953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a010c170 msgr2=0x7f38a010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 --2- 172.21.15.76:0/467145953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a010c170 0x7f38a010e610 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3898009ca0 tx=0x7f389802a950 comp rx=0 tx=0).stop 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 -- 172.21.15.76:0/467145953 shutdown_connections 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 --2- 172.21.15.76:0/467145953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a010c170 0x7f38a010e610 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 --2- 172.21.15.76:0/467145953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38a0103660 0x7f38a010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 --2- 172.21.15.76:0/467145953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a0102d40 0x7f38a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 -- 172.21.15.76:0/467145953 >> 172.21.15.76:0/467145953 conn(0x7f38a00fc7a0 msgr2=0x7f38a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 -- 172.21.15.76:0/467145953 shutdown_connections 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.846+0000 7f38a66de640 1 -- 172.21.15.76:0/467145953 wait complete. 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 Processor -- start 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 -- start start 2024-09-19T07:51:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38a0102d40 0x7f38a01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 0x7f38a0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a010c170 0x7f38a019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f38a01120e0 con 0x7f38a0103660 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0111f60 con 0x7f38a0102d40 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f38a66de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0112260 con 0x7f38a010c170 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 0x7f38a0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 0x7f38a0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43576/0 (socket says 172.21.15.76:43576) 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.847+0000 7f389f7fe640 1 -- 172.21.15.76:0/3902966076 learned_addr learned my addr 172.21.15.76:0/3902966076 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389ffff640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38a0102d40 0x7f38a01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f38a4c7b640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a010c170 0x7f38a019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389f7fe640 1 -- 172.21.15.76:0/3902966076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a010c170 msgr2=0x7f38a019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389f7fe640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a010c170 0x7f38a019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389f7fe640 1 -- 172.21.15.76:0/3902966076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38a0102d40 msgr2=0x7f38a01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389f7fe640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38a0102d40 0x7f38a01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389f7fe640 1 -- 172.21.15.76:0/3902966076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a019d470 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389f7fe640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 0x7f38a0198a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f389400d740 tx=0x7f389400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894017070 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f389400de50 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389400f620 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a019d760 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.848+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a01a5040 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.849+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a0103120 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.850+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f3894009c30 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.851+0000 7f389d7fa640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38880a3440 0x7f38880a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.851+0000 7f389ffff640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38880a3440 0x7f38880a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.851+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f38940cfb70 con 0x7f38a0103660 2024-09-19T07:51:23.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.852+0000 7f389ffff640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38880a3440 0x7f38880a5900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3890005e10 tx=0x7f3890005da0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:23.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:23.856+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f389409c3e0 con 0x7f38a0103660 2024-09-19T07:51:24.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.020+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38a00fe3b0 con 0x7f38880a3440 2024-09-19T07:51:24.020 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:23 smithi076 ceph-mon[30930]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:24.020 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:23 smithi076 ceph-mon[30930]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:24.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.028+0000 7f389d7fa640 1 -- 172.21.15.76:0/3902966076 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258001 (secure 0 0 0) 0x7f38a00fe3b0 con 0x7f38880a3440 2024-09-19T07:51:24.031 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:24.032 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:51:24.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38880a3440 msgr2=0x7f38880a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:24.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38880a3440 0x7f38880a5900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3890005e10 tx=0x7f3890005da0 comp rx=0 tx=0).stop 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 msgr2=0x7f38a0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 0x7f38a0198a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f389400d740 tx=0x7f389400dc00 comp rx=0 tx=0).stop 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 shutdown_connections 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38880a3440 0x7f38880a5900 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a010c170 0x7f38a019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f38a0103660 0x7f38a0198a00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 --2- 172.21.15.76:0/3902966076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38a0102d40 0x7f38a01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 >> 172.21.15.76:0/3902966076 conn(0x7f38a00fc7a0 msgr2=0x7f38a010e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 shutdown_connections 2024-09-19T07:51:24.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:24.031+0000 7f38a66de640 1 -- 172.21.15.76:0/3902966076 wait complete. 2024-09-19T07:51:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:23 smithi152 ceph-mon[35117]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:24.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:23 smithi152 ceph-mon[35117]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:24.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:23 smithi137 ceph-mon[35309]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:24.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:23 smithi137 ceph-mon[35309]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:51:24.832 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-19T07:51:22.793648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187221,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":973,"num_read_kb":807,"num_write":495,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":877,"ondisk_log_size":877,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381520,"kb_used_data":11436,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560304,"statfs":{"total":1151940427776,"available":1151549751296,"internally_reserved":0,"allocated":11710464,"data_stored":8965503,"data_compressed":287409,"data_compressed_allocated":380928,"data_compressed_original":3612672,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":225,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.992861"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073201+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:51:13.073201+0000","last_peered":"2024-09-19T07:51:13.073201+0000","last_clean":"2024-09-19T07:51:13.073201+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:51:13.073201+0000","last_undegraded":"2024-09-19T07:51:13.073201+0000","last_fullsized":"2024-09-19T07:51:13.073201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053081+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:51:13.053081+0000","last_peered":"2024-09-19T07:51:13.053081+0000","last_clean":"2024-09-19T07:51:13.053081+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:51:13.053081+0000","last_undegraded":"2024-09-19T07:51:13.053081+0000","last_fullsized":"2024-09-19T07:51:13.053081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052870+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:51:13.052870+0000","last_peered":"2024-09-19T07:51:13.052870+0000","last_clean":"2024-09-19T07:51:13.052870+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:51:13.052870+0000","last_undegraded":"2024-09-19T07:51:13.052870+0000","last_fullsized":"2024-09-19T07:51:13.052870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786281+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:51:12.786281+0000","last_peered":"2024-09-19T07:51:12.786281+0000","last_clean":"2024-09-19T07:51:12.786281+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:51:12.786281+0000","last_undegraded":"2024-09-19T07:51:12.786281+0000","last_fullsized":"2024-09-19T07:51:12.786281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885874+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:51:12.885874+0000","last_peered":"2024-09-19T07:51:12.885874+0000","last_clean":"2024-09-19T07:51:12.885874+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:51:12.885874+0000","last_undegraded":"2024-09-19T07:51:12.885874+0000","last_fullsized":"2024-09-19T07:51:12.885874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820633+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:51:12.820633+0000","last_peered":"2024-09-19T07:51:12.820633+0000","last_clean":"2024-09-19T07:51:12.820633+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:51:12.820633+0000","last_undegraded":"2024-09-19T07:51:12.820633+0000","last_fullsized":"2024-09-19T07:51:12.820633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085272+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:51:13.085272+0000","last_peered":"2024-09-19T07:51:13.085272+0000","last_clean":"2024-09-19T07:51:13.085272+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:51:13.085272+0000","last_undegraded":"2024-09-19T07:51:13.085272+0000","last_fullsized":"2024-09-19T07:51:13.085272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886640+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:51:12.886640+0000","last_peered":"2024-09-19T07:51:12.886640+0000","last_clean":"2024-09-19T07:51:12.886640+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:51:12.886640+0000","last_undegraded":"2024-09-19T07:51:12.886640+0000","last_fullsized":"2024-09-19T07:51:12.886640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779282+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:51:12.779282+0000","last_peered":"2024-09-19T07:51:12.779282+0000","last_clean":"2024-09-19T07:51:12.779282+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:51:12.779282+0000","last_undegraded":"2024-09-19T07:51:12.779282+0000","last_fullsized":"2024-09-19T07:51:12.779282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820979+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:51:12.820979+0000","last_peered":"2024-09-19T07:51:12.820979+0000","last_clean":"2024-09-19T07:51:12.820979+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:51:12.820979+0000","last_undegraded":"2024-09-19T07:51:12.820979+0000","last_fullsized":"2024-09-19T07:51:12.820979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085724+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:51:13.085724+0000","last_peered":"2024-09-19T07:51:13.085724+0000","last_clean":"2024-09-19T07:51:13.085724+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:51:13.085724+0000","last_undegraded":"2024-09-19T07:51:13.085724+0000","last_fullsized":"2024-09-19T07:51:13.085724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786352+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:51:12.786352+0000","last_peered":"2024-09-19T07:51:12.786352+0000","last_clean":"2024-09-19T07:51:12.786352+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:51:12.786352+0000","last_undegraded":"2024-09-19T07:51:12.786352+0000","last_fullsized":"2024-09-19T07:51:12.786352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777843+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:51:12.777843+0000","last_peered":"2024-09-19T07:51:12.777843+0000","last_clean":"2024-09-19T07:51:12.777843+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:51:12.777843+0000","last_undegraded":"2024-09-19T07:51:12.777843+0000","last_fullsized":"2024-09-19T07:51:12.777843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052179+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:51:13.052179+0000","last_peered":"2024-09-19T07:51:13.052179+0000","last_clean":"2024-09-19T07:51:13.052179+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:51:13.052179+0000","last_undegraded":"2024-09-19T07:51:13.052179+0000","last_fullsized":"2024-09-19T07:51:13.052179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.051887+0000","last_change":"2024-09-19T07:50:34.028760+0000","last_active":"2024-09-19T07:51:13.051887+0000","last_peered":"2024-09-19T07:51:13.051887+0000","last_clean":"2024-09-19T07:51:13.051887+0000","last_became_active":"2024-09-19T07:50:34.028384+0000","last_became_peered":"2024-09-19T07:50:34.028384+0000","last_unstale":"2024-09-19T07:51:13.051887+0000","last_undegraded":"2024-09-19T07:51:13.051887+0000","last_fullsized":"2024-09-19T07:51:13.051887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:00.072227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778575+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:51:12.778575+0000","last_peered":"2024-09-19T07:51:12.778575+0000","last_clean":"2024-09-19T07:51:12.778575+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:51:12.778575+0000","last_undegraded":"2024-09-19T07:51:12.778575+0000","last_fullsized":"2024-09-19T07:51:12.778575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073263+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:51:13.073263+0000","last_peered":"2024-09-19T07:51:13.073263+0000","last_clean":"2024-09-19T07:51:13.073263+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:51:13.073263+0000","last_undegraded":"2024-09-19T07:51:13.073263+0000","last_fullsized":"2024-09-19T07:51:13.073263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884084+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:51:12.884084+0000","last_peered":"2024-09-19T07:51:12.884084+0000","last_clean":"2024-09-19T07:51:12.884084+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:51:12.884084+0000","last_undegraded":"2024-09-19T07:51:12.884084+0000","last_fullsized":"2024-09-19T07:51:12.884084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779398+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:51:12.779398+0000","last_peered":"2024-09-19T07:51:12.779398+0000","last_clean":"2024-09-19T07:51:12.779398+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:51:12.779398+0000","last_undegraded":"2024-09-19T07:51:12.779398+0000","last_fullsized":"2024-09-19T07:51:12.779398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777912+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:51:12.777912+0000","last_peered":"2024-09-19T07:51:12.777912+0000","last_clean":"2024-09-19T07:51:12.777912+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:51:12.777912+0000","last_undegraded":"2024-09-19T07:51:12.777912+0000","last_fullsized":"2024-09-19T07:51:12.777912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778712+0000","last_change":"2024-09-19T07:50:34.030741+0000","last_active":"2024-09-19T07:51:12.778712+0000","last_peered":"2024-09-19T07:51:12.778712+0000","last_clean":"2024-09-19T07:51:12.778712+0000","last_became_active":"2024-09-19T07:50:34.030300+0000","last_became_peered":"2024-09-19T07:50:34.030300+0000","last_unstale":"2024-09-19T07:51:12.778712+0000","last_undegraded":"2024-09-19T07:51:12.778712+0000","last_fullsized":"2024-09-19T07:51:12.778712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:30.131138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886659+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:51:12.886659+0000","last_peered":"2024-09-19T07:51:12.886659+0000","last_clean":"2024-09-19T07:51:12.886659+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:51:12.886659+0000","last_undegraded":"2024-09-19T07:51:12.886659+0000","last_fullsized":"2024-09-19T07:51:12.886659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897046+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:51:12.897046+0000","last_peered":"2024-09-19T07:51:12.897046+0000","last_clean":"2024-09-19T07:51:12.897046+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:51:12.897046+0000","last_undegraded":"2024-09-19T07:51:12.897046+0000","last_fullsized":"2024-09-19T07:51:12.897046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886916+0000","last_change":"2024-09-19T07:50:34.028762+0000","last_active":"2024-09-19T07:51:12.886916+0000","last_peered":"2024-09-19T07:51:12.886916+0000","last_clean":"2024-09-19T07:51:12.886916+0000","last_became_active":"2024-09-19T07:50:34.028343+0000","last_became_peered":"2024-09-19T07:50:34.028343+0000","last_unstale":"2024-09-19T07:51:12.886916+0000","last_undegraded":"2024-09-19T07:51:12.886916+0000","last_fullsized":"2024-09-19T07:51:12.886916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:08.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779564+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:51:12.779564+0000","last_peered":"2024-09-19T07:51:12.779564+0000","last_clean":"2024-09-19T07:51:12.779564+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:51:12.779564+0000","last_undegraded":"2024-09-19T07:51:12.779564+0000","last_fullsized":"2024-09-19T07:51:12.779564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072980+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:51:13.072980+0000","last_peered":"2024-09-19T07:51:13.072980+0000","last_clean":"2024-09-19T07:51:13.072980+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:51:13.072980+0000","last_undegraded":"2024-09-19T07:51:13.072980+0000","last_fullsized":"2024-09-19T07:51:13.072980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778090+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:51:12.778090+0000","last_peered":"2024-09-19T07:51:12.778090+0000","last_clean":"2024-09-19T07:51:12.778090+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:51:12.778090+0000","last_undegraded":"2024-09-19T07:51:12.778090+0000","last_fullsized":"2024-09-19T07:51:12.778090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052432+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:51:13.052432+0000","last_peered":"2024-09-19T07:51:13.052432+0000","last_clean":"2024-09-19T07:51:13.052432+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:51:13.052432+0000","last_undegraded":"2024-09-19T07:51:13.052432+0000","last_fullsized":"2024-09-19T07:51:13.052432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779132+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:51:12.779132+0000","last_peered":"2024-09-19T07:51:12.779132+0000","last_clean":"2024-09-19T07:51:12.779132+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:51:12.779132+0000","last_undegraded":"2024-09-19T07:51:12.779132+0000","last_fullsized":"2024-09-19T07:51:12.779132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779167+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:51:12.779167+0000","last_peered":"2024-09-19T07:51:12.779167+0000","last_clean":"2024-09-19T07:51:12.779167+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:51:12.779167+0000","last_undegraded":"2024-09-19T07:51:12.779167+0000","last_fullsized":"2024-09-19T07:51:12.779167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:50:34.028399+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:50:34.027948+0000","last_became_peered":"2024-09-19T07:50:34.027948+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:36.822727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885803+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:51:12.885803+0000","last_peered":"2024-09-19T07:51:12.885803+0000","last_clean":"2024-09-19T07:51:12.885803+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:51:12.885803+0000","last_undegraded":"2024-09-19T07:51:12.885803+0000","last_fullsized":"2024-09-19T07:51:12.885803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:17.774513+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:17.774513+0000","last_peered":"2024-09-19T07:51:17.774513+0000","last_clean":"2024-09-19T07:51:17.774513+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:51:17.774513+0000","last_undegraded":"2024-09-19T07:51:17.774513+0000","last_fullsized":"2024-09-19T07:51:17.774513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897140+0000","last_change":"2024-09-19T07:50:34.026626+0000","last_active":"2024-09-19T07:51:12.897140+0000","last_peered":"2024-09-19T07:51:12.897140+0000","last_clean":"2024-09-19T07:51:12.897140+0000","last_became_active":"2024-09-19T07:50:34.026058+0000","last_became_peered":"2024-09-19T07:50:34.026058+0000","last_unstale":"2024-09-19T07:51:12.897140+0000","last_undegraded":"2024-09-19T07:51:12.897140+0000","last_fullsized":"2024-09-19T07:51:12.897140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:22.700331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820706+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:51:12.820706+0000","last_peered":"2024-09-19T07:51:12.820706+0000","last_clean":"2024-09-19T07:51:12.820706+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:51:12.820706+0000","last_undegraded":"2024-09-19T07:51:12.820706+0000","last_fullsized":"2024-09-19T07:51:12.820706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777625+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:51:12.777625+0000","last_peered":"2024-09-19T07:51:12.777625+0000","last_clean":"2024-09-19T07:51:12.777625+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:51:12.777625+0000","last_undegraded":"2024-09-19T07:51:12.777625+0000","last_fullsized":"2024-09-19T07:51:12.777625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886790+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:51:12.886790+0000","last_peered":"2024-09-19T07:51:12.886790+0000","last_clean":"2024-09-19T07:51:12.886790+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:51:12.886790+0000","last_undegraded":"2024-09-19T07:51:12.886790+0000","last_fullsized":"2024-09-19T07:51:12.886790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897268+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:51:12.897268+0000","last_peered":"2024-09-19T07:51:12.897268+0000","last_clean":"2024-09-19T07:51:12.897268+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:51:12.897268+0000","last_undegraded":"2024-09-19T07:51:12.897268+0000","last_fullsized":"2024-09-19T07:51:12.897268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883449+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:51:12.883449+0000","last_peered":"2024-09-19T07:51:12.883449+0000","last_clean":"2024-09-19T07:51:12.883449+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:51:12.883449+0000","last_undegraded":"2024-09-19T07:51:12.883449+0000","last_fullsized":"2024-09-19T07:51:12.883449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:17.773851+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:51:17.773851+0000","last_peered":"2024-09-19T07:51:17.773851+0000","last_clean":"2024-09-19T07:51:17.773851+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:51:17.773851+0000","last_undegraded":"2024-09-19T07:51:17.773851+0000","last_fullsized":"2024-09-19T07:51:17.773851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779095+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:51:12.779095+0000","last_peered":"2024-09-19T07:51:12.779095+0000","last_clean":"2024-09-19T07:51:12.779095+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:51:12.779095+0000","last_undegraded":"2024-09-19T07:51:12.779095+0000","last_fullsized":"2024-09-19T07:51:12.779095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085762+0000","last_change":"2024-09-19T07:50:34.356734+0000","last_active":"2024-09-19T07:51:13.085762+0000","last_peered":"2024-09-19T07:51:13.085762+0000","last_clean":"2024-09-19T07:51:13.085762+0000","last_became_active":"2024-09-19T07:50:34.350578+0000","last_became_peered":"2024-09-19T07:50:34.350578+0000","last_unstale":"2024-09-19T07:51:13.085762+0000","last_undegraded":"2024-09-19T07:51:13.085762+0000","last_fullsized":"2024-09-19T07:51:13.085762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:57.110465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053636+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:51:13.053636+0000","last_peered":"2024-09-19T07:51:13.053636+0000","last_clean":"2024-09-19T07:51:13.053636+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:51:13.053636+0000","last_undegraded":"2024-09-19T07:51:13.053636+0000","last_fullsized":"2024-09-19T07:51:13.053636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897310+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:51:12.897310+0000","last_peered":"2024-09-19T07:51:12.897310+0000","last_clean":"2024-09-19T07:51:12.897310+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:51:12.897310+0000","last_undegraded":"2024-09-19T07:51:12.897310+0000","last_fullsized":"2024-09-19T07:51:12.897310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778760+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:51:12.778760+0000","last_peered":"2024-09-19T07:51:12.778760+0000","last_clean":"2024-09-19T07:51:12.778760+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:51:12.778760+0000","last_undegraded":"2024-09-19T07:51:12.778760+0000","last_fullsized":"2024-09-19T07:51:12.778760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":274,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:18.775308+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:51:18.775308+0000","last_peered":"2024-09-19T07:51:18.775308+0000","last_clean":"2024-09-19T07:51:18.775308+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:51:18.775308+0000","last_undegraded":"2024-09-19T07:51:18.775308+0000","last_fullsized":"2024-09-19T07:51:18.775308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":173,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885917+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:51:12.885917+0000","last_peered":"2024-09-19T07:51:12.885917+0000","last_clean":"2024-09-19T07:51:12.885917+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:51:12.885917+0000","last_undegraded":"2024-09-19T07:51:12.885917+0000","last_fullsized":"2024-09-19T07:51:12.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779272+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:12.779272+0000","last_peered":"2024-09-19T07:51:12.779272+0000","last_clean":"2024-09-19T07:51:12.779272+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:51:12.779272+0000","last_undegraded":"2024-09-19T07:51:12.779272+0000","last_fullsized":"2024-09-19T07:51:12.779272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777765+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:51:12.777765+0000","last_peered":"2024-09-19T07:51:12.777765+0000","last_clean":"2024-09-19T07:51:12.777765+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:51:12.777765+0000","last_undegraded":"2024-09-19T07:51:12.777765+0000","last_fullsized":"2024-09-19T07:51:12.777765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897105+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:51:12.897105+0000","last_peered":"2024-09-19T07:51:12.897105+0000","last_clean":"2024-09-19T07:51:12.897105+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:51:12.897105+0000","last_undegraded":"2024-09-19T07:51:12.897105+0000","last_fullsized":"2024-09-19T07:51:12.897105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085518+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:51:13.085518+0000","last_peered":"2024-09-19T07:51:13.085518+0000","last_clean":"2024-09-19T07:51:13.085518+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:51:13.085518+0000","last_undegraded":"2024-09-19T07:51:13.085518+0000","last_fullsized":"2024-09-19T07:51:13.085518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:16.796428+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:51:16.796428+0000","last_peered":"2024-09-19T07:51:16.796428+0000","last_clean":"2024-09-19T07:51:16.796428+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:51:16.796428+0000","last_undegraded":"2024-09-19T07:51:16.796428+0000","last_fullsized":"2024-09-19T07:51:16.796428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085252+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:51:13.085252+0000","last_peered":"2024-09-19T07:51:13.085252+0000","last_clean":"2024-09-19T07:51:13.085252+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:51:13.085252+0000","last_undegraded":"2024-09-19T07:51:13.085252+0000","last_fullsized":"2024-09-19T07:51:13.085252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884108+0000","last_change":"2024-09-19T07:50:34.349498+0000","last_active":"2024-09-19T07:51:12.884108+0000","last_peered":"2024-09-19T07:51:12.884108+0000","last_clean":"2024-09-19T07:51:12.884108+0000","last_became_active":"2024-09-19T07:50:34.349238+0000","last_became_peered":"2024-09-19T07:50:34.349238+0000","last_unstale":"2024-09-19T07:51:12.884108+0000","last_undegraded":"2024-09-19T07:51:12.884108+0000","last_fullsized":"2024-09-19T07:51:12.884108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:40.879641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885913+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:51:12.885913+0000","last_peered":"2024-09-19T07:51:12.885913+0000","last_clean":"2024-09-19T07:51:12.885913+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:51:12.885913+0000","last_undegraded":"2024-09-19T07:51:12.885913+0000","last_fullsized":"2024-09-19T07:51:12.885913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073006+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:51:13.073006+0000","last_peered":"2024-09-19T07:51:13.073006+0000","last_clean":"2024-09-19T07:51:13.073006+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:51:13.073006+0000","last_undegraded":"2024-09-19T07:51:13.073006+0000","last_fullsized":"2024-09-19T07:51:13.073006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778040+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:51:12.778040+0000","last_peered":"2024-09-19T07:51:12.778040+0000","last_clean":"2024-09-19T07:51:12.778040+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:51:12.778040+0000","last_undegraded":"2024-09-19T07:51:12.778040+0000","last_fullsized":"2024-09-19T07:51:12.778040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085798+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:51:13.085798+0000","last_peered":"2024-09-19T07:51:13.085798+0000","last_clean":"2024-09-19T07:51:13.085798+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:51:13.085798+0000","last_undegraded":"2024-09-19T07:51:13.085798+0000","last_fullsized":"2024-09-19T07:51:13.085798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.022869+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:51:13.022869+0000","last_peered":"2024-09-19T07:51:13.022869+0000","last_clean":"2024-09-19T07:51:13.022869+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:51:13.022869+0000","last_undegraded":"2024-09-19T07:51:13.022869+0000","last_fullsized":"2024-09-19T07:51:13.022869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085413+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:51:13.085413+0000","last_peered":"2024-09-19T07:51:13.085413+0000","last_clean":"2024-09-19T07:51:13.085413+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:51:13.085413+0000","last_undegraded":"2024-09-19T07:51:13.085413+0000","last_fullsized":"2024-09-19T07:51:13.085413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779460+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:51:12.779460+0000","last_peered":"2024-09-19T07:51:12.779460+0000","last_clean":"2024-09-19T07:51:12.779460+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:51:12.779460+0000","last_undegraded":"2024-09-19T07:51:12.779460+0000","last_fullsized":"2024-09-19T07:51:12.779460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085732+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:51:13.085732+0000","last_peered":"2024-09-19T07:51:13.085732+0000","last_clean":"2024-09-19T07:51:13.085732+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:51:13.085732+0000","last_undegraded":"2024-09-19T07:51:13.085732+0000","last_fullsized":"2024-09-19T07:51:13.085732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":395,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:14.891705+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:51:14.891705+0000","last_peered":"2024-09-19T07:51:14.891705+0000","last_clean":"2024-09-19T07:51:14.891705+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:51:14.891705+0000","last_undegraded":"2024-09-19T07:51:14.891705+0000","last_fullsized":"2024-09-19T07:51:14.891705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786233+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:51:12.786233+0000","last_peered":"2024-09-19T07:51:12.786233+0000","last_clean":"2024-09-19T07:51:12.786233+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:51:12.786233+0000","last_undegraded":"2024-09-19T07:51:12.786233+0000","last_fullsized":"2024-09-19T07:51:12.786233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883560+0000","last_change":"2024-09-19T07:50:34.028464+0000","last_active":"2024-09-19T07:51:12.883560+0000","last_peered":"2024-09-19T07:51:12.883560+0000","last_clean":"2024-09-19T07:51:12.883560+0000","last_became_active":"2024-09-19T07:50:34.028078+0000","last_became_peered":"2024-09-19T07:50:34.028078+0000","last_unstale":"2024-09-19T07:51:12.883560+0000","last_undegraded":"2024-09-19T07:51:12.883560+0000","last_fullsized":"2024-09-19T07:51:12.883560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:33.498575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085358+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:51:13.085358+0000","last_peered":"2024-09-19T07:51:13.085358+0000","last_clean":"2024-09-19T07:51:13.085358+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:51:13.085358+0000","last_undegraded":"2024-09-19T07:51:13.085358+0000","last_fullsized":"2024-09-19T07:51:13.085358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777583+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:51:12.777583+0000","last_peered":"2024-09-19T07:51:12.777583+0000","last_clean":"2024-09-19T07:51:12.777583+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:51:12.777583+0000","last_undegraded":"2024-09-19T07:51:12.777583+0000","last_fullsized":"2024-09-19T07:51:12.777583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:16.796176+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:51:16.796176+0000","last_peered":"2024-09-19T07:51:16.796176+0000","last_clean":"2024-09-19T07:51:16.796176+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:51:16.796176+0000","last_undegraded":"2024-09-19T07:51:16.796176+0000","last_fullsized":"2024-09-19T07:51:16.796176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897052+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:51:12.897052+0000","last_peered":"2024-09-19T07:51:12.897052+0000","last_clean":"2024-09-19T07:51:12.897052+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:51:12.897052+0000","last_undegraded":"2024-09-19T07:51:12.897052+0000","last_fullsized":"2024-09-19T07:51:12.897052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085545+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:51:13.085545+0000","last_peered":"2024-09-19T07:51:13.085545+0000","last_clean":"2024-09-19T07:51:13.085545+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:51:13.085545+0000","last_undegraded":"2024-09-19T07:51:13.085545+0000","last_fullsized":"2024-09-19T07:51:13.085545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820738+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:51:12.820738+0000","last_peered":"2024-09-19T07:51:12.820738+0000","last_clean":"2024-09-19T07:51:12.820738+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:51:12.820738+0000","last_undegraded":"2024-09-19T07:51:12.820738+0000","last_fullsized":"2024-09-19T07:51:12.820738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884217+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:51:12.884217+0000","last_peered":"2024-09-19T07:51:12.884217+0000","last_clean":"2024-09-19T07:51:12.884217+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:51:12.884217+0000","last_undegraded":"2024-09-19T07:51:12.884217+0000","last_fullsized":"2024-09-19T07:51:12.884217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820842+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:51:12.820842+0000","last_peered":"2024-09-19T07:51:12.820842+0000","last_clean":"2024-09-19T07:51:12.820842+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:51:12.820842+0000","last_undegraded":"2024-09-19T07:51:12.820842+0000","last_fullsized":"2024-09-19T07:51:12.820842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886077+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:51:12.886077+0000","last_peered":"2024-09-19T07:51:12.886077+0000","last_clean":"2024-09-19T07:51:12.886077+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:51:12.886077+0000","last_undegraded":"2024-09-19T07:51:12.886077+0000","last_fullsized":"2024-09-19T07:51:12.886077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778175+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:51:12.778175+0000","last_peered":"2024-09-19T07:51:12.778175+0000","last_clean":"2024-09-19T07:51:12.778175+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:51:12.778175+0000","last_undegraded":"2024-09-19T07:51:12.778175+0000","last_fullsized":"2024-09-19T07:51:12.778175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'49","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.032938+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:51:13.032938+0000","last_peered":"2024-09-19T07:51:13.032938+0000","last_clean":"2024-09-19T07:51:13.032938+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:51:13.032938+0000","last_undegraded":"2024-09-19T07:51:13.032938+0000","last_fullsized":"2024-09-19T07:51:13.032938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887028+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:51:12.887028+0000","last_peered":"2024-09-19T07:51:12.887028+0000","last_clean":"2024-09-19T07:51:12.887028+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:51:12.887028+0000","last_undegraded":"2024-09-19T07:51:12.887028+0000","last_fullsized":"2024-09-19T07:51:12.887028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786476+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:51:12.786476+0000","last_peered":"2024-09-19T07:51:12.786476+0000","last_clean":"2024-09-19T07:51:12.786476+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:51:12.786476+0000","last_undegraded":"2024-09-19T07:51:12.786476+0000","last_fullsized":"2024-09-19T07:51:12.786476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053199+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:51:13.053199+0000","last_peered":"2024-09-19T07:51:13.053199+0000","last_clean":"2024-09-19T07:51:13.053199+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:51:13.053199+0000","last_undegraded":"2024-09-19T07:51:13.053199+0000","last_fullsized":"2024-09-19T07:51:13.053199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778663+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:51:12.778663+0000","last_peered":"2024-09-19T07:51:12.778663+0000","last_clean":"2024-09-19T07:51:12.778663+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:51:12.778663+0000","last_undegraded":"2024-09-19T07:51:12.778663+0000","last_fullsized":"2024-09-19T07:51:12.778663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886882+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:51:12.886882+0000","last_peered":"2024-09-19T07:51:12.886882+0000","last_clean":"2024-09-19T07:51:12.886882+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:51:12.886882+0000","last_undegraded":"2024-09-19T07:51:12.886882+0000","last_fullsized":"2024-09-19T07:51:12.886882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073002+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:51:13.073002+0000","last_peered":"2024-09-19T07:51:13.073002+0000","last_clean":"2024-09-19T07:51:13.073002+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:51:13.073002+0000","last_undegraded":"2024-09-19T07:51:13.073002+0000","last_fullsized":"2024-09-19T07:51:13.073002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779211+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:51:12.779211+0000","last_peered":"2024-09-19T07:51:12.779211+0000","last_clean":"2024-09-19T07:51:12.779211+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:51:12.779211+0000","last_undegraded":"2024-09-19T07:51:12.779211+0000","last_fullsized":"2024-09-19T07:51:12.779211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887345+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:51:12.887345+0000","last_peered":"2024-09-19T07:51:12.887345+0000","last_clean":"2024-09-19T07:51:12.887345+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:51:12.887345+0000","last_undegraded":"2024-09-19T07:51:12.887345+0000","last_fullsized":"2024-09-19T07:51:12.887345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885828+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:51:12.885828+0000","last_peered":"2024-09-19T07:51:12.885828+0000","last_clean":"2024-09-19T07:51:12.885828+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:51:12.885828+0000","last_undegraded":"2024-09-19T07:51:12.885828+0000","last_fullsized":"2024-09-19T07:51:12.885828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085403+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:51:13.085403+0000","last_peered":"2024-09-19T07:51:13.085403+0000","last_clean":"2024-09-19T07:51:13.085403+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:51:13.085403+0000","last_undegraded":"2024-09-19T07:51:13.085403+0000","last_fullsized":"2024-09-19T07:51:13.085403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897311+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:51:12.897311+0000","last_peered":"2024-09-19T07:51:12.897311+0000","last_clean":"2024-09-19T07:51:12.897311+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:51:12.897311+0000","last_undegraded":"2024-09-19T07:51:12.897311+0000","last_fullsized":"2024-09-19T07:51:12.897311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886120+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:51:12.886120+0000","last_peered":"2024-09-19T07:51:12.886120+0000","last_clean":"2024-09-19T07:51:12.886120+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:51:12.886120+0000","last_undegraded":"2024-09-19T07:51:12.886120+0000","last_fullsized":"2024-09-19T07:51:12.886120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778673+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:51:12.778673+0000","last_peered":"2024-09-19T07:51:12.778673+0000","last_clean":"2024-09-19T07:51:12.778673+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:51:12.778673+0000","last_undegraded":"2024-09-19T07:51:12.778673+0000","last_fullsized":"2024-09-19T07:51:12.778673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886035+0000","last_change":"2024-09-19T07:50:34.354839+0000","last_active":"2024-09-19T07:51:12.886035+0000","last_peered":"2024-09-19T07:51:12.886035+0000","last_clean":"2024-09-19T07:51:12.886035+0000","last_became_active":"2024-09-19T07:50:34.350424+0000","last_became_peered":"2024-09-19T07:50:34.350424+0000","last_unstale":"2024-09-19T07:51:12.886035+0000","last_undegraded":"2024-09-19T07:51:12.886035+0000","last_fullsized":"2024-09-19T07:51:12.886035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:36.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053516+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:51:13.053516+0000","last_peered":"2024-09-19T07:51:13.053516+0000","last_clean":"2024-09-19T07:51:13.053516+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:51:13.053516+0000","last_undegraded":"2024-09-19T07:51:13.053516+0000","last_fullsized":"2024-09-19T07:51:13.053516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887230+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:51:12.887230+0000","last_peered":"2024-09-19T07:51:12.887230+0000","last_clean":"2024-09-19T07:51:12.887230+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:51:12.887230+0000","last_undegraded":"2024-09-19T07:51:12.887230+0000","last_fullsized":"2024-09-19T07:51:12.887230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886656+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:51:12.886656+0000","last_peered":"2024-09-19T07:51:12.886656+0000","last_clean":"2024-09-19T07:51:12.886656+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:51:12.886656+0000","last_undegraded":"2024-09-19T07:51:12.886656+0000","last_fullsized":"2024-09-19T07:51:12.886656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884312+0000","last_change":"2024-09-19T07:50:34.034480+0000","last_active":"2024-09-19T07:51:12.884312+0000","last_peered":"2024-09-19T07:51:12.884312+0000","last_clean":"2024-09-19T07:51:12.884312+0000","last_became_active":"2024-09-19T07:50:34.027982+0000","last_became_peered":"2024-09-19T07:50:34.027982+0000","last_unstale":"2024-09-19T07:51:12.884312+0000","last_undegraded":"2024-09-19T07:51:12.884312+0000","last_fullsized":"2024-09-19T07:51:12.884312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:40.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596619,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":736,"num_read_kb":477,"num_write":292,"num_write_kb":1435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1789857,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":450902,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":1240856,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":844354,"data_compressed":27820,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":954368,"data_stored":843692,"data_compressed":27820,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1044310,"data_compressed":44479,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":450527,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1175201,"data_compressed":50635,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":451357,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":975654,"data_compressed":33976,"data_compressed_allocated":45056,"data_compressed_original":540672,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":519470,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":517382,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":451798,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134396,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":200051,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:51:24.837 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:51:25.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:24 smithi152 ceph-mon[35117]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T07:51:25.088 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:25.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:24 smithi137 ceph-mon[35309]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T07:51:25.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:24 smithi076 ceph-mon[30930]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 -- 172.21.15.76:0/2223650947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748102780 msgr2=0x7fe7481067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 --2- 172.21.15.76:0/2223650947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748102780 0x7fe7481067d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe730009900 tx=0x7fe73002a410 comp rx=0 tx=0).stop 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 -- 172.21.15.76:0/2223650947 shutdown_connections 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 --2- 172.21.15.76:0/2223650947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe748106f00 0x7fe74810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 --2- 172.21.15.76:0/2223650947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748102780 0x7fe7481067d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 --2- 172.21.15.76:0/2223650947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe748101dd0 0x7fe7481021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 -- 172.21.15.76:0/2223650947 >> 172.21.15.76:0/2223650947 conn(0x7fe7480fd890 msgr2=0x7fe7480ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 -- 172.21.15.76:0/2223650947 shutdown_connections 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.609+0000 7fe74da37640 1 -- 172.21.15.76:0/2223650947 wait complete. 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 Processor -- start 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 -- start start 2024-09-19T07:51:25.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe748101dd0 0x7fe7481985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe748102780 0x7fe748198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 0x7fe74819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7481120e0 con 0x7fe748106f00 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe748111f60 con 0x7fe748101dd0 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe74da37640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe748112260 con 0x7fe748102780 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe7477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 0x7fe74819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe7467fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe748102780 0x7fe748198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe7477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 0x7fe74819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43594/0 (socket says 172.21.15.76:43594) 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe7477fe640 1 -- 172.21.15.76:0/4274372473 learned_addr learned my addr 172.21.15.76:0/4274372473 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.610+0000 7fe746ffd640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe748101dd0 0x7fe7481985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe7477fe640 1 -- 172.21.15.76:0/4274372473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe748102780 msgr2=0x7fe748198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe7477fe640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe748102780 0x7fe748198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe7477fe640 1 -- 172.21.15.76:0/4274372473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe748101dd0 msgr2=0x7fe7481985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe7477fe640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe748101dd0 0x7fe7481985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe7477fe640 1 -- 172.21.15.76:0/4274372473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74819d550 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe7477fe640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 0x7fe74819ce70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe738009fd0 tx=0x7fe73800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738011830 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe738016070 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74819d840 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73800f2e0 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.611+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7481a5120 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.612+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7481021b0 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.613+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fe73801b460 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.614+0000 7fe74ca35640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7340a3440 0x7fe7340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.614+0000 7fe746ffd640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7340a3440 0x7fe7340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.614+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fe7380cf370 con 0x7fe748106f00 2024-09-19T07:51:25.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.615+0000 7fe746ffd640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7340a3440 0x7fe7340a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe740005fd0 tx=0x7fe740009680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:25.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.618+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe73809bcf0 con 0x7fe748106f00 2024-09-19T07:51:25.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.786+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe748062630 con 0x7fe7340a3440 2024-09-19T07:51:25.787 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:25 smithi076 ceph-mon[30930]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:25.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.794+0000 7fe74ca35640 1 -- 172.21.15.76:0/4274372473 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258031 (secure 0 0 0) 0x7fe748062630 con 0x7fe7340a3440 2024-09-19T07:51:25.797 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:25.798 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:51:25.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7340a3440 msgr2=0x7fe7340a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:25.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7340a3440 0x7fe7340a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe740005fd0 tx=0x7fe740009680 comp rx=0 tx=0).stop 2024-09-19T07:51:25.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 msgr2=0x7fe74819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 0x7fe74819ce70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe738009fd0 tx=0x7fe73800b8e0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 shutdown_connections 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7340a3440 0x7fe7340a5900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe748106f00 0x7fe74819ce70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe748102780 0x7fe748198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 --2- 172.21.15.76:0/4274372473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe748101dd0 0x7fe7481985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.797+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 >> 172.21.15.76:0/4274372473 conn(0x7fe7480fd890 msgr2=0x7fe7480febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.798+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 shutdown_connections 2024-09-19T07:51:25.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:25.798+0000 7fe74da37640 1 -- 172.21.15.76:0/4274372473 wait complete. 2024-09-19T07:51:26.008 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:25 smithi152 ceph-mon[35117]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:26.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:25 smithi137 ceph-mon[35309]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:26.610 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T07:51:24.793960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1383853,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1258,"num_read_kb":1054,"num_write":621,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381608,"kb_used_data":11508,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560216,"statfs":{"total":1151940427776,"available":1151549661184,"internally_reserved":0,"allocated":11784192,"data_stored":9555399,"data_compressed":314976,"data_compressed_allocated":417792,"data_compressed_original":4165632,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":472,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.993174"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073201+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:51:13.073201+0000","last_peered":"2024-09-19T07:51:13.073201+0000","last_clean":"2024-09-19T07:51:13.073201+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:51:13.073201+0000","last_undegraded":"2024-09-19T07:51:13.073201+0000","last_fullsized":"2024-09-19T07:51:13.073201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053081+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:51:13.053081+0000","last_peered":"2024-09-19T07:51:13.053081+0000","last_clean":"2024-09-19T07:51:13.053081+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:51:13.053081+0000","last_undegraded":"2024-09-19T07:51:13.053081+0000","last_fullsized":"2024-09-19T07:51:13.053081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052870+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:51:13.052870+0000","last_peered":"2024-09-19T07:51:13.052870+0000","last_clean":"2024-09-19T07:51:13.052870+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:51:13.052870+0000","last_undegraded":"2024-09-19T07:51:13.052870+0000","last_fullsized":"2024-09-19T07:51:13.052870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786281+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:51:12.786281+0000","last_peered":"2024-09-19T07:51:12.786281+0000","last_clean":"2024-09-19T07:51:12.786281+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:51:12.786281+0000","last_undegraded":"2024-09-19T07:51:12.786281+0000","last_fullsized":"2024-09-19T07:51:12.786281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885874+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:51:12.885874+0000","last_peered":"2024-09-19T07:51:12.885874+0000","last_clean":"2024-09-19T07:51:12.885874+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:51:12.885874+0000","last_undegraded":"2024-09-19T07:51:12.885874+0000","last_fullsized":"2024-09-19T07:51:12.885874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820633+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:51:12.820633+0000","last_peered":"2024-09-19T07:51:12.820633+0000","last_clean":"2024-09-19T07:51:12.820633+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:51:12.820633+0000","last_undegraded":"2024-09-19T07:51:12.820633+0000","last_fullsized":"2024-09-19T07:51:12.820633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085272+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:51:13.085272+0000","last_peered":"2024-09-19T07:51:13.085272+0000","last_clean":"2024-09-19T07:51:13.085272+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:51:13.085272+0000","last_undegraded":"2024-09-19T07:51:13.085272+0000","last_fullsized":"2024-09-19T07:51:13.085272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886640+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:51:12.886640+0000","last_peered":"2024-09-19T07:51:12.886640+0000","last_clean":"2024-09-19T07:51:12.886640+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:51:12.886640+0000","last_undegraded":"2024-09-19T07:51:12.886640+0000","last_fullsized":"2024-09-19T07:51:12.886640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779282+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:51:12.779282+0000","last_peered":"2024-09-19T07:51:12.779282+0000","last_clean":"2024-09-19T07:51:12.779282+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:51:12.779282+0000","last_undegraded":"2024-09-19T07:51:12.779282+0000","last_fullsized":"2024-09-19T07:51:12.779282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820979+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:51:12.820979+0000","last_peered":"2024-09-19T07:51:12.820979+0000","last_clean":"2024-09-19T07:51:12.820979+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:51:12.820979+0000","last_undegraded":"2024-09-19T07:51:12.820979+0000","last_fullsized":"2024-09-19T07:51:12.820979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085724+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:51:13.085724+0000","last_peered":"2024-09-19T07:51:13.085724+0000","last_clean":"2024-09-19T07:51:13.085724+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:51:13.085724+0000","last_undegraded":"2024-09-19T07:51:13.085724+0000","last_fullsized":"2024-09-19T07:51:13.085724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786352+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:51:12.786352+0000","last_peered":"2024-09-19T07:51:12.786352+0000","last_clean":"2024-09-19T07:51:12.786352+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:51:12.786352+0000","last_undegraded":"2024-09-19T07:51:12.786352+0000","last_fullsized":"2024-09-19T07:51:12.786352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777843+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:51:12.777843+0000","last_peered":"2024-09-19T07:51:12.777843+0000","last_clean":"2024-09-19T07:51:12.777843+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:51:12.777843+0000","last_undegraded":"2024-09-19T07:51:12.777843+0000","last_fullsized":"2024-09-19T07:51:12.777843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052179+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:51:13.052179+0000","last_peered":"2024-09-19T07:51:13.052179+0000","last_clean":"2024-09-19T07:51:13.052179+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:51:13.052179+0000","last_undegraded":"2024-09-19T07:51:13.052179+0000","last_fullsized":"2024-09-19T07:51:13.052179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.051887+0000","last_change":"2024-09-19T07:50:34.028760+0000","last_active":"2024-09-19T07:51:13.051887+0000","last_peered":"2024-09-19T07:51:13.051887+0000","last_clean":"2024-09-19T07:51:13.051887+0000","last_became_active":"2024-09-19T07:50:34.028384+0000","last_became_peered":"2024-09-19T07:50:34.028384+0000","last_unstale":"2024-09-19T07:51:13.051887+0000","last_undegraded":"2024-09-19T07:51:13.051887+0000","last_fullsized":"2024-09-19T07:51:13.051887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:00.072227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778575+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:51:12.778575+0000","last_peered":"2024-09-19T07:51:12.778575+0000","last_clean":"2024-09-19T07:51:12.778575+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:51:12.778575+0000","last_undegraded":"2024-09-19T07:51:12.778575+0000","last_fullsized":"2024-09-19T07:51:12.778575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073263+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:51:13.073263+0000","last_peered":"2024-09-19T07:51:13.073263+0000","last_clean":"2024-09-19T07:51:13.073263+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:51:13.073263+0000","last_undegraded":"2024-09-19T07:51:13.073263+0000","last_fullsized":"2024-09-19T07:51:13.073263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884084+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:51:12.884084+0000","last_peered":"2024-09-19T07:51:12.884084+0000","last_clean":"2024-09-19T07:51:12.884084+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:51:12.884084+0000","last_undegraded":"2024-09-19T07:51:12.884084+0000","last_fullsized":"2024-09-19T07:51:12.884084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779398+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:51:12.779398+0000","last_peered":"2024-09-19T07:51:12.779398+0000","last_clean":"2024-09-19T07:51:12.779398+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:51:12.779398+0000","last_undegraded":"2024-09-19T07:51:12.779398+0000","last_fullsized":"2024-09-19T07:51:12.779398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777912+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:51:12.777912+0000","last_peered":"2024-09-19T07:51:12.777912+0000","last_clean":"2024-09-19T07:51:12.777912+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:51:12.777912+0000","last_undegraded":"2024-09-19T07:51:12.777912+0000","last_fullsized":"2024-09-19T07:51:12.777912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778712+0000","last_change":"2024-09-19T07:50:34.030741+0000","last_active":"2024-09-19T07:51:12.778712+0000","last_peered":"2024-09-19T07:51:12.778712+0000","last_clean":"2024-09-19T07:51:12.778712+0000","last_became_active":"2024-09-19T07:50:34.030300+0000","last_became_peered":"2024-09-19T07:50:34.030300+0000","last_unstale":"2024-09-19T07:51:12.778712+0000","last_undegraded":"2024-09-19T07:51:12.778712+0000","last_fullsized":"2024-09-19T07:51:12.778712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:30.131138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886659+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:51:12.886659+0000","last_peered":"2024-09-19T07:51:12.886659+0000","last_clean":"2024-09-19T07:51:12.886659+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:51:12.886659+0000","last_undegraded":"2024-09-19T07:51:12.886659+0000","last_fullsized":"2024-09-19T07:51:12.886659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897046+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:51:12.897046+0000","last_peered":"2024-09-19T07:51:12.897046+0000","last_clean":"2024-09-19T07:51:12.897046+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:51:12.897046+0000","last_undegraded":"2024-09-19T07:51:12.897046+0000","last_fullsized":"2024-09-19T07:51:12.897046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886916+0000","last_change":"2024-09-19T07:50:34.028762+0000","last_active":"2024-09-19T07:51:12.886916+0000","last_peered":"2024-09-19T07:51:12.886916+0000","last_clean":"2024-09-19T07:51:12.886916+0000","last_became_active":"2024-09-19T07:50:34.028343+0000","last_became_peered":"2024-09-19T07:50:34.028343+0000","last_unstale":"2024-09-19T07:51:12.886916+0000","last_undegraded":"2024-09-19T07:51:12.886916+0000","last_fullsized":"2024-09-19T07:51:12.886916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:08.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779564+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:51:12.779564+0000","last_peered":"2024-09-19T07:51:12.779564+0000","last_clean":"2024-09-19T07:51:12.779564+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:51:12.779564+0000","last_undegraded":"2024-09-19T07:51:12.779564+0000","last_fullsized":"2024-09-19T07:51:12.779564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072980+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:51:13.072980+0000","last_peered":"2024-09-19T07:51:13.072980+0000","last_clean":"2024-09-19T07:51:13.072980+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:51:13.072980+0000","last_undegraded":"2024-09-19T07:51:13.072980+0000","last_fullsized":"2024-09-19T07:51:13.072980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778090+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:51:12.778090+0000","last_peered":"2024-09-19T07:51:12.778090+0000","last_clean":"2024-09-19T07:51:12.778090+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:51:12.778090+0000","last_undegraded":"2024-09-19T07:51:12.778090+0000","last_fullsized":"2024-09-19T07:51:12.778090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052432+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:51:13.052432+0000","last_peered":"2024-09-19T07:51:13.052432+0000","last_clean":"2024-09-19T07:51:13.052432+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:51:13.052432+0000","last_undegraded":"2024-09-19T07:51:13.052432+0000","last_fullsized":"2024-09-19T07:51:13.052432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779132+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:51:12.779132+0000","last_peered":"2024-09-19T07:51:12.779132+0000","last_clean":"2024-09-19T07:51:12.779132+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:51:12.779132+0000","last_undegraded":"2024-09-19T07:51:12.779132+0000","last_fullsized":"2024-09-19T07:51:12.779132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779167+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:51:12.779167+0000","last_peered":"2024-09-19T07:51:12.779167+0000","last_clean":"2024-09-19T07:51:12.779167+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:51:12.779167+0000","last_undegraded":"2024-09-19T07:51:12.779167+0000","last_fullsized":"2024-09-19T07:51:12.779167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:50:34.028399+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:50:34.027948+0000","last_became_peered":"2024-09-19T07:50:34.027948+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:36.822727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885803+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:51:12.885803+0000","last_peered":"2024-09-19T07:51:12.885803+0000","last_clean":"2024-09-19T07:51:12.885803+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:51:12.885803+0000","last_undegraded":"2024-09-19T07:51:12.885803+0000","last_fullsized":"2024-09-19T07:51:12.885803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.782135+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:22.782135+0000","last_peered":"2024-09-19T07:51:22.782135+0000","last_clean":"2024-09-19T07:51:22.782135+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:51:22.782135+0000","last_undegraded":"2024-09-19T07:51:22.782135+0000","last_fullsized":"2024-09-19T07:51:22.782135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897140+0000","last_change":"2024-09-19T07:50:34.026626+0000","last_active":"2024-09-19T07:51:12.897140+0000","last_peered":"2024-09-19T07:51:12.897140+0000","last_clean":"2024-09-19T07:51:12.897140+0000","last_became_active":"2024-09-19T07:50:34.026058+0000","last_became_peered":"2024-09-19T07:50:34.026058+0000","last_unstale":"2024-09-19T07:51:12.897140+0000","last_undegraded":"2024-09-19T07:51:12.897140+0000","last_fullsized":"2024-09-19T07:51:12.897140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:22.700331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820706+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:51:12.820706+0000","last_peered":"2024-09-19T07:51:12.820706+0000","last_clean":"2024-09-19T07:51:12.820706+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:51:12.820706+0000","last_undegraded":"2024-09-19T07:51:12.820706+0000","last_fullsized":"2024-09-19T07:51:12.820706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777625+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:51:12.777625+0000","last_peered":"2024-09-19T07:51:12.777625+0000","last_clean":"2024-09-19T07:51:12.777625+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:51:12.777625+0000","last_undegraded":"2024-09-19T07:51:12.777625+0000","last_fullsized":"2024-09-19T07:51:12.777625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886790+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:51:12.886790+0000","last_peered":"2024-09-19T07:51:12.886790+0000","last_clean":"2024-09-19T07:51:12.886790+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:51:12.886790+0000","last_undegraded":"2024-09-19T07:51:12.886790+0000","last_fullsized":"2024-09-19T07:51:12.886790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897268+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:51:12.897268+0000","last_peered":"2024-09-19T07:51:12.897268+0000","last_clean":"2024-09-19T07:51:12.897268+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:51:12.897268+0000","last_undegraded":"2024-09-19T07:51:12.897268+0000","last_fullsized":"2024-09-19T07:51:12.897268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883449+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:51:12.883449+0000","last_peered":"2024-09-19T07:51:12.883449+0000","last_clean":"2024-09-19T07:51:12.883449+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:51:12.883449+0000","last_undegraded":"2024-09-19T07:51:12.883449+0000","last_fullsized":"2024-09-19T07:51:12.883449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.781412+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:51:22.781412+0000","last_peered":"2024-09-19T07:51:22.781412+0000","last_clean":"2024-09-19T07:51:22.781412+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:51:22.781412+0000","last_undegraded":"2024-09-19T07:51:22.781412+0000","last_fullsized":"2024-09-19T07:51:22.781412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779095+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:51:12.779095+0000","last_peered":"2024-09-19T07:51:12.779095+0000","last_clean":"2024-09-19T07:51:12.779095+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:51:12.779095+0000","last_undegraded":"2024-09-19T07:51:12.779095+0000","last_fullsized":"2024-09-19T07:51:12.779095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085762+0000","last_change":"2024-09-19T07:50:34.356734+0000","last_active":"2024-09-19T07:51:13.085762+0000","last_peered":"2024-09-19T07:51:13.085762+0000","last_clean":"2024-09-19T07:51:13.085762+0000","last_became_active":"2024-09-19T07:50:34.350578+0000","last_became_peered":"2024-09-19T07:50:34.350578+0000","last_unstale":"2024-09-19T07:51:13.085762+0000","last_undegraded":"2024-09-19T07:51:13.085762+0000","last_fullsized":"2024-09-19T07:51:13.085762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:57.110465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053636+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:51:13.053636+0000","last_peered":"2024-09-19T07:51:13.053636+0000","last_clean":"2024-09-19T07:51:13.053636+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:51:13.053636+0000","last_undegraded":"2024-09-19T07:51:13.053636+0000","last_fullsized":"2024-09-19T07:51:13.053636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897310+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:51:12.897310+0000","last_peered":"2024-09-19T07:51:12.897310+0000","last_clean":"2024-09-19T07:51:12.897310+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:51:12.897310+0000","last_undegraded":"2024-09-19T07:51:12.897310+0000","last_fullsized":"2024-09-19T07:51:12.897310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778760+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:51:12.778760+0000","last_peered":"2024-09-19T07:51:12.778760+0000","last_clean":"2024-09-19T07:51:12.778760+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:51:12.778760+0000","last_undegraded":"2024-09-19T07:51:12.778760+0000","last_fullsized":"2024-09-19T07:51:12.778760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:23.783165+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:51:23.783165+0000","last_peered":"2024-09-19T07:51:23.783165+0000","last_clean":"2024-09-19T07:51:23.783165+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:51:23.783165+0000","last_undegraded":"2024-09-19T07:51:23.783165+0000","last_fullsized":"2024-09-19T07:51:23.783165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":179,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885917+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:51:12.885917+0000","last_peered":"2024-09-19T07:51:12.885917+0000","last_clean":"2024-09-19T07:51:12.885917+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:51:12.885917+0000","last_undegraded":"2024-09-19T07:51:12.885917+0000","last_fullsized":"2024-09-19T07:51:12.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779272+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:12.779272+0000","last_peered":"2024-09-19T07:51:12.779272+0000","last_clean":"2024-09-19T07:51:12.779272+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:51:12.779272+0000","last_undegraded":"2024-09-19T07:51:12.779272+0000","last_fullsized":"2024-09-19T07:51:12.779272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777765+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:51:12.777765+0000","last_peered":"2024-09-19T07:51:12.777765+0000","last_clean":"2024-09-19T07:51:12.777765+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:51:12.777765+0000","last_undegraded":"2024-09-19T07:51:12.777765+0000","last_fullsized":"2024-09-19T07:51:12.777765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897105+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:51:12.897105+0000","last_peered":"2024-09-19T07:51:12.897105+0000","last_clean":"2024-09-19T07:51:12.897105+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:51:12.897105+0000","last_undegraded":"2024-09-19T07:51:12.897105+0000","last_fullsized":"2024-09-19T07:51:12.897105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085518+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:51:13.085518+0000","last_peered":"2024-09-19T07:51:13.085518+0000","last_clean":"2024-09-19T07:51:13.085518+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:51:13.085518+0000","last_undegraded":"2024-09-19T07:51:13.085518+0000","last_fullsized":"2024-09-19T07:51:13.085518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:21.803523+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:51:21.803523+0000","last_peered":"2024-09-19T07:51:21.803523+0000","last_clean":"2024-09-19T07:51:21.803523+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:51:21.803523+0000","last_undegraded":"2024-09-19T07:51:21.803523+0000","last_fullsized":"2024-09-19T07:51:21.803523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085252+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:51:13.085252+0000","last_peered":"2024-09-19T07:51:13.085252+0000","last_clean":"2024-09-19T07:51:13.085252+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:51:13.085252+0000","last_undegraded":"2024-09-19T07:51:13.085252+0000","last_fullsized":"2024-09-19T07:51:13.085252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884108+0000","last_change":"2024-09-19T07:50:34.349498+0000","last_active":"2024-09-19T07:51:12.884108+0000","last_peered":"2024-09-19T07:51:12.884108+0000","last_clean":"2024-09-19T07:51:12.884108+0000","last_became_active":"2024-09-19T07:50:34.349238+0000","last_became_peered":"2024-09-19T07:50:34.349238+0000","last_unstale":"2024-09-19T07:51:12.884108+0000","last_undegraded":"2024-09-19T07:51:12.884108+0000","last_fullsized":"2024-09-19T07:51:12.884108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:40.879641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885913+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:51:12.885913+0000","last_peered":"2024-09-19T07:51:12.885913+0000","last_clean":"2024-09-19T07:51:12.885913+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:51:12.885913+0000","last_undegraded":"2024-09-19T07:51:12.885913+0000","last_fullsized":"2024-09-19T07:51:12.885913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073006+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:51:13.073006+0000","last_peered":"2024-09-19T07:51:13.073006+0000","last_clean":"2024-09-19T07:51:13.073006+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:51:13.073006+0000","last_undegraded":"2024-09-19T07:51:13.073006+0000","last_fullsized":"2024-09-19T07:51:13.073006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778040+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:51:12.778040+0000","last_peered":"2024-09-19T07:51:12.778040+0000","last_clean":"2024-09-19T07:51:12.778040+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:51:12.778040+0000","last_undegraded":"2024-09-19T07:51:12.778040+0000","last_fullsized":"2024-09-19T07:51:12.778040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085798+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:51:13.085798+0000","last_peered":"2024-09-19T07:51:13.085798+0000","last_clean":"2024-09-19T07:51:13.085798+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:51:13.085798+0000","last_undegraded":"2024-09-19T07:51:13.085798+0000","last_fullsized":"2024-09-19T07:51:13.085798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'65","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.114910+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:51:22.114910+0000","last_peered":"2024-09-19T07:51:22.114910+0000","last_clean":"2024-09-19T07:51:22.114910+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:51:22.114910+0000","last_undegraded":"2024-09-19T07:51:22.114910+0000","last_fullsized":"2024-09-19T07:51:22.114910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085413+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:51:13.085413+0000","last_peered":"2024-09-19T07:51:13.085413+0000","last_clean":"2024-09-19T07:51:13.085413+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:51:13.085413+0000","last_undegraded":"2024-09-19T07:51:13.085413+0000","last_fullsized":"2024-09-19T07:51:13.085413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779460+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:51:12.779460+0000","last_peered":"2024-09-19T07:51:12.779460+0000","last_clean":"2024-09-19T07:51:12.779460+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:51:12.779460+0000","last_undegraded":"2024-09-19T07:51:12.779460+0000","last_fullsized":"2024-09-19T07:51:12.779460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085732+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:51:13.085732+0000","last_peered":"2024-09-19T07:51:13.085732+0000","last_clean":"2024-09-19T07:51:13.085732+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:51:13.085732+0000","last_undegraded":"2024-09-19T07:51:13.085732+0000","last_fullsized":"2024-09-19T07:51:13.085732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":395,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:14.891705+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:51:14.891705+0000","last_peered":"2024-09-19T07:51:14.891705+0000","last_clean":"2024-09-19T07:51:14.891705+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:51:14.891705+0000","last_undegraded":"2024-09-19T07:51:14.891705+0000","last_fullsized":"2024-09-19T07:51:14.891705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786233+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:51:12.786233+0000","last_peered":"2024-09-19T07:51:12.786233+0000","last_clean":"2024-09-19T07:51:12.786233+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:51:12.786233+0000","last_undegraded":"2024-09-19T07:51:12.786233+0000","last_fullsized":"2024-09-19T07:51:12.786233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883560+0000","last_change":"2024-09-19T07:50:34.028464+0000","last_active":"2024-09-19T07:51:12.883560+0000","last_peered":"2024-09-19T07:51:12.883560+0000","last_clean":"2024-09-19T07:51:12.883560+0000","last_became_active":"2024-09-19T07:50:34.028078+0000","last_became_peered":"2024-09-19T07:50:34.028078+0000","last_unstale":"2024-09-19T07:51:12.883560+0000","last_undegraded":"2024-09-19T07:51:12.883560+0000","last_fullsized":"2024-09-19T07:51:12.883560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:33.498575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085358+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:51:13.085358+0000","last_peered":"2024-09-19T07:51:13.085358+0000","last_clean":"2024-09-19T07:51:13.085358+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:51:13.085358+0000","last_undegraded":"2024-09-19T07:51:13.085358+0000","last_fullsized":"2024-09-19T07:51:13.085358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777583+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:51:12.777583+0000","last_peered":"2024-09-19T07:51:12.777583+0000","last_clean":"2024-09-19T07:51:12.777583+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:51:12.777583+0000","last_undegraded":"2024-09-19T07:51:12.777583+0000","last_fullsized":"2024-09-19T07:51:12.777583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:21.802849+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:51:21.802849+0000","last_peered":"2024-09-19T07:51:21.802849+0000","last_clean":"2024-09-19T07:51:21.802849+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:51:21.802849+0000","last_undegraded":"2024-09-19T07:51:21.802849+0000","last_fullsized":"2024-09-19T07:51:21.802849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897052+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:51:12.897052+0000","last_peered":"2024-09-19T07:51:12.897052+0000","last_clean":"2024-09-19T07:51:12.897052+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:51:12.897052+0000","last_undegraded":"2024-09-19T07:51:12.897052+0000","last_fullsized":"2024-09-19T07:51:12.897052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085545+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:51:13.085545+0000","last_peered":"2024-09-19T07:51:13.085545+0000","last_clean":"2024-09-19T07:51:13.085545+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:51:13.085545+0000","last_undegraded":"2024-09-19T07:51:13.085545+0000","last_fullsized":"2024-09-19T07:51:13.085545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820738+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:51:12.820738+0000","last_peered":"2024-09-19T07:51:12.820738+0000","last_clean":"2024-09-19T07:51:12.820738+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:51:12.820738+0000","last_undegraded":"2024-09-19T07:51:12.820738+0000","last_fullsized":"2024-09-19T07:51:12.820738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884217+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:51:12.884217+0000","last_peered":"2024-09-19T07:51:12.884217+0000","last_clean":"2024-09-19T07:51:12.884217+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:51:12.884217+0000","last_undegraded":"2024-09-19T07:51:12.884217+0000","last_fullsized":"2024-09-19T07:51:12.884217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820842+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:51:12.820842+0000","last_peered":"2024-09-19T07:51:12.820842+0000","last_clean":"2024-09-19T07:51:12.820842+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:51:12.820842+0000","last_undegraded":"2024-09-19T07:51:12.820842+0000","last_fullsized":"2024-09-19T07:51:12.820842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886077+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:51:12.886077+0000","last_peered":"2024-09-19T07:51:12.886077+0000","last_clean":"2024-09-19T07:51:12.886077+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:51:12.886077+0000","last_undegraded":"2024-09-19T07:51:12.886077+0000","last_fullsized":"2024-09-19T07:51:12.886077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778175+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:51:12.778175+0000","last_peered":"2024-09-19T07:51:12.778175+0000","last_clean":"2024-09-19T07:51:12.778175+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:51:12.778175+0000","last_undegraded":"2024-09-19T07:51:12.778175+0000","last_fullsized":"2024-09-19T07:51:12.778175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'102","reported_seq":218,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.451935+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:51:22.451935+0000","last_peered":"2024-09-19T07:51:22.451935+0000","last_clean":"2024-09-19T07:51:22.451935+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:51:22.451935+0000","last_undegraded":"2024-09-19T07:51:22.451935+0000","last_fullsized":"2024-09-19T07:51:22.451935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887028+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:51:12.887028+0000","last_peered":"2024-09-19T07:51:12.887028+0000","last_clean":"2024-09-19T07:51:12.887028+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:51:12.887028+0000","last_undegraded":"2024-09-19T07:51:12.887028+0000","last_fullsized":"2024-09-19T07:51:12.887028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786476+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:51:12.786476+0000","last_peered":"2024-09-19T07:51:12.786476+0000","last_clean":"2024-09-19T07:51:12.786476+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:51:12.786476+0000","last_undegraded":"2024-09-19T07:51:12.786476+0000","last_fullsized":"2024-09-19T07:51:12.786476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053199+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:51:13.053199+0000","last_peered":"2024-09-19T07:51:13.053199+0000","last_clean":"2024-09-19T07:51:13.053199+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:51:13.053199+0000","last_undegraded":"2024-09-19T07:51:13.053199+0000","last_fullsized":"2024-09-19T07:51:13.053199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778663+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:51:12.778663+0000","last_peered":"2024-09-19T07:51:12.778663+0000","last_clean":"2024-09-19T07:51:12.778663+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:51:12.778663+0000","last_undegraded":"2024-09-19T07:51:12.778663+0000","last_fullsized":"2024-09-19T07:51:12.778663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886882+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:51:12.886882+0000","last_peered":"2024-09-19T07:51:12.886882+0000","last_clean":"2024-09-19T07:51:12.886882+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:51:12.886882+0000","last_undegraded":"2024-09-19T07:51:12.886882+0000","last_fullsized":"2024-09-19T07:51:12.886882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073002+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:51:13.073002+0000","last_peered":"2024-09-19T07:51:13.073002+0000","last_clean":"2024-09-19T07:51:13.073002+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:51:13.073002+0000","last_undegraded":"2024-09-19T07:51:13.073002+0000","last_fullsized":"2024-09-19T07:51:13.073002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779211+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:51:12.779211+0000","last_peered":"2024-09-19T07:51:12.779211+0000","last_clean":"2024-09-19T07:51:12.779211+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:51:12.779211+0000","last_undegraded":"2024-09-19T07:51:12.779211+0000","last_fullsized":"2024-09-19T07:51:12.779211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887345+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:51:12.887345+0000","last_peered":"2024-09-19T07:51:12.887345+0000","last_clean":"2024-09-19T07:51:12.887345+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:51:12.887345+0000","last_undegraded":"2024-09-19T07:51:12.887345+0000","last_fullsized":"2024-09-19T07:51:12.887345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885828+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:51:12.885828+0000","last_peered":"2024-09-19T07:51:12.885828+0000","last_clean":"2024-09-19T07:51:12.885828+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:51:12.885828+0000","last_undegraded":"2024-09-19T07:51:12.885828+0000","last_fullsized":"2024-09-19T07:51:12.885828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085403+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:51:13.085403+0000","last_peered":"2024-09-19T07:51:13.085403+0000","last_clean":"2024-09-19T07:51:13.085403+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:51:13.085403+0000","last_undegraded":"2024-09-19T07:51:13.085403+0000","last_fullsized":"2024-09-19T07:51:13.085403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897311+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:51:12.897311+0000","last_peered":"2024-09-19T07:51:12.897311+0000","last_clean":"2024-09-19T07:51:12.897311+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:51:12.897311+0000","last_undegraded":"2024-09-19T07:51:12.897311+0000","last_fullsized":"2024-09-19T07:51:12.897311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886120+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:51:12.886120+0000","last_peered":"2024-09-19T07:51:12.886120+0000","last_clean":"2024-09-19T07:51:12.886120+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:51:12.886120+0000","last_undegraded":"2024-09-19T07:51:12.886120+0000","last_fullsized":"2024-09-19T07:51:12.886120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778673+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:51:12.778673+0000","last_peered":"2024-09-19T07:51:12.778673+0000","last_clean":"2024-09-19T07:51:12.778673+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:51:12.778673+0000","last_undegraded":"2024-09-19T07:51:12.778673+0000","last_fullsized":"2024-09-19T07:51:12.778673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886035+0000","last_change":"2024-09-19T07:50:34.354839+0000","last_active":"2024-09-19T07:51:12.886035+0000","last_peered":"2024-09-19T07:51:12.886035+0000","last_clean":"2024-09-19T07:51:12.886035+0000","last_became_active":"2024-09-19T07:50:34.350424+0000","last_became_peered":"2024-09-19T07:50:34.350424+0000","last_unstale":"2024-09-19T07:51:12.886035+0000","last_undegraded":"2024-09-19T07:51:12.886035+0000","last_fullsized":"2024-09-19T07:51:12.886035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:36.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053516+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:51:13.053516+0000","last_peered":"2024-09-19T07:51:13.053516+0000","last_clean":"2024-09-19T07:51:13.053516+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:51:13.053516+0000","last_undegraded":"2024-09-19T07:51:13.053516+0000","last_fullsized":"2024-09-19T07:51:13.053516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887230+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:51:12.887230+0000","last_peered":"2024-09-19T07:51:12.887230+0000","last_clean":"2024-09-19T07:51:12.887230+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:51:12.887230+0000","last_undegraded":"2024-09-19T07:51:12.887230+0000","last_fullsized":"2024-09-19T07:51:12.887230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886656+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:51:12.886656+0000","last_peered":"2024-09-19T07:51:12.886656+0000","last_clean":"2024-09-19T07:51:12.886656+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:51:12.886656+0000","last_undegraded":"2024-09-19T07:51:12.886656+0000","last_fullsized":"2024-09-19T07:51:12.886656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884356+0000","last_change":"2024-09-19T07:50:34.034480+0000","last_active":"2024-09-19T07:51:12.884356+0000","last_peered":"2024-09-19T07:51:12.884356+0000","last_clean":"2024-09-19T07:51:12.884356+0000","last_became_active":"2024-09-19T07:50:34.027982+0000","last_became_peered":"2024-09-19T07:50:34.027982+0000","last_unstale":"2024-09-19T07:51:12.884356+0000","last_undegraded":"2024-09-19T07:51:12.884356+0000","last_fullsized":"2024-09-19T07:51:12.884356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:40.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":793251,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1021,"num_read_kb":724,"num_write":418,"num_write_kb":2349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":651264,"data_stored":2379753,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":450902,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743466,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1122304,"data_stored":1437488,"data_compressed":59681,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":844354,"data_compressed":27963,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":843692,"data_compressed":27963,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1044310,"data_compressed":44479,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":450527,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1371833,"data_compressed":59681,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":451357,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1007616,"data_stored":1172286,"data_compressed":43165,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":519470,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":517382,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":451798,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":721732,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":331028,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":396683,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:51:26.613 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:51:26.614 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:51:26.864 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:26.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:26 smithi076 ceph-mon[30930]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 50 op/s 2024-09-19T07:51:27.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:26 smithi152 ceph-mon[35117]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 50 op/s 2024-09-19T07:51:27.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:26 smithi137 ceph-mon[35309]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 50 op/s 2024-09-19T07:51:27.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 -- 172.21.15.76:0/3662629260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0108290 msgr2=0x7fdfc010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:27.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3662629260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0108290 0x7fdfc010ec30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009930 tx=0x7fdfb802a420 comp rx=0 tx=0).stop 2024-09-19T07:51:27.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 -- 172.21.15.76:0/3662629260 shutdown_connections 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3662629260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0108290 0x7fdfc010ec30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3662629260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc0103740 0x7fdfc0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3662629260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfc0102d90 0x7fdfc0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 -- 172.21.15.76:0/3662629260 >> 172.21.15.76:0/3662629260 conn(0x7fdfc00fc7d0 msgr2=0x7fdfc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 -- 172.21.15.76:0/3662629260 shutdown_connections 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 -- 172.21.15.76:0/3662629260 wait complete. 2024-09-19T07:51:27.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.326+0000 7fdfc58df640 1 Processor -- start 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 -- start start 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 0x7fdfc01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfc0103740 0x7fdfc0100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc0108290 0x7fdfc0101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc01121b0 con 0x7fdfc0102d90 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc0112030 con 0x7fdfc0103740 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfc58df640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc0112330 con 0x7fdfc0108290 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 0x7fdfc01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 0x7fdfc01009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43610/0 (socket says 172.21.15.76:43610) 2024-09-19T07:51:27.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 -- 172.21.15.76:0/3756327489 learned_addr learned my addr 172.21.15.76:0/3756327489 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbf7fe640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc0108290 0x7fdfc0101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbe7fc640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfc0103740 0x7fdfc0100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 -- 172.21.15.76:0/3756327489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc0108290 msgr2=0x7fdfc0101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc0108290 0x7fdfc0101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 -- 172.21.15.76:0/3756327489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfc0103740 msgr2=0x7fdfc0100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfc0103740 0x7fdfc0100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.327+0000 7fdfbeffd640 1 -- 172.21.15.76:0/3756327489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc01a69d0 con 0x7fdfc0102d90 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.328+0000 7fdfbeffd640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 0x7fdfc01009f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cce0 tx=0x7fdfb000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.328+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000f650 con 0x7fdfc0102d90 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.328+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfb000fcf0 con 0x7fdfc0102d90 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.328+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc01a6cc0 con 0x7fdfc0102d90 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.328+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0018d20 con 0x7fdfc0102d90 2024-09-19T07:51:27.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.328+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc01a71b0 con 0x7fdfc0102d90 2024-09-19T07:51:27.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.329+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc0103170 con 0x7fdfc0102d90 2024-09-19T07:51:27.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.330+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fdfb000f7f0 con 0x7fdfc0102d90 2024-09-19T07:51:27.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.331+0000 7fdfc48dd640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdfa80a3440 0x7fdfa80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:27.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.331+0000 7fdfbe7fc640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdfa80a3440 0x7fdfa80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:27.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.331+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdfb00d04d0 con 0x7fdfc0102d90 2024-09-19T07:51:27.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.331+0000 7fdfbe7fc640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdfa80a3440 0x7fdfa80a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0102480 tx=0x7fdfb4005c50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:27.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.335+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfb0014030 con 0x7fdfc0102d90 2024-09-19T07:51:27.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.497+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfc00fe8e0 con 0x7fdfa80a3440 2024-09-19T07:51:27.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.504+0000 7fdfc48dd640 1 -- 172.21.15.76:0/3756327489 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258032 (secure 0 0 0) 0x7fdfc00fe8e0 con 0x7fdfa80a3440 2024-09-19T07:51:27.506 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:27.507 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdfa80a3440 msgr2=0x7fdfa80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdfa80a3440 0x7fdfa80a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0102480 tx=0x7fdfb4005c50 comp rx=0 tx=0).stop 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 msgr2=0x7fdfc01009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 0x7fdfc01009f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cce0 tx=0x7fdfb000a620 comp rx=0 tx=0).stop 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 shutdown_connections 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdfa80a3440 0x7fdfa80a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc0108290 0x7fdfc0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfc0103740 0x7fdfc0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 --2- 172.21.15.76:0/3756327489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdfc0102d90 0x7fdfc01009f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 >> 172.21.15.76:0/3756327489 conn(0x7fdfc00fc7d0 msgr2=0x7fdfc00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:27.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 shutdown_connections 2024-09-19T07:51:27.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:27.507+0000 7fdfc58df640 1 -- 172.21.15.76:0/3756327489 wait complete. 2024-09-19T07:51:27.885 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:27 smithi076 ceph-mon[30930]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:28.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:27 smithi152 ceph-mon[35117]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:28.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:27 smithi137 ceph-mon[35309]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:28.222 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T07:51:26.794525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1383853,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1258,"num_read_kb":1054,"num_write":621,"num_write_kb":5289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381608,"kb_used_data":11508,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560216,"statfs":{"total":1151940427776,"available":1151549661184,"internally_reserved":0,"allocated":11784192,"data_stored":9555399,"data_compressed":314976,"data_compressed_allocated":417792,"data_compressed_original":4165632,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":472,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002853"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073201+0000","last_change":"2024-09-19T07:49:27.585238+0000","last_active":"2024-09-19T07:51:13.073201+0000","last_peered":"2024-09-19T07:51:13.073201+0000","last_clean":"2024-09-19T07:51:13.073201+0000","last_became_active":"2024-09-19T07:49:27.584889+0000","last_became_peered":"2024-09-19T07:49:27.584889+0000","last_unstale":"2024-09-19T07:51:13.073201+0000","last_undegraded":"2024-09-19T07:51:13.073201+0000","last_fullsized":"2024-09-19T07:51:13.073201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:18.087973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053081+0000","last_change":"2024-09-19T07:49:27.588772+0000","last_active":"2024-09-19T07:51:13.053081+0000","last_peered":"2024-09-19T07:51:13.053081+0000","last_clean":"2024-09-19T07:51:13.053081+0000","last_became_active":"2024-09-19T07:49:27.588440+0000","last_became_peered":"2024-09-19T07:49:27.588440+0000","last_unstale":"2024-09-19T07:51:13.053081+0000","last_undegraded":"2024-09-19T07:51:13.053081+0000","last_fullsized":"2024-09-19T07:51:13.053081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:18.223234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052870+0000","last_change":"2024-09-19T07:49:27.590396+0000","last_active":"2024-09-19T07:51:13.052870+0000","last_peered":"2024-09-19T07:51:13.052870+0000","last_clean":"2024-09-19T07:51:13.052870+0000","last_became_active":"2024-09-19T07:49:27.590117+0000","last_became_peered":"2024-09-19T07:49:27.590117+0000","last_unstale":"2024-09-19T07:51:13.052870+0000","last_undegraded":"2024-09-19T07:51:13.052870+0000","last_fullsized":"2024-09-19T07:51:13.052870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:49.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786281+0000","last_change":"2024-09-19T07:49:27.594975+0000","last_active":"2024-09-19T07:51:12.786281+0000","last_peered":"2024-09-19T07:51:12.786281+0000","last_clean":"2024-09-19T07:51:12.786281+0000","last_became_active":"2024-09-19T07:49:27.594623+0000","last_became_peered":"2024-09-19T07:49:27.594623+0000","last_unstale":"2024-09-19T07:51:12.786281+0000","last_undegraded":"2024-09-19T07:51:12.786281+0000","last_fullsized":"2024-09-19T07:51:12.786281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:01:45.344982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885874+0000","last_change":"2024-09-19T07:49:27.583212+0000","last_active":"2024-09-19T07:51:12.885874+0000","last_peered":"2024-09-19T07:51:12.885874+0000","last_clean":"2024-09-19T07:51:12.885874+0000","last_became_active":"2024-09-19T07:49:27.582892+0000","last_became_peered":"2024-09-19T07:49:27.582892+0000","last_unstale":"2024-09-19T07:51:12.885874+0000","last_undegraded":"2024-09-19T07:51:12.885874+0000","last_fullsized":"2024-09-19T07:51:12.885874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:40.689239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820633+0000","last_change":"2024-09-19T07:49:27.595348+0000","last_active":"2024-09-19T07:51:12.820633+0000","last_peered":"2024-09-19T07:51:12.820633+0000","last_clean":"2024-09-19T07:51:12.820633+0000","last_became_active":"2024-09-19T07:49:27.594739+0000","last_became_peered":"2024-09-19T07:49:27.594739+0000","last_unstale":"2024-09-19T07:51:12.820633+0000","last_undegraded":"2024-09-19T07:51:12.820633+0000","last_fullsized":"2024-09-19T07:51:12.820633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:42.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085272+0000","last_change":"2024-09-19T07:49:27.587713+0000","last_active":"2024-09-19T07:51:13.085272+0000","last_peered":"2024-09-19T07:51:13.085272+0000","last_clean":"2024-09-19T07:51:13.085272+0000","last_became_active":"2024-09-19T07:49:27.587263+0000","last_became_peered":"2024-09-19T07:49:27.587263+0000","last_unstale":"2024-09-19T07:51:13.085272+0000","last_undegraded":"2024-09-19T07:51:13.085272+0000","last_fullsized":"2024-09-19T07:51:13.085272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:42.929509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886640+0000","last_change":"2024-09-19T07:49:27.587929+0000","last_active":"2024-09-19T07:51:12.886640+0000","last_peered":"2024-09-19T07:51:12.886640+0000","last_clean":"2024-09-19T07:51:12.886640+0000","last_became_active":"2024-09-19T07:49:27.587638+0000","last_became_peered":"2024-09-19T07:49:27.587638+0000","last_unstale":"2024-09-19T07:51:12.886640+0000","last_undegraded":"2024-09-19T07:51:12.886640+0000","last_fullsized":"2024-09-19T07:51:12.886640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:50.807411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779282+0000","last_change":"2024-09-19T07:49:27.590708+0000","last_active":"2024-09-19T07:51:12.779282+0000","last_peered":"2024-09-19T07:51:12.779282+0000","last_clean":"2024-09-19T07:51:12.779282+0000","last_became_active":"2024-09-19T07:49:27.589723+0000","last_became_peered":"2024-09-19T07:49:27.589723+0000","last_unstale":"2024-09-19T07:51:12.779282+0000","last_undegraded":"2024-09-19T07:51:12.779282+0000","last_fullsized":"2024-09-19T07:51:12.779282+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:51:19.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820979+0000","last_change":"2024-09-19T07:49:27.596042+0000","last_active":"2024-09-19T07:51:12.820979+0000","last_peered":"2024-09-19T07:51:12.820979+0000","last_clean":"2024-09-19T07:51:12.820979+0000","last_became_active":"2024-09-19T07:49:27.594238+0000","last_became_peered":"2024-09-19T07:49:27.594238+0000","last_unstale":"2024-09-19T07:51:12.820979+0000","last_undegraded":"2024-09-19T07:51:12.820979+0000","last_fullsized":"2024-09-19T07:51:12.820979+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:47.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085724+0000","last_change":"2024-09-19T07:49:27.598455+0000","last_active":"2024-09-19T07:51:13.085724+0000","last_peered":"2024-09-19T07:51:13.085724+0000","last_clean":"2024-09-19T07:51:13.085724+0000","last_became_active":"2024-09-19T07:49:27.598135+0000","last_became_peered":"2024-09-19T07:49:27.598135+0000","last_unstale":"2024-09-19T07:51:13.085724+0000","last_undegraded":"2024-09-19T07:51:13.085724+0000","last_fullsized":"2024-09-19T07:51:13.085724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:34.116180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786352+0000","last_change":"2024-09-19T07:49:27.592827+0000","last_active":"2024-09-19T07:51:12.786352+0000","last_peered":"2024-09-19T07:51:12.786352+0000","last_clean":"2024-09-19T07:51:12.786352+0000","last_became_active":"2024-09-19T07:49:27.592527+0000","last_became_peered":"2024-09-19T07:49:27.592527+0000","last_unstale":"2024-09-19T07:51:12.786352+0000","last_undegraded":"2024-09-19T07:51:12.786352+0000","last_fullsized":"2024-09-19T07:51:12.786352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.893209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777843+0000","last_change":"2024-09-19T07:49:27.587020+0000","last_active":"2024-09-19T07:51:12.777843+0000","last_peered":"2024-09-19T07:51:12.777843+0000","last_clean":"2024-09-19T07:51:12.777843+0000","last_became_active":"2024-09-19T07:49:27.586699+0000","last_became_peered":"2024-09-19T07:49:27.586699+0000","last_unstale":"2024-09-19T07:51:12.777843+0000","last_undegraded":"2024-09-19T07:51:12.777843+0000","last_fullsized":"2024-09-19T07:51:12.777843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:44.056320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052179+0000","last_change":"2024-09-19T07:49:27.586228+0000","last_active":"2024-09-19T07:51:13.052179+0000","last_peered":"2024-09-19T07:51:13.052179+0000","last_clean":"2024-09-19T07:51:13.052179+0000","last_became_active":"2024-09-19T07:49:27.585048+0000","last_became_peered":"2024-09-19T07:49:27.585048+0000","last_unstale":"2024-09-19T07:51:13.052179+0000","last_undegraded":"2024-09-19T07:51:13.052179+0000","last_fullsized":"2024-09-19T07:51:13.052179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:19.460501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.051887+0000","last_change":"2024-09-19T07:50:34.028760+0000","last_active":"2024-09-19T07:51:13.051887+0000","last_peered":"2024-09-19T07:51:13.051887+0000","last_clean":"2024-09-19T07:51:13.051887+0000","last_became_active":"2024-09-19T07:50:34.028384+0000","last_became_peered":"2024-09-19T07:50:34.028384+0000","last_unstale":"2024-09-19T07:51:13.051887+0000","last_undegraded":"2024-09-19T07:51:13.051887+0000","last_fullsized":"2024-09-19T07:51:13.051887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:00.072227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778575+0000","last_change":"2024-09-19T07:49:27.591196+0000","last_active":"2024-09-19T07:51:12.778575+0000","last_peered":"2024-09-19T07:51:12.778575+0000","last_clean":"2024-09-19T07:51:12.778575+0000","last_became_active":"2024-09-19T07:49:27.590852+0000","last_became_peered":"2024-09-19T07:49:27.590852+0000","last_unstale":"2024-09-19T07:51:12.778575+0000","last_undegraded":"2024-09-19T07:51:12.778575+0000","last_fullsized":"2024-09-19T07:51:12.778575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:47.041898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073263+0000","last_change":"2024-09-19T07:49:27.584441+0000","last_active":"2024-09-19T07:51:13.073263+0000","last_peered":"2024-09-19T07:51:13.073263+0000","last_clean":"2024-09-19T07:51:13.073263+0000","last_became_active":"2024-09-19T07:49:27.584075+0000","last_became_peered":"2024-09-19T07:49:27.584075+0000","last_unstale":"2024-09-19T07:51:13.073263+0000","last_undegraded":"2024-09-19T07:51:13.073263+0000","last_fullsized":"2024-09-19T07:51:13.073263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:41.810045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884084+0000","last_change":"2024-09-19T07:49:27.581487+0000","last_active":"2024-09-19T07:51:12.884084+0000","last_peered":"2024-09-19T07:51:12.884084+0000","last_clean":"2024-09-19T07:51:12.884084+0000","last_became_active":"2024-09-19T07:49:27.581206+0000","last_became_peered":"2024-09-19T07:49:27.581206+0000","last_unstale":"2024-09-19T07:51:12.884084+0000","last_undegraded":"2024-09-19T07:51:12.884084+0000","last_fullsized":"2024-09-19T07:51:12.884084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:54.071447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779398+0000","last_change":"2024-09-19T07:49:27.588599+0000","last_active":"2024-09-19T07:51:12.779398+0000","last_peered":"2024-09-19T07:51:12.779398+0000","last_clean":"2024-09-19T07:51:12.779398+0000","last_became_active":"2024-09-19T07:49:27.588240+0000","last_became_peered":"2024-09-19T07:49:27.588240+0000","last_unstale":"2024-09-19T07:51:12.779398+0000","last_undegraded":"2024-09-19T07:51:12.779398+0000","last_fullsized":"2024-09-19T07:51:12.779398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:27.276784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:49:27.594845+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:49:27.594470+0000","last_became_peered":"2024-09-19T07:49:27.594470+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:25.232373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777912+0000","last_change":"2024-09-19T07:49:27.589468+0000","last_active":"2024-09-19T07:51:12.777912+0000","last_peered":"2024-09-19T07:51:12.777912+0000","last_clean":"2024-09-19T07:51:12.777912+0000","last_became_active":"2024-09-19T07:49:27.589177+0000","last_became_peered":"2024-09-19T07:49:27.589177+0000","last_unstale":"2024-09-19T07:51:12.777912+0000","last_undegraded":"2024-09-19T07:51:12.777912+0000","last_fullsized":"2024-09-19T07:51:12.777912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:48.577278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778712+0000","last_change":"2024-09-19T07:50:34.030741+0000","last_active":"2024-09-19T07:51:12.778712+0000","last_peered":"2024-09-19T07:51:12.778712+0000","last_clean":"2024-09-19T07:51:12.778712+0000","last_became_active":"2024-09-19T07:50:34.030300+0000","last_became_peered":"2024-09-19T07:50:34.030300+0000","last_unstale":"2024-09-19T07:51:12.778712+0000","last_undegraded":"2024-09-19T07:51:12.778712+0000","last_fullsized":"2024-09-19T07:51:12.778712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:30.131138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886659+0000","last_change":"2024-09-19T07:49:27.589091+0000","last_active":"2024-09-19T07:51:12.886659+0000","last_peered":"2024-09-19T07:51:12.886659+0000","last_clean":"2024-09-19T07:51:12.886659+0000","last_became_active":"2024-09-19T07:49:27.588790+0000","last_became_peered":"2024-09-19T07:49:27.588790+0000","last_unstale":"2024-09-19T07:51:12.886659+0000","last_undegraded":"2024-09-19T07:51:12.886659+0000","last_fullsized":"2024-09-19T07:51:12.886659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:42.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897046+0000","last_change":"2024-09-19T07:49:27.590884+0000","last_active":"2024-09-19T07:51:12.897046+0000","last_peered":"2024-09-19T07:51:12.897046+0000","last_clean":"2024-09-19T07:51:12.897046+0000","last_became_active":"2024-09-19T07:49:27.589875+0000","last_became_peered":"2024-09-19T07:49:27.589875+0000","last_unstale":"2024-09-19T07:51:12.897046+0000","last_undegraded":"2024-09-19T07:51:12.897046+0000","last_fullsized":"2024-09-19T07:51:12.897046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:26:55.257384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886916+0000","last_change":"2024-09-19T07:50:34.028762+0000","last_active":"2024-09-19T07:51:12.886916+0000","last_peered":"2024-09-19T07:51:12.886916+0000","last_clean":"2024-09-19T07:51:12.886916+0000","last_became_active":"2024-09-19T07:50:34.028343+0000","last_became_peered":"2024-09-19T07:50:34.028343+0000","last_unstale":"2024-09-19T07:51:12.886916+0000","last_undegraded":"2024-09-19T07:51:12.886916+0000","last_fullsized":"2024-09-19T07:51:12.886916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:37:08.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779564+0000","last_change":"2024-09-19T07:49:27.586623+0000","last_active":"2024-09-19T07:51:12.779564+0000","last_peered":"2024-09-19T07:51:12.779564+0000","last_clean":"2024-09-19T07:51:12.779564+0000","last_became_active":"2024-09-19T07:49:27.586289+0000","last_became_peered":"2024-09-19T07:49:27.586289+0000","last_unstale":"2024-09-19T07:51:12.779564+0000","last_undegraded":"2024-09-19T07:51:12.779564+0000","last_fullsized":"2024-09-19T07:51:12.779564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.539566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072980+0000","last_change":"2024-09-19T07:49:27.586659+0000","last_active":"2024-09-19T07:51:13.072980+0000","last_peered":"2024-09-19T07:51:13.072980+0000","last_clean":"2024-09-19T07:51:13.072980+0000","last_became_active":"2024-09-19T07:49:27.586275+0000","last_became_peered":"2024-09-19T07:49:27.586275+0000","last_unstale":"2024-09-19T07:51:13.072980+0000","last_undegraded":"2024-09-19T07:51:13.072980+0000","last_fullsized":"2024-09-19T07:51:13.072980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:58.277474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778090+0000","last_change":"2024-09-19T07:49:27.585991+0000","last_active":"2024-09-19T07:51:12.778090+0000","last_peered":"2024-09-19T07:51:12.778090+0000","last_clean":"2024-09-19T07:51:12.778090+0000","last_became_active":"2024-09-19T07:49:27.585671+0000","last_became_peered":"2024-09-19T07:49:27.585671+0000","last_unstale":"2024-09-19T07:51:12.778090+0000","last_undegraded":"2024-09-19T07:51:12.778090+0000","last_fullsized":"2024-09-19T07:51:12.778090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:27.810108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.052432+0000","last_change":"2024-09-19T07:49:27.595252+0000","last_active":"2024-09-19T07:51:13.052432+0000","last_peered":"2024-09-19T07:51:13.052432+0000","last_clean":"2024-09-19T07:51:13.052432+0000","last_became_active":"2024-09-19T07:49:27.594963+0000","last_became_peered":"2024-09-19T07:49:27.594963+0000","last_unstale":"2024-09-19T07:51:13.052432+0000","last_undegraded":"2024-09-19T07:51:13.052432+0000","last_fullsized":"2024-09-19T07:51:13.052432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:21.359072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779132+0000","last_change":"2024-09-19T07:49:27.588203+0000","last_active":"2024-09-19T07:51:12.779132+0000","last_peered":"2024-09-19T07:51:12.779132+0000","last_clean":"2024-09-19T07:51:12.779132+0000","last_became_active":"2024-09-19T07:49:27.587767+0000","last_became_peered":"2024-09-19T07:49:27.587767+0000","last_unstale":"2024-09-19T07:51:12.779132+0000","last_undegraded":"2024-09-19T07:51:12.779132+0000","last_fullsized":"2024-09-19T07:51:12.779132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:36.697543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779167+0000","last_change":"2024-09-19T07:49:27.590071+0000","last_active":"2024-09-19T07:51:12.779167+0000","last_peered":"2024-09-19T07:51:12.779167+0000","last_clean":"2024-09-19T07:51:12.779167+0000","last_became_active":"2024-09-19T07:49:27.589662+0000","last_became_peered":"2024-09-19T07:49:27.589662+0000","last_unstale":"2024-09-19T07:51:12.779167+0000","last_undegraded":"2024-09-19T07:51:12.779167+0000","last_fullsized":"2024-09-19T07:51:12.779167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:45.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.072859+0000","last_change":"2024-09-19T07:50:34.028399+0000","last_active":"2024-09-19T07:51:13.072859+0000","last_peered":"2024-09-19T07:51:13.072859+0000","last_clean":"2024-09-19T07:51:13.072859+0000","last_became_active":"2024-09-19T07:50:34.027948+0000","last_became_peered":"2024-09-19T07:50:34.027948+0000","last_unstale":"2024-09-19T07:51:13.072859+0000","last_undegraded":"2024-09-19T07:51:13.072859+0000","last_fullsized":"2024-09-19T07:51:13.072859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:36.822727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885803+0000","last_change":"2024-09-19T07:49:27.587484+0000","last_active":"2024-09-19T07:51:12.885803+0000","last_peered":"2024-09-19T07:51:12.885803+0000","last_clean":"2024-09-19T07:51:12.885803+0000","last_became_active":"2024-09-19T07:49:27.587159+0000","last_became_peered":"2024-09-19T07:49:27.587159+0000","last_unstale":"2024-09-19T07:51:12.885803+0000","last_undegraded":"2024-09-19T07:51:12.885803+0000","last_fullsized":"2024-09-19T07:51:12.885803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:57.594610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'9","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.782135+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:22.782135+0000","last_peered":"2024-09-19T07:51:22.782135+0000","last_clean":"2024-09-19T07:51:22.782135+0000","last_became_active":"2024-09-19T07:49:25.572792+0000","last_became_peered":"2024-09-19T07:49:25.572792+0000","last_unstale":"2024-09-19T07:51:22.782135+0000","last_undegraded":"2024-09-19T07:51:22.782135+0000","last_fullsized":"2024-09-19T07:51:22.782135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:51.563022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897140+0000","last_change":"2024-09-19T07:50:34.026626+0000","last_active":"2024-09-19T07:51:12.897140+0000","last_peered":"2024-09-19T07:51:12.897140+0000","last_clean":"2024-09-19T07:51:12.897140+0000","last_became_active":"2024-09-19T07:50:34.026058+0000","last_became_peered":"2024-09-19T07:50:34.026058+0000","last_unstale":"2024-09-19T07:51:12.897140+0000","last_undegraded":"2024-09-19T07:51:12.897140+0000","last_fullsized":"2024-09-19T07:51:12.897140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:22.700331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820706+0000","last_change":"2024-09-19T07:49:25.574298+0000","last_active":"2024-09-19T07:51:12.820706+0000","last_peered":"2024-09-19T07:51:12.820706+0000","last_clean":"2024-09-19T07:51:12.820706+0000","last_became_active":"2024-09-19T07:49:25.573985+0000","last_became_peered":"2024-09-19T07:49:25.573985+0000","last_unstale":"2024-09-19T07:51:12.820706+0000","last_undegraded":"2024-09-19T07:51:12.820706+0000","last_fullsized":"2024-09-19T07:51:12.820706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:31.715669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777625+0000","last_change":"2024-09-19T07:49:25.571290+0000","last_active":"2024-09-19T07:51:12.777625+0000","last_peered":"2024-09-19T07:51:12.777625+0000","last_clean":"2024-09-19T07:51:12.777625+0000","last_became_active":"2024-09-19T07:49:25.570953+0000","last_became_peered":"2024-09-19T07:49:25.570953+0000","last_unstale":"2024-09-19T07:51:12.777625+0000","last_undegraded":"2024-09-19T07:51:12.777625+0000","last_fullsized":"2024-09-19T07:51:12.777625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:26.108449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886790+0000","last_change":"2024-09-19T07:49:27.581072+0000","last_active":"2024-09-19T07:51:12.886790+0000","last_peered":"2024-09-19T07:51:12.886790+0000","last_clean":"2024-09-19T07:51:12.886790+0000","last_became_active":"2024-09-19T07:49:27.580759+0000","last_became_peered":"2024-09-19T07:49:27.580759+0000","last_unstale":"2024-09-19T07:51:12.886790+0000","last_undegraded":"2024-09-19T07:51:12.886790+0000","last_fullsized":"2024-09-19T07:51:12.886790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:09.105319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897268+0000","last_change":"2024-09-19T07:49:25.575000+0000","last_active":"2024-09-19T07:51:12.897268+0000","last_peered":"2024-09-19T07:51:12.897268+0000","last_clean":"2024-09-19T07:51:12.897268+0000","last_became_active":"2024-09-19T07:49:25.574682+0000","last_became_peered":"2024-09-19T07:49:25.574682+0000","last_unstale":"2024-09-19T07:51:12.897268+0000","last_undegraded":"2024-09-19T07:51:12.897268+0000","last_fullsized":"2024-09-19T07:51:12.897268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:12:50.949881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883449+0000","last_change":"2024-09-19T07:49:27.578019+0000","last_active":"2024-09-19T07:51:12.883449+0000","last_peered":"2024-09-19T07:51:12.883449+0000","last_clean":"2024-09-19T07:51:12.883449+0000","last_became_active":"2024-09-19T07:49:27.577687+0000","last_became_peered":"2024-09-19T07:49:27.577687+0000","last_unstale":"2024-09-19T07:51:12.883449+0000","last_undegraded":"2024-09-19T07:51:12.883449+0000","last_fullsized":"2024-09-19T07:51:12.883449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:29.712597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.781412+0000","last_change":"2024-09-19T07:49:25.571541+0000","last_active":"2024-09-19T07:51:22.781412+0000","last_peered":"2024-09-19T07:51:22.781412+0000","last_clean":"2024-09-19T07:51:22.781412+0000","last_became_active":"2024-09-19T07:49:25.571209+0000","last_became_peered":"2024-09-19T07:49:25.571209+0000","last_unstale":"2024-09-19T07:51:22.781412+0000","last_undegraded":"2024-09-19T07:51:22.781412+0000","last_fullsized":"2024-09-19T07:51:22.781412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.919401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779095+0000","last_change":"2024-09-19T07:49:27.587245+0000","last_active":"2024-09-19T07:51:12.779095+0000","last_peered":"2024-09-19T07:51:12.779095+0000","last_clean":"2024-09-19T07:51:12.779095+0000","last_became_active":"2024-09-19T07:49:27.586626+0000","last_became_peered":"2024-09-19T07:49:27.586626+0000","last_unstale":"2024-09-19T07:51:12.779095+0000","last_undegraded":"2024-09-19T07:51:12.779095+0000","last_fullsized":"2024-09-19T07:51:12.779095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:39.663677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085762+0000","last_change":"2024-09-19T07:50:34.356734+0000","last_active":"2024-09-19T07:51:13.085762+0000","last_peered":"2024-09-19T07:51:13.085762+0000","last_clean":"2024-09-19T07:51:13.085762+0000","last_became_active":"2024-09-19T07:50:34.350578+0000","last_became_peered":"2024-09-19T07:50:34.350578+0000","last_unstale":"2024-09-19T07:51:13.085762+0000","last_undegraded":"2024-09-19T07:51:13.085762+0000","last_fullsized":"2024-09-19T07:51:13.085762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:57.110465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053636+0000","last_change":"2024-09-19T07:49:27.593184+0000","last_active":"2024-09-19T07:51:13.053636+0000","last_peered":"2024-09-19T07:51:13.053636+0000","last_clean":"2024-09-19T07:51:13.053636+0000","last_became_active":"2024-09-19T07:49:27.592832+0000","last_became_peered":"2024-09-19T07:49:27.592832+0000","last_unstale":"2024-09-19T07:51:13.053636+0000","last_undegraded":"2024-09-19T07:51:13.053636+0000","last_fullsized":"2024-09-19T07:51:13.053636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:12.676505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897310+0000","last_change":"2024-09-19T07:49:25.772928+0000","last_active":"2024-09-19T07:51:12.897310+0000","last_peered":"2024-09-19T07:51:12.897310+0000","last_clean":"2024-09-19T07:51:12.897310+0000","last_became_active":"2024-09-19T07:49:25.772565+0000","last_became_peered":"2024-09-19T07:49:25.772565+0000","last_unstale":"2024-09-19T07:51:12.897310+0000","last_undegraded":"2024-09-19T07:51:12.897310+0000","last_fullsized":"2024-09-19T07:51:12.897310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:41.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778760+0000","last_change":"2024-09-19T07:49:27.590028+0000","last_active":"2024-09-19T07:51:12.778760+0000","last_peered":"2024-09-19T07:51:12.778760+0000","last_clean":"2024-09-19T07:51:12.778760+0000","last_became_active":"2024-09-19T07:49:27.589528+0000","last_became_peered":"2024-09-19T07:49:27.589528+0000","last_unstale":"2024-09-19T07:51:12.778760+0000","last_undegraded":"2024-09-19T07:51:12.778760+0000","last_fullsized":"2024-09-19T07:51:12.778760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:45.609517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:23.783165+0000","last_change":"2024-09-19T07:49:25.576345+0000","last_active":"2024-09-19T07:51:23.783165+0000","last_peered":"2024-09-19T07:51:23.783165+0000","last_clean":"2024-09-19T07:51:23.783165+0000","last_became_active":"2024-09-19T07:49:25.575960+0000","last_became_peered":"2024-09-19T07:49:25.575960+0000","last_unstale":"2024-09-19T07:51:23.783165+0000","last_undegraded":"2024-09-19T07:51:23.783165+0000","last_fullsized":"2024-09-19T07:51:23.783165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:41.692536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":227,"num_read_kb":179,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885917+0000","last_change":"2024-09-19T07:49:27.592082+0000","last_active":"2024-09-19T07:51:12.885917+0000","last_peered":"2024-09-19T07:51:12.885917+0000","last_clean":"2024-09-19T07:51:12.885917+0000","last_became_active":"2024-09-19T07:49:27.591801+0000","last_became_peered":"2024-09-19T07:49:27.591801+0000","last_unstale":"2024-09-19T07:51:12.885917+0000","last_undegraded":"2024-09-19T07:51:12.885917+0000","last_fullsized":"2024-09-19T07:51:12.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:02.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779272+0000","last_change":"2024-09-19T07:49:25.573182+0000","last_active":"2024-09-19T07:51:12.779272+0000","last_peered":"2024-09-19T07:51:12.779272+0000","last_clean":"2024-09-19T07:51:12.779272+0000","last_became_active":"2024-09-19T07:49:25.572617+0000","last_became_peered":"2024-09-19T07:49:25.572617+0000","last_unstale":"2024-09-19T07:51:12.779272+0000","last_undegraded":"2024-09-19T07:51:12.779272+0000","last_fullsized":"2024-09-19T07:51:12.779272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:47.615911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777765+0000","last_change":"2024-09-19T07:49:27.591570+0000","last_active":"2024-09-19T07:51:12.777765+0000","last_peered":"2024-09-19T07:51:12.777765+0000","last_clean":"2024-09-19T07:51:12.777765+0000","last_became_active":"2024-09-19T07:49:27.591286+0000","last_became_peered":"2024-09-19T07:49:27.591286+0000","last_unstale":"2024-09-19T07:51:12.777765+0000","last_undegraded":"2024-09-19T07:51:12.777765+0000","last_fullsized":"2024-09-19T07:51:12.777765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:00.944810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897105+0000","last_change":"2024-09-19T07:49:25.576821+0000","last_active":"2024-09-19T07:51:12.897105+0000","last_peered":"2024-09-19T07:51:12.897105+0000","last_clean":"2024-09-19T07:51:12.897105+0000","last_became_active":"2024-09-19T07:49:25.576493+0000","last_became_peered":"2024-09-19T07:49:25.576493+0000","last_unstale":"2024-09-19T07:51:12.897105+0000","last_undegraded":"2024-09-19T07:51:12.897105+0000","last_fullsized":"2024-09-19T07:51:12.897105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:57.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085518+0000","last_change":"2024-09-19T07:49:27.596182+0000","last_active":"2024-09-19T07:51:13.085518+0000","last_peered":"2024-09-19T07:51:13.085518+0000","last_clean":"2024-09-19T07:51:13.085518+0000","last_became_active":"2024-09-19T07:49:27.595855+0000","last_became_peered":"2024-09-19T07:49:27.595855+0000","last_unstale":"2024-09-19T07:51:13.085518+0000","last_undegraded":"2024-09-19T07:51:13.085518+0000","last_fullsized":"2024-09-19T07:51:13.085518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.836952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:21.803523+0000","last_change":"2024-09-19T07:49:25.572626+0000","last_active":"2024-09-19T07:51:21.803523+0000","last_peered":"2024-09-19T07:51:21.803523+0000","last_clean":"2024-09-19T07:51:21.803523+0000","last_became_active":"2024-09-19T07:49:25.572273+0000","last_became_peered":"2024-09-19T07:49:25.572273+0000","last_unstale":"2024-09-19T07:51:21.803523+0000","last_undegraded":"2024-09-19T07:51:21.803523+0000","last_fullsized":"2024-09-19T07:51:21.803523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:11.026079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085252+0000","last_change":"2024-09-19T07:49:27.590188+0000","last_active":"2024-09-19T07:51:13.085252+0000","last_peered":"2024-09-19T07:51:13.085252+0000","last_clean":"2024-09-19T07:51:13.085252+0000","last_became_active":"2024-09-19T07:49:27.589851+0000","last_became_peered":"2024-09-19T07:49:27.589851+0000","last_unstale":"2024-09-19T07:51:13.085252+0000","last_undegraded":"2024-09-19T07:51:13.085252+0000","last_fullsized":"2024-09-19T07:51:13.085252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.846569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:25.773691+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:25.772608+0000","last_became_peered":"2024-09-19T07:49:25.772608+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884108+0000","last_change":"2024-09-19T07:50:34.349498+0000","last_active":"2024-09-19T07:51:12.884108+0000","last_peered":"2024-09-19T07:51:12.884108+0000","last_clean":"2024-09-19T07:51:12.884108+0000","last_became_active":"2024-09-19T07:50:34.349238+0000","last_became_peered":"2024-09-19T07:50:34.349238+0000","last_unstale":"2024-09-19T07:51:12.884108+0000","last_undegraded":"2024-09-19T07:51:12.884108+0000","last_fullsized":"2024-09-19T07:51:12.884108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:40.879641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885913+0000","last_change":"2024-09-19T07:49:25.571222+0000","last_active":"2024-09-19T07:51:12.885913+0000","last_peered":"2024-09-19T07:51:12.885913+0000","last_clean":"2024-09-19T07:51:12.885913+0000","last_became_active":"2024-09-19T07:49:25.570854+0000","last_became_peered":"2024-09-19T07:49:25.570854+0000","last_unstale":"2024-09-19T07:51:12.885913+0000","last_undegraded":"2024-09-19T07:51:12.885913+0000","last_fullsized":"2024-09-19T07:51:12.885913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:03.799889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073006+0000","last_change":"2024-09-19T07:49:27.593900+0000","last_active":"2024-09-19T07:51:13.073006+0000","last_peered":"2024-09-19T07:51:13.073006+0000","last_clean":"2024-09-19T07:51:13.073006+0000","last_became_active":"2024-09-19T07:49:27.593514+0000","last_became_peered":"2024-09-19T07:49:27.593514+0000","last_unstale":"2024-09-19T07:51:13.073006+0000","last_undegraded":"2024-09-19T07:51:13.073006+0000","last_fullsized":"2024-09-19T07:51:13.073006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:29.491208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778040+0000","last_change":"2024-09-19T07:49:25.572474+0000","last_active":"2024-09-19T07:51:12.778040+0000","last_peered":"2024-09-19T07:51:12.778040+0000","last_clean":"2024-09-19T07:51:12.778040+0000","last_became_active":"2024-09-19T07:49:25.571984+0000","last_became_peered":"2024-09-19T07:49:25.571984+0000","last_unstale":"2024-09-19T07:51:12.778040+0000","last_undegraded":"2024-09-19T07:51:12.778040+0000","last_fullsized":"2024-09-19T07:51:12.778040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:13.418924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085798+0000","last_change":"2024-09-19T07:49:27.598238+0000","last_active":"2024-09-19T07:51:13.085798+0000","last_peered":"2024-09-19T07:51:13.085798+0000","last_clean":"2024-09-19T07:51:13.085798+0000","last_became_active":"2024-09-19T07:49:27.597585+0000","last_became_peered":"2024-09-19T07:49:27.597585+0000","last_unstale":"2024-09-19T07:51:13.085798+0000","last_undegraded":"2024-09-19T07:51:13.085798+0000","last_fullsized":"2024-09-19T07:51:13.085798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:23.334216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'65","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.114910+0000","last_change":"2024-09-19T07:49:25.575391+0000","last_active":"2024-09-19T07:51:22.114910+0000","last_peered":"2024-09-19T07:51:22.114910+0000","last_clean":"2024-09-19T07:51:22.114910+0000","last_became_active":"2024-09-19T07:49:25.575010+0000","last_became_peered":"2024-09-19T07:49:25.575010+0000","last_unstale":"2024-09-19T07:51:22.114910+0000","last_undegraded":"2024-09-19T07:51:22.114910+0000","last_fullsized":"2024-09-19T07:51:22.114910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:47.465685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085413+0000","last_change":"2024-09-19T07:49:27.590000+0000","last_active":"2024-09-19T07:51:13.085413+0000","last_peered":"2024-09-19T07:51:13.085413+0000","last_clean":"2024-09-19T07:51:13.085413+0000","last_became_active":"2024-09-19T07:49:27.589552+0000","last_became_peered":"2024-09-19T07:49:27.589552+0000","last_unstale":"2024-09-19T07:51:13.085413+0000","last_undegraded":"2024-09-19T07:51:13.085413+0000","last_fullsized":"2024-09-19T07:51:13.085413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.502220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779460+0000","last_change":"2024-09-19T07:49:25.772365+0000","last_active":"2024-09-19T07:51:12.779460+0000","last_peered":"2024-09-19T07:51:12.779460+0000","last_clean":"2024-09-19T07:51:12.779460+0000","last_became_active":"2024-09-19T07:49:25.771959+0000","last_became_peered":"2024-09-19T07:49:25.771959+0000","last_unstale":"2024-09-19T07:51:12.779460+0000","last_undegraded":"2024-09-19T07:51:12.779460+0000","last_fullsized":"2024-09-19T07:51:12.779460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:10.015014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085732+0000","last_change":"2024-09-19T07:49:27.598556+0000","last_active":"2024-09-19T07:51:13.085732+0000","last_peered":"2024-09-19T07:51:13.085732+0000","last_clean":"2024-09-19T07:51:13.085732+0000","last_became_active":"2024-09-19T07:49:27.598169+0000","last_became_peered":"2024-09-19T07:49:27.598169+0000","last_unstale":"2024-09-19T07:51:13.085732+0000","last_undegraded":"2024-09-19T07:51:13.085732+0000","last_fullsized":"2024-09-19T07:51:13.085732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.298830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"85'148","reported_seq":395,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:14.891705+0000","last_change":"2024-09-19T07:48:11.863286+0000","last_active":"2024-09-19T07:51:14.891705+0000","last_peered":"2024-09-19T07:51:14.891705+0000","last_clean":"2024-09-19T07:51:14.891705+0000","last_became_active":"2024-09-19T07:48:11.862802+0000","last_became_peered":"2024-09-19T07:48:11.862802+0000","last_unstale":"2024-09-19T07:51:14.891705+0000","last_undegraded":"2024-09-19T07:51:14.891705+0000","last_fullsized":"2024-09-19T07:51:14.891705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:44:47.196619+0000","last_clean_scrub_stamp":"2024-09-19T07:44:47.196619+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:40.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786233+0000","last_change":"2024-09-19T07:49:25.569488+0000","last_active":"2024-09-19T07:51:12.786233+0000","last_peered":"2024-09-19T07:51:12.786233+0000","last_clean":"2024-09-19T07:51:12.786233+0000","last_became_active":"2024-09-19T07:49:25.569094+0000","last_became_peered":"2024-09-19T07:49:25.569094+0000","last_unstale":"2024-09-19T07:51:12.786233+0000","last_undegraded":"2024-09-19T07:51:12.786233+0000","last_fullsized":"2024-09-19T07:51:12.786233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:20.399158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.883560+0000","last_change":"2024-09-19T07:50:34.028464+0000","last_active":"2024-09-19T07:51:12.883560+0000","last_peered":"2024-09-19T07:51:12.883560+0000","last_clean":"2024-09-19T07:51:12.883560+0000","last_became_active":"2024-09-19T07:50:34.028078+0000","last_became_peered":"2024-09-19T07:50:34.028078+0000","last_unstale":"2024-09-19T07:51:12.883560+0000","last_undegraded":"2024-09-19T07:51:12.883560+0000","last_fullsized":"2024-09-19T07:51:12.883560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:33.498575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085358+0000","last_change":"2024-09-19T07:49:25.572939+0000","last_active":"2024-09-19T07:51:13.085358+0000","last_peered":"2024-09-19T07:51:13.085358+0000","last_clean":"2024-09-19T07:51:13.085358+0000","last_became_active":"2024-09-19T07:49:25.572356+0000","last_became_peered":"2024-09-19T07:49:25.572356+0000","last_unstale":"2024-09-19T07:51:13.085358+0000","last_undegraded":"2024-09-19T07:51:13.085358+0000","last_fullsized":"2024-09-19T07:51:13.085358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:38.614823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.777583+0000","last_change":"2024-09-19T07:49:27.589574+0000","last_active":"2024-09-19T07:51:12.777583+0000","last_peered":"2024-09-19T07:51:12.777583+0000","last_clean":"2024-09-19T07:51:12.777583+0000","last_became_active":"2024-09-19T07:49:27.588622+0000","last_became_peered":"2024-09-19T07:49:27.588622+0000","last_unstale":"2024-09-19T07:51:12.777583+0000","last_undegraded":"2024-09-19T07:51:12.777583+0000","last_fullsized":"2024-09-19T07:51:12.777583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:09.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:21.802849+0000","last_change":"2024-09-19T07:49:25.771569+0000","last_active":"2024-09-19T07:51:21.802849+0000","last_peered":"2024-09-19T07:51:21.802849+0000","last_clean":"2024-09-19T07:51:21.802849+0000","last_became_active":"2024-09-19T07:49:25.771244+0000","last_became_peered":"2024-09-19T07:49:25.771244+0000","last_unstale":"2024-09-19T07:51:21.802849+0000","last_undegraded":"2024-09-19T07:51:21.802849+0000","last_fullsized":"2024-09-19T07:51:21.802849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:00.879472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897052+0000","last_change":"2024-09-19T07:49:27.596780+0000","last_active":"2024-09-19T07:51:12.897052+0000","last_peered":"2024-09-19T07:51:12.897052+0000","last_clean":"2024-09-19T07:51:12.897052+0000","last_became_active":"2024-09-19T07:49:27.596451+0000","last_became_peered":"2024-09-19T07:49:27.596451+0000","last_unstale":"2024-09-19T07:51:12.897052+0000","last_undegraded":"2024-09-19T07:51:12.897052+0000","last_fullsized":"2024-09-19T07:51:12.897052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:11.198721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085545+0000","last_change":"2024-09-19T07:49:25.570420+0000","last_active":"2024-09-19T07:51:13.085545+0000","last_peered":"2024-09-19T07:51:13.085545+0000","last_clean":"2024-09-19T07:51:13.085545+0000","last_became_active":"2024-09-19T07:49:25.569994+0000","last_became_peered":"2024-09-19T07:49:25.569994+0000","last_unstale":"2024-09-19T07:51:13.085545+0000","last_undegraded":"2024-09-19T07:51:13.085545+0000","last_fullsized":"2024-09-19T07:51:13.085545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.151016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820738+0000","last_change":"2024-09-19T07:49:27.594564+0000","last_active":"2024-09-19T07:51:12.820738+0000","last_peered":"2024-09-19T07:51:12.820738+0000","last_clean":"2024-09-19T07:51:12.820738+0000","last_became_active":"2024-09-19T07:49:27.594263+0000","last_became_peered":"2024-09-19T07:49:27.594263+0000","last_unstale":"2024-09-19T07:51:12.820738+0000","last_undegraded":"2024-09-19T07:51:12.820738+0000","last_fullsized":"2024-09-19T07:51:12.820738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:23.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884217+0000","last_change":"2024-09-19T07:49:25.772534+0000","last_active":"2024-09-19T07:51:12.884217+0000","last_peered":"2024-09-19T07:51:12.884217+0000","last_clean":"2024-09-19T07:51:12.884217+0000","last_became_active":"2024-09-19T07:49:25.772196+0000","last_became_peered":"2024-09-19T07:49:25.772196+0000","last_unstale":"2024-09-19T07:51:12.884217+0000","last_undegraded":"2024-09-19T07:51:12.884217+0000","last_fullsized":"2024-09-19T07:51:12.884217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:24.532279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.820842+0000","last_change":"2024-09-19T07:49:27.579268+0000","last_active":"2024-09-19T07:51:12.820842+0000","last_peered":"2024-09-19T07:51:12.820842+0000","last_clean":"2024-09-19T07:51:12.820842+0000","last_became_active":"2024-09-19T07:49:27.578796+0000","last_became_peered":"2024-09-19T07:49:27.578796+0000","last_unstale":"2024-09-19T07:51:12.820842+0000","last_undegraded":"2024-09-19T07:51:12.820842+0000","last_fullsized":"2024-09-19T07:51:12.820842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:02.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886077+0000","last_change":"2024-09-19T07:49:25.773362+0000","last_active":"2024-09-19T07:51:12.886077+0000","last_peered":"2024-09-19T07:51:12.886077+0000","last_clean":"2024-09-19T07:51:12.886077+0000","last_became_active":"2024-09-19T07:49:25.772845+0000","last_became_peered":"2024-09-19T07:49:25.772845+0000","last_unstale":"2024-09-19T07:51:12.886077+0000","last_undegraded":"2024-09-19T07:51:12.886077+0000","last_fullsized":"2024-09-19T07:51:12.886077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:16.792638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778175+0000","last_change":"2024-09-19T07:49:27.589405+0000","last_active":"2024-09-19T07:51:12.778175+0000","last_peered":"2024-09-19T07:51:12.778175+0000","last_clean":"2024-09-19T07:51:12.778175+0000","last_became_active":"2024-09-19T07:49:27.589124+0000","last_became_peered":"2024-09-19T07:49:27.589124+0000","last_unstale":"2024-09-19T07:51:12.778175+0000","last_undegraded":"2024-09-19T07:51:12.778175+0000","last_fullsized":"2024-09-19T07:51:12.778175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:34.620845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'102","reported_seq":218,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:22.451935+0000","last_change":"2024-09-19T07:49:25.567250+0000","last_active":"2024-09-19T07:51:22.451935+0000","last_peered":"2024-09-19T07:51:22.451935+0000","last_clean":"2024-09-19T07:51:22.451935+0000","last_became_active":"2024-09-19T07:49:25.566695+0000","last_became_peered":"2024-09-19T07:49:25.566695+0000","last_unstale":"2024-09-19T07:51:22.451935+0000","last_undegraded":"2024-09-19T07:51:22.451935+0000","last_fullsized":"2024-09-19T07:51:22.451935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:42.689647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887028+0000","last_change":"2024-09-19T07:49:27.591337+0000","last_active":"2024-09-19T07:51:12.887028+0000","last_peered":"2024-09-19T07:51:12.887028+0000","last_clean":"2024-09-19T07:51:12.887028+0000","last_became_active":"2024-09-19T07:49:27.591041+0000","last_became_peered":"2024-09-19T07:49:27.591041+0000","last_unstale":"2024-09-19T07:51:12.887028+0000","last_undegraded":"2024-09-19T07:51:12.887028+0000","last_fullsized":"2024-09-19T07:51:12.887028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:53.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.786476+0000","last_change":"2024-09-19T07:49:25.606998+0000","last_active":"2024-09-19T07:51:12.786476+0000","last_peered":"2024-09-19T07:51:12.786476+0000","last_clean":"2024-09-19T07:51:12.786476+0000","last_became_active":"2024-09-19T07:49:25.606680+0000","last_became_peered":"2024-09-19T07:49:25.606680+0000","last_unstale":"2024-09-19T07:51:12.786476+0000","last_undegraded":"2024-09-19T07:51:12.786476+0000","last_fullsized":"2024-09-19T07:51:12.786476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:56.839882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053199+0000","last_change":"2024-09-19T07:49:27.595180+0000","last_active":"2024-09-19T07:51:13.053199+0000","last_peered":"2024-09-19T07:51:13.053199+0000","last_clean":"2024-09-19T07:51:13.053199+0000","last_became_active":"2024-09-19T07:49:27.594853+0000","last_became_peered":"2024-09-19T07:49:27.594853+0000","last_unstale":"2024-09-19T07:51:13.053199+0000","last_undegraded":"2024-09-19T07:51:13.053199+0000","last_fullsized":"2024-09-19T07:51:13.053199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778663+0000","last_change":"2024-09-19T07:49:25.771590+0000","last_active":"2024-09-19T07:51:12.778663+0000","last_peered":"2024-09-19T07:51:12.778663+0000","last_clean":"2024-09-19T07:51:12.778663+0000","last_became_active":"2024-09-19T07:49:25.771224+0000","last_became_peered":"2024-09-19T07:49:25.771224+0000","last_unstale":"2024-09-19T07:51:12.778663+0000","last_undegraded":"2024-09-19T07:51:12.778663+0000","last_fullsized":"2024-09-19T07:51:12.778663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.438482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885719+0000","last_change":"2024-09-19T07:49:27.587281+0000","last_active":"2024-09-19T07:51:12.885719+0000","last_peered":"2024-09-19T07:51:12.885719+0000","last_clean":"2024-09-19T07:51:12.885719+0000","last_became_active":"2024-09-19T07:49:27.586835+0000","last_became_peered":"2024-09-19T07:49:27.586835+0000","last_unstale":"2024-09-19T07:51:12.885719+0000","last_undegraded":"2024-09-19T07:51:12.885719+0000","last_fullsized":"2024-09-19T07:51:12.885719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:12.934869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886882+0000","last_change":"2024-09-19T07:49:25.569445+0000","last_active":"2024-09-19T07:51:12.886882+0000","last_peered":"2024-09-19T07:51:12.886882+0000","last_clean":"2024-09-19T07:51:12.886882+0000","last_became_active":"2024-09-19T07:49:25.569129+0000","last_became_peered":"2024-09-19T07:49:25.569129+0000","last_unstale":"2024-09-19T07:51:12.886882+0000","last_undegraded":"2024-09-19T07:51:12.886882+0000","last_fullsized":"2024-09-19T07:51:12.886882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.373454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.073002+0000","last_change":"2024-09-19T07:49:27.595415+0000","last_active":"2024-09-19T07:51:13.073002+0000","last_peered":"2024-09-19T07:51:13.073002+0000","last_clean":"2024-09-19T07:51:13.073002+0000","last_became_active":"2024-09-19T07:49:27.595095+0000","last_became_peered":"2024-09-19T07:49:27.595095+0000","last_unstale":"2024-09-19T07:51:13.073002+0000","last_undegraded":"2024-09-19T07:51:13.073002+0000","last_fullsized":"2024-09-19T07:51:13.073002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:49.892861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.779211+0000","last_change":"2024-09-19T07:49:25.574915+0000","last_active":"2024-09-19T07:51:12.779211+0000","last_peered":"2024-09-19T07:51:12.779211+0000","last_clean":"2024-09-19T07:51:12.779211+0000","last_became_active":"2024-09-19T07:49:25.574579+0000","last_became_peered":"2024-09-19T07:49:25.574579+0000","last_unstale":"2024-09-19T07:51:12.779211+0000","last_undegraded":"2024-09-19T07:51:12.779211+0000","last_fullsized":"2024-09-19T07:51:12.779211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:29.901996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887345+0000","last_change":"2024-09-19T07:49:27.583024+0000","last_active":"2024-09-19T07:51:12.887345+0000","last_peered":"2024-09-19T07:51:12.887345+0000","last_clean":"2024-09-19T07:51:12.887345+0000","last_became_active":"2024-09-19T07:49:27.582715+0000","last_became_peered":"2024-09-19T07:49:27.582715+0000","last_unstale":"2024-09-19T07:51:12.887345+0000","last_undegraded":"2024-09-19T07:51:12.887345+0000","last_fullsized":"2024-09-19T07:51:12.887345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:19.553378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.885828+0000","last_change":"2024-09-19T07:49:25.573806+0000","last_active":"2024-09-19T07:51:12.885828+0000","last_peered":"2024-09-19T07:51:12.885828+0000","last_clean":"2024-09-19T07:51:12.885828+0000","last_became_active":"2024-09-19T07:49:25.572630+0000","last_became_peered":"2024-09-19T07:49:25.572630+0000","last_unstale":"2024-09-19T07:51:12.885828+0000","last_undegraded":"2024-09-19T07:51:12.885828+0000","last_fullsized":"2024-09-19T07:51:12.885828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:46.831925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.085403+0000","last_change":"2024-09-19T07:49:27.599461+0000","last_active":"2024-09-19T07:51:13.085403+0000","last_peered":"2024-09-19T07:51:13.085403+0000","last_clean":"2024-09-19T07:51:13.085403+0000","last_became_active":"2024-09-19T07:49:27.598783+0000","last_became_peered":"2024-09-19T07:49:27.598783+0000","last_unstale":"2024-09-19T07:51:13.085403+0000","last_undegraded":"2024-09-19T07:51:13.085403+0000","last_fullsized":"2024-09-19T07:51:13.085403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:59.213052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.897311+0000","last_change":"2024-09-19T07:49:27.597687+0000","last_active":"2024-09-19T07:51:12.897311+0000","last_peered":"2024-09-19T07:51:12.897311+0000","last_clean":"2024-09-19T07:51:12.897311+0000","last_became_active":"2024-09-19T07:49:27.597383+0000","last_became_peered":"2024-09-19T07:49:27.597383+0000","last_unstale":"2024-09-19T07:51:12.897311+0000","last_undegraded":"2024-09-19T07:51:12.897311+0000","last_fullsized":"2024-09-19T07:51:12.897311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:59.716809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886120+0000","last_change":"2024-09-19T07:49:25.571216+0000","last_active":"2024-09-19T07:51:12.886120+0000","last_peered":"2024-09-19T07:51:12.886120+0000","last_clean":"2024-09-19T07:51:12.886120+0000","last_became_active":"2024-09-19T07:49:25.570844+0000","last_became_peered":"2024-09-19T07:49:25.570844+0000","last_unstale":"2024-09-19T07:51:12.886120+0000","last_undegraded":"2024-09-19T07:51:12.886120+0000","last_fullsized":"2024-09-19T07:51:12.886120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:35.156832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.778673+0000","last_change":"2024-09-19T07:49:27.587909+0000","last_active":"2024-09-19T07:51:12.778673+0000","last_peered":"2024-09-19T07:51:12.778673+0000","last_clean":"2024-09-19T07:51:12.778673+0000","last_became_active":"2024-09-19T07:49:27.587541+0000","last_became_peered":"2024-09-19T07:49:27.587541+0000","last_unstale":"2024-09-19T07:51:12.778673+0000","last_undegraded":"2024-09-19T07:51:12.778673+0000","last_fullsized":"2024-09-19T07:51:12.778673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:59.091037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886035+0000","last_change":"2024-09-19T07:50:34.354839+0000","last_active":"2024-09-19T07:51:12.886035+0000","last_peered":"2024-09-19T07:51:12.886035+0000","last_clean":"2024-09-19T07:51:12.886035+0000","last_became_active":"2024-09-19T07:50:34.350424+0000","last_became_peered":"2024-09-19T07:50:34.350424+0000","last_unstale":"2024-09-19T07:51:12.886035+0000","last_undegraded":"2024-09-19T07:51:12.886035+0000","last_fullsized":"2024-09-19T07:51:12.886035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:36.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:13.053516+0000","last_change":"2024-09-19T07:49:27.585723+0000","last_active":"2024-09-19T07:51:13.053516+0000","last_peered":"2024-09-19T07:51:13.053516+0000","last_clean":"2024-09-19T07:51:13.053516+0000","last_became_active":"2024-09-19T07:49:27.585437+0000","last_became_peered":"2024-09-19T07:49:27.585437+0000","last_unstale":"2024-09-19T07:51:13.053516+0000","last_undegraded":"2024-09-19T07:51:13.053516+0000","last_fullsized":"2024-09-19T07:51:13.053516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:57.287466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.887230+0000","last_change":"2024-09-19T07:49:25.772639+0000","last_active":"2024-09-19T07:51:12.887230+0000","last_peered":"2024-09-19T07:51:12.887230+0000","last_clean":"2024-09-19T07:51:12.887230+0000","last_became_active":"2024-09-19T07:49:25.772278+0000","last_became_peered":"2024-09-19T07:49:25.772278+0000","last_unstale":"2024-09-19T07:51:12.887230+0000","last_undegraded":"2024-09-19T07:51:12.887230+0000","last_fullsized":"2024-09-19T07:51:12.887230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.234922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.886656+0000","last_change":"2024-09-19T07:49:27.590138+0000","last_active":"2024-09-19T07:51:12.886656+0000","last_peered":"2024-09-19T07:51:12.886656+0000","last_clean":"2024-09-19T07:51:12.886656+0000","last_became_active":"2024-09-19T07:49:27.589836+0000","last_became_peered":"2024-09-19T07:49:27.589836+0000","last_unstale":"2024-09-19T07:51:12.886656+0000","last_undegraded":"2024-09-19T07:51:12.886656+0000","last_fullsized":"2024-09-19T07:51:12.886656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:26.558074+0000","last_clean_scrub_stamp":"2024-09-19T07:49:26.558074+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.888736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T07:51:12.884356+0000","last_change":"2024-09-19T07:50:34.034480+0000","last_active":"2024-09-19T07:51:12.884356+0000","last_peered":"2024-09-19T07:51:12.884356+0000","last_clean":"2024-09-19T07:51:12.884356+0000","last_became_active":"2024-09-19T07:50:34.027982+0000","last_became_peered":"2024-09-19T07:50:34.027982+0000","last_unstale":"2024-09-19T07:51:12.884356+0000","last_undegraded":"2024-09-19T07:51:12.884356+0000","last_fullsized":"2024-09-19T07:51:12.884356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:49:24.549160+0000","last_clean_scrub_stamp":"2024-09-19T07:49:24.549160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:40.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":793251,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1021,"num_read_kb":724,"num_write":418,"num_write_kb":2349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":651264,"data_stored":2379753,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107415,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514533,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":450902,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743466,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1122304,"data_stored":1437488,"data_compressed":59681,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906991,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":844354,"data_compressed":27963,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":843692,"data_compressed":27963,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1044310,"data_compressed":44479,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":450527,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1371833,"data_compressed":59681,"data_compressed_allocated":77824,"data_compressed_original":921600,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":451357,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1007616,"data_stored":1172286,"data_compressed":43165,"data_compressed_allocated":57344,"data_compressed_original":724992,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":519470,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":517382,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":451798,"data_compressed":8674,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35805,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":721732,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":331028,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":396683,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:51:28.226 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:28.473 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:28.925 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:28 smithi076 ceph-mon[30930]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-09-19T07:51:28.925 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:28 smithi076 ceph-mon[30930]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.003+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3764993077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 msgr2=0x7f5cb810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.003+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3764993077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb810ec40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009930 tx=0x7f5cb002a440 comp rx=0 tx=0).stop 2024-09-19T07:51:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3764993077 shutdown_connections 2024-09-19T07:51:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3764993077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb810ec40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3764993077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 0x7f5cb8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3764993077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cb8102d30 0x7f5cb8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3764993077 >> 172.21.15.76:0/3764993077 conn(0x7f5cb80fc7d0 msgr2=0x7f5cb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3764993077 shutdown_connections 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3764993077 wait complete. 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 Processor -- start 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.004+0000 7f5cbcfc2640 1 -- start start 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cb8102d30 0x7f5cb81a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 0x7f5cb81a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb8112240 con 0x7f5cb81082a0 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81120c0 con 0x7f5cb81036e0 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb81123c0 con 0x7f5cb8102d30 2024-09-19T07:51:29.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43622/0 (socket says 172.21.15.76:43622) 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 -- 172.21.15.76:0/3547627890 learned_addr learned my addr 172.21.15.76:0/3547627890 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb659c640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cb8102d30 0x7f5cb81a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb5d9b640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 0x7f5cb81a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 -- 172.21.15.76:0/3547627890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cb8102d30 msgr2=0x7f5cb81a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cb8102d30 0x7f5cb81a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 -- 172.21.15.76:0/3547627890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 msgr2=0x7f5cb81a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 0x7f5cb81a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 -- 172.21.15.76:0/3547627890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb819af50 con 0x7f5cb81082a0 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb5d9b640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 0x7f5cb81a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cb6d9d640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb819a6e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0004770 tx=0x7f5cb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb003f030 con 0x7f5cb81082a0 2024-09-19T07:51:29.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cb0003d00 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb819b1e0 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.005+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0035070 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.006+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb81a73c0 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.007+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb806a850 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.008+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f5cb0042030 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.008+0000 7f5ca77fe640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ca00a3440 0x7f5ca00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.008+0000 7f5cb659c640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ca00a3440 0x7f5ca00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.008+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f5cb00f0800 con 0x7f5cb81082a0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.009+0000 7f5cb659c640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ca00a3440 0x7f5ca00a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8005fd0 tx=0x7f5ca8009870 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:29.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.011+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5cb00bd070 con 0x7f5cb81082a0 2024-09-19T07:51:29.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:28 smithi152 ceph-mon[35117]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-09-19T07:51:29.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:28 smithi152 ceph-mon[35117]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:29.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:28 smithi137 ceph-mon[35309]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-09-19T07:51:29.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:28 smithi137 ceph-mon[35309]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:51:29.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.215+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cb810c2c0 con 0x7f5cb81082a0 2024-09-19T07:51:29.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.216+0000 7f5ca77fe640 1 -- 172.21.15.76:0/3547627890 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f5cb00bc970 con 0x7f5cb81082a0 2024-09-19T07:51:29.216 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:29.216 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:29.216 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:29.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ca00a3440 msgr2=0x7f5ca00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:29.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ca00a3440 0x7f5ca00a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8005fd0 tx=0x7f5ca8009870 comp rx=0 tx=0).stop 2024-09-19T07:51:29.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 msgr2=0x7f5cb819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb819a6e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0004770 tx=0x7f5cb00042f0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 shutdown_connections 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5ca00a3440 0x7f5ca00a5900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5cb81082a0 0x7f5cb819a6e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cb81036e0 0x7f5cb81a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 --2- 172.21.15.76:0/3547627890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cb8102d30 0x7f5cb81a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 >> 172.21.15.76:0/3547627890 conn(0x7f5cb80fc7d0 msgr2=0x7f5cb81011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 shutdown_connections 2024-09-19T07:51:29.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:29.218+0000 7f5cbcfc2640 1 -- 172.21.15.76:0/3547627890 wait complete. 2024-09-19T07:51:29.877 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:29 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3547627890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:30.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:29 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3547627890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:30.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:29 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3547627890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:30.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 -- 172.21.15.76:0/3866391281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 msgr2=0x7f35e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:30.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/3866391281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e4106e60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009cd0 tx=0x7f35d402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 -- 172.21.15.76:0/3866391281 shutdown_connections 2024-09-19T07:51:30.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/3866391281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35e4101420 0x7f35e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/3866391281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35e4100a80 0x7f35e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/3866391281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e4106e60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 -- 172.21.15.76:0/3866391281 >> 172.21.15.76:0/3866391281 conn(0x7f35e40fc7a0 msgr2=0x7f35e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 -- 172.21.15.76:0/3866391281 shutdown_connections 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.624+0000 7f35e9b8b640 1 -- 172.21.15.76:0/3866391281 wait complete. 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 Processor -- start 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 -- start start 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35e4100a80 0x7f35e419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35e4101420 0x7f35e419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f35e4110fa0 con 0x7f35e4106a80 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35e4110e20 con 0x7f35e4100a80 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.625+0000 7f35e9b8b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f35e4111120 con 0x7f35e4101420 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:30.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43642/0 (socket says 172.21.15.76:43642) 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 -- 172.21.15.76:0/1121817752 learned_addr learned my addr 172.21.15.76:0/1121817752 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e2ffd640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35e4101420 0x7f35e419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e37fe640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35e4100a80 0x7f35e419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 -- 172.21.15.76:0/1121817752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35e4101420 msgr2=0x7f35e419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35e4101420 0x7f35e419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 -- 172.21.15.76:0/1121817752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35e4100a80 msgr2=0x7f35e419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35e4100a80 0x7f35e419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 -- 172.21.15.76:0/1121817752 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e419f6b0 con 0x7f35e4106a80 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e3fff640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e419efd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c970 tx=0x7f35dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc007bb0 con 0x7f35e4106a80 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f35dc007d50 con 0x7f35e4106a80 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc00f450 con 0x7f35e4106a80 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e419f9a0 con 0x7f35e4106a80 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.626+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e41a7280 con 0x7f35e4106a80 2024-09-19T07:51:30.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.627+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e4100ee0 con 0x7f35e4106a80 2024-09-19T07:51:30.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.629+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f35dc005000 con 0x7f35e4106a80 2024-09-19T07:51:30.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.629+0000 7f35e0ff9640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f35cc0a34c0 0x7f35cc0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:30.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.629+0000 7f35e37fe640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f35cc0a34c0 0x7f35cc0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:30.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.629+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f35dc0cfdc0 con 0x7f35e4106a80 2024-09-19T07:51:30.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.630+0000 7f35e37fe640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f35cc0a34c0 0x7f35cc0a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35d4006010 tx=0x7f35d4031000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:30.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.632+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35dc014030 con 0x7f35e4106a80 2024-09-19T07:51:30.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.833+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35e419ba60 con 0x7f35e4106a80 2024-09-19T07:51:30.834 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:30 smithi076 ceph-mon[30930]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-09-19T07:51:30.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.834+0000 7f35e0ff9640 1 -- 172.21.15.76:0/1121817752 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f35e419ba60 con 0x7f35e4106a80 2024-09-19T07:51:30.834 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:30.835 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:30.835 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:30.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f35cc0a34c0 msgr2=0x7f35cc0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:30.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f35cc0a34c0 0x7f35cc0a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35d4006010 tx=0x7f35d4031000 comp rx=0 tx=0).stop 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 msgr2=0x7f35e419efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e419efd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c970 tx=0x7f35dc00ce30 comp rx=0 tx=0).stop 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 shutdown_connections 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f35cc0a34c0 0x7f35cc0a5980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f35e4106a80 0x7f35e419efd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35e4101420 0x7f35e419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 --2- 172.21.15.76:0/1121817752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35e4100a80 0x7f35e419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.836+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 >> 172.21.15.76:0/1121817752 conn(0x7f35e40fc7a0 msgr2=0x7f35e406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.837+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 shutdown_connections 2024-09-19T07:51:30.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:30.837+0000 7f35e9b8b640 1 -- 172.21.15.76:0/1121817752 wait complete. 2024-09-19T07:51:31.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:30 smithi152 ceph-mon[35117]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-09-19T07:51:31.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:30 smithi137 ceph-mon[35309]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-09-19T07:51:31.498 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:51:31.748 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:32.014 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:31 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1121817752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:32.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:31 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1121817752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:32.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:31 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1121817752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 -- 172.21.15.76:0/3656706290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750106f10 msgr2=0x7f075010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 --2- 172.21.15.76:0/3656706290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750106f10 0x7f075010ea90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0748009ca0 tx=0x7f074802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 -- 172.21.15.76:0/3656706290 shutdown_connections 2024-09-19T07:51:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 --2- 172.21.15.76:0/3656706290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750106f10 0x7f075010ea90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 --2- 172.21.15.76:0/3656706290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0750102790 0x7f07501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 --2- 172.21.15.76:0/3656706290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750101de0 0x7f07501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.234+0000 7f075482a640 1 -- 172.21.15.76:0/3656706290 >> 172.21.15.76:0/3656706290 conn(0x7f07500fd8c0 msgr2=0x7f07500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.235+0000 7f075482a640 1 -- 172.21.15.76:0/3656706290 shutdown_connections 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.235+0000 7f075482a640 1 -- 172.21.15.76:0/3656706290 wait complete. 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.235+0000 7f075482a640 1 Processor -- start 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.235+0000 7f075482a640 1 -- start start 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.235+0000 7f075482a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 0x7f07500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0750102790 0x7f0750074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750106f10 0x7f0750074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f07501120f0 con 0x7f0750101de0 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0750111f70 con 0x7f0750102790 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0750112270 con 0x7f0750106f10 2024-09-19T07:51:32.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 0x7f07500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 0x7f07500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43666/0 (socket says 172.21.15.76:43666) 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 -- 172.21.15.76:0/346257350 learned_addr learned my addr 172.21.15.76:0/346257350 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074dd9b640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0750102790 0x7f0750074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074ed9d640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750106f10 0x7f0750074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 -- 172.21.15.76:0/346257350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750106f10 msgr2=0x7f0750074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750106f10 0x7f0750074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 -- 172.21.15.76:0/346257350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0750102790 msgr2=0x7f0750074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0750102790 0x7f0750074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 -- 172.21.15.76:0/346257350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07501a69e0 con 0x7f0750101de0 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f074e59c640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 0x7f07500744f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f074000c970 tx=0x7f074000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740007bb0 con 0x7f0750101de0 2024-09-19T07:51:32.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0740007d50 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074000f4b0 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07501a6cd0 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.236+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501a71c0 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.237+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07501021c0 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.239+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f07400046c0 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.240+0000 7f073f7fe640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f07380a34c0 0x7f07380a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.240+0000 7f074dd9b640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f07380a34c0 0x7f07380a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.240+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f07400d0000 con 0x7f0750101de0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.240+0000 7f074dd9b640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f07380a34c0 0x7f07380a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0750075f80 tx=0x7f0744008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:32.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.243+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0740014030 con 0x7f0750101de0 2024-09-19T07:51:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.411+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0750075a20 con 0x7f0750101de0 2024-09-19T07:51:32.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.412+0000 7f073f7fe640 1 -- 172.21.15.76:0/346257350 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23153 (secure 0 0 0) 0x7f0750075a20 con 0x7f0750101de0 2024-09-19T07:51:32.413 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:32.413 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":85,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T07:51:12.773711+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1524312740":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3175575583":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1359391390":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/2768770565":"2024-09-20T07:51:12.773685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:51:32.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f07380a34c0 msgr2=0x7f07380a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f07380a34c0 0x7f07380a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0750075f80 tx=0x7f0744008040 comp rx=0 tx=0).stop 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 msgr2=0x7f07500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 0x7f07500744f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f074000c970 tx=0x7f074000ce30 comp rx=0 tx=0).stop 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 shutdown_connections 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f07380a34c0 0x7f07380a5980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750106f10 0x7f0750074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0750102790 0x7f0750074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 --2- 172.21.15.76:0/346257350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0750101de0 0x7f07500744f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 >> 172.21.15.76:0/346257350 conn(0x7f07500fd8c0 msgr2=0x7f07500febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:32.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 shutdown_connections 2024-09-19T07:51:32.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:32.415+0000 7f075482a640 1 -- 172.21.15.76:0/346257350 wait complete. 2024-09-19T07:51:33.045 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:32 smithi076 ceph-mon[30930]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 48 op/s 2024-09-19T07:51:33.045 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:32 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/346257350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:33.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:32 smithi152 ceph-mon[35117]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 48 op/s 2024-09-19T07:51:33.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:32 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/346257350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:33.073 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T07:51:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:32 smithi137 ceph-mon[35309]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 48 op/s 2024-09-19T07:51:33.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:32 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/346257350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:51:33.321 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:34.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:33 smithi152 ceph-mon[35117]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:51:34.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:33 smithi137 ceph-mon[35309]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:51:34.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:33 smithi076 ceph-mon[30930]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:51:34.540 INFO:teuthology.orchestra.run.smithi076.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T07:51:34.541 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T07:51:34.541 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T07:51:34.541 DEBUG:tasks.quiescer:Yielding 2024-09-19T07:51:34.542 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T07:51:34.560 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T07:51:34.561 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T07:51:34.561 INFO:tasks.workunit:timeout=3h 2024-09-19T07:51:34.561 INFO:tasks.workunit:cleanup=True 2024-09-19T07:51:34.561 DEBUG:teuthology.orchestra.run.smithi076:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:34.562 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:34.578 INFO:teuthology.orchestra.run.smithi076.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-19 07:49:46.178161886 +0000 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-19 07:49:46.178161886 +0000 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-19 07:51:10.974253023 +0000 2024-09-19T07:51:34.579 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-19 07:49:46.178161886 +0000 2024-09-19T07:51:34.579 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T07:51:34.579 DEBUG:teuthology.orchestra.run.smithi076:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T07:51:34.653 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T07:51:34.710 INFO:tasks.workunit.client.0.smithi076.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T07:51:34.817 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:34.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:34 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:51:35.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:34 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:51:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:34 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:51:35.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 -- 172.21.15.76:0/2000920059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75541036e0 msgr2=0x7f7554107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 --2- 172.21.15.76:0/2000920059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75541036e0 0x7f7554107b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7548009930 tx=0x7f754802a420 comp rx=0 tx=0).stop 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 -- 172.21.15.76:0/2000920059 shutdown_connections 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 --2- 172.21.15.76:0/2000920059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75541082a0 0x7f755410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 --2- 172.21.15.76:0/2000920059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f75541036e0 0x7f7554107b90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 --2- 172.21.15.76:0/2000920059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7554102d30 0x7f7554103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 -- 172.21.15.76:0/2000920059 >> 172.21.15.76:0/2000920059 conn(0x7f75540fc7d0 msgr2=0x7f75540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 -- 172.21.15.76:0/2000920059 shutdown_connections 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.325+0000 7f7559cae640 1 -- 172.21.15.76:0/2000920059 wait complete. 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 Processor -- start 2024-09-19T07:51:35.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 -- start start 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 0x7f7554100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75541036e0 0x7f7554100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75541082a0 0x7f7554101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7554112180 con 0x7f7554102d30 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7554112000 con 0x7f75541082a0 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.326+0000 7f7559cae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7554112300 con 0x7f75541036e0 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 0x7f7554100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 0x7f7554100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34988/0 (socket says 172.21.15.76:34988) 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 -- 172.21.15.76:0/2911964756 learned_addr learned my addr 172.21.15.76:0/2911964756 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7552ffd640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75541036e0 0x7f7554100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7553fff640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75541082a0 0x7f7554101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:35.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 -- 172.21.15.76:0/2911964756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75541036e0 msgr2=0x7f7554100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75541036e0 0x7f7554100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 -- 172.21.15.76:0/2911964756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75541082a0 msgr2=0x7f7554101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75541082a0 0x7f7554101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 -- 172.21.15.76:0/2911964756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75541a6ae0 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f75537fe640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 0x7f7554100990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f754400c920 tx=0x7f754400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544007c70 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75541a6dd0 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7544007e10 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544018940 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.327+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75541a7230 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.328+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7554103110 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.330+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f7544018b00 con 0x7f7554102d30 2024-09-19T07:51:35.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.331+0000 7f7550ff9640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f753c0a3440 0x7f753c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:35.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.331+0000 7f7552ffd640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f753c0a3440 0x7f753c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:35.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.332+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f75440d0280 con 0x7f7554102d30 2024-09-19T07:51:35.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.332+0000 7f7552ffd640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f753c0a3440 0x7f753c0a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7548005940 tx=0x7f75480058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:35.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.337+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7544014030 con 0x7f7554102d30 2024-09-19T07:51:35.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.558+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7554101ec0 con 0x7f7554102d30 2024-09-19T07:51:35.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.559+0000 7f7550ff9640 1 -- 172.21.15.76:0/2911964756 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f754409cb80 con 0x7f7554102d30 2024-09-19T07:51:35.559 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:35.559 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:35.559 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f753c0a3440 msgr2=0x7f753c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f753c0a3440 0x7f753c0a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7548005940 tx=0x7f75480058d0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 msgr2=0x7f7554100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 0x7f7554100990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f754400c920 tx=0x7f754400cde0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 shutdown_connections 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f753c0a3440 0x7f753c0a5900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75541082a0 0x7f7554101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75541036e0 0x7f7554100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 --2- 172.21.15.76:0/2911964756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7554102d30 0x7f7554100990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:35.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 >> 172.21.15.76:0/2911964756 conn(0x7f75540fc7d0 msgr2=0x7f7554106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:35.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 shutdown_connections 2024-09-19T07:51:35.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:35.561+0000 7f7559cae640 1 -- 172.21.15.76:0/2911964756 wait complete. 2024-09-19T07:51:35.858 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:35 smithi076 ceph-mon[30930]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:51:35.859 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:35 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2911964756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:35 smithi152 ceph-mon[35117]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:51:36.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:35 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2911964756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:36.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:49:28.218932+0000', 'modified': '2024-09-19T07:51:11.703422+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24478, 'mds_1': 24458, 'mds_2': 24457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6833/4080590897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 4080590897}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 4080590897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/1714762912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1714762912}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1714762912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6835/266318645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 266318645}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 266318645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.152:6837/3136720511', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 3136720511}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3136720511}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.137:6839/1413757795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 1413757795}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 1413757795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6839/1843787894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 1843787894}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 1843787894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24478, 'qdb_cluster': [24478, 24458, 24457]} 2024-09-19T07:51:36.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:51:36.128 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T07:51:36.157 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:35 smithi137 ceph-mon[35309]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:51:36.157 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:35 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2911964756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:36.413 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:36.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/2796259237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 msgr2=0x7fdc981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/2796259237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc981021c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009900 tx=0x7fdc8802a410 comp rx=0 tx=0).stop 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/2796259237 shutdown_connections 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/2796259237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98106f10 0x7fdc9810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/2796259237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc98102790 0x7fdc981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/2796259237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc981021c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/2796259237 >> 172.21.15.76:0/2796259237 conn(0x7fdc980fd8c0 msgr2=0x7fdc980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/2796259237 shutdown_connections 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.896+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/2796259237 wait complete. 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 Processor -- start 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 -- start start 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc98102790 0x7fdc98074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98106f10 0x7fdc98074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdc98112150 con 0x7fdc98101de0 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc98111fd0 con 0x7fdc98102790 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9cdc4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc981122d0 con 0x7fdc98106f10 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc980744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35010/0 (socket says 172.21.15.76:35010) 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 -- 172.21.15.76:0/1544503928 learned_addr learned my addr 172.21.15.76:0/1544503928 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc98102790 0x7fdc98074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98106f10 0x7fdc98074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 -- 172.21.15.76:0/1544503928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98106f10 msgr2=0x7fdc98074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98106f10 0x7fdc98074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 -- 172.21.15.76:0/1544503928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc98102790 msgr2=0x7fdc98074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.897+0000 7fdc9659c640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc98102790 0x7fdc98074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc9659c640 1 -- 172.21.15.76:0/1544503928 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc981a6b30 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc9659c640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc980744f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdc88006010 tx=0x7fdc880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc8f7fe640 1 -- 172.21.15.76:0/1544503928 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8803f030 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc8f7fe640 1 -- 172.21.15.76:0/1544503928 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc88003d00 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc981a6dc0 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc8f7fe640 1 -- 172.21.15.76:0/1544503928 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88035070 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.898+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc981a7240 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.900+0000 7fdc8f7fe640 1 -- 172.21.15.76:0/1544503928 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fdc88042030 con 0x7fdc98101de0 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 Processor -- start 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 -- start start 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41448db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 0x55cc41453670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41455fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cc413af090 con 0x55cc414492f0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc41356a70 con 0x55cc414489d0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cc413ab050 con 0x55cc41453bb0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 0x55cc41453670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc8f7fe640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdc840a3440 0x7fdc840a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 0x55cc41453670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35020/0 (socket says 172.21.15.76:35020) 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.901+0000 7fdc9659c640 1 -- 172.21.15.76:0/3256325570 learned_addr learned my addr 172.21.15.76:0/3256325570 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdc840a3440 0x7fdc840a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41455fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41448db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc8f7fe640 1 -- 172.21.15.76:0/1544503928 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdc880f0550 con 0x7fdc98101de0 2024-09-19T07:51:36.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc9659c640 1 -- 172.21.15.76:0/3256325570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 msgr2=0x55cc41455fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc9659c640 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41455fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc9659c640 1 -- 172.21.15.76:0/3256325570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 msgr2=0x55cc41448db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc9659c640 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41448db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc9659c640 1 -- 172.21.15.76:0/3256325570 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc41363130 con 0x55cc414492f0 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41448db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc9659c640 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 0x55cc41453670 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdc880a6f90 tx=0x7fdc8802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2061d5f56cfc407 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdc840a3440 0x7fdc840a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc90009540 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc8cff9640 1 -- 172.21.15.76:0/3256325570 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88049070 con 0x55cc414492f0 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc8cff9640 1 -- 172.21.15.76:0/3256325570 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc880bcd60 con 0x55cc414492f0 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.902+0000 7fdc8cff9640 1 -- 172.21.15.76:0/3256325570 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880b8cd0 con 0x55cc414492f0 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3256325570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 msgr2=0x55cc41453670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 0x55cc41453670 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdc880a6f90 tx=0x7fdc8802a410 comp rx=0 tx=0).stop 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3256325570 shutdown_connections 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41455fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414492f0 0x55cc41453670 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3256325570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41448db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3256325570 >> 172.21.15.76:0/3256325570 conn(0x55cc41444f60 msgr2=0x55cc41445340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3256325570 shutdown_connections 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3256325570 wait complete. 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.903+0000 7fdc9f19d740 1 -- start start 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 Processor -- start 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41453440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc41450790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 0x55cc41450cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cc41456540 con 0x55cc41453bb0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc41369f20 con 0x55cc414489d0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cc414566c0 con 0x55cc414492f0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9f19d740 10 client.0 _ll_register_callbacks cb 0x55cc41333030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 0x55cc41450cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41453440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 0x55cc41450cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35024/0 (socket says 172.21.15.76:35024) 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 -- 172.21.15.76:0/483096335 learned_addr learned my addr 172.21.15.76:0/483096335 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc41450790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 -- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 msgr2=0x55cc41450790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc41450790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 -- 172.21.15.76:0/483096335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 msgr2=0x55cc41453440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41453440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 -- 172.21.15.76:0/483096335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc411202b0 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 0x55cc41450cd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000af50 tx=0x7fdc90004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1932e261d28df1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.904+0000 7fdc7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc7dffb640 1 -- 172.21.15.76:0/483096335 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90029060 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc7dffb640 1 -- 172.21.15.76:0/483096335 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdc90019920 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc880bcd60 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc7dffb640 1 -- 172.21.15.76:0/483096335 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdc90013040 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 10 client.15384 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc41461da0 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc7dffb640 1 -- 172.21.15.76:0/483096335 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc880bcd60 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc7dffb640 1 -- 172.21.15.76:0/483096335 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdc9002c3b0 con 0x55cc41453bb0 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 10 client.15384 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 10 client.15384 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 20 client.15384 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:36.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc41464470 0x55cc414658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 4 client.15384 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.905+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc413bc600 con 0x55cc41464470 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.906+0000 7fdc9659c640 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc41464470 0x55cc414658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.906+0000 7fdc9659c640 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc41464470 0x55cc414658e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=262621350a0462c0 server_cookie=eb05fa38fec942b0 in_seq=0 out_seq=0 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.906+0000 7fdc7dffb640 10 client.15384 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc7dffb640 1 -- 172.21.15.76:0/483096335 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc413bc600 con 0x55cc41464470 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc7dffb640 10 client.15384 handle_command_reply: tid=0 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 client.15384 shutdown 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 msgr2=0x55cc41450cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 0x55cc41450cd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000af50 tx=0x7fdc90004b50 comp rx=0 tx=0).stop 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 shutdown_connections 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc41464470 0x55cc414658e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc41453bb0 0x55cc41450cd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc41450790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/483096335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414489d0 0x55cc41453440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 >> 172.21.15.76:0/483096335 conn(0x55cc41444f60 msgr2=0x55cc4144ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc7dffb640 0 client.15384 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 shutdown_connections 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 1 -- 172.21.15.76:0/483096335 wait complete. 2024-09-19T07:51:36.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.907+0000 7fdc9f19d740 20 client.15384 trim_cache size 0 max 16384 2024-09-19T07:51:36.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 Processor -- start 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 -- start start 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc41464470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc4143fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc41453bb0 0x55cc4145f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cc41463c20 con 0x55cc414489d0 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc414642f0 con 0x55cc41453bb0 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cc414649c0 con 0x55cc414492f0 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc41464470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc41464470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35040/0 (socket says 172.21.15.76:35040) 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 -- 172.21.15.76:0/3370856667 learned_addr learned my addr 172.21.15.76:0/3370856667 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc4143fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 -- 172.21.15.76:0/3370856667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 msgr2=0x55cc4143fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc4143fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 -- 172.21.15.76:0/3370856667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc41453bb0 msgr2=0x55cc4145f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc41453bb0 0x55cc4145f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.925+0000 7fdc9659c640 1 -- 172.21.15.76:0/3370856667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc41444a00 con 0x55cc414489d0 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9659c640 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc41464470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdc880b9030 tx=0x7fdc880b8980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2433bb14efb07b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc7ffff640 1 -- 172.21.15.76:0/3370856667 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880da070 con 0x55cc414489d0 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc7ffff640 1 -- 172.21.15.76:0/3370856667 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc880bcd60 con 0x55cc414489d0 2024-09-19T07:51:36.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc7ffff640 1 -- 172.21.15.76:0/3370856667 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88049040 con 0x55cc414489d0 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3370856667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 msgr2=0x55cc41464470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc41464470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdc880b9030 tx=0x7fdc880b8980 comp rx=0 tx=0).stop 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3370856667 shutdown_connections 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc41453bb0 0x55cc4145f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc414492f0 0x55cc4143fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/3370856667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc41464470 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3370856667 >> 172.21.15.76:0/3370856667 conn(0x55cc41444f60 msgr2=0x55cc41450750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.926+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3370856667 shutdown_connections 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 -- 172.21.15.76:0/3370856667 wait complete. 2024-09-19T07:51:36.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 -- start start 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 Processor -- start 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc4146e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414492f0 0x55cc41468400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41468940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cc41465760 con 0x55cc414489d0 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc41465090 con 0x55cc414492f0 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cc41465e30 con 0x55cc41453bb0 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9f19d740 10 client.0 _ll_register_callbacks cb 0x7fdc9000a5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc4146e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc4146e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35044/0 (socket says 172.21.15.76:35044) 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 -- 172.21.15.76:0/1926224652 learned_addr learned my addr 172.21.15.76:0/1926224652 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41468940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 -- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 msgr2=0x55cc41468940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41468940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 -- 172.21.15.76:0/1926224652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414492f0 msgr2=0x55cc41468400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414492f0 0x55cc41468400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414492f0 0x55cc41468400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.927+0000 7fdc9659c640 1 -- 172.21.15.76:0/1926224652 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc41468f00 con 0x55cc414489d0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc96d9d640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41468940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414492f0 0x55cc41468400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9659c640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc4146e0e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdc880bc5f0 tx=0x7fdc880c5350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682c2667346b81df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc7dffb640 1 -- 172.21.15.76:0/1926224652 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880da070 con 0x55cc414489d0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc7dffb640 1 -- 172.21.15.76:0/1926224652 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdc880b8040 con 0x55cc414489d0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc880bcd60 con 0x55cc414489d0 2024-09-19T07:51:36.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc7dffb640 1 -- 172.21.15.76:0/1926224652 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdc88049040 con 0x55cc414489d0 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc414cd960 con 0x55cc414489d0 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc7dffb640 1 -- 172.21.15.76:0/1926224652 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc880bcd60 con 0x55cc414489d0 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc7dffb640 1 -- 172.21.15.76:0/1926224652 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdc880c4e40 con 0x55cc414489d0 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 10 client.15390 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 20 client.15390 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc414d20d0 0x55cc414d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 4 client.15390 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.928+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "status"}) -- 0x55cc413b6b10 con 0x55cc414d20d0 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc414d20d0 0x55cc414d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc7dffb640 10 client.15390 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:36.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc95d9b640 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc414d20d0 0x55cc414d0de0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ed8dfa7e523ffdb server_cookie=40765892b189da91 in_seq=0 out_seq=0 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc7dffb640 1 -- 172.21.15.76:0/1926224652 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cc413b6b10 con 0x55cc414d20d0 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc7dffb640 10 client.15390 handle_command_reply: tid=0 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 client.15390 shutdown 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 msgr2=0x55cc4146e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc4146e0e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdc880bc5f0 tx=0x7fdc880c5350 comp rx=0 tx=0).stop 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 shutdown_connections 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55cc414d20d0 0x55cc414d0de0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc41453bb0 0x55cc41468940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc414492f0 0x55cc41468400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 --2- 172.21.15.76:0/1926224652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc414489d0 0x55cc4146e0e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.929+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 >> 172.21.15.76:0/1926224652 conn(0x55cc41444f60 msgr2=0x55cc41450750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc7dffb640 0 client.15390 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 shutdown_connections 2024-09-19T07:51:36.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9f19d740 1 -- 172.21.15.76:0/1926224652 wait complete. 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9f19d740 20 client.15390 trim_cache size 0 max 16384 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 2, 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24457, 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 120.314541315, 2024-09-19T07:51:36.936 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 25, 2024-09-19T07:51:36.937 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 85, 2024-09-19T07:51:36.937 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T07:51:36.937 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 153.19795632200001 2024-09-19T07:51:36.937 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:36.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdc840a3440 msgr2=0x7fdc840a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdc840a3440 0x7fdc840a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009fd0 tx=0x7fdc90009540 comp rx=0 tx=0).stop 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 msgr2=0x7fdc980744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc980744f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdc88006010 tx=0x7fdc880042f0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 shutdown_connections 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdc840a3440 0x7fdc840a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98106f10 0x7fdc98074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc98102790 0x7fdc98074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 --2- 172.21.15.76:0/1544503928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdc98101de0 0x7fdc980744f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 >> 172.21.15.76:0/1544503928 conn(0x7fdc980fd8c0 msgr2=0x7fdc980fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 shutdown_connections 2024-09-19T07:51:36.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:36.930+0000 7fdc9cdc4640 1 -- 172.21.15.76:0/1544503928 wait complete. 2024-09-19T07:51:37.597 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:51:37.844 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:38.101 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:37 smithi076 ceph-mon[30930]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:38.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:37 smithi137 ceph-mon[35309]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:38.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:37 smithi152 ceph-mon[35117]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:38.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 -- 172.21.15.76:0/2277323023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990106f50 msgr2=0x7f999010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 --2- 172.21.15.76:0/2277323023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990106f50 0x7f999010eaf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9988009cd0 tx=0x7f998802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 -- 172.21.15.76:0/2277323023 shutdown_connections 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 --2- 172.21.15.76:0/2277323023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990106f50 0x7f999010eaf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 --2- 172.21.15.76:0/2277323023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9990100ca0 0x7f9990106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 --2- 172.21.15.76:0/2277323023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 0x7f99901006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 -- 172.21.15.76:0/2277323023 >> 172.21.15.76:0/2277323023 conn(0x7f9990077210 msgr2=0x7f99900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 -- 172.21.15.76:0/2277323023 shutdown_connections 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.312+0000 7f99956a1640 1 -- 172.21.15.76:0/2277323023 wait complete. 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 Processor -- start 2024-09-19T07:51:38.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 -- start start 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 0x7f9990198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990100ca0 0x7f9990198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9990106f50 0x7f999019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9990112140 con 0x7f9990100ca0 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9990111fc0 con 0x7f9990106f50 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.313+0000 7f99956a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f99901122c0 con 0x7f99901002f0 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 0x7f9990198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990100ca0 0x7f9990198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 0x7f9990198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:47256/0 (socket says 172.21.15.76:47256) 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998effd640 1 -- 172.21.15.76:0/4143503662 learned_addr learned my addr 172.21.15.76:0/4143503662 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998f7fe640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9990106f50 0x7f999019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 -- 172.21.15.76:0/4143503662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 msgr2=0x7f9990198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 0x7f9990198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 -- 172.21.15.76:0/4143503662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9990106f50 msgr2=0x7f999019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9990106f50 0x7f999019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 -- 172.21.15.76:0/4143503662 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999019d510 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99867fc640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990100ca0 0x7f9990198aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f997800b3c0 tx=0x7f997800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998cff9640 1 -- 172.21.15.76:0/4143503662 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978011830 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999019d800 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998cff9640 1 -- 172.21.15.76:0/4143503662 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9978016070 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f998cff9640 1 -- 172.21.15.76:0/4143503662 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800f2e0 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.314+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99901a50e0 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.316+0000 7f998cff9640 1 -- 172.21.15.76:0/4143503662 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f99780119d0 con 0x7f9990100ca0 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.317+0000 7f9997a7a740 1 Processor -- start 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.317+0000 7f9997a7a740 1 -- start start 2024-09-19T07:51:38.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.317+0000 7f998cff9640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f997c0a3440 0x7f997c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f998f7fe640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f997c0a3440 0x7f997c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f998cff9640 1 -- 172.21.15.76:0/4143503662 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f99780cf3a0 con 0x7f9990100ca0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c309d0 0x5632c9c30db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 0x5632c9c3b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c3bbb0 0x5632c9c3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f9997a7a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5632c9b97090 con 0x5632c9c312f0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f9997a7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632c9b3ea70 con 0x5632c9c309d0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f9997a7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632c9b93050 con 0x5632c9c3bbb0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 0x5632c9c3b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 0x5632c9c3b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35052/0 (socket says 172.21.15.76:35052) 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 -- 172.21.15.76:0/2929428515 learned_addr learned my addr 172.21.15.76:0/2929428515 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f998effd640 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c309d0 0x5632c9c30db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f998f7fe640 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c3bbb0 0x5632c9c3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f998f7fe640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f997c0a3440 0x7f997c0a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9988006010 tx=0x7f9988009880 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 -- 172.21.15.76:0/2929428515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c3bbb0 msgr2=0x5632c9c3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c3bbb0 0x5632c9c3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 -- 172.21.15.76:0/2929428515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c309d0 msgr2=0x5632c9c30db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c309d0 0x5632c9c30db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 -- 172.21.15.76:0/2929428515 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c9b4b130 con 0x5632c9c312f0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.318+0000 7f99867fc640 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 0x5632c9c3b670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f99780ccbd0 tx=0x7f997809af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fcbe1e685a9f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f99857fa640 1 -- 172.21.15.76:0/2929428515 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997809f9d0 con 0x5632c9c312f0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f99857fa640 1 -- 172.21.15.76:0/2929428515 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99780a4290 con 0x5632c9c312f0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f99857fa640 1 -- 172.21.15.76:0/2929428515 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99780ccee0 con 0x5632c9c312f0 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 -- 172.21.15.76:0/2929428515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 msgr2=0x5632c9c3b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 0x5632c9c3b670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f99780ccbd0 tx=0x7f997809af80 comp rx=0 tx=0).stop 2024-09-19T07:51:38.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 -- 172.21.15.76:0/2929428515 shutdown_connections 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c3bbb0 0x5632c9c3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c312f0 0x5632c9c3b670 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2929428515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c309d0 0x5632c9c30db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 -- 172.21.15.76:0/2929428515 >> 172.21.15.76:0/2929428515 conn(0x5632c9c2cf60 msgr2=0x5632c9c2d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.319+0000 7f9997a7a740 1 -- 172.21.15.76:0/2929428515 shutdown_connections 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 -- 172.21.15.76:0/2929428515 wait complete. 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 -- start start 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 Processor -- start 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c309d0 0x5632c9c3b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c312f0 0x5632c9c387b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 0x5632c9c38cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c3e780 con 0x5632c9c3bbb0 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632c9b51f20 con 0x5632c9c312f0 2024-09-19T07:51:38.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c3e900 con 0x5632c9c309d0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f9997a7a740 10 client.0 _ll_register_callbacks cb 0x5632c9b1b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f998f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 0x5632c9c38cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f998f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 0x5632c9c38cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35056/0 (socket says 172.21.15.76:35056) 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f998f7fe640 1 -- 172.21.15.76:0/741779973 learned_addr learned my addr 172.21.15.76:0/741779973 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f998effd640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c309d0 0x5632c9c3b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.320+0000 7f99867fc640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c312f0 0x5632c9c387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f998f7fe640 1 -- 172.21.15.76:0/741779973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c309d0 msgr2=0x5632c9c3b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f998f7fe640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c309d0 0x5632c9c3b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f998f7fe640 1 -- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c312f0 msgr2=0x5632c9c387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f998f7fe640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c312f0 0x5632c9c387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f998f7fe640 1 -- 172.21.15.76:0/741779973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c99082b0 con 0x5632c9c3bbb0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f998f7fe640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 0x5632c9c38cf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9988035000 tx=0x7f998802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c9c54bb84bb194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:38.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f99767fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f99767fc640 1 -- 172.21.15.76:0/741779973 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988004240 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f99767fc640 1 -- 172.21.15.76:0/741779973 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f99880043e0 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99780a4290 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f99767fc640 1 -- 172.21.15.76:0/741779973 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9988031e40 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f9997a7a740 10 client.15402 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5632c9c4a0a0 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f99767fc640 1 -- 172.21.15.76:0/741779973 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99780a4290 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f99767fc640 1 -- 172.21.15.76:0/741779973 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9988030070 con 0x5632c9c3bbb0 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.321+0000 7f9997a7a740 10 client.15402 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f9997a7a740 10 client.15402 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f9997a7a740 20 client.15402 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f9997a7a740 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9c4c730 0x5632c9c4dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f9997a7a740 4 client.15402 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632c9ba4600 con 0x5632c9c4c730 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f998effd640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9c4c730 0x5632c9c4dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f99767fc640 10 client.15402 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.322+0000 7f998effd640 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9c4c730 0x5632c9c4dba0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e3b4c67153e73ad server_cookie=54fe9886d9a689ce in_seq=0 out_seq=0 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f99767fc640 1 -- 172.21.15.76:0/741779973 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632c9ba4600 con 0x5632c9c4c730 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f99767fc640 10 client.15402 handle_command_reply: tid=0 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 client.15402 shutdown 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 msgr2=0x5632c9c38cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 0x5632c9c38cf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9988035000 tx=0x7f998802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 shutdown_connections 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9c4c730 0x5632c9c4dba0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c3bbb0 0x5632c9c38cf0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c312f0 0x5632c9c387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 --2- 172.21.15.76:0/741779973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c309d0 0x5632c9c3b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f99767fc640 0 client.15402 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:38.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.323+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 >> 172.21.15.76:0/741779973 conn(0x5632c9c2cf60 msgr2=0x5632c9c32c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:38.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.324+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 shutdown_connections 2024-09-19T07:51:38.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.324+0000 7f9997a7a740 1 -- 172.21.15.76:0/741779973 wait complete. 2024-09-19T07:51:38.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.324+0000 7f9997a7a740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T07:51:38.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.341+0000 7f9997a7a740 1 Processor -- start 2024-09-19T07:51:38.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.341+0000 7f9997a7a740 1 -- start start 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9c38070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9c2c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c56270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9997a7a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c4bee0 con 0x5632c9c309d0 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9997a7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c4c5b0 con 0x5632c9c3bbb0 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9997a7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c4cc80 con 0x5632c9c312f0 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9c38070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9c38070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35072/0 (socket says 172.21.15.76:35072) 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 -- 172.21.15.76:0/2115867118 learned_addr learned my addr 172.21.15.76:0/2115867118 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f99867fc640 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9c2c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998f7fe640 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c56270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 -- 172.21.15.76:0/2115867118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 msgr2=0x5632c9c2c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9c2c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 -- 172.21.15.76:0/2115867118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 msgr2=0x5632c9c56270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c56270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 -- 172.21.15.76:0/2115867118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c9c3b7d0 con 0x5632c9c309d0 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998f7fe640 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c56270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f998effd640 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9c38070 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x5632c9c4e3d0 tx=0x7f998000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46808df8a9d0823f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.342+0000 7f9984ff9640 1 -- 172.21.15.76:0/2115867118 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998000bea0 con 0x5632c9c309d0 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9984ff9640 1 -- 172.21.15.76:0/2115867118 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99800047a0 con 0x5632c9c309d0 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9984ff9640 1 -- 172.21.15.76:0/2115867118 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99800119a0 con 0x5632c9c309d0 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 -- 172.21.15.76:0/2115867118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 msgr2=0x5632c9c38070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9c38070 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x5632c9c4e3d0 tx=0x7f998000b480 comp rx=0 tx=0).stop 2024-09-19T07:51:38.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 -- 172.21.15.76:0/2115867118 shutdown_connections 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c56270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9c2c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 --2- 172.21.15.76:0/2115867118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9c38070 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 -- 172.21.15.76:0/2115867118 >> 172.21.15.76:0/2115867118 conn(0x5632c9c2cf60 msgr2=0x5632c9c38770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 -- 172.21.15.76:0/2115867118 shutdown_connections 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.343+0000 7f9997a7a740 1 -- 172.21.15.76:0/2115867118 wait complete. 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 -- start start 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 Processor -- start 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9cb2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9cb26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c53630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c4da20 con 0x5632c9c309d0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c4d350 con 0x5632c9c3bbb0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5632c9c4e0f0 con 0x5632c9c312f0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f9997a7a740 10 client.0 _ll_register_callbacks cb 0x7f9988009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9cb2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9cb2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35078/0 (socket says 172.21.15.76:35078) 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 -- 172.21.15.76:0/4276724090 learned_addr learned my addr 172.21.15.76:0/4276724090 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998f7fe640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c53630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f99867fc640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9cb26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 -- 172.21.15.76:0/4276724090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 msgr2=0x5632c9cb26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9cb26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 -- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 msgr2=0x5632c9c53630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c53630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f998effd640 1 -- 172.21.15.76:0/4276724090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c9c53e30 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.344+0000 7f99867fc640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9cb26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f998effd640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9cb2190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f998000b2e0 tx=0x7f9980011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a522480c482049 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f99767fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f99767fc640 1 -- 172.21.15.76:0/4276724090 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980004b60 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f99767fc640 1 -- 172.21.15.76:0/4276724090 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f9980004d00 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99800047a0 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f99767fc640 1 -- 172.21.15.76:0/4276724090 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9980005020 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 10 client.15408 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5632c9cba970 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f99767fc640 1 -- 172.21.15.76:0/4276724090 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99800047a0 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f99767fc640 1 -- 172.21.15.76:0/4276724090 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9980024030 con 0x5632c9c309d0 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 10 client.15408 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:38.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 10 client.15408 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:51:38.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 20 client.15408 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:38.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.345+0000 7f9997a7a740 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9cbf1a0 0x5632c9cbdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:38.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f9997a7a740 4 client.15408 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:51:38.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "status"}) -- 0x5632c9b9eb10 con 0x5632c9cbf1a0 2024-09-19T07:51:38.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f99867fc640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9cbf1a0 0x5632c9cbdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f99867fc640 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9cbf1a0 0x5632c9cbdeb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdecc1998d859b1e server_cookie=4473414a43bb0a33 in_seq=0 out_seq=0 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f99767fc640 10 client.15408 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f99767fc640 1 -- 172.21.15.76:0/4276724090 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5632c9b9eb10 con 0x5632c9cbf1a0 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.346+0000 7f99767fc640 10 client.15408 handle_command_reply: tid=0 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 client.15408 shutdown 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 msgr2=0x5632c9cb2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9cb2190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f998000b2e0 tx=0x7f9980011440 comp rx=0 tx=0).stop 2024-09-19T07:51:38.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 shutdown_connections 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5632c9cbf1a0 0x5632c9cbdeb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632c9c3bbb0 0x5632c9c53630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5632c9c312f0 0x5632c9cb26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 --2- 172.21.15.76:0/4276724090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5632c9c309d0 0x5632c9cb2190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 >> 172.21.15.76:0/4276724090 conn(0x5632c9c2cf60 msgr2=0x5632c9c38770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99767fc640 0 client.15408 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 shutdown_connections 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 1 -- 172.21.15.76:0/4276724090 wait complete. 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f9997a7a740 20 client.15408 trim_cache size 0 max 16384 2024-09-19T07:51:38.353 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 1, 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24458, 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 122.73825660599999, 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 25, 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 85, 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 140.60780634899999 2024-09-19T07:51:38.354 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:38.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f997c0a3440 msgr2=0x7f997c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f997c0a3440 0x7f997c0a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9988006010 tx=0x7f9988009880 comp rx=0 tx=0).stop 2024-09-19T07:51:38.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990100ca0 msgr2=0x7f9990198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:38.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990100ca0 0x7f9990198aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f997800b3c0 tx=0x7f997800b880 comp rx=0 tx=0).stop 2024-09-19T07:51:38.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 shutdown_connections 2024-09-19T07:51:38.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f997c0a3440 0x7f997c0a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9990106f50 0x7f999019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9990100ca0 0x7f9990198aa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 --2- 172.21.15.76:0/4143503662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99901002f0 0x7f9990198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:38.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.347+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 >> 172.21.15.76:0/4143503662 conn(0x7f9990077210 msgr2=0x7f9990105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:38.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.348+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 shutdown_connections 2024-09-19T07:51:38.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:38.348+0000 7f99956a1640 1 -- 172.21.15.76:0/4143503662 wait complete. 2024-09-19T07:51:39.162 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:51:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 -- 172.21.15.76:0/861328801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 msgr2=0x7f24a41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/861328801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a41021d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f249c009ca0 tx=0x7f249c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 -- 172.21.15.76:0/861328801 shutdown_connections 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/861328801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4106f20 0x7f24a410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/861328801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24a41027a0 0x7f24a41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/861328801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a41021d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 -- 172.21.15.76:0/861328801 >> 172.21.15.76:0/861328801 conn(0x7f24a40fd8b0 msgr2=0x7f24a40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 -- 172.21.15.76:0/861328801 shutdown_connections 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.917+0000 7f24ac7d5640 1 -- 172.21.15.76:0/861328801 wait complete. 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 Processor -- start 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 -- start start 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24a41027a0 0x7f24a4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4106f20 0x7f24a419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112160 con 0x7f24a4101df0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4111fe0 con 0x7f24a41027a0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24ac7d5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24a41122e0 con 0x7f24a4106f20 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a4198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35094/0 (socket says 172.21.15.76:35094) 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 -- 172.21.15.76:0/800146985 learned_addr learned my addr 172.21.15.76:0/800146985 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aad72640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4106f20 0x7f24a419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24a9d70640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24a41027a0 0x7f24a4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 -- 172.21.15.76:0/800146985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4106f20 msgr2=0x7f24a419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4106f20 0x7f24a419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 -- 172.21.15.76:0/800146985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24a41027a0 msgr2=0x7f24a4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24a41027a0 0x7f24a4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 -- 172.21.15.76:0/800146985 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a419d610 con 0x7f24a4101df0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.918+0000 7f24aa571640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a4198660 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f249c006010 tx=0x7f249c031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.919+0000 7f249b7fe640 1 -- 172.21.15.76:0/800146985 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c003c30 con 0x7f24a4101df0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.919+0000 7f249b7fe640 1 -- 172.21.15.76:0/800146985 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f249c003dd0 con 0x7f24a4101df0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.919+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a419d8a0 con 0x7f24a4101df0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.919+0000 7f249b7fe640 1 -- 172.21.15.76:0/800146985 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0305c0 con 0x7f24a4101df0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.919+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41a51e0 con 0x7f24a4101df0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.921+0000 7f249b7fe640 1 -- 172.21.15.76:0/800146985 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f249c004050 con 0x7f24a4101df0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.921+0000 7f24aebae740 1 Processor -- start 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 -- start start 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b68db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b73670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b75fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f249b7fe640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24900a34c0 0x7f24900a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b591acf090 con 0x55b591b73bb0 2024-09-19T07:51:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b591a76a70 con 0x55b591b692f0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aebae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b591acb050 con 0x55b591b689d0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aad72640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24900a34c0 0x7f24900a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b75fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35106/0 (socket says 172.21.15.76:35106) 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 -- 172.21.15.76:0/2097034006 learned_addr learned my addr 172.21.15.76:0/2097034006 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aad72640 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b68db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f249b7fe640 1 -- 172.21.15.76:0/800146985 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f249c0f1250 con 0x7f24a4101df0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aa571640 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b73670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 -- 172.21.15.76:0/2097034006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 msgr2=0x55b591b68db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b68db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 -- 172.21.15.76:0/2097034006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 msgr2=0x55b591b73670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b73670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 -- 172.21.15.76:0/2097034006 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b591a83130 con 0x55b591b73bb0 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24aad72640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24900a34c0 0x7f24900a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24a0006e10 tx=0x7f24a00098b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.922+0000 7f24a9d70640 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b75fa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f249400b7f0 tx=0x7f249400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ed4631c383f0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f2498ff9640 1 -- 172.21.15.76:0/2097034006 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249400d8d0 con 0x55b591b73bb0 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f2498ff9640 1 -- 172.21.15.76:0/2097034006 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2494018070 con 0x55b591b73bb0 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f2498ff9640 1 -- 172.21.15.76:0/2097034006 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494012640 con 0x55b591b73bb0 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 -- 172.21.15.76:0/2097034006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 msgr2=0x55b591b75fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b75fa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f249400b7f0 tx=0x7f249400bcb0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 -- 172.21.15.76:0/2097034006 shutdown_connections 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b75fa0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b73670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 --2- 172.21.15.76:0/2097034006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 -- 172.21.15.76:0/2097034006 >> 172.21.15.76:0/2097034006 conn(0x55b591b64f60 msgr2=0x55b591b65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 -- 172.21.15.76:0/2097034006 shutdown_connections 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.923+0000 7f24aebae740 1 -- 172.21.15.76:0/2097034006 wait complete. 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 -- start start 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 Processor -- start 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b70750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b70c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b591b76780 con 0x55b591b73bb0 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b591a89f20 con 0x55b591b692f0 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b591b76900 con 0x55b591b689d0 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aebae740 10 client.0 _ll_register_callbacks cb 0x55b591a53030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b70c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b70c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35108/0 (socket says 172.21.15.76:35108) 2024-09-19T07:51:39.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 -- 172.21.15.76:0/1154686028 learned_addr learned my addr 172.21.15.76:0/1154686028 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24a9d70640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b70750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aa571640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 -- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 msgr2=0x55b591b733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 -- 172.21.15.76:0/1154686028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 msgr2=0x55b591b70750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b70750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24aad72640 1 -- 172.21.15.76:0/1154686028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5918402b0 con 0x55b591b73bb0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.924+0000 7f24a9d70640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b70750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aad72640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b70c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f24a0017b10 tx=0x7f24a00090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc64e01e93e574b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f248dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f248dffb640 1 -- 172.21.15.76:0/1154686028 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0018ca0 con 0x55b591b73bb0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f248dffb640 1 -- 172.21.15.76:0/1154686028 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f24a0024460 con 0x55b591b73bb0 2024-09-19T07:51:39.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2494018070 con 0x55b591b73bb0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f248dffb640 1 -- 172.21.15.76:0/1154686028 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24a0032050 con 0x55b591b73bb0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 10 client.15420 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b591b82040 con 0x55b591b73bb0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f248dffb640 1 -- 172.21.15.76:0/1154686028 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2494018070 con 0x55b591b73bb0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f248dffb640 1 -- 172.21.15.76:0/1154686028 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24a00225a0 con 0x55b591b73bb0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 10 client.15420 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 10 client.15420 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 20 client.15420 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591b84710 0x55b591b85b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 4 client.15420 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.925+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b591adc600 con 0x55b591b84710 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.926+0000 7f24aa571640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591b84710 0x55b591b85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.926+0000 7f24aa571640 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591b84710 0x55b591b85b80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=956e2cb692bcb513 server_cookie=1f252c49066bdf3 in_seq=0 out_seq=0 2024-09-19T07:51:39.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.926+0000 7f248dffb640 10 client.15420 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f248dffb640 1 -- 172.21.15.76:0/1154686028 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b591adc600 con 0x55b591b84710 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f248dffb640 10 client.15420 handle_command_reply: tid=0 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 client.15420 shutdown 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 msgr2=0x55b591b70c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b70c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f24a0017b10 tx=0x7f24a00090e0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 shutdown_connections 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591b84710 0x55b591b85b80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b70c90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b692f0 0x55b591b70750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 --2- 172.21.15.76:0/1154686028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b689d0 0x55b591b733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f248dffb640 0 client.15420 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 >> 172.21.15.76:0/1154686028 conn(0x55b591b64f60 msgr2=0x55b591b6ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:39.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 shutdown_connections 2024-09-19T07:51:39.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 1 -- 172.21.15.76:0/1154686028 wait complete. 2024-09-19T07:51:39.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.927+0000 7f24aebae740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T07:51:39.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 Processor -- start 2024-09-19T07:51:39.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 -- start start 2024-09-19T07:51:39.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b85b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 0x55b591b5fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b73bb0 0x55b591b6f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b591b83ec0 con 0x55b591b692f0 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b591b84590 con 0x55b591b689d0 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aebae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b591b84c60 con 0x55b591b73bb0 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 0x55b591b5fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 0x55b591b5fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35114/0 (socket says 172.21.15.76:35114) 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 -- 172.21.15.76:0/3671837365 learned_addr learned my addr 172.21.15.76:0/3671837365 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aad72640 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b73bb0 0x55b591b6f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aa571640 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 -- 172.21.15.76:0/3671837365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b73bb0 msgr2=0x55b591b6f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b73bb0 0x55b591b6f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 -- 172.21.15.76:0/3671837365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 msgr2=0x55b591b85b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b85b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24a9d70640 1 -- 172.21.15.76:0/3671837365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b591b73720 con 0x55b591b692f0 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.945+0000 7f24aad72640 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b73bb0 0x55b591b6f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24a9d70640 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 0x55b591b5fce0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2494004810 tx=0x7f249400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a510e5a6dc694c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f248ffff640 1 -- 172.21.15.76:0/3671837365 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494013680 con 0x55b591b692f0 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f248ffff640 1 -- 172.21.15.76:0/3671837365 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2494018040 con 0x55b591b692f0 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f248ffff640 1 -- 172.21.15.76:0/3671837365 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494026cd0 con 0x55b591b692f0 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 -- 172.21.15.76:0/3671837365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 msgr2=0x55b591b5fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 0x55b591b5fce0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2494004810 tx=0x7f249400dae0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 -- 172.21.15.76:0/3671837365 shutdown_connections 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b73bb0 0x55b591b6f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b692f0 0x55b591b5fce0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 --2- 172.21.15.76:0/3671837365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b85b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.946+0000 7f24aebae740 1 -- 172.21.15.76:0/3671837365 >> 172.21.15.76:0/3671837365 conn(0x55b591b64f60 msgr2=0x55b591b65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 -- 172.21.15.76:0/3671837365 shutdown_connections 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 -- 172.21.15.76:0/3671837365 wait complete. 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 -- start start 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 Processor -- start 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b8dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b692f0 0x55b591b8e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b87340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b591b85a00 con 0x55b591b73bb0 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b591b85330 con 0x55b591b689d0 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b591b860d0 con 0x55b591b692f0 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aebae740 10 client.0 _ll_register_callbacks cb 0x7f24a0009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aad72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b87340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aad72640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b87340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35128/0 (socket says 172.21.15.76:35128) 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aad72640 1 -- 172.21.15.76:0/1540553610 learned_addr learned my addr 172.21.15.76:0/1540553610 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.947+0000 7f24aa571640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b8dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24a9d70640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b692f0 0x55b591b8e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aad72640 1 -- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b692f0 msgr2=0x55b591b8e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aad72640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b692f0 0x55b591b8e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aad72640 1 -- 172.21.15.76:0/1540553610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 msgr2=0x55b591b8dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aad72640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b8dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aad72640 1 -- 172.21.15.76:0/1540553610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b591b87b50 con 0x55b591b73bb0 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24a9d70640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b692f0 0x55b591b8e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aad72640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b87340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f24a0018010 tx=0x7f24a0009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27644bb4b5bbeb61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f248dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f248dffb640 1 -- 172.21.15.76:0/1540553610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a003a070 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f248dffb640 1 -- 172.21.15.76:0/1540553610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f24a00225e0 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2494018040 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f248dffb640 1 -- 172.21.15.76:0/1540553610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24a0018820 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aebae740 10 client.15426 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b591b8c4f0 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.948+0000 7f248dffb640 1 -- 172.21.15.76:0/1540553610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2494018040 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f248dffb640 1 -- 172.21.15.76:0/1540553610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24a003f440 con 0x55b591b73bb0 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aebae740 10 client.15426 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aebae740 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aebae740 20 client.15426 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aebae740 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591bf33b0 0x55b591bf20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aebae740 4 client.15426 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "status"}) -- 0x55b591ad6b10 con 0x55b591bf33b0 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aa571640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591bf33b0 0x55b591bf20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f248dffb640 10 client.15426 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.949+0000 7f24aa571640 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591bf33b0 0x55b591bf20c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3aa43afcfde0a7b server_cookie=62f7588dadd1af29 in_seq=0 out_seq=0 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f248dffb640 1 -- 172.21.15.76:0/1540553610 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b591ad6b10 con 0x55b591bf33b0 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f248dffb640 10 client.15426 handle_command_reply: tid=0 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 client.15426 shutdown 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 msgr2=0x55b591b87340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b87340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f24a0018010 tx=0x7f24a0009eb0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 shutdown_connections 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b591bf33b0 0x55b591bf20c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b591b73bb0 0x55b591b87340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b591b692f0 0x55b591b8e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 --2- 172.21.15.76:0/1540553610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b591b689d0 0x55b591b8dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f248dffb640 0 client.15426 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 >> 172.21.15.76:0/1540553610 conn(0x55b591b64f60 msgr2=0x55b591b6efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 shutdown_connections 2024-09-19T07:51:39.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 1 -- 172.21.15.76:0/1540553610 wait complete. 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.950+0000 7f24aebae740 20 client.15426 trim_cache size 0 max 16384 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "6aad871c-765a-11ef-bceb-c7b262605968", 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 24478, 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 131.37737020200001, 2024-09-19T07:51:39.960 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 25, 2024-09-19T07:51:39.961 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 85, 2024-09-19T07:51:39.961 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T07:51:39.961 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 150.986150294 2024-09-19T07:51:39.961 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:39.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24900a34c0 msgr2=0x7f24900a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24900a34c0 0x7f24900a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24a0006e10 tx=0x7f24a00098b0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 msgr2=0x7f24a4198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a4198660 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f249c006010 tx=0x7f249c031b10 comp rx=0 tx=0).stop 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 shutdown_connections 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24900a34c0 0x7f24900a5980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4106f20 0x7f24a419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24a41027a0 0x7f24a4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 --2- 172.21.15.76:0/800146985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24a4101df0 0x7f24a4198660 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 >> 172.21.15.76:0/800146985 conn(0x7f24a40fd8b0 msgr2=0x7f24a40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 shutdown_connections 2024-09-19T07:51:39.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:39.951+0000 7f24ac7d5640 1 -- 172.21.15.76:0/800146985 wait complete. 2024-09-19T07:51:40.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:39 smithi137 ceph-mon[35309]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:51:40.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:39 smithi076 ceph-mon[30930]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:51:40.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:39 smithi152 ceph-mon[35117]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:51:40.665 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T07:51:42.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:41 smithi137 ceph-mon[35309]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T07:51:42.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:41 smithi076 ceph-mon[30930]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T07:51:42.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:41 smithi152 ceph-mon[35117]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T07:51:44.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:43 smithi137 ceph-mon[35309]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:51:44.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:43 smithi076 ceph-mon[30930]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:51:44.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:43 smithi152 ceph-mon[35117]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:51:46.113 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:45 smithi152 ceph-mon[35117]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T07:51:46.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:45 smithi137 ceph-mon[35309]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T07:51:46.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:45 smithi076 ceph-mon[30930]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T07:51:48.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:47 smithi137 ceph-mon[35309]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:51:48.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:47 smithi076 ceph-mon[30930]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:51:48.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:47 smithi152 ceph-mon[35117]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:51:50.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:49 smithi137 ceph-mon[35309]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T07:51:50.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:49 smithi076 ceph-mon[30930]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T07:51:50.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:49 smithi152 ceph-mon[35117]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T07:51:52.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:51 smithi137 ceph-mon[35309]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T07:51:52.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:51 smithi076 ceph-mon[30930]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T07:51:52.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:51 smithi152 ceph-mon[35117]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T07:51:53.253 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:51:53.514 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:53.929 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:53 smithi076 ceph-mon[30930]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 -- 172.21.15.76:0/1243710579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984100e20 msgr2=0x7f7984101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 --2- 172.21.15.76:0/1243710579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984100e20 0x7f7984101200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f796c009900 tx=0x7f796c02a480 comp rx=0 tx=0).stop 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 -- 172.21.15.76:0/1243710579 shutdown_connections 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 --2- 172.21.15.76:0/1243710579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102ef0 0x7f798410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 --2- 172.21.15.76:0/1243710579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7984102570 0x7f79841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 --2- 172.21.15.76:0/1243710579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984100e20 0x7f7984101200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 -- 172.21.15.76:0/1243710579 >> 172.21.15.76:0/1243710579 conn(0x7f79840fc7d0 msgr2=0x7f79840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 -- 172.21.15.76:0/1243710579 shutdown_connections 2024-09-19T07:51:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.015+0000 7f798adca640 1 -- 172.21.15.76:0/1243710579 wait complete. 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 Processor -- start 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 -- start start 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7984100e20 0x7f79841994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102570 0x7f79841999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 0x7f79841a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79841110e0 con 0x7f7984102ef0 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7984110f60 con 0x7f7984100e20 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f798adca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7984111260 con 0x7f7984102570 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f7989367640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 0x7f79841a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f7989367640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 0x7f79841a4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60328/0 (socket says 172.21.15.76:60328) 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f7989367640 1 -- 172.21.15.76:0/2162647052 learned_addr learned my addr 172.21.15.76:0/2162647052 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.016+0000 7f7983fff640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102570 0x7f79841999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7988b66640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7984100e20 0x7f79841994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7989367640 1 -- 172.21.15.76:0/2162647052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102570 msgr2=0x7f79841999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7989367640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102570 0x7f79841999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7989367640 1 -- 172.21.15.76:0/2162647052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7984100e20 msgr2=0x7f79841994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7989367640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7984100e20 0x7f79841994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7989367640 1 -- 172.21.15.76:0/2162647052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79841a4a70 con 0x7f7984102ef0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7989367640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 0x7f79841a4530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f797c00eaa0 tx=0x7f797c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7981ffb640 1 -- 172.21.15.76:0/2162647052 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c004d20 con 0x7f7984102ef0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7981ffb640 1 -- 172.21.15.76:0/2162647052 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f797c005020 con 0x7f7984102ef0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79841a4c40 con 0x7f7984102ef0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f7981ffb640 1 -- 172.21.15.76:0/2162647052 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c0116b0 con 0x7f7984102ef0 2024-09-19T07:51:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.017+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79841a5100 con 0x7f7984102ef0 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.019+0000 7f7981ffb640 1 -- 172.21.15.76:0/2162647052 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f797c0051d0 con 0x7f7984102ef0 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 Processor -- start 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 -- start start 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c753a0 0x5597a4c75780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f7981ffb640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79700a3440 0x7f79700a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 0x5597a4c84550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c86e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5597a4bdb2e0 con 0x5597a4c75cc0 2024-09-19T07:51:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5597a4b82ce0 con 0x5597a4c753a0 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f798d1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5597a4bd72a0 con 0x5597a4c84a90 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.020+0000 7f7988b66640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79700a3440 0x7f79700a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7983fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 0x5597a4c84550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7983fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 0x5597a4c84550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60344/0 (socket says 172.21.15.76:60344) 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7983fff640 1 -- 172.21.15.76:0/1507089816 learned_addr learned my addr 172.21.15.76:0/1507089816 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7981ffb640 1 -- 172.21.15.76:0/2162647052 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f797c0d00d0 con 0x7f7984102ef0 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c86e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7983fff640 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c753a0 0x5597a4c75780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 -- 172.21.15.76:0/1507089816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c753a0 msgr2=0x5597a4c75780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c753a0 0x5597a4c75780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 -- 172.21.15.76:0/1507089816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 msgr2=0x5597a4c84550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 0x5597a4c84550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 -- 172.21.15.76:0/1507089816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a4b67440 con 0x5597a4c84a90 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7983fff640 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 0x5597a4c84550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7988b66640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79700a3440 0x7f79700a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f796c005ab0 tx=0x7f796c005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f7989367640 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c86e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cd800 tx=0x7f797c09bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fc999aeba17a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.021+0000 7f797affd640 1 -- 172.21.15.76:0/1507089816 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c01f030 con 0x5597a4c84a90 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f797affd640 1 -- 172.21.15.76:0/1507089816 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f797c096e50 con 0x5597a4c84a90 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f797affd640 1 -- 172.21.15.76:0/1507089816 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c09b730 con 0x5597a4c84a90 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 -- 172.21.15.76:0/1507089816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 msgr2=0x5597a4c86e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c86e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cd800 tx=0x7f797c09bf20 comp rx=0 tx=0).stop 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 -- 172.21.15.76:0/1507089816 shutdown_connections 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c86e80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c75cc0 0x5597a4c84550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1507089816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c753a0 0x5597a4c75780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 -- 172.21.15.76:0/1507089816 >> 172.21.15.76:0/1507089816 conn(0x5597a4c71a30 msgr2=0x5597a4c71e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 -- 172.21.15.76:0/1507089816 shutdown_connections 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.022+0000 7f798d1a3740 1 -- 172.21.15.76:0/1507089816 wait complete. 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 -- start start 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 Processor -- start 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c84410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c816c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c81c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5597a4c876c0 con 0x5597a4c753a0 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5597a4b96050 con 0x5597a4c75cc0 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5597a4c87840 con 0x5597a4c84a90 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f7988b66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c84410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f798d1a3740 10 client.0 _ll_register_callbacks cb 0x5597a4bd6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f7988b66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c84410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60352/0 (socket says 172.21.15.76:60352) 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f7988b66640 1 -- 172.21.15.76:0/3448281084 learned_addr learned my addr 172.21.15.76:0/3448281084 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.023+0000 7f7989367640 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c81c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7988b66640 1 -- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 msgr2=0x5597a4c81c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7988b66640 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c81c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7988b66640 1 -- 172.21.15.76:0/3448281084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 msgr2=0x5597a4c816c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7988b66640 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c816c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7988b66640 1 -- 172.21.15.76:0/3448281084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a494c3c0 con 0x5597a4c753a0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7988b66640 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c84410 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f796c033000 tx=0x7f796c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87abd01d232b5617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7963fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7963fff640 1 -- 172.21.15.76:0/3448281084 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c04b020 con 0x5597a4c753a0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7963fff640 1 -- 172.21.15.76:0/3448281084 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f796c003af0 con 0x5597a4c753a0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f797c096e50 con 0x5597a4c753a0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f7963fff640 1 -- 172.21.15.76:0/3448281084 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f796c056050 con 0x5597a4c753a0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f798d1a3740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.024+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5597a4c930f0 con 0x5597a4c753a0 2024-09-19T07:51:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f7963fff640 1 -- 172.21.15.76:0/3448281084 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f797c096e50 con 0x5597a4c753a0 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f7963fff640 1 -- 172.21.15.76:0/3448281084 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f796c0046e0 con 0x5597a4c753a0 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f798d1a3740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f798d1a3740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f798d1a3740 20 client.15438 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f798d1a3740 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4c94550 0x5597a4c96a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f798d1a3740 4 client.15438 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a4be8850 con 0x5597a4c94550 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f7983fff640 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4c94550 0x5597a4c96a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f7983fff640 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4c94550 0x5597a4c96a10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8839bc22ebf8a265 server_cookie=2ce257c04c554ed6 in_seq=0 out_seq=0 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.025+0000 7f7963fff640 10 client.15438 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f7963fff640 1 -- 172.21.15.76:0/3448281084 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597a4be8850 con 0x5597a4c94550 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f7963fff640 10 client.15438 handle_command_reply: tid=0 2024-09-19T07:51:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 client.15438 shutdown 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 msgr2=0x5597a4c84410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c84410 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f796c033000 tx=0x7f796c009260 comp rx=0 tx=0).stop 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 shutdown_connections 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c81c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c816c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4c94550 0x5597a4c96a10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f7963fff640 0 client.15438 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 --2- 172.21.15.76:0/3448281084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c84410 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.026+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 >> 172.21.15.76:0/3448281084 conn(0x5597a4c71a30 msgr2=0x5597a4c77790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.027+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 shutdown_connections 2024-09-19T07:51:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.027+0000 7f798d1a3740 1 -- 172.21.15.76:0/3448281084 wait complete. 2024-09-19T07:51:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.027+0000 7f798d1a3740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.044+0000 7f798d1a3740 1 Processor -- start 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.044+0000 7f798d1a3740 1 -- start start 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c90960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c75cc0 0x5597a4c9c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c84a90 0x5597a4c9c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f798d1a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79841ae160 con 0x5597a4c753a0 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f798d1a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79841aba30 con 0x5597a4c84a90 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f798d1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79841a9880 con 0x5597a4c75cc0 2024-09-19T07:51:54.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c90960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c90960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60368/0 (socket says 172.21.15.76:60368) 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 -- 172.21.15.76:0/345269434 learned_addr learned my addr 172.21.15.76:0/345269434 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7983fff640 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c75cc0 0x5597a4c9c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 -- 172.21.15.76:0/345269434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c75cc0 msgr2=0x5597a4c9c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7989367640 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c84a90 0x5597a4c9c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c75cc0 0x5597a4c9c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 -- 172.21.15.76:0/345269434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c84a90 msgr2=0x5597a4c9c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c84a90 0x5597a4c9c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 -- 172.21.15.76:0/345269434 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a4c72ba0 con 0x5597a4c753a0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7989367640 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c84a90 0x5597a4c9c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f7988b66640 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c90960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f796c02a4c0 tx=0x7f796c047490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af6588a5a86e208 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.045+0000 7f797a7fc640 1 -- 172.21.15.76:0/345269434 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c04b050 con 0x5597a4c753a0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f797a7fc640 1 -- 172.21.15.76:0/345269434 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f796c0046c0 con 0x5597a4c753a0 2024-09-19T07:51:54.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f797a7fc640 1 -- 172.21.15.76:0/345269434 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c035050 con 0x5597a4c753a0 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 -- 172.21.15.76:0/345269434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 msgr2=0x5597a4c90960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c90960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f796c02a4c0 tx=0x7f796c047490 comp rx=0 tx=0).stop 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 -- 172.21.15.76:0/345269434 shutdown_connections 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c84a90 0x5597a4c9c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c75cc0 0x5597a4c9c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 --2- 172.21.15.76:0/345269434 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c90960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 -- 172.21.15.76:0/345269434 >> 172.21.15.76:0/345269434 conn(0x5597a4c71a30 msgr2=0x5597a4c7cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 -- 172.21.15.76:0/345269434 shutdown_connections 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.046+0000 7f798d1a3740 1 -- 172.21.15.76:0/345269434 wait complete. 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 -- start start 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 Processor -- start 2024-09-19T07:51:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c88ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c89020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c89560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79841a9ef0 con 0x5597a4c753a0 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79841ab360 con 0x5597a4c75cc0 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79841aa5c0 con 0x5597a4c84a90 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f798d1a3740 10 client.0 _ll_register_callbacks cb 0x7f796c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f7988b66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c88ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f7988b66640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c88ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60382/0 (socket says 172.21.15.76:60382) 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.047+0000 7f7988b66640 1 -- 172.21.15.76:0/1265016492 learned_addr learned my addr 172.21.15.76:0/1265016492 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7988b66640 1 -- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 msgr2=0x5597a4c89560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7988b66640 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c89560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7988b66640 1 -- 172.21.15.76:0/1265016492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 msgr2=0x5597a4c89020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7983fff640 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c89020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7988b66640 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c89020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7988b66640 1 -- 172.21.15.76:0/1265016492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a4cfe500 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7988b66640 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c88ae0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f796c005010 tx=0x7f796c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15204ab8a1925a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7963fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7963fff640 1 -- 172.21.15.76:0/1265016492 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c066070 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f796c0046c0 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.048+0000 7f7963fff640 1 -- 172.21.15.76:0/1265016492 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f796c003bc0 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f7963fff640 1 -- 172.21.15.76:0/1265016492 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f796c035040 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 10 client.15444 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5597a4cff780 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f7963fff640 1 -- 172.21.15.76:0/1265016492 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f796c0046c0 con 0x5597a4c753a0 2024-09-19T07:51:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f7963fff640 1 -- 172.21.15.76:0/1265016492 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f796c0479b0 con 0x5597a4c753a0 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 10 client.15444 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 20 client.15444 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4cffe30 0x5597a4d02240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 4 client.15444 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597a4be2d60 con 0x5597a4cffe30 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.049+0000 7f7983fff640 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4cffe30 0x5597a4d02240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.050+0000 7f7963fff640 10 client.15444 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.050+0000 7f7983fff640 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4cffe30 0x5597a4d02240 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59cea23cb2c17f5a server_cookie=7f86349b89b8d426 in_seq=0 out_seq=0 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.050+0000 7f7963fff640 1 -- 172.21.15.76:0/1265016492 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5597a4be2d60 con 0x5597a4cffe30 2024-09-19T07:51:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.050+0000 7f7963fff640 10 client.15444 handle_command_reply: tid=0 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.050+0000 7f798d1a3740 1 client.15444 shutdown 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 msgr2=0x5597a4c88ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c88ae0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f796c005010 tx=0x7f796c032ce0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 shutdown_connections 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a4c84a90 0x5597a4c89560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597a4c75cc0 0x5597a4c89020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597a4cffe30 0x5597a4d02240 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f7963fff640 0 client.15444 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 --2- 172.21.15.76:0/1265016492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597a4c753a0 0x5597a4c88ae0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 >> 172.21.15.76:0/1265016492 conn(0x5597a4c71a30 msgr2=0x5597a4c76f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 shutdown_connections 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 1 -- 172.21.15.76:0/1265016492 wait complete. 2024-09-19T07:51:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.051+0000 7f798d1a3740 20 client.15444 trim_cache size 0 max 16384 2024-09-19T07:51:54.060 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:54.060 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:51:54.060 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:51:54.060 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79700a3440 msgr2=0x7f79700a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79700a3440 0x7f79700a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f796c005ab0 tx=0x7f796c005a20 comp rx=0 tx=0).stop 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 msgr2=0x7f79841a4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 0x7f79841a4530 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f797c00eaa0 tx=0x7f797c00eea0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 shutdown_connections 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79700a3440 0x7f79700a5900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7984102ef0 0x7f79841a4530 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102570 0x7f79841999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 --2- 172.21.15.76:0/2162647052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7984100e20 0x7f79841994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 >> 172.21.15.76:0/2162647052 conn(0x7f79840fc7d0 msgr2=0x7f79840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 shutdown_connections 2024-09-19T07:51:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:54.052+0000 7f798adca640 1 -- 172.21.15.76:0/2162647052 wait complete. 2024-09-19T07:51:54.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:53 smithi137 ceph-mon[35309]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:54.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:53 smithi152 ceph-mon[35117]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:54.736 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:51:54.737 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:54.996 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:55.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 -- 172.21.15.76:0/312259033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24102570 msgr2=0x7f4a241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:55.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 --2- 172.21.15.76:0/312259033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24102570 0x7f4a241029b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009900 tx=0x7f4a1802a480 comp rx=0 tx=0).stop 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 -- 172.21.15.76:0/312259033 shutdown_connections 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 --2- 172.21.15.76:0/312259033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24102ef0 0x7f4a2410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 --2- 172.21.15.76:0/312259033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24102570 0x7f4a241029b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 --2- 172.21.15.76:0/312259033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a24100e20 0x7f4a24101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 -- 172.21.15.76:0/312259033 >> 172.21.15.76:0/312259033 conn(0x7f4a240fc7d0 msgr2=0x7f4a240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 -- 172.21.15.76:0/312259033 shutdown_connections 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 -- 172.21.15.76:0/312259033 wait complete. 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.494+0000 7f4a29dab640 1 Processor -- start 2024-09-19T07:51:55.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 -- start start 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 0x7f4a24198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24102570 0x7f4a24198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a24102ef0 0x7f4a2419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241110a0 con 0x7f4a24100e20 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24110f20 con 0x7f4a24102570 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a29dab640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24111220 con 0x7f4a24102ef0 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 0x7f4a24198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 0x7f4a24198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60404/0 (socket says 172.21.15.76:60404) 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 -- 172.21.15.76:0/3135858492 learned_addr learned my addr 172.21.15.76:0/3135858492 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a22ffd640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24102570 0x7f4a24198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:55.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a23fff640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a24102ef0 0x7f4a2419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 -- 172.21.15.76:0/3135858492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a24102ef0 msgr2=0x7f4a2419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a24102ef0 0x7f4a2419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 -- 172.21.15.76:0/3135858492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24102570 msgr2=0x7f4a24198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24102570 0x7f4a24198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.495+0000 7f4a237fe640 1 -- 172.21.15.76:0/3135858492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2419d610 con 0x7f4a24100e20 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.496+0000 7f4a237fe640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 0x7f4a24198660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d770 tx=0x7f4a1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.496+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14017070 con 0x7f4a24100e20 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.496+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2419d900 con 0x7f4a24100e20 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.496+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4a14005520 con 0x7f4a24100e20 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.496+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14010460 con 0x7f4a24100e20 2024-09-19T07:51:55.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.496+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a241a51e0 con 0x7f4a24100e20 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.497+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a241021b0 con 0x7f4a24100e20 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.498+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f4a14004ea0 con 0x7f4a24100e20 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.499+0000 7f4a20ff9640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4a0c0a3440 0x7f4a0c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.499+0000 7f4a22ffd640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4a0c0a3440 0x7f4a0c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.499+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f4a140cfd00 con 0x7f4a24100e20 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.499+0000 7f4a22ffd640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4a0c0a3440 0x7f4a0c0a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009230 tx=0x7f4a180058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:55.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.502+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a1409bf20 con 0x7f4a24100e20 2024-09-19T07:51:55.666 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T07:51:55.666 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:51:55.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.725+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a241999c0 con 0x7f4a24100e20 2024-09-19T07:51:55.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.726+0000 7f4a20ff9640 1 -- 172.21.15.76:0/3135858492 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f4a140a0220 con 0x7f4a24100e20 2024-09-19T07:51:55.727 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:55.727 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:55.727 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:55.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.729+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4a0c0a3440 msgr2=0x7f4a0c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.729+0000 7f4a29dab640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4a0c0a3440 0x7f4a0c0a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009230 tx=0x7f4a180058d0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.729+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 msgr2=0x7f4a24198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.729+0000 7f4a29dab640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 0x7f4a24198660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d770 tx=0x7f4a1400dc30 comp rx=0 tx=0).stop 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.729+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 shutdown_connections 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.729+0000 7f4a29dab640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4a0c0a3440 0x7f4a0c0a5900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.730+0000 7f4a29dab640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a24102ef0 0x7f4a2419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.730+0000 7f4a29dab640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24102570 0x7f4a24198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.730+0000 7f4a29dab640 1 --2- 172.21.15.76:0/3135858492 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4a24100e20 0x7f4a24198660 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.730+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 >> 172.21.15.76:0/3135858492 conn(0x7f4a240fc7d0 msgr2=0x7f4a2406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.730+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 shutdown_connections 2024-09-19T07:51:55.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:55.730+0000 7f4a29dab640 1 -- 172.21.15.76:0/3135858492 wait complete. 2024-09-19T07:51:55.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:55 smithi076 ceph-mon[30930]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:51:55.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:55 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3135858492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:56.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:55 smithi137 ceph-mon[35309]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:51:56.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:55 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3135858492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:56.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:55 smithi152 ceph-mon[35117]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:51:56.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:55 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3135858492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:56.624 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:51:56.692 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 -- 172.21.15.76:0/1609560662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca4101e10 msgr2=0x7f9ca41021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/1609560662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca4101e10 0x7f9ca41021f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009900 tx=0x7f9c9402a410 comp rx=0 tx=0).stop 2024-09-19T07:51:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 -- 172.21.15.76:0/1609560662 shutdown_connections 2024-09-19T07:51:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/1609560662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ca4106f40 0x7f9ca410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/1609560662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca41027c0 0x7f9ca4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/1609560662 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca4101e10 0x7f9ca41021f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 -- 172.21.15.76:0/1609560662 >> 172.21.15.76:0/1609560662 conn(0x7f9ca40fd8d0 msgr2=0x7f9ca40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:57.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 -- 172.21.15.76:0/1609560662 shutdown_connections 2024-09-19T07:51:57.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.188+0000 7f9ca8cce640 1 -- 172.21.15.76:0/1609560662 wait complete. 2024-09-19T07:51:57.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 Processor -- start 2024-09-19T07:51:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 -- start start 2024-09-19T07:51:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca4101e10 0x7f9ca40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 0x7f9ca4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ca4106f40 0x7f9ca4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4112120 con 0x7f9ca41027c0 2024-09-19T07:51:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4111fa0 con 0x7f9ca4101e10 2024-09-19T07:51:57.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca8cce640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41122a0 con 0x7f9ca4106f40 2024-09-19T07:51:57.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 0x7f9ca4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:57.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 0x7f9ca4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60424/0 (socket says 172.21.15.76:60424) 2024-09-19T07:51:57.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 -- 172.21.15.76:0/197032334 learned_addr learned my addr 172.21.15.76:0/197032334 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:57.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca2d9d640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ca4106f40 0x7f9ca4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:57.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca259c640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca4101e10 0x7f9ca40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:57.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 -- 172.21.15.76:0/197032334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ca4106f40 msgr2=0x7f9ca4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:57.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ca4106f40 0x7f9ca4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 -- 172.21.15.76:0/197032334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca4101e10 msgr2=0x7f9ca40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:57.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca4101e10 0x7f9ca40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9c9bfff640 1 -- 172.21.15.76:0/197032334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca41a6a60 con 0x7f9ca41027c0 2024-09-19T07:51:57.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.189+0000 7f9ca259c640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca4101e10 0x7f9ca40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:57.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.190+0000 7f9c9bfff640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 0x7f9ca4074a30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00b4a0 tx=0x7f9c8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:57.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.190+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c014070 con 0x7f9ca41027c0 2024-09-19T07:51:57.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.190+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c8c010b10 con 0x7f9ca41027c0 2024-09-19T07:51:57.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.190+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41a6d50 con 0x7f9ca41027c0 2024-09-19T07:51:57.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.190+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c017d60 con 0x7f9ca41027c0 2024-09-19T07:51:57.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.190+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41a7250 con 0x7f9ca41027c0 2024-09-19T07:51:57.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.191+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca41021f0 con 0x7f9ca41027c0 2024-09-19T07:51:57.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.192+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f9c8c017070 con 0x7f9ca41027c0 2024-09-19T07:51:57.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.193+0000 7f9c9b7fe640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c900a34c0 0x7f9c900a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:57.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.193+0000 7f9ca259c640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c900a34c0 0x7f9c900a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:57.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.193+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f9c8c0cf150 con 0x7f9ca41027c0 2024-09-19T07:51:57.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.193+0000 7f9ca259c640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c900a34c0 0x7f9c900a5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94032c80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:57.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.197+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c8c09bad0 con 0x7f9ca41027c0 2024-09-19T07:51:57.233 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:57.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.436+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ca402d7c0 con 0x7f9ca41027c0 2024-09-19T07:51:57.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.437+0000 7f9c9b7fe640 1 -- 172.21.15.76:0/197032334 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f9c8c09b3d0 con 0x7f9ca41027c0 2024-09-19T07:51:57.438 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:51:57.438 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:51:57.438 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:51:57.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.439+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c900a34c0 msgr2=0x7f9c900a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:57.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.439+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c900a34c0 0x7f9c900a5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94032c80 comp rx=0 tx=0).stop 2024-09-19T07:51:57.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.439+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 msgr2=0x7f9ca4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:57.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.439+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 0x7f9ca4074a30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00b4a0 tx=0x7f9c8c00b960 comp rx=0 tx=0).stop 2024-09-19T07:51:57.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.439+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 shutdown_connections 2024-09-19T07:51:57.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c900a34c0 0x7f9c900a5980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ca4106f40 0x7f9ca4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9ca41027c0 0x7f9ca4074a30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 --2- 172.21.15.76:0/197032334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ca4101e10 0x7f9ca40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:57.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 >> 172.21.15.76:0/197032334 conn(0x7f9ca40fd8d0 msgr2=0x7f9ca40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:57.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 shutdown_connections 2024-09-19T07:51:57.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:57.440+0000 7f9ca8cce640 1 -- 172.21.15.76:0/197032334 wait complete. 2024-09-19T07:51:58.064 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:57 smithi076 ceph-mon[30930]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:58.064 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:57 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/197032334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:58.092 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T07:51:58.092 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T07:51:58.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:57 smithi137 ceph-mon[35309]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:58.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:57 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/197032334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:58.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 -- 172.21.15.76:0/2838966406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60100aa0 msgr2=0x7eff6010ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 --2- 172.21.15.76:0/2838966406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60100aa0 0x7eff6010ea20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7eff58009ca0 tx=0x7eff5802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 -- 172.21.15.76:0/2838966406 shutdown_connections 2024-09-19T07:51:58.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 --2- 172.21.15.76:0/2838966406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60100aa0 0x7eff6010ea20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 --2- 172.21.15.76:0/2838966406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 0x7eff60100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 --2- 172.21.15.76:0/2838966406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60106b80 0x7eff60106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 -- 172.21.15.76:0/2838966406 >> 172.21.15.76:0/2838966406 conn(0x7eff60077230 msgr2=0x7eff600fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 -- 172.21.15.76:0/2838966406 shutdown_connections 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.281+0000 7eff65b67640 1 -- 172.21.15.76:0/2838966406 wait complete. 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.282+0000 7eff65b67640 1 Processor -- start 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.282+0000 7eff65b67640 1 -- start start 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff65b67640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 0x7eff601012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff65b67640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60100aa0 0x7eff60101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff65b67640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 0x7eff60101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff65b67640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7eff60112170 con 0x7eff60106b80 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff65b67640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff60111ff0 con 0x7eff60100100 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff65b67640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7eff601122f0 con 0x7eff60100aa0 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 0x7eff60101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 0x7eff60101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60436/0 (socket says 172.21.15.76:60436) 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff5ffff640 1 -- 172.21.15.76:0/3424907786 learned_addr learned my addr 172.21.15.76:0/3424907786 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:58.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 0x7eff601012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.283+0000 7eff5effd640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60100aa0 0x7eff60101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5ffff640 1 -- 172.21.15.76:0/3424907786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60100aa0 msgr2=0x7eff60101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5ffff640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60100aa0 0x7eff60101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5ffff640 1 -- 172.21.15.76:0/3424907786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 msgr2=0x7eff601012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5ffff640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 0x7eff601012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5ffff640 1 -- 172.21.15.76:0/3424907786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff601a69d0 con 0x7eff60106b80 2024-09-19T07:51:58.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5effd640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60100aa0 0x7eff60101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 0x7eff601012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.284+0000 7eff5ffff640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 0x7eff60101d60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff58009430 tx=0x7eff580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.285+0000 7eff5cff9640 1 -- 172.21.15.76:0/3424907786 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58003b70 con 0x7eff60106b80 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.285+0000 7eff5cff9640 1 -- 172.21.15.76:0/3424907786 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff58003d10 con 0x7eff60106b80 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.285+0000 7eff5cff9640 1 -- 172.21.15.76:0/3424907786 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5802fce0 con 0x7eff60106b80 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.285+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff601a6c60 con 0x7eff60106b80 2024-09-19T07:51:58.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.285+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff601a7150 con 0x7eff60106b80 2024-09-19T07:51:58.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.288+0000 7eff5cff9640 1 -- 172.21.15.76:0/3424907786 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7eff58004050 con 0x7eff60106b80 2024-09-19T07:51:58.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.288+0000 7eff67f40740 1 Processor -- start 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.288+0000 7eff67f40740 1 -- start start 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.288+0000 7eff67f40740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b1026090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.288+0000 7eff67f40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b10265d0 0x5577b1026a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff67f40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b1033760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff67f40740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5577b0f8c2f0 con 0x5577b1027b40 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff67f40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577b0f33cf0 con 0x5577b10265d0 2024-09-19T07:51:58.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff67f40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5577b0f882b0 con 0x5577b1031370 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b1026090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b1026090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60444/0 (socket says 172.21.15.76:60444) 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 -- 172.21.15.76:0/1396572235 learned_addr learned my addr 172.21.15.76:0/1396572235 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 -- 172.21.15.76:0/1396572235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 msgr2=0x5577b1033760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b1033760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 -- 172.21.15.76:0/1396572235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b10265d0 msgr2=0x5577b1026a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b10265d0 0x5577b1026a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5cff9640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7eff480a34c0 0x7eff480a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.289+0000 7eff5effd640 1 -- 172.21.15.76:0/1396572235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b0f183a0 con 0x5577b1027b40 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.290+0000 7eff5cff9640 1 -- 172.21.15.76:0/3424907786 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7eff580f10a0 con 0x7eff60106b80 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.290+0000 7eff5effd640 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b1026090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff54005fd0 tx=0x7eff5400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acae80a3b6479814 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.290+0000 7eff5effd640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7eff480a34c0 0x7eff480a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.290+0000 7eff45ffb640 1 -- 172.21.15.76:0/1396572235 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54016070 con 0x5577b1027b40 2024-09-19T07:51:58.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.290+0000 7eff45ffb640 1 -- 172.21.15.76:0/1396572235 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff54011bb0 con 0x5577b1027b40 2024-09-19T07:51:58.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff45ffb640 1 -- 172.21.15.76:0/1396572235 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff540103d0 con 0x5577b1027b40 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 -- 172.21.15.76:0/1396572235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 msgr2=0x5577b1026090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff5effd640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7eff480a34c0 0x7eff480a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff54018000 tx=0x7eff54010b40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b1026090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff54005fd0 tx=0x7eff5400e6c0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 -- 172.21.15.76:0/1396572235 shutdown_connections 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b1033760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b10265d0 0x5577b1026a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 --2- 172.21.15.76:0/1396572235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b1026090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 -- 172.21.15.76:0/1396572235 >> 172.21.15.76:0/1396572235 conn(0x5577b0fef310 msgr2=0x5577b1022c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 -- 172.21.15.76:0/1396572235 shutdown_connections 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.291+0000 7eff67f40740 1 -- 172.21.15.76:0/1396572235 wait complete. 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 -- start start 2024-09-19T07:51:58.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 Processor -- start 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b1030c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5577b1034110 con 0x5577b1027b40 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577b0f47060 con 0x5577b1031370 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.292+0000 7eff67f40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5577b1034290 con 0x5577b10265d0 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60450/0 (socket says 172.21.15.76:60450) 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 -- 172.21.15.76:0/2329165095 learned_addr learned my addr 172.21.15.76:0/2329165095 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff67f40740 10 client.0 _ll_register_callbacks cb 0x5577b0c9a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b1030c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5ffff640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 -- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 msgr2=0x5577b1030c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b1030c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 -- 172.21.15.76:0/2329165095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 msgr2=0x5577b102e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 -- 172.21.15.76:0/2329165095 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b0cfd3c0 con 0x5577b1027b40 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff5effd640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102dec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7eff5401ba60 tx=0x7eff54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15eb8e64dff53055 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff3effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff3effd640 1 -- 172.21.15.76:0/2329165095 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54016040 con 0x5577b1027b40 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff3effd640 1 -- 172.21.15.76:0/2329165095 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7eff5401bca0 con 0x5577b1027b40 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.293+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff54011bb0 con 0x5577b1027b40 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff3effd640 1 -- 172.21.15.76:0/2329165095 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff54010d30 con 0x5577b1027b40 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 10 client.15468 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577b1048330 con 0x5577b1027b40 2024-09-19T07:51:58.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff3effd640 1 -- 172.21.15.76:0/2329165095 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff54011bb0 con 0x5577b1027b40 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff3effd640 1 -- 172.21.15.76:0/2329165095 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7eff54030030 con 0x5577b1027b40 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 10 client.15468 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 10 client.15468 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 20 client.15468 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10496e0 0x5577b104bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 4 client.15468 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.294+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577b0f99860 con 0x5577b10496e0 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.295+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10496e0 0x5577b104bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.295+0000 7eff3effd640 10 client.15468 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.295+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10496e0 0x5577b104bad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6ac0eda99598759 server_cookie=9ab19e8a1b7b1dc2 in_seq=0 out_seq=0 2024-09-19T07:51:58.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff3effd640 1 -- 172.21.15.76:0/2329165095 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577b0f99860 con 0x5577b10496e0 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff3effd640 10 client.15468 handle_command_reply: tid=0 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 client.15468 shutdown 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 msgr2=0x5577b102dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102dec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7eff5401ba60 tx=0x7eff54019000 comp rx=0 tx=0).stop 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 shutdown_connections 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10496e0 0x5577b104bad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102dec0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 --2- 172.21.15.76:0/2329165095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b1030c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff3effd640 0 client.15468 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.296+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 >> 172.21.15.76:0/2329165095 conn(0x5577b0fef310 msgr2=0x5577b1028930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.297+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 shutdown_connections 2024-09-19T07:51:58.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.297+0000 7eff67f40740 1 -- 172.21.15.76:0/2329165095 wait complete. 2024-09-19T07:51:58.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.297+0000 7eff67f40740 20 client.15468 trim_cache size 0 max 16384 2024-09-19T07:51:58.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 Processor -- start 2024-09-19T07:51:58.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 -- start start 2024-09-19T07:51:58.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 0x5577b1051260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1027b40 0x5577b10517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b102b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ae0b0 con 0x5577b10265d0 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ab980 con 0x5577b1027b40 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.310+0000 7eff67f40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7eff601a97f0 con 0x5577b1031370 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 0x5577b1051260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 0x5577b1051260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60462/0 (socket says 172.21.15.76:60462) 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 -- 172.21.15.76:0/1688102998 learned_addr learned my addr 172.21.15.76:0/1688102998 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:58.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5ffff640 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b102b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:57 smithi152 ceph-mon[35117]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:51:58.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:57 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/197032334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:51:58.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5effd640 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1027b40 0x5577b10517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 -- 172.21.15.76:0/1688102998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 msgr2=0x5577b102b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b102b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 -- 172.21.15.76:0/1688102998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1027b40 msgr2=0x5577b10517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1027b40 0x5577b10517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 -- 172.21.15.76:0/1688102998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b1029ae0 con 0x5577b10265d0 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5effd640 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1027b40 0x5577b10517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.311+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 0x5577b1051260 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7eff50004700 tx=0x7eff50014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55413d2f07681c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:58.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff457fa640 1 -- 172.21.15.76:0/1688102998 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500140d0 con 0x5577b10265d0 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff457fa640 1 -- 172.21.15.76:0/1688102998 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff50014270 con 0x5577b10265d0 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff457fa640 1 -- 172.21.15.76:0/1688102998 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5001d970 con 0x5577b10265d0 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 -- 172.21.15.76:0/1688102998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 msgr2=0x5577b1051260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 0x5577b1051260 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7eff50004700 tx=0x7eff50014840 comp rx=0 tx=0).stop 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 -- 172.21.15.76:0/1688102998 shutdown_connections 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b1031370 0x5577b102b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1027b40 0x5577b10517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 --2- 172.21.15.76:0/1688102998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b10265d0 0x5577b1051260 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.312+0000 7eff67f40740 1 -- 172.21.15.76:0/1688102998 >> 172.21.15.76:0/1688102998 conn(0x5577b0fef310 msgr2=0x5577b102de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.313+0000 7eff67f40740 1 -- 172.21.15.76:0/1688102998 shutdown_connections 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.313+0000 7eff67f40740 1 -- 172.21.15.76:0/1688102998 wait complete. 2024-09-19T07:51:58.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.313+0000 7eff67f40740 1 -- start start 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.313+0000 7eff67f40740 1 Processor -- start 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b102ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7eff601a9e40 con 0x5577b1027b40 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ab2b0 con 0x5577b1031370 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7eff601aa510 con 0x5577b10265d0 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60478/0 (socket says 172.21.15.76:60478) 2024-09-19T07:51:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 -- 172.21.15.76:0/2937997506 learned_addr learned my addr 172.21.15.76:0/2937997506 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff67f40740 10 client.0 _ll_register_callbacks cb 0x7eff54009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b102ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5ffff640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 -- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 msgr2=0x5577b102ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b102ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 -- 172.21.15.76:0/2937997506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 msgr2=0x5577b102b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 -- 172.21.15.76:0/2937997506 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b10b3230 con 0x5577b1027b40 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5ffff640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:58.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff5effd640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102b390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff54005d00 tx=0x7eff54011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7761f2f1a25a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.314+0000 7eff3effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff3effd640 1 -- 172.21.15.76:0/2937997506 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54016030 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff3effd640 1 -- 172.21.15.76:0/2937997506 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7eff54019af0 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff50014270 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff3effd640 1 -- 172.21.15.76:0/2937997506 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff54019900 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff67f40740 10 client.15474 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577b10b43f0 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff3effd640 1 -- 172.21.15.76:0/2937997506 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff50014270 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.315+0000 7eff3effd640 1 -- 172.21.15.76:0/2937997506 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7eff54030070 con 0x5577b1027b40 2024-09-19T07:51:58.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.316+0000 7eff67f40740 10 client.15474 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:58.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.316+0000 7eff67f40740 10 client.15474 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:51:58.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.316+0000 7eff67f40740 20 client.15474 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:58.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.316+0000 7eff67f40740 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10b4b00 0x5577b10b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:58.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.316+0000 7eff67f40740 4 client.15474 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:51:58.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.316+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577b0f93d70 con 0x5577b10b4b00 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.317+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10b4b00 0x5577b10b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff3effd640 10 client.15474 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff5f7fe640 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10b4b00 0x5577b10b6f20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3b7eda4f1c8d5d2 server_cookie=837c001a75e7e993 in_seq=0 out_seq=0 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff3effd640 1 -- 172.21.15.76:0/2937997506 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577b0f93d70 con 0x5577b10b4b00 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff3effd640 10 client.15474 handle_command_reply: tid=0 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 client.15474 shutdown 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 msgr2=0x5577b102b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102b390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff54005d00 tx=0x7eff54011df0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 shutdown_connections 2024-09-19T07:51:58.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5577b10b4b00 0x5577b10b6f20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577b1031370 0x5577b102b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5577b1027b40 0x5577b102b390 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 --2- 172.21.15.76:0/2937997506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5577b10265d0 0x5577b102ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 >> 172.21.15.76:0/2937997506 conn(0x5577b0fef310 msgr2=0x5577b1021500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff3effd640 0 client.15474 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.318+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 shutdown_connections 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff67f40740 1 -- 172.21.15.76:0/2937997506 wait complete. 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff67f40740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T07:51:58.324 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7eff480a34c0 msgr2=0x7eff480a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7eff480a34c0 0x7eff480a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff54018000 tx=0x7eff54010b40 comp rx=0 tx=0).stop 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 msgr2=0x7eff60101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 0x7eff60101d60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff58009430 tx=0x7eff580319f0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 shutdown_connections 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7eff480a34c0 0x7eff480a5980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff60106b80 0x7eff60101d60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff60100aa0 0x7eff60101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 --2- 172.21.15.76:0/3424907786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff60100100 0x7eff601012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:58.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.319+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 >> 172.21.15.76:0/3424907786 conn(0x7eff60077230 msgr2=0x7eff60104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:58.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.320+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 shutdown_connections 2024-09-19T07:51:58.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:58.320+0000 7eff65b67640 1 -- 172.21.15.76:0/3424907786 wait complete. 2024-09-19T07:51:59.015 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:51:59.039 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:59.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 -- 172.21.15.76:0/3304734564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 msgr2=0x7f700010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 --2- 172.21.15.76:0/3304734564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f700010da40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009ca0 tx=0x7f6ff802a950 comp rx=0 tx=0).stop 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 -- 172.21.15.76:0/3304734564 shutdown_connections 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 --2- 172.21.15.76:0/3304734564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f700010da40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 --2- 172.21.15.76:0/3304734564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7000102570 0x7f70001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 --2- 172.21.15.76:0/3304734564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7000100e20 0x7f7000101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 -- 172.21.15.76:0/3304734564 >> 172.21.15.76:0/3304734564 conn(0x7f70000fc7d0 msgr2=0x7f70000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 -- 172.21.15.76:0/3304734564 shutdown_connections 2024-09-19T07:51:59.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.547+0000 7f70070f5640 1 -- 172.21.15.76:0/3304734564 wait complete. 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.548+0000 7f70070f5640 1 Processor -- start 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.548+0000 7f70070f5640 1 -- start start 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f70070f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7000100e20 0x7f70001993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f70070f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7000102570 0x7f7000199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f70070f5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f70001a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f70070f5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f70001110a0 con 0x7f7000102ef0 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f70070f5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7000110f20 con 0x7f7000100e20 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f70070f5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7000111220 con 0x7f7000102570 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f70001a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f70001a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60482/0 (socket says 172.21.15.76:60482) 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 -- 172.21.15.76:0/3578143324 learned_addr learned my addr 172.21.15.76:0/3578143324 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f6ffffff640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7000102570 0x7f7000199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7004e91640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7000100e20 0x7f70001993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 -- 172.21.15.76:0/3578143324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7000102570 msgr2=0x7f7000199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7000102570 0x7f7000199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 -- 172.21.15.76:0/3578143324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7000100e20 msgr2=0x7f70001993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7000100e20 0x7f70001993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 -- 172.21.15.76:0/3578143324 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70001a4990 con 0x7f7000102ef0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f7005692640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f70001a4450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8005cc0 tx=0x7f6ff8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.549+0000 7f6ffdffb640 1 -- 172.21.15.76:0/3578143324 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8034040 con 0x7f7000102ef0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.550+0000 7f6ffdffb640 1 -- 172.21.15.76:0/3578143324 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ff802f7d0 con 0x7f7000102ef0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.550+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70001a4b60 con 0x7f7000102ef0 2024-09-19T07:51:59.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.550+0000 7f6ffdffb640 1 -- 172.21.15.76:0/3578143324 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8045480 con 0x7f7000102ef0 2024-09-19T07:51:59.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.550+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70001a5010 con 0x7f7000102ef0 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 Processor -- start 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f6ffdffb640 1 -- 172.21.15.76:0/3578143324 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f6ff8037020 con 0x7f7000102ef0 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 -- start start 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afcbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afd6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd6940 0x55e31afd8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e31af312a0 con 0x55e31afcb760 2024-09-19T07:51:59.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e31aed8b10 con 0x55e31afcc080 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.553+0000 7f70094ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e31af2d260 con 0x55e31afd6940 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afd6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afd6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:38758/0 (socket says 172.21.15.76:38758) 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 -- 172.21.15.76:0/2028639560 learned_addr learned my addr 172.21.15.76:0/2028639560 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f6ffffff640 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afcbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f6ffdffb640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6ff00a34c0 0x7f6ff00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7005692640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6ff00a34c0 0x7f6ff00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 -- 172.21.15.76:0/2028639560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd6940 msgr2=0x55e31afd8d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd6940 0x55e31afd8d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 -- 172.21.15.76:0/2028639560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 msgr2=0x55e31afcbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afcbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 -- 172.21.15.76:0/2028639560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31aca2b90 con 0x55e31afcc080 2024-09-19T07:51:59.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f6ffdffb640 1 -- 172.21.15.76:0/3578143324 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f6ff80f0b60 con 0x7f7000102ef0 2024-09-19T07:51:59.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f6ffffff640 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afcbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:59.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.554+0000 7f7004e91640 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afd6400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009d20 tx=0x7f6ff4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f0571aac0f24fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:59.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.555+0000 7f6feaffd640 1 -- 172.21.15.76:0/2028639560 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff401e070 con 0x55e31afcc080 2024-09-19T07:51:59.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.555+0000 7f7005692640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6ff00a34c0 0x7f6ff00a5980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ee360 tx=0x7f6ff80b9120 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:59.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.555+0000 7f6feaffd640 1 -- 172.21.15.76:0/2028639560 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ff4019b30 con 0x55e31afcc080 2024-09-19T07:51:59.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.555+0000 7f6feaffd640 1 -- 172.21.15.76:0/2028639560 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400ec00 con 0x55e31afcc080 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 -- 172.21.15.76:0/2028639560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 msgr2=0x55e31afd6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afd6400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009d20 tx=0x7f6ff4011810 comp rx=0 tx=0).stop 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 -- 172.21.15.76:0/2028639560 shutdown_connections 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd6940 0x55e31afd8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afd6400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 --2- 172.21.15.76:0/2028639560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afcbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 -- 172.21.15.76:0/2028639560 >> 172.21.15.76:0/2028639560 conn(0x55e31afc7cf0 msgr2=0x55e31afc80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 -- 172.21.15.76:0/2028639560 shutdown_connections 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 -- 172.21.15.76:0/2028639560 wait complete. 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 -- start start 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.556+0000 7f70094ce740 1 Processor -- start 2024-09-19T07:51:59.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afd3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd6940 0x55e31afd42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e31afd9510 con 0x55e31afd6940 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e31aeb96e0 con 0x55e31afcb760 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e31afd9690 con 0x55e31afcc080 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f70094ce740 10 client.0 _ll_register_callbacks cb 0x55e31aedda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f6ffffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f6ffffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:38774/0 (socket says 172.21.15.76:38774) 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f6ffffff640 1 -- 172.21.15.76:0/766367865 learned_addr learned my addr 172.21.15.76:0/766367865 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f6ffffff640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd6940 0x55e31afd42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.557+0000 7f7004e91640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afd3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6ffffff640 1 -- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 msgr2=0x55e31afd3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6ffffff640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afd3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6ffffff640 1 -- 172.21.15.76:0/766367865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 msgr2=0x55e31afd3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6ffffff640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6ffffff640 1 -- 172.21.15.76:0/766367865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e31afe2a30 con 0x55e31afd6940 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f7004e91640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afd3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6ffffff640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd6940 0x55e31afd42d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6fec01cf10 tx=0x7f6fec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370a5be8b607881c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6fdffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6fdffff640 1 -- 172.21.15.76:0/766367865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec01c2d0 con 0x55e31afd6940 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6fdffff640 1 -- 172.21.15.76:0/766367865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f6fec005020 con 0x55e31afd6940 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ff4019b30 con 0x55e31afd6940 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f6fdffff640 1 -- 172.21.15.76:0/766367865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6fec02d050 con 0x55e31afd6940 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f70094ce740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:59.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.558+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e31afe53c0 con 0x55e31afd6940 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f6fdffff640 1 -- 172.21.15.76:0/766367865 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ff4019b30 con 0x55e31afd6940 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f6fdffff640 1 -- 172.21.15.76:0/766367865 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6fec01a560 con 0x55e31afd6940 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f70094ce740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f70094ce740 10 client.15486 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f70094ce740 20 client.15486 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f70094ce740 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31afe6880 0x55e31afe8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f70094ce740 4 client.15486 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.559+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e31af3e9d0 con 0x55e31afe6880 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.560+0000 7f7004e91640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31afe6880 0x55e31afe8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.560+0000 7f7004e91640 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31afe6880 0x55e31afe8c70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2392fa407ec1988 server_cookie=f1c63dde54fa87f4 in_seq=0 out_seq=0 2024-09-19T07:51:59.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.560+0000 7f6fdffff640 10 client.15486 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:59.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f6fdffff640 1 -- 172.21.15.76:0/766367865 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e31af3e9d0 con 0x55e31afe6880 2024-09-19T07:51:59.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f6fdffff640 10 client.15486 handle_command_reply: tid=0 2024-09-19T07:51:59.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 client.15486 shutdown 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd6940 msgr2=0x55e31afd42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd6940 0x55e31afd42d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6fec01cf10 tx=0x7f6fec005f90 comp rx=0 tx=0).stop 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 shutdown_connections 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31afe6880 0x55e31afe8c70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f6fdffff640 0 client.15486 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd6940 0x55e31afd42d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afd3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 --2- 172.21.15.76:0/766367865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 >> 172.21.15.76:0/766367865 conn(0x55e31afc7cf0 msgr2=0x55e31afcda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:59.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 shutdown_connections 2024-09-19T07:51:59.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 1 -- 172.21.15.76:0/766367865 wait complete. 2024-09-19T07:51:59.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.561+0000 7f70094ce740 20 client.15486 trim_cache size 0 max 16384 2024-09-19T07:51:59.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.583+0000 7f70094ce740 1 Processor -- start 2024-09-19T07:51:59.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.583+0000 7f70094ce740 1 -- start start 2024-09-19T07:51:59.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.583+0000 7f70094ce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.583+0000 7f70094ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afee540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.583+0000 7f70094ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd2c40 0x55e31afeea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f70094ce740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f70001adff0 con 0x55e31afd2c40 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f70094ce740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70001ab8c0 con 0x55e31afcb760 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f70094ce740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f70001a9710 con 0x55e31afcc080 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f6ffffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afee540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:58906/0 (socket says 172.21.15.76:58906) 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 -- 172.21.15.76:0/3465342970 learned_addr learned my addr 172.21.15.76:0/3465342970 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f6ffffff640 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd2c40 0x55e31afeea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 -- 172.21.15.76:0/3465342970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 msgr2=0x55e31afd2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 -- 172.21.15.76:0/3465342970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd2c40 msgr2=0x55e31afeea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd2c40 0x55e31afeea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 -- 172.21.15.76:0/3465342970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31afc3260 con 0x55e31afcc080 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f6ffffff640 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd2c40 0x55e31afeea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.584+0000 7f7004e91640 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afee540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400a010 tx=0x7f6ff400e880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7740ea71b0bddd86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.585+0000 7f6fea7fc640 1 -- 172.21.15.76:0/3465342970 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4035070 con 0x55e31afcc080 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.585+0000 7f6fea7fc640 1 -- 172.21.15.76:0/3465342970 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ff401f040 con 0x55e31afcc080 2024-09-19T07:51:59.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.585+0000 7f6fea7fc640 1 -- 172.21.15.76:0/3465342970 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff401e040 con 0x55e31afcc080 2024-09-19T07:51:59.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.585+0000 7f70094ce740 1 -- 172.21.15.76:0/3465342970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 msgr2=0x55e31afee540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.585+0000 7f70094ce740 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afee540 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400a010 tx=0x7f6ff400e880 comp rx=0 tx=0).stop 2024-09-19T07:51:59.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 -- 172.21.15.76:0/3465342970 shutdown_connections 2024-09-19T07:51:59.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afd2c40 0x55e31afeea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afcc080 0x55e31afee540 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 --2- 172.21.15.76:0/3465342970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcb760 0x55e31afd2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 -- 172.21.15.76:0/3465342970 >> 172.21.15.76:0/3465342970 conn(0x55e31afc7cf0 msgr2=0x55e31afd1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 -- 172.21.15.76:0/3465342970 shutdown_connections 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 -- 172.21.15.76:0/3465342970 wait complete. 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 -- start start 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 Processor -- start 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.586+0000 7f70094ce740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afdadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f70094ce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afdb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f70094ce740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd2c40 0x55e31b058d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f6ffffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afdadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f6ffffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afdadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60518/0 (socket says 172.21.15.76:60518) 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f6ffffff640 1 -- 172.21.15.76:0/2782880029 learned_addr learned my addr 172.21.15.76:0/2782880029 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f70001a9d80 con 0x55e31afcb760 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70001ab1f0 con 0x55e31afcc080 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f70001aa450 con 0x55e31afd2c40 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f70094ce740 10 client.0 _ll_register_callbacks cb 0x7f6fec01cb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f7004e91640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afdb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f6ffffff640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd2c40 0x55e31b058d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f7004e91640 1 -- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd2c40 msgr2=0x55e31b058d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f7004e91640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd2c40 0x55e31b058d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f7004e91640 1 -- 172.21.15.76:0/2782880029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 msgr2=0x55e31afdadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f7004e91640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afdadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.587+0000 7f7004e91640 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e31afc8980 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f7004e91640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afdb300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55e31afc7be0 tx=0x7f6ff4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935f62d46927b1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f6fdffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f6fdffff640 1 -- 172.21.15.76:0/2782880029 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff401e070 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f6fdffff640 1 -- 172.21.15.76:0/2782880029 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f6ff40050b0 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ff401f040 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f6fdffff640 1 -- 172.21.15.76:0/2782880029 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ff4035070 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f70094ce740 10 client.24980 fetch_fsmap learned FSMap version 25 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.588+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e31b05a390 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f6fdffff640 1 -- 172.21.15.76:0/2782880029 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ff401f040 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f6fdffff640 1 -- 172.21.15.76:0/2782880029 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ff402f070 con 0x55e31afcc080 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f70094ce740 10 client.24980 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f70094ce740 10 client.24980 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f70094ce740 20 client.24980 populate_metadata read hostname 'smithi076' 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f70094ce740 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31b05a820 0x55e31b05cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:51:59.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f70094ce740 4 client.24980 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T07:51:59.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55e31af38d20 con 0x55e31b05a820 2024-09-19T07:51:59.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.589+0000 7f6ffffff640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31b05a820 0x55e31b05cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:51:59.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.590+0000 7f6ffffff640 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31b05a820 0x55e31b05cc10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e775f268448b3c server_cookie=974b44943fdc3729 in_seq=0 out_seq=0 2024-09-19T07:51:59.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.590+0000 7f6fdffff640 10 client.24980 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:59.601 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f6fdffff640 1 -- 172.21.15.76:0/2782880029 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e31af38d20 con 0x55e31b05a820 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f6fdffff640 10 client.24980 handle_command_reply: tid=0 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 client.24980 shutdown 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 msgr2=0x55e31afdb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afdb300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55e31afc7be0 tx=0x7f6ff4009c20 comp rx=0 tx=0).stop 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 shutdown_connections 2024-09-19T07:51:59.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e31afd2c40 0x55e31b058d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e31afcc080 0x55e31afdb300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e31b05a820 0x55e31b05cc10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 --2- 172.21.15.76:0/2782880029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e31afcb760 0x55e31afdadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f6fdffff640 0 client.24980 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 >> 172.21.15.76:0/2782880029 conn(0x55e31afc7cf0 msgr2=0x55e31afd37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 shutdown_connections 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 1 -- 172.21.15.76:0/2782880029 wait complete. 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.603+0000 7f70094ce740 20 client.24980 trim_cache size 0 max 16384 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:51:59.604 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 25, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 2, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "6c86a709": { 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 2, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 131.2, 2024-09-19T07:51:59.605 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:59.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:59.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:59.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:51:59.607 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6ff00a34c0 msgr2=0x7f6ff00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6ff00a34c0 0x7f6ff00a5980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80ee360 tx=0x7f6ff80b9120 comp rx=0 tx=0).stop 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 msgr2=0x7f70001a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f70001a4450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8005cc0 tx=0x7f6ff8030000 comp rx=0 tx=0).stop 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 shutdown_connections 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6ff00a34c0 0x7f6ff00a5980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7000102ef0 0x7f70001a4450 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7000102570 0x7f7000199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 --2- 172.21.15.76:0/3578143324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7000100e20 0x7f70001993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:51:59.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 >> 172.21.15.76:0/3578143324 conn(0x7f70000fc7d0 msgr2=0x7f70001067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:51:59.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 shutdown_connections 2024-09-19T07:51:59.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:51:59.604+0000 7f70070f5640 1 -- 172.21.15.76:0/3578143324 wait complete. 2024-09-19T07:52:00.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:51:59 smithi137 ceph-mon[35309]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:52:00.184 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:51:59 smithi076 ceph-mon[30930]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:52:00.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:51:59 smithi152 ceph-mon[35117]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:52:00.490 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6c86a709', quiesce took 4.8 seconds. Will release after: 6.3999999999999995 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 -- 172.21.15.76:0/756749379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748100a80 msgr2=0x7ff748100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/756749379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748100a80 0x7ff748100ee0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009930 tx=0x7ff73c02a420 comp rx=0 tx=0).stop 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 -- 172.21.15.76:0/756749379 shutdown_connections 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/756749379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff748101420 0x7ff74810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/756749379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748100a80 0x7ff748100ee0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/756749379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff748106a80 0x7ff748106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 -- 172.21.15.76:0/756749379 >> 172.21.15.76:0/756749379 conn(0x7ff7480fc7a0 msgr2=0x7ff7480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 -- 172.21.15.76:0/756749379 shutdown_connections 2024-09-19T07:52:00.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.752+0000 7ff74c8bb640 1 -- 172.21.15.76:0/756749379 wait complete. 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 Processor -- start 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 -- start start 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff748100a80 0x7ff7480fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff748101420 0x7ff7480fd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 0x7ff7480fd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff748110f60 con 0x7ff748106a80 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff748110de0 con 0x7ff748100a80 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74c8bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481110e0 con 0x7ff748101420 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 0x7ff7480fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 0x7ff7480fd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60536/0 (socket says 172.21.15.76:60536) 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 -- 172.21.15.76:0/1780211704 learned_addr learned my addr 172.21.15.76:0/1780211704 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff745d9b640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff748101420 0x7ff7480fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff74659c640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff748100a80 0x7ff7480fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 -- 172.21.15.76:0/1780211704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff748101420 msgr2=0x7ff7480fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff748101420 0x7ff7480fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 -- 172.21.15.76:0/1780211704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff748100a80 msgr2=0x7ff7480fcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff748100a80 0x7ff7480fcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.753+0000 7ff746d9d640 1 -- 172.21.15.76:0/1780211704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7481a69f0 con 0x7ff748106a80 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.754+0000 7ff746d9d640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 0x7ff7480fd870 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff74000eb10 tx=0x7ff74000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.754+0000 7ff7377fe640 1 -- 172.21.15.76:0/1780211704 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740004b20 con 0x7ff748106a80 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.754+0000 7ff7377fe640 1 -- 172.21.15.76:0/1780211704 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff740004cc0 con 0x7ff748106a80 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.754+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7481a6ce0 con 0x7ff748106a80 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.754+0000 7ff7377fe640 1 -- 172.21.15.76:0/1780211704 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400107f0 con 0x7ff748106a80 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.754+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481a71a0 con 0x7ff748106a80 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.757+0000 7ff74ec94740 1 Processor -- start 2024-09-19T07:52:00.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.757+0000 7ff7377fe640 1 -- 172.21.15.76:0/1780211704 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7ff740005020 con 0x7ff748106a80 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.757+0000 7ff74ec94740 1 -- start start 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 0x55d4a13ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13ca5d0 0x55d4a13caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74ec94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d4a13302f0 con 0x55d4a13cbb40 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74ec94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d4a12d7cf0 con 0x55d4a13d5370 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74ec94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d4a132c2b0 con 0x55d4a13ca5d0 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 0x55d4a13ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 0x55d4a13ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60548/0 (socket says 172.21.15.76:60548) 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 -- 172.21.15.76:0/1448590518 learned_addr learned my addr 172.21.15.76:0/1448590518 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff74659c640 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13ca5d0 0x55d4a13caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 -- 172.21.15.76:0/1448590518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13ca5d0 msgr2=0x55d4a13caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13ca5d0 0x55d4a13caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 -- 172.21.15.76:0/1448590518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 msgr2=0x55d4a13d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.758+0000 7ff745d9b640 1 -- 172.21.15.76:0/1448590518 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a12bc3a0 con 0x55d4a13cbb40 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff7377fe640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff7300a3440 0x7ff7300a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff745d9b640 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 0x55d4a13ca090 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff73c005c40 tx=0x7ff73c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c92c0dc7b7c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff74659c640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff7300a3440 0x7ff7300a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff7377fe640 1 -- 172.21.15.76:0/1780211704 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff7400d0510 con 0x7ff748106a80 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff734ff9640 1 -- 172.21.15.76:0/1448590518 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c044030 con 0x55d4a13cbb40 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff734ff9640 1 -- 172.21.15.76:0/1448590518 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff73c031920 con 0x55d4a13cbb40 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.759+0000 7ff734ff9640 1 -- 172.21.15.76:0/1448590518 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c035040 con 0x55d4a13cbb40 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 -- 172.21.15.76:0/1448590518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 msgr2=0x55d4a13ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74659c640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff7300a3440 0x7ff7300a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55d4a13c7ac0 tx=0x7ff738005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 0x55d4a13ca090 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff73c005c40 tx=0x7ff73c005fd0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 -- 172.21.15.76:0/1448590518 shutdown_connections 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13ca5d0 0x55d4a13caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1448590518 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13cbb40 0x55d4a13ca090 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 -- 172.21.15.76:0/1448590518 >> 172.21.15.76:0/1448590518 conn(0x55d4a1393310 msgr2=0x55d4a13c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 -- 172.21.15.76:0/1448590518 shutdown_connections 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 -- 172.21.15.76:0/1448590518 wait complete. 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.760+0000 7ff74ec94740 1 -- start start 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 Processor -- start 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d4a13d8010 con 0x55d4a13d5370 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d4a12eb060 con 0x55d4a13ca5d0 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d4a13d8190 con 0x55d4a13cbb40 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74ec94740 10 client.0 _ll_register_callbacks cb 0x55d4a103e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13d27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60564/0 (socket says 172.21.15.76:60564) 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff746d9d640 1 -- 172.21.15.76:0/3373373485 learned_addr learned my addr 172.21.15.76:0/3373373485 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff74659c640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff745d9b640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff746d9d640 1 -- 172.21.15.76:0/3373373485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 msgr2=0x55d4a13d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.761+0000 7ff746d9d640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff746d9d640 1 -- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 msgr2=0x55d4a13d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff746d9d640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff746d9d640 1 -- 172.21.15.76:0/3373373485 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a10a13c0 con 0x55d4a13d5370 2024-09-19T07:52:00.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff746d9d640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13d27f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff74009c380 tx=0x7ff74009bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c8710f8bcd4880 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff72dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff72dffb640 1 -- 172.21.15.76:0/3373373485 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400ce060 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff72dffb640 1 -- 172.21.15.76:0/3373373485 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff7400a4e60 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff73c031920 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff72dffb640 1 -- 172.21.15.76:0/3373373485 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff7400a0a30 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff74ec94740 10 client.15504 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d4a13e3b00 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff72dffb640 1 -- 172.21.15.76:0/3373373485 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff7400a52f0 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.762+0000 7ff72dffb640 1 -- 172.21.15.76:0/3373373485 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff74009bad0 con 0x55d4a13d5370 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74ec94740 10 client.15504 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74ec94740 10 client.15504 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74ec94740 20 client.15504 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74ec94740 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a13e5010 0x55d4a13e7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74ec94740 4 client.15504 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff73c031920 con 0x55d4a13e5010 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74659c640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a13e5010 0x55d4a13e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff74659c640 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a13e5010 0x55d4a13e7400 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b1a7a9b0298bc server_cookie=d69e1394edba54b4 in_seq=0 out_seq=0 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.763+0000 7ff72dffb640 10 client.15504 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff72dffb640 1 -- 172.21.15.76:0/3373373485 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff73c031920 con 0x55d4a13e5010 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff72dffb640 10 client.15504 handle_command_reply: tid=0 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 client.15504 shutdown 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 msgr2=0x55d4a13d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13d27f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff74009c380 tx=0x7ff74009bfe0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 shutdown_connections 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a13e5010 0x55d4a13e7400 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13d27f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 --2- 172.21.15.76:0/3373373485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 >> 172.21.15.76:0/3373373485 conn(0x55d4a1393310 msgr2=0x55d4a13cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:00.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff72dffb640 0 client.15504 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:00.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 shutdown_connections 2024-09-19T07:52:00.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.764+0000 7ff74ec94740 1 -- 172.21.15.76:0/3373373485 wait complete. 2024-09-19T07:52:00.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.765+0000 7ff74ec94740 20 client.15504 trim_cache size 0 max 16384 2024-09-19T07:52:00.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 Processor -- start 2024-09-19T07:52:00.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 -- start start 2024-09-19T07:52:00.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481b23f0 con 0x55d4a13ca5d0 2024-09-19T07:52:00.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481afcc0 con 0x55d4a13d5370 2024-09-19T07:52:00.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74ec94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481adb10 con 0x55d4a13cbb40 2024-09-19T07:52:00.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60580/0 (socket says 172.21.15.76:60580) 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74659c640 1 -- 172.21.15.76:0/1516012959 learned_addr learned my addr 172.21.15.76:0/1516012959 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff745d9b640 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff746d9d640 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.789+0000 7ff74659c640 1 -- 172.21.15.76:0/1516012959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 msgr2=0x55d4a13cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff74659c640 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff74659c640 1 -- 172.21.15.76:0/1516012959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 msgr2=0x55d4a13eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff74659c640 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13eccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff74659c640 1 -- 172.21.15.76:0/1516012959 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a13d05f0 con 0x55d4a13ca5d0 2024-09-19T07:52:00.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff74659c640 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cd120 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55d4a13e7c70 tx=0x7ff738016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd552cd19091de3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:00.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff72ffff640 1 -- 172.21.15.76:0/1516012959 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738003d20 con 0x55d4a13ca5d0 2024-09-19T07:52:00.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff72ffff640 1 -- 172.21.15.76:0/1516012959 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff73802a920 con 0x55d4a13ca5d0 2024-09-19T07:52:00.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.790+0000 7ff72ffff640 1 -- 172.21.15.76:0/1516012959 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738011c20 con 0x55d4a13ca5d0 2024-09-19T07:52:00.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 -- 172.21.15.76:0/1516012959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 msgr2=0x55d4a13cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cd120 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55d4a13e7c70 tx=0x7ff738016000 comp rx=0 tx=0).stop 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 -- 172.21.15.76:0/1516012959 shutdown_connections 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13d5370 0x55d4a13eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 --2- 172.21.15.76:0/1516012959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cd120 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 -- 172.21.15.76:0/1516012959 >> 172.21.15.76:0/1516012959 conn(0x55d4a1393310 msgr2=0x55d4a13c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 -- 172.21.15.76:0/1516012959 shutdown_connections 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.791+0000 7ff74ec94740 1 -- 172.21.15.76:0/1516012959 wait complete. 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 -- start start 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 Processor -- start 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ae180 con 0x55d4a13d5370 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481af5f0 con 0x55d4a13ca5d0 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ae850 con 0x55d4a13cbb40 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74ec94740 10 client.0 _ll_register_callbacks cb 0x7ff7400cda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff745d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60582/0 (socket says 172.21.15.76:60582) 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff746d9d640 1 -- 172.21.15.76:0/2250140769 learned_addr learned my addr 172.21.15.76:0/2250140769 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff74659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:38862/0 (socket says 172.21.15.76:38862) 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.792+0000 7ff745d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:58960/0 (socket says 172.21.15.76:58960) 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff745d9b640 1 -- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 msgr2=0x55d4a13cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff745d9b640 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff745d9b640 1 -- 172.21.15.76:0/2250140769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 msgr2=0x55d4a13cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff745d9b640 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff745d9b640 1 -- 172.21.15.76:0/2250140769 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a144eea0 con 0x55d4a13cbb40 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff745d9b640 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cf7f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55d4a13d18f0 tx=0x7ff73c0315a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a76c331fc3729e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff72dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff72dffb640 1 -- 172.21.15.76:0/2250140769 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c04e070 con 0x55d4a13cbb40 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff73802a920 con 0x55d4a13cbb40 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.793+0000 7ff72dffb640 1 -- 172.21.15.76:0/2250140769 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff73c004040 con 0x55d4a13cbb40 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.794+0000 7ff72dffb640 1 -- 172.21.15.76:0/2250140769 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff73c05a050 con 0x55d4a13cbb40 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.794+0000 7ff74ec94740 10 client.25072 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.794+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d4a1450140 con 0x55d4a13cbb40 2024-09-19T07:52:00.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.794+0000 7ff72dffb640 1 -- 172.21.15.76:0/2250140769 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff73c004240 con 0x55d4a13cbb40 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff72dffb640 1 -- 172.21.15.76:0/2250140769 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff73c04a450 con 0x55d4a13cbb40 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74ec94740 10 client.25072 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74ec94740 10 client.25072 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74ec94740 20 client.25072 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74ec94740 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a14503d0 0x55d4a14527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74ec94740 4 client.25072 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff73802a920 con 0x55d4a14503d0 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.795+0000 7ff74659c640 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a14503d0 0x55d4a14527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff72dffb640 10 client.25072 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74659c640 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a14503d0 0x55d4a14527c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f43a9a0d15c8fb69 server_cookie=171a60d12d2b8a69 in_seq=0 out_seq=0 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff72dffb640 1 -- 172.21.15.76:0/2250140769 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff73802a920 con 0x55d4a14503d0 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff72dffb640 10 client.25072 handle_command_reply: tid=0 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 client.25072 shutdown 2024-09-19T07:52:00.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 msgr2=0x55d4a13cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cf7f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55d4a13d18f0 tx=0x7ff73c0315a0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 shutdown_connections 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d4a14503d0 0x55d4a14527c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4a13d5370 0x55d4a13cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4a13cbb40 0x55d4a13cf7f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 --2- 172.21.15.76:0/2250140769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d4a13ca5d0 0x55d4a13cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 >> 172.21.15.76:0/2250140769 conn(0x55d4a1393310 msgr2=0x55d4a13e0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff72dffb640 0 client.25072 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.796+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 shutdown_connections 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.797+0000 7ff74ec94740 1 -- 172.21.15.76:0/2250140769 wait complete. 2024-09-19T07:52:00.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.797+0000 7ff74ec94740 20 client.25072 trim_cache size 0 max 16384 2024-09-19T07:52:00.802 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:52:00.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.797+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff7300a3440 msgr2=0x7ff7300a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.797+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff7300a3440 0x7ff7300a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55d4a13c7ac0 tx=0x7ff738005f90 comp rx=0 tx=0).stop 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.797+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 msgr2=0x7ff7480fd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.797+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 0x7ff7480fd870 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff74000eb10 tx=0x7ff74000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 shutdown_connections 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff7300a3440 0x7ff7300a5900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff748106a80 0x7ff7480fd870 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff748101420 0x7ff7480fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 --2- 172.21.15.76:0/1780211704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff748100a80 0x7ff7480fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:00.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 >> 172.21.15.76:0/1780211704 conn(0x7ff7480fc7a0 msgr2=0x7ff74806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:00.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 shutdown_connections 2024-09-19T07:52:00.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:00.798+0000 7ff74c8bb640 1 -- 172.21.15.76:0/1780211704 wait complete. 2024-09-19T07:52:01.193 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:52:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:52:00.797+0000 7fd5bbfa3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:52:01.193 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:52:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:52:00.797+0000 7fd5bbfa3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:52:01.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:52:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:52:00.797+0000 7fd5bbfa3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:52:01.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:52:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:52:00.797+0000 7fd5bbfa3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:52:01.194 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 07:52:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T07:52:00.797+0000 7fd5bbfa3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:52:02.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:01 smithi137 ceph-mon[35309]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:52:02.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:01 smithi076 ceph-mon[30930]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:52:02.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:01 smithi152 ceph-mon[35117]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:52:04.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:03 smithi137 ceph-mon[35309]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:04.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:03 smithi137 ceph-mon[35309]: mgrmap e25: x(active, since 50s), standbys: z, y 2024-09-19T07:52:04.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:03 smithi076 ceph-mon[30930]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:04.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:03 smithi076 ceph-mon[30930]: mgrmap e25: x(active, since 50s), standbys: z, y 2024-09-19T07:52:04.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:03 smithi152 ceph-mon[35117]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:04.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:03 smithi152 ceph-mon[35117]: mgrmap e25: x(active, since 50s), standbys: z, y 2024-09-19T07:52:05.578 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:52:05.858 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:06.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:05 smithi137 ceph-mon[35309]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:52:06.175 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:05 smithi076 ceph-mon[30930]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:52:06.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:05 smithi152 ceph-mon[35117]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:52:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 -- 172.21.15.76:0/3794644044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220106a90 msgr2=0x7ff220106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 --2- 172.21.15.76:0/3794644044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220106a90 0x7ff220106e70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff214009930 tx=0x7ff21402a420 comp rx=0 tx=0).stop 2024-09-19T07:52:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 -- 172.21.15.76:0/3794644044 shutdown_connections 2024-09-19T07:52:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 --2- 172.21.15.76:0/3794644044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff220101430 0x7ff22010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 --2- 172.21.15.76:0/3794644044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220100a90 0x7ff220100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 --2- 172.21.15.76:0/3794644044 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220106a90 0x7ff220106e70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 -- 172.21.15.76:0/3794644044 >> 172.21.15.76:0/3794644044 conn(0x7ff2200fc7d0 msgr2=0x7ff2200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.427+0000 7ff22701a640 1 -- 172.21.15.76:0/3794644044 shutdown_connections 2024-09-19T07:52:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.428+0000 7ff22701a640 1 -- 172.21.15.76:0/3794644044 wait complete. 2024-09-19T07:52:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.428+0000 7ff22701a640 1 Processor -- start 2024-09-19T07:52:06.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.428+0000 7ff22701a640 1 -- start start 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff22701a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220100a90 0x7ff2201984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff22701a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff220101430 0x7ff220198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff22701a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220106a90 0x7ff22019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff22701a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff220110fb0 con 0x7ff220100a90 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff22701a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff220110e30 con 0x7ff220101430 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff22701a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff220111130 con 0x7ff220106a90 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff2255b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220106a90 0x7ff22019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff224db6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220100a90 0x7ff2201984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff2255b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220106a90 0x7ff22019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:39714/0 (socket says 172.21.15.76:39714) 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff2255b7640 1 -- 172.21.15.76:0/3134601478 learned_addr learned my addr 172.21.15.76:0/3134601478 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff21ffff640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff220101430 0x7ff220198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff224db6640 1 -- 172.21.15.76:0/3134601478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220106a90 msgr2=0x7ff22019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff224db6640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220106a90 0x7ff22019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff224db6640 1 -- 172.21.15.76:0/3134601478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff220101430 msgr2=0x7ff220198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.429+0000 7ff224db6640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff220101430 0x7ff220198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff224db6640 1 -- 172.21.15.76:0/3134601478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22019d480 con 0x7ff220100a90 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff224db6640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220100a90 0x7ff2201984d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff214005940 tx=0x7ff2140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff21dffb640 1 -- 172.21.15.76:0/3134601478 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21403f070 con 0x7ff220100a90 2024-09-19T07:52:06.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22019d710 con 0x7ff220100a90 2024-09-19T07:52:06.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff21dffb640 1 -- 172.21.15.76:0/3134601478 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff21403b460 con 0x7ff220100a90 2024-09-19T07:52:06.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff21dffb640 1 -- 172.21.15.76:0/3134601478 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214035070 con 0x7ff220100a90 2024-09-19T07:52:06.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.430+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff220102590 con 0x7ff220100a90 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 Processor -- start 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 -- start start 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff21dffb640 1 -- 172.21.15.76:0/3134601478 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7ff21403b610 con 0x7ff220100a90 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cbc490b2f0 con 0x55cbc49a55d0 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cbc48b2cf0 con 0x55cbc49b0370 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2293f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cbc49072b0 con 0x55cbc49a6b40 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff224db6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43724/0 (socket says 172.21.15.76:43724) 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff21ffff640 1 -- 172.21.15.76:0/3187346253 learned_addr learned my addr 172.21.15.76:0/3187346253 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.434+0000 7ff2255b7640 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff21ffff640 1 -- 172.21.15.76:0/3187346253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 msgr2=0x55cbc49a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff21ffff640 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff21ffff640 1 -- 172.21.15.76:0/3187346253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 msgr2=0x55cbc49a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff21ffff640 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff21ffff640 1 -- 172.21.15.76:0/3187346253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbc48973a0 con 0x55cbc49b0370 2024-09-19T07:52:06.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff2255b7640 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:52:06.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff21ffff640 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49b2760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00bc80 tx=0x7ff20c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8d81f9946e046d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:06.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff20affd640 1 -- 172.21.15.76:0/3187346253 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c015070 con 0x55cbc49b0370 2024-09-19T07:52:06.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff20affd640 1 -- 172.21.15.76:0/3187346253 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff20c01a960 con 0x55cbc49b0370 2024-09-19T07:52:06.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.435+0000 7ff20affd640 1 -- 172.21.15.76:0/3187346253 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011a80 con 0x55cbc49b0370 2024-09-19T07:52:06.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.437+0000 7ff21dffb640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff2100a35d0 0x7ff2100a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.437+0000 7ff2255b7640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff2100a35d0 0x7ff2100a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.437+0000 7ff21dffb640 1 -- 172.21.15.76:0/3134601478 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff2140f0510 con 0x7ff220100a90 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.438+0000 7ff2255b7640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff2100a35d0 0x7ff2100a5a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff2180077f0 tx=0x7ff218010040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.438+0000 7ff2293f3740 1 -- 172.21.15.76:0/3187346253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 msgr2=0x55cbc49b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.438+0000 7ff2293f3740 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49b2760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00bc80 tx=0x7ff20c00f730 comp rx=0 tx=0).stop 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.439+0000 7ff2293f3740 1 -- 172.21.15.76:0/3187346253 shutdown_connections 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.439+0000 7ff2293f3740 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49b2760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.439+0000 7ff2293f3740 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.439+0000 7ff2293f3740 1 --2- 172.21.15.76:0/3187346253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.439+0000 7ff2293f3740 1 -- 172.21.15.76:0/3187346253 >> 172.21.15.76:0/3187346253 conn(0x55cbc496e310 msgr2=0x55cbc49a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.439+0000 7ff2293f3740 1 -- 172.21.15.76:0/3187346253 shutdown_connections 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.440+0000 7ff2293f3740 1 -- 172.21.15.76:0/3187346253 wait complete. 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.440+0000 7ff2293f3740 1 -- start start 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.440+0000 7ff2293f3740 1 Processor -- start 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 0x55cbc49acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cbc49b3070 con 0x55cbc49a6b40 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cbc48c6060 con 0x55cbc49b0370 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cbc49b31f0 con 0x55cbc49a55d0 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 0x55cbc49acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2293f3740 10 client.0 _ll_register_callbacks cb 0x55cbc46198c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 0x55cbc49acfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37734/0 (socket says 172.21.15.76:37734) 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 -- 172.21.15.76:0/286771423 learned_addr learned my addr 172.21.15.76:0/286771423 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff224db6640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2255b7640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 -- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 msgr2=0x55cbc49afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 -- 172.21.15.76:0/286771423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 msgr2=0x55cbc49ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 -- 172.21.15.76:0/286771423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbc467c3c0 con 0x55cbc49a6b40 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff224db6640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff2255b7640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:06.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff21ffff640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 0x55cbc49acfb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000c00 tx=0x7ff20c00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3e624d0c589e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff1fffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff1fffff640 1 -- 172.21.15.76:0/286771423 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c015070 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.441+0000 7ff1fffff640 1 -- 172.21.15.76:0/286771423 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff20c01ad20 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff20c01a960 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff1fffff640 1 -- 172.21.15.76:0/286771423 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff20c01a460 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 10 client.15528 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbc49c7290 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff1fffff640 1 -- 172.21.15.76:0/286771423 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff20c01a960 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff1fffff640 1 -- 172.21.15.76:0/286771423 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff20c011af0 con 0x55cbc49a6b40 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 10 client.15528 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 20 client.15528 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:06.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.442+0000 7ff2293f3740 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc49c85e0 0x55cbc49ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.443+0000 7ff2293f3740 4 client.15528 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:06.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.443+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbc4918860 con 0x55cbc49c85e0 2024-09-19T07:52:06.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.443+0000 7ff224db6640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc49c85e0 0x55cbc49ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.443+0000 7ff224db6640 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc49c85e0 0x55cbc49ca9d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d87bab8dde422c server_cookie=c32f108a0114be97 in_seq=0 out_seq=0 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.443+0000 7ff1fffff640 10 client.15528 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.444+0000 7ff1fffff640 1 -- 172.21.15.76:0/286771423 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbc4918860 con 0x55cbc49c85e0 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.444+0000 7ff1fffff640 10 client.15528 handle_command_reply: tid=0 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.444+0000 7ff2293f3740 1 client.15528 shutdown 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.444+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 msgr2=0x55cbc49acfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.444+0000 7ff2293f3740 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 0x55cbc49acfb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000c00 tx=0x7ff20c00bfa0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 shutdown_connections 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc49c85e0 0x55cbc49ca9d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a6b40 0x55cbc49acfb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 --2- 172.21.15.76:0/286771423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 >> 172.21.15.76:0/286771423 conn(0x55cbc496e310 msgr2=0x55cbc49a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff1fffff640 0 client.15528 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 shutdown_connections 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 1 -- 172.21.15.76:0/286771423 wait complete. 2024-09-19T07:52:06.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.445+0000 7ff2293f3740 20 client.15528 trim_cache size 0 max 16384 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 Processor -- start 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 -- start start 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201ae170 con 0x55cbc49a55d0 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201aba40 con 0x55cbc49b0370 2024-09-19T07:52:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2293f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201a9890 con 0x55cbc49a6b40 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:39734/0 (socket says 172.21.15.76:39734) 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff224db6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.469+0000 7ff2255b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 -- 172.21.15.76:0/1490818693 learned_addr learned my addr 172.21.15.76:0/1490818693 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 -- 172.21.15.76:0/1490818693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 msgr2=0x55cbc49a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 -- 172.21.15.76:0/1490818693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 msgr2=0x55cbc49c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 -- 172.21.15.76:0/1490818693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbc49a2960 con 0x55cbc49a6b40 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff2255b7640 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff224db6640 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff21ffff640 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49ac870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff20c004680 tx=0x7ff20c00fdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5b75b9f5b209bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff20a7fc640 1 -- 172.21.15.76:0/1490818693 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c015040 con 0x55cbc49a6b40 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff20a7fc640 1 -- 172.21.15.76:0/1490818693 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff20c00bb00 con 0x55cbc49a6b40 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.470+0000 7ff20a7fc640 1 -- 172.21.15.76:0/1490818693 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c01a600 con 0x55cbc49a6b40 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.471+0000 7ff2293f3740 1 -- 172.21.15.76:0/1490818693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 msgr2=0x55cbc49ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.471+0000 7ff2293f3740 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49ac870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff20c004680 tx=0x7ff20c00fdd0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 -- 172.21.15.76:0/1490818693 shutdown_connections 2024-09-19T07:52:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49b0370 0x55cbc49a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a6b40 0x55cbc49ac870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 --2- 172.21.15.76:0/1490818693 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49a55d0 0x55cbc49c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 -- 172.21.15.76:0/1490818693 >> 172.21.15.76:0/1490818693 conn(0x55cbc496e310 msgr2=0x55cbc49ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 -- 172.21.15.76:0/1490818693 shutdown_connections 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 -- 172.21.15.76:0/1490818693 wait complete. 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 -- start start 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.472+0000 7ff2293f3740 1 Processor -- start 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49bc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49a6b40 0x55cbc49bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 0x55cbc4a310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201a9f00 con 0x55cbc49b0370 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201ab370 con 0x55cbc49a6b40 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201aa5d0 con 0x55cbc49a55d0 2024-09-19T07:52:06.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2293f3740 10 client.0 _ll_register_callbacks cb 0x7ff2140f3df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2255b7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 0x55cbc4a310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2255b7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 0x55cbc4a310b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37756/0 (socket says 172.21.15.76:37756) 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff2255b7640 1 -- 172.21.15.76:0/2893589666 learned_addr learned my addr 172.21.15.76:0/2893589666 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff224db6640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.473+0000 7ff21ffff640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49a6b40 0x55cbc49bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2255b7640 1 -- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 msgr2=0x55cbc49bc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2255b7640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49bc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2255b7640 1 -- 172.21.15.76:0/2893589666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49a6b40 msgr2=0x55cbc49bc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2255b7640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49a6b40 0x55cbc49bc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2255b7640 1 -- 172.21.15.76:0/2893589666 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbc4a315f0 con 0x55cbc49b0370 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff224db6640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49bc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2255b7640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 0x55cbc4a310b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff2180167a0 tx=0x7ff218004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a0903108348524 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:06.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff1fffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:06.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff1fffff640 1 -- 172.21.15.76:0/2893589666 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21800ddd0 con 0x55cbc49b0370 2024-09-19T07:52:06.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff1fffff640 1 -- 172.21.15.76:0/2893589666 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff218026460 con 0x55cbc49b0370 2024-09-19T07:52:06.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.474+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff20c00bb00 con 0x55cbc49b0370 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff1fffff640 1 -- 172.21.15.76:0/2893589666 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff218034050 con 0x55cbc49b0370 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 10 client.15534 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbc4a32890 con 0x55cbc49b0370 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff1fffff640 1 -- 172.21.15.76:0/2893589666 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff20c00bb00 con 0x55cbc49b0370 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff1fffff640 1 -- 172.21.15.76:0/2893589666 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff21801c740 con 0x55cbc49b0370 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 10 client.15534 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 20 client.15534 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc4a330c0 0x55cbc4a354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 4 client.15534 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:52:06.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.475+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbc4912d70 con 0x55cbc4a330c0 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff224db6640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc4a330c0 0x55cbc4a354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff224db6640 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc4a330c0 0x55cbc4a354e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45bc3f277cbcc60c server_cookie=1bb97e7e6f59aa28 in_seq=0 out_seq=0 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff1fffff640 10 client.15534 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff1fffff640 1 -- 172.21.15.76:0/2893589666 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbc4912d70 con 0x55cbc4a330c0 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff1fffff640 10 client.15534 handle_command_reply: tid=0 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 client.15534 shutdown 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 msgr2=0x55cbc4a310b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 0x55cbc4a310b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff2180167a0 tx=0x7ff218004ab0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 shutdown_connections 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cbc4a330c0 0x55cbc4a354e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff1fffff640 0 client.15534 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cbc49b0370 0x55cbc4a310b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cbc49a6b40 0x55cbc49bc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 --2- 172.21.15.76:0/2893589666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cbc49a55d0 0x55cbc49bc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.476+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 >> 172.21.15.76:0/2893589666 conn(0x55cbc496e310 msgr2=0x55cbc49ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:06.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.477+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 shutdown_connections 2024-09-19T07:52:06.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.477+0000 7ff2293f3740 1 -- 172.21.15.76:0/2893589666 wait complete. 2024-09-19T07:52:06.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.477+0000 7ff2293f3740 20 client.15534 trim_cache size 0 max 16384 2024-09-19T07:52:06.480 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.477+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff2100a35d0 msgr2=0x7ff2100a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.477+0000 7ff22701a640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff2100a35d0 0x7ff2100a5a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff2180077f0 tx=0x7ff218010040 comp rx=0 tx=0).stop 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220100a90 msgr2=0x7ff2201984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220100a90 0x7ff2201984d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff214005940 tx=0x7ff2140042f0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 shutdown_connections 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff2100a35d0 0x7ff2100a5a90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff220106a90 0x7ff22019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff220101430 0x7ff220198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 --2- 172.21.15.76:0/3134601478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff220100a90 0x7ff2201984d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 >> 172.21.15.76:0/3134601478 conn(0x7ff2200fc7d0 msgr2=0x7ff220104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 shutdown_connections 2024-09-19T07:52:06.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:06.478+0000 7ff22701a640 1 -- 172.21.15.76:0/3134601478 wait complete. 2024-09-19T07:52:06.890 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:52:07.255 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:07.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 -- 172.21.15.76:0/1624376855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 msgr2=0x7fec0810e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 --2- 172.21.15.76:0/1624376855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0810e620 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fec00009900 tx=0x7fec0002a480 comp rx=0 tx=0).stop 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 -- 172.21.15.76:0/1624376855 shutdown_connections 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 --2- 172.21.15.76:0/1624376855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0810e620 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 --2- 172.21.15.76:0/1624376855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec08103670 0x7fec0810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 --2- 172.21.15.76:0/1624376855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 0x7fec08103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.746+0000 7fec0f988640 1 -- 172.21.15.76:0/1624376855 >> 172.21.15.76:0/1624376855 conn(0x7fec080fc7d0 msgr2=0x7fec080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.747+0000 7fec0f988640 1 -- 172.21.15.76:0/1624376855 shutdown_connections 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.747+0000 7fec0f988640 1 -- 172.21.15.76:0/1624376855 wait complete. 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.747+0000 7fec0f988640 1 Processor -- start 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.747+0000 7fec0f988640 1 -- start start 2024-09-19T07:52:07.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0f988640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 0x7fec081984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0f988640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec08103670 0x7fec08198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0f988640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0f988640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fec081120d0 con 0x7fec0810c180 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0f988640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec08111f50 con 0x7fec08103670 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0f988640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec08112250 con 0x7fec08102d50 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37774/0 (socket says 172.21.15.76:37774) 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 -- 172.21.15.76:0/2861256864 learned_addr learned my addr 172.21.15.76:0/2861256864 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0cf23640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec08103670 0x7fec08198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0d724640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 0x7fec081984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 -- 172.21.15.76:0/2861256864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 msgr2=0x7fec081984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 0x7fec081984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 -- 172.21.15.76:0/2861256864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec08103670 msgr2=0x7fec08198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec08103670 0x7fec08198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0df25640 1 -- 172.21.15.76:0/2861256864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0819d4a0 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.748+0000 7fec0d724640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 0x7fec081984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.749+0000 7fec0df25640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0819cdc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec00004770 tx=0x7fec000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.749+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00035070 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.749+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec0003dc60 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.749+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0819d730 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.750+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec000453d0 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.750+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec081008e0 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.751+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0806b070 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.751+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fec0003d760 con 0x7fec0810c180 2024-09-19T07:52:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.752+0000 7fec067fc640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7febf00a35d0 0x7febf00a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:07.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.752+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fec000f4b90 con 0x7fec0810c180 2024-09-19T07:52:07.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.753+0000 7fec0d724640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7febf00a35d0 0x7febf00a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:07.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.753+0000 7fec0d724640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7febf00a35d0 0x7febf00a5a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7febf8008e50 tx=0x7febf8008350 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:07.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:07.757+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec000c14a0 con 0x7fec0810c180 2024-09-19T07:52:07.894 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:07 smithi076 ceph-mon[30930]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:52:08.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.110+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec08100ab0 con 0x7fec0810c180 2024-09-19T07:52:08.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.111+0000 7fec067fc640 1 -- 172.21.15.76:0/2861256864 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7fec000c0da0 con 0x7fec0810c180 2024-09-19T07:52:08.111 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:52:08.111 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:52:08.111 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:52:08.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7febf00a35d0 msgr2=0x7febf00a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:08.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7febf00a35d0 0x7febf00a5a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7febf8008e50 tx=0x7febf8008350 comp rx=0 tx=0).stop 2024-09-19T07:52:08.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 msgr2=0x7fec0819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:08.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0819cdc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec00004770 tx=0x7fec000045e0 comp rx=0 tx=0).stop 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 shutdown_connections 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7febf00a35d0 0x7febf00a5a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec0810c180 0x7fec0819cdc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec08103670 0x7fec08198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 --2- 172.21.15.76:0/2861256864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec08102d50 0x7fec081984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 >> 172.21.15.76:0/2861256864 conn(0x7fec080fc7d0 msgr2=0x7fec0810e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 shutdown_connections 2024-09-19T07:52:08.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:08.114+0000 7fec0f988640 1 -- 172.21.15.76:0/2861256864 wait complete. 2024-09-19T07:52:08.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:07 smithi137 ceph-mon[35309]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:52:08.182 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:52:08.182 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:52:08.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:07 smithi152 ceph-mon[35117]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:52:08.748 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db --set-id 6c86a709 --release --await' 2024-09-19T07:52:08.748 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db --set-id 6c86a709 --release --await 2024-09-19T07:52:08.823 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:08.970 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:08 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2861256864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:08 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2861256864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:09.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:08 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2861256864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:09.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.349+0000 7fdda5ffb640 1 -- 172.21.15.76:0/3388781365 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd980319a0 con 0x7fdda8100e20 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 -- 172.21.15.76:0/3388781365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8100e20 msgr2=0x7fdda8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 --2- 172.21.15.76:0/3388781365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8100e20 0x7fdda8101200 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009900 tx=0x7fdd9802a480 comp rx=0 tx=0).stop 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 -- 172.21.15.76:0/3388781365 shutdown_connections 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 --2- 172.21.15.76:0/3388781365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdda8102ef0 0x7fdda810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 --2- 172.21.15.76:0/3388781365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda8102570 0x7fdda81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 --2- 172.21.15.76:0/3388781365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8100e20 0x7fdda8101200 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 -- 172.21.15.76:0/3388781365 >> 172.21.15.76:0/3388781365 conn(0x7fdda80fc7d0 msgr2=0x7fdda80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 -- 172.21.15.76:0/3388781365 shutdown_connections 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.350+0000 7fddad4c9640 1 -- 172.21.15.76:0/3388781365 wait complete. 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 Processor -- start 2024-09-19T07:52:09.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 -- start start 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 0x7fdda810d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdda8102ef0 0x7fdda810d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda810b3c0 0x7fdda810b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8110080 con 0x7fdda8102570 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdda810ff00 con 0x7fdda8102ef0 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fddad4c9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8110200 con 0x7fdda810b3c0 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fdda6ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 0x7fdda810d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fdda6ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 0x7fdda810d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37796/0 (socket says 172.21.15.76:37796) 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.351+0000 7fdda6ffd640 1 -- 172.21.15.76:0/1847076986 learned_addr learned my addr 172.21.15.76:0/1847076986 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda67fc640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdda8102ef0 0x7fdda810d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda77fe640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda810b3c0 0x7fdda810b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda6ffd640 1 -- 172.21.15.76:0/1847076986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda810b3c0 msgr2=0x7fdda810b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda6ffd640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda810b3c0 0x7fdda810b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda6ffd640 1 -- 172.21.15.76:0/1847076986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdda8102ef0 msgr2=0x7fdda810d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda6ffd640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdda8102ef0 0x7fdda810d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda6ffd640 1 -- 172.21.15.76:0/1847076986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda810c100 con 0x7fdda8102570 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda77fe640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda810b3c0 0x7fdda810b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdda6ffd640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 0x7fdda810d270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005940 tx=0x7fdd98004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdd8ffff640 1 -- 172.21.15.76:0/1847076986 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9803f030 con 0x7fdda8102570 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fdd8ffff640 1 -- 172.21.15.76:0/1847076986 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd98005500 con 0x7fdda8102570 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.352+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda81ab8a0 con 0x7fdda8102570 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.353+0000 7fdd8ffff640 1 -- 172.21.15.76:0/1847076986 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98035070 con 0x7fdda8102570 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.353+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda81abc40 con 0x7fdda8102570 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.356+0000 7fddaf8a2740 1 Processor -- start 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.356+0000 7fddaf8a2740 1 -- start start 2024-09-19T07:52:09.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdd8ffff640 1 -- 172.21.15.76:0/1847076986 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fdd98042030 con 0x7fdda8102570 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x55711367ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x55711368a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711368d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5571135e5280 con 0x55711368ad40 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55711358cb10 con 0x55711367fb60 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5571135e1240 con 0x557113680480 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x55711367ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x55711367ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43802/0 (socket says 172.21.15.76:43802) 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 -- 172.21.15.76:0/502118558 learned_addr learned my addr 172.21.15.76:0/502118558 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda67fc640 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711368d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda6ffd640 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x55711368a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 -- 172.21.15.76:0/502118558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 msgr2=0x55711368a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x55711368a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 -- 172.21.15.76:0/502118558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 msgr2=0x55711368d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711368d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.357+0000 7fdda77fe640 1 -- 172.21.15.76:0/502118558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571135991f0 con 0x55711367fb60 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdda77fe640 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x55711367ff40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009f30 tx=0x7fdda0010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b2610f2d3aea356 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdd8ffff640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdd900a34d0 0x7fdd900a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdd8ffff640 1 -- 172.21.15.76:0/1847076986 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdd980f00c0 con 0x7fdda8102570 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdd8d7fa640 1 -- 172.21.15.76:0/502118558 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0016070 con 0x55711367fb60 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdd8d7fa640 1 -- 172.21.15.76:0/502118558 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdda001bb60 con 0x55711367fb60 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdda6ffd640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdd900a34d0 0x7fdd900a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.358+0000 7fdd8d7fa640 1 -- 172.21.15.76:0/502118558 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0012db0 con 0x55711367fb60 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 -- 172.21.15.76:0/502118558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 msgr2=0x55711367ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x55711367ff40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009f30 tx=0x7fdda0010800 comp rx=0 tx=0).stop 2024-09-19T07:52:09.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fdda6ffd640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdd900a34d0 0x7fdd900a5990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd980ed790 tx=0x7fdd9802a480 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 -- 172.21.15.76:0/502118558 shutdown_connections 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711368d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x55711368a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/502118558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x55711367ff40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 -- 172.21.15.76:0/502118558 >> 172.21.15.76:0/502118558 conn(0x55711367c0f0 msgr2=0x55711367c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 -- 172.21.15.76:0/502118558 shutdown_connections 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.359+0000 7fddaf8a2740 1 -- 172.21.15.76:0/502118558 wait complete. 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 -- start start 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 Processor -- start 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 0x557113687c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 0x557113687c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 0x557113687c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37802/0 (socket says 172.21.15.76:37802) 2024-09-19T07:52:09.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fdda77fe640 1 -- 172.21.15.76:0/567072156 learned_addr learned my addr 172.21.15.76:0/567072156 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557113680480 0x557113688180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55711368ad40 0x5571136886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55711368d9b0 con 0x55711367fb60 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55711359ff10 con 0x557113680480 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.360+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55711368db30 con 0x55711368ad40 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdda77fe640 1 -- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55711368ad40 msgr2=0x5571136886c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdda77fe640 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55711368ad40 0x5571136886c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdda77fe640 1 -- 172.21.15.76:0/567072156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557113680480 msgr2=0x557113688180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdda77fe640 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557113680480 0x557113688180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdda77fe640 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571133566a0 con 0x55711367fb60 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdda77fe640 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 0x557113687c40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdda0004c70 tx=0x7fdda0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd671cad837de21f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fddaf8a2740 10 client.0 _ll_register_callbacks cb 0x557113568a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:09.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda001bb60 con 0x55711367fb60 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdd8aff5640 10 client.15552 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdd8aff5640 1 -- 172.21.15.76:0/567072156 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0029060 con 0x55711367fb60 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.361+0000 7fdd8aff5640 1 -- 172.21.15.76:0/567072156 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdda0012a30 con 0x55711367fb60 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fdd8aff5640 1 -- 172.21.15.76:0/567072156 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdda0016070 con 0x55711367fb60 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 10 client.15552 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557113699450 con 0x55711367fb60 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fdd8aff5640 1 -- 172.21.15.76:0/567072156 <== mon.0 v2:172.21.15.76:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdda000f040 con 0x55711367fb60 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 10 client.15552 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 20 client.15552 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55711369abb0 0x55711369d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 4 client.15552 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.362+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571135f27f0 con 0x55711369abb0 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.363+0000 7fdda67fc640 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55711369abb0 0x55711369d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.363+0000 7fdda67fc640 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55711369abb0 0x55711369d070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26914abdff3f7fc8 server_cookie=42f57526f5e81d8e in_seq=0 out_seq=0 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.363+0000 7fdd8aff5640 10 client.15552 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fdd8aff5640 1 -- 172.21.15.76:0/567072156 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571135f27f0 con 0x55711369abb0 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fdd8aff5640 10 client.15552 handle_command_reply: tid=0 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 client.15552 shutdown 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 msgr2=0x557113687c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 0x557113687c40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdda0004c70 tx=0x7fdda0000f40 comp rx=0 tx=0).stop 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 shutdown_connections 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55711368ad40 0x5571136886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557113680480 0x557113688180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55711369abb0 0x55711369d070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/567072156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711367fb60 0x557113687c40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 >> 172.21.15.76:0/567072156 conn(0x55711367c0f0 msgr2=0x557113681dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fdd8aff5640 0 client.15552 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 shutdown_connections 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.364+0000 7fddaf8a2740 1 -- 172.21.15.76:0/567072156 wait complete. 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.365+0000 7fddaf8a2740 20 client.15552 trim_cache size 0 max 16384 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.396+0000 7fddaf8a2740 1 Processor -- start 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.396+0000 7fddaf8a2740 1 -- start start 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x557113688510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x557113696490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x5571136a2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81b6ea0 con 0x55711368ad40 2024-09-19T07:52:09.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81b4770 con 0x55711367fb60 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x5571136a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81b25c0 con 0x557113680480 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x5571136a2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37804/0 (socket says 172.21.15.76:37804) 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 -- 172.21.15.76:0/3406250350 learned_addr learned my addr 172.21.15.76:0/3406250350 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x557113688510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda67fc640 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x557113696490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 -- 172.21.15.76:0/3406250350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 msgr2=0x557113696490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x557113696490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 -- 172.21.15.76:0/3406250350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 msgr2=0x557113688510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x557113688510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.397+0000 7fdda77fe640 1 -- 172.21.15.76:0/3406250350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557113686bf0 con 0x55711368ad40 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.398+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x5571136a2680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdda0011010 tx=0x7fdda0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e66b7e959cf0d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:09.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.398+0000 7fdd8cff9640 1 -- 172.21.15.76:0/3406250350 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0024e60 con 0x55711368ad40 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.398+0000 7fdd8cff9640 1 -- 172.21.15.76:0/3406250350 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdda001bb60 con 0x55711368ad40 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.398+0000 7fdd8cff9640 1 -- 172.21.15.76:0/3406250350 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0024b20 con 0x55711368ad40 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3406250350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 msgr2=0x5571136a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x5571136a2680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdda0011010 tx=0x7fdda0016000 comp rx=0 tx=0).stop 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3406250350 shutdown_connections 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x5571136a2680 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x557113696490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3406250350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x557113688510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3406250350 >> 172.21.15.76:0/3406250350 conn(0x55711367c0f0 msgr2=0x557113695d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3406250350 shutdown_connections 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3406250350 wait complete. 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.399+0000 7fddaf8a2740 1 -- start start 2024-09-19T07:52:09.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 Processor -- start 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x5571136a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x5571136a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711369fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81b2c30 con 0x55711368ad40 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81b40a0 con 0x55711367fb60 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81b3300 con 0x557113680480 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fddaf8a2740 10 client.0 _ll_register_callbacks cb 0x7fdd9c004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x5571136a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x5571136a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43832/0 (socket says 172.21.15.76:43832) 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fdda77fe640 1 -- 172.21.15.76:0/3602369581 learned_addr learned my addr 172.21.15.76:0/3602369581 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.400+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711369fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdda77fe640 1 -- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 msgr2=0x5571136a2c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x5571136a2c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdda77fe640 1 -- 172.21.15.76:0/3602369581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 msgr2=0x55711369fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711369fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdda77fe640 1 -- 172.21.15.76:0/3602369581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571136a03d0 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdda77fe640 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x5571136a2710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdda0024800 tx=0x7fdda001d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2513c8b3d79f8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdd8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdd8aff5640 1 -- 172.21.15.76:0/3602369581 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0009d80 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fdd8aff5640 1 -- 172.21.15.76:0/3602369581 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fdda0021070 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.401+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda001bb60 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fdd8aff5640 1 -- 172.21.15.76:0/3602369581 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdda00248a0 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fddaf8a2740 10 client.25037 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557113705180 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fdd8aff5640 1 -- 172.21.15.76:0/3602369581 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdda001b960 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fdd8aff5640 1 -- 172.21.15.76:0/3602369581 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdda003c990 con 0x55711367fb60 2024-09-19T07:52:09.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fddaf8a2740 10 client.25037 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fddaf8a2740 10 client.25037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.402+0000 7fddaf8a2740 20 client.25037 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.403+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557113705730 0x557113707b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.403+0000 7fddaf8a2740 4 client.25037 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.403+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fdda001bb60 con 0x557113705730 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.403+0000 7fdda67fc640 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557113705730 0x557113707b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.404+0000 7fdda67fc640 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557113705730 0x557113707b20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0dffbc3bed35a5 server_cookie=ffaf08f17a3002b6 in_seq=0 out_seq=0 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.404+0000 7fdd8aff5640 10 client.25037 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fdd8aff5640 1 -- 172.21.15.76:0/3602369581 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fdda001bb60 con 0x557113705730 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fdd8aff5640 10 client.25037 handle_command_reply: tid=0 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 client.25037 shutdown 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 msgr2=0x5571136a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x5571136a2710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdda0024800 tx=0x7fdda001d040 comp rx=0 tx=0).stop 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 shutdown_connections 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557113705730 0x557113707b20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55711368ad40 0x55711369fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557113680480 0x5571136a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 --2- 172.21.15.76:0/3602369581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55711367fb60 0x5571136a2710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fdd8aff5640 0 client.25037 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 >> 172.21.15.76:0/3602369581 conn(0x55711367c0f0 msgr2=0x557113681dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 shutdown_connections 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 1 -- 172.21.15.76:0/3602369581 wait complete. 2024-09-19T07:52:09.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.405+0000 7fddaf8a2740 20 client.25037 trim_cache size 0 max 16384 2024-09-19T07:52:09.815 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:09.815 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:52:09.815 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "20d668a4-01b8-4f26-bf72-6df998e1bafa", 2024-09-19T07:52:09.815 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:52:09.815 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.406+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdd900a34d0 msgr2=0x7fdd900a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.406+0000 7fddad4c9640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdd900a34d0 0x7fdd900a5990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd980ed790 tx=0x7fdd9802a480 comp rx=0 tx=0).stop 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.406+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 msgr2=0x7fdda810d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.406+0000 7fddad4c9640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 0x7fdda810d270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005940 tx=0x7fdd98004c00 comp rx=0 tx=0).stop 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.406+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 shutdown_connections 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.406+0000 7fddad4c9640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdd900a34d0 0x7fdd900a5990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.407+0000 7fddad4c9640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda810b3c0 0x7fdda810b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.407+0000 7fddad4c9640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdda8102ef0 0x7fdda810d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.407+0000 7fddad4c9640 1 --2- 172.21.15.76:0/1847076986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdda8102570 0x7fdda810d270 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.407+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 >> 172.21.15.76:0/1847076986 conn(0x7fdda80fc7d0 msgr2=0x7fdda8106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:09.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.407+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 shutdown_connections 2024-09-19T07:52:09.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:09.407+0000 7fddad4c9640 1 -- 172.21.15.76:0/1847076986 wait complete. 2024-09-19T07:52:09.817 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:10.105 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:09 smithi076 ceph-mon[30930]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T07:52:10.140 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:52:10.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:09 smithi137 ceph-mon[35309]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T07:52:10.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:09 smithi152 ceph-mon[35117]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 -- 172.21.15.76:0/32104446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 msgr2=0x7fca50106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 --2- 172.21.15.76:0/32104446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 0x7fca50106840 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fca44009930 tx=0x7fca4402a420 comp rx=0 tx=0).stop 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 -- 172.21.15.76:0/32104446 shutdown_connections 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 --2- 172.21.15.76:0/32104446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca50106f50 0x7fca5010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 --2- 172.21.15.76:0/32104446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 0x7fca50106840 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 --2- 172.21.15.76:0/32104446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca501002f0 0x7fca501006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.631+0000 7fca55a93640 1 -- 172.21.15.76:0/32104446 >> 172.21.15.76:0/32104446 conn(0x7fca50077210 msgr2=0x7fca500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.632+0000 7fca55a93640 1 -- 172.21.15.76:0/32104446 shutdown_connections 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.632+0000 7fca55a93640 1 -- 172.21.15.76:0/32104446 wait complete. 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.633+0000 7fca55a93640 1 Processor -- start 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.633+0000 7fca55a93640 1 -- start start 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.633+0000 7fca55a93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 0x7fca50198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.633+0000 7fca55a93640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 0x7fca50198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 0x7fca50198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca55a93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca50106f50 0x7fca5019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca55a93640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fca50112140 con 0x7fca50100ca0 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca55a93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca50111fc0 con 0x7fca501002f0 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca55a93640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca501122c0 con 0x7fca50106f50 2024-09-19T07:52:10.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 0x7fca50198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 0x7fca50198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43844/0 (socket says 172.21.15.76:43844) 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 -- 172.21.15.76:0/3619043682 learned_addr learned my addr 172.21.15.76:0/3619043682 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 -- 172.21.15.76:0/3619043682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca50106f50 msgr2=0x7fca5019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca50106f50 0x7fca5019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 -- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 msgr2=0x7fca50198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 0x7fca50198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.634+0000 7fca4f7fe640 1 -- 172.21.15.76:0/3619043682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5019d5b0 con 0x7fca501002f0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.635+0000 7fca4f7fe640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 0x7fca50198600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca4000d770 tx=0x7fca4000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.635+0000 7fca4cff9640 1 -- 172.21.15.76:0/3619043682 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40017070 con 0x7fca501002f0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.635+0000 7fca4cff9640 1 -- 172.21.15.76:0/3619043682 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca40005520 con 0x7fca501002f0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.635+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5019d8a0 con 0x7fca501002f0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.635+0000 7fca4cff9640 1 -- 172.21.15.76:0/3619043682 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40010460 con 0x7fca501002f0 2024-09-19T07:52:10.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.635+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5019dcf0 con 0x7fca501002f0 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.637+0000 7fca57e6c740 1 Processor -- start 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 -- start start 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5604cb846620 con 0x5604cb8eb260 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5604cb7ede50 con 0x5604cb8f02a0 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca57e6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5604cb8425e0 con 0x5604cb8f0bc0 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43856/0 (socket says 172.21.15.76:43856) 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 -- 172.21.15.76:0/2888502647 learned_addr learned my addr 172.21.15.76:0/2888502647 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:10.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4cff9640 1 -- 172.21.15.76:0/3619043682 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fca40010600 con 0x7fca501002f0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 -- 172.21.15.76:0/2888502647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 msgr2=0x5604cb8eabf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8eabf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 -- 172.21.15.76:0/2888502647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 msgr2=0x5604cb8eb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.638+0000 7fca4ffff640 1 -- 172.21.15.76:0/2888502647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604cb7ded40 con 0x5604cb8f02a0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.639+0000 7fca4ffff640 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f0680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca48009d00 tx=0x7fca4800b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9574b667ef7d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.639+0000 7fca35ffb640 1 -- 172.21.15.76:0/2888502647 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4800bd40 con 0x5604cb8f02a0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.639+0000 7fca35ffb640 1 -- 172.21.15.76:0/2888502647 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca48017070 con 0x5604cb8f02a0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.639+0000 7fca35ffb640 1 -- 172.21.15.76:0/2888502647 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48011770 con 0x5604cb8f02a0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.639+0000 7fca4cff9640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fca380a3550 0x7fca380a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca4f7fe640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fca380a3550 0x7fca380a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 -- 172.21.15.76:0/2888502647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 msgr2=0x5604cb8f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f0680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca48009d00 tx=0x7fca4800b420 comp rx=0 tx=0).stop 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 -- 172.21.15.76:0/2888502647 shutdown_connections 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2888502647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f0680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 -- 172.21.15.76:0/2888502647 >> 172.21.15.76:0/2888502647 conn(0x5604cb8dd0a0 msgr2=0x5604cb8dd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca57e6c740 1 -- 172.21.15.76:0/2888502647 shutdown_connections 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca4cff9640 1 -- 172.21.15.76:0/3619043682 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fca400cfa30 con 0x7fca501002f0 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.640+0000 7fca4f7fe640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fca380a3550 0x7fca380a5a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca400cd060 tx=0x7fca40097d80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.641+0000 7fca57e6c740 1 -- 172.21.15.76:0/2888502647 wait complete. 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.641+0000 7fca57e6c740 1 -- start start 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.641+0000 7fca57e6c740 1 Processor -- start 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.641+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f02a0 0x5604cb8f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca57e6c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5604cb8f75e0 con 0x5604cb8f02a0 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca57e6c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5604cb7cef10 con 0x5604cb8eb260 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca57e6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5604cb8f7760 con 0x5604cb8f0bc0 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca57e6c740 10 client.0 _ll_register_callbacks cb 0x5604cb7f2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43860/0 (socket says 172.21.15.76:43860) 2024-09-19T07:52:10.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 -- 172.21.15.76:0/4253790072 learned_addr learned my addr 172.21.15.76:0/4253790072 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:10.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4effd640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f02a0 0x5604cb8f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 -- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 msgr2=0x5604cb8f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 -- 172.21.15.76:0/4253790072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f02a0 msgr2=0x5604cb8f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f02a0 0x5604cb8f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4ffff640 1 -- 172.21.15.76:0/4253790072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604cb555580 con 0x5604cb8eb260 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.642+0000 7fca4effd640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f02a0 0x5604cb8f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca4ffff640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8f40a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca48011d40 tx=0x7fca48011390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27471b1d3d6e58f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca2effd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca2effd640 1 -- 172.21.15.76:0/4253790072 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48012630 con 0x5604cb8eb260 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca48017070 con 0x5604cb8eb260 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca2effd640 1 -- 172.21.15.76:0/4253790072 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fca480127d0 con 0x5604cb8eb260 2024-09-19T07:52:10.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca2effd640 1 -- 172.21.15.76:0/4253790072 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca480129d0 con 0x5604cb8eb260 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca57e6c740 10 client.25046 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604cb61f960 con 0x5604cb8eb260 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.643+0000 7fca2effd640 1 -- 172.21.15.76:0/4253790072 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca48017070 con 0x5604cb8eb260 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca2effd640 1 -- 172.21.15.76:0/4253790072 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fca48011070 con 0x5604cb8eb260 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca57e6c740 10 client.25046 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca57e6c740 10 client.25046 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca57e6c740 20 client.25046 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca57e6c740 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb904570 0x5604cb906960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca57e6c740 4 client.25046 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604cb853b90 con 0x5604cb904570 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.644+0000 7fca4effd640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb904570 0x5604cb906960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.645+0000 7fca2effd640 10 client.25046 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:10.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.645+0000 7fca4effd640 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb904570 0x5604cb906960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f26718a4d386bcb server_cookie=df27b99655771e65 in_seq=0 out_seq=0 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.645+0000 7fca2effd640 1 -- 172.21.15.76:0/4253790072 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604cb853b90 con 0x5604cb904570 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.645+0000 7fca2effd640 10 client.25046 handle_command_reply: tid=0 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.645+0000 7fca57e6c740 1 client.25046 shutdown 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 msgr2=0x5604cb8f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8f40a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca48011d40 tx=0x7fca48011390 comp rx=0 tx=0).stop 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 shutdown_connections 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb904570 0x5604cb906960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca2effd640 0 client.25046 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f02a0 0x5604cb8f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 --2- 172.21.15.76:0/4253790072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8f40a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 >> 172.21.15.76:0/4253790072 conn(0x5604cb8dd0a0 msgr2=0x5604cb8dc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:10.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 shutdown_connections 2024-09-19T07:52:10.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 1 -- 172.21.15.76:0/4253790072 wait complete. 2024-09-19T07:52:10.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.646+0000 7fca57e6c740 20 client.25046 trim_cache size 0 max 16384 2024-09-19T07:52:10.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.679+0000 7fca57e6c740 1 Processor -- start 2024-09-19T07:52:10.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.679+0000 7fca57e6c740 1 -- start start 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.679+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca57e6c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ae200 con 0x5604cb8eb260 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca57e6c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca501abad0 con 0x5604cb8f02a0 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca57e6c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca501a9920 con 0x5604cb8f0bc0 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca4effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca4effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43864/0 (socket says 172.21.15.76:43864) 2024-09-19T07:52:10.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca4effd640 1 -- 172.21.15.76:0/3514953191 learned_addr learned my addr 172.21.15.76:0/3514953191 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.680+0000 7fca4ffff640 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4ffff640 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4effd640 1 -- 172.21.15.76:0/3514953191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 msgr2=0x5604cb8f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4effd640 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4effd640 1 -- 172.21.15.76:0/3514953191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 msgr2=0x5604cb8eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4effd640 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4effd640 1 -- 172.21.15.76:0/3514953191 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604cb8f1fb0 con 0x5604cb8f02a0 2024-09-19T07:52:10.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.681+0000 7fca4ffff640 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:10.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.682+0000 7fca4effd640 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f4770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca44009930 tx=0x7fca44000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=405f24c54b52b892 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:10.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.682+0000 7fca357fa640 1 -- 172.21.15.76:0/3514953191 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44035040 con 0x5604cb8f02a0 2024-09-19T07:52:10.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.682+0000 7fca357fa640 1 -- 172.21.15.76:0/3514953191 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca440035f0 con 0x5604cb8f02a0 2024-09-19T07:52:10.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.682+0000 7fca357fa640 1 -- 172.21.15.76:0/3514953191 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44045600 con 0x5604cb8f02a0 2024-09-19T07:52:10.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.684+0000 7fca57e6c740 1 -- 172.21.15.76:0/3514953191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 msgr2=0x5604cb8f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.684+0000 7fca57e6c740 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f4770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca44009930 tx=0x7fca44000bc0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.684+0000 7fca57e6c740 1 -- 172.21.15.76:0/3514953191 shutdown_connections 2024-09-19T07:52:10.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.684+0000 7fca57e6c740 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.684+0000 7fca57e6c740 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8f02a0 0x5604cb8f4770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.685+0000 7fca57e6c740 1 --2- 172.21.15.76:0/3514953191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8eb260 0x5604cb8eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.685+0000 7fca57e6c740 1 -- 172.21.15.76:0/3514953191 >> 172.21.15.76:0/3514953191 conn(0x5604cb8dd0a0 msgr2=0x5604cb8f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:10.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.685+0000 7fca57e6c740 1 -- 172.21.15.76:0/3514953191 shutdown_connections 2024-09-19T07:52:10.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.685+0000 7fca57e6c740 1 -- 172.21.15.76:0/3514953191 wait complete. 2024-09-19T07:52:10.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.686+0000 7fca57e6c740 1 -- start start 2024-09-19T07:52:10.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.687+0000 7fca57e6c740 1 Processor -- start 2024-09-19T07:52:10.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.687+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.688+0000 7fca57e6c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f02a0 0x5604cb8fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.688+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.688+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8fc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:43870/0 (socket says 172.21.15.76:43870) 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.688+0000 7fca4effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f02a0 0x5604cb8fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f02a0 0x5604cb8fcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:39874/0 (socket says 172.21.15.76:39874) 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4ffff640 1 -- 172.21.15.76:0/2831996857 learned_addr learned my addr 172.21.15.76:0/2831996857 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fca501a9f90 con 0x5604cb8f0bc0 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ab400 con 0x5604cb8eb260 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca501aa660 con 0x5604cb8f02a0 2024-09-19T07:52:10.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca57e6c740 10 client.0 _ll_register_callbacks cb 0x7fca48011a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:10.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4ffff640 1 -- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f02a0 msgr2=0x5604cb8fcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4ffff640 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f02a0 0x5604cb8fcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4ffff640 1 -- 172.21.15.76:0/2831996857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f0bc0 msgr2=0x5604cb8f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:10.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4ffff640 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.689+0000 7fca4ffff640 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604cb90ca20 con 0x5604cb8eb260 2024-09-19T07:52:10.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.690+0000 7fca4ffff640 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8fc9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca48011360 tx=0x7fca48011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ff263d4e5278f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:10.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.691+0000 7fca2effd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:52:10.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.691+0000 7fca2effd640 1 -- 172.21.15.76:0/2831996857 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48035020 con 0x5604cb8eb260 2024-09-19T07:52:10.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.691+0000 7fca2effd640 1 -- 172.21.15.76:0/2831996857 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fca48007000 con 0x5604cb8eb260 2024-09-19T07:52:10.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.691+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca440035f0 con 0x5604cb8eb260 2024-09-19T07:52:10.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.692+0000 7fca2effd640 1 -- 172.21.15.76:0/2831996857 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca4801c8d0 con 0x5604cb8eb260 2024-09-19T07:52:10.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.692+0000 7fca57e6c740 10 client.25052 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:10.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.692+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604cb96f3a0 con 0x5604cb8eb260 2024-09-19T07:52:10.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca2effd640 1 -- 172.21.15.76:0/2831996857 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca48017070 con 0x5604cb8eb260 2024-09-19T07:52:10.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca2effd640 1 -- 172.21.15.76:0/2831996857 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fca480298e0 con 0x5604cb8eb260 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca57e6c740 10 client.25052 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca57e6c740 10 client.25052 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca57e6c740 20 client.25052 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb96fa10 0x5604cb971e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca57e6c740 4 client.25052 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6c86a709", "release": true, "await": true}] 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6c86a709", "release": true, "await": true}) -- 0x7fca440035f0 con 0x5604cb96fa10 2024-09-19T07:52:10.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.693+0000 7fca4effd640 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb96fa10 0x5604cb971e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:10.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.695+0000 7fca4effd640 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb96fa10 0x5604cb971e30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98409b33921a9f1a server_cookie=402752262a687963 in_seq=0 out_seq=0 2024-09-19T07:52:10.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.695+0000 7fca2effd640 10 client.25052 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:10.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.697+0000 7fca2effd640 1 -- 172.21.15.76:0/2831996857 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fca440035f0 con 0x5604cb96fa10 2024-09-19T07:52:10.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.697+0000 7fca2effd640 10 client.25052 handle_command_reply: tid=0 2024-09-19T07:52:10.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.697+0000 7fca57e6c740 1 client.25052 shutdown 2024-09-19T07:52:10.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.697+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 msgr2=0x5604cb8fc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.697+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8fc9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca48011360 tx=0x7fca48011930 comp rx=0 tx=0).stop 2024-09-19T07:52:10.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 shutdown_connections 2024-09-19T07:52:10.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5604cb96fa10 0x5604cb971e30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604cb8f0bc0 0x5604cb8f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604cb8f02a0 0x5604cb8fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca57e6c740 1 --2- 172.21.15.76:0/2831996857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604cb8eb260 0x5604cb8fc9f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 >> 172.21.15.76:0/2831996857 conn(0x5604cb8dd0a0 msgr2=0x5604cb8f17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:10.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.698+0000 7fca2effd640 0 client.25052 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:10.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.699+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 shutdown_connections 2024-09-19T07:52:10.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.700+0000 7fca57e6c740 1 -- 172.21.15.76:0/2831996857 wait complete. 2024-09-19T07:52:10.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.700+0000 7fca57e6c740 20 client.25052 trim_cache size 0 max 16384 2024-09-19T07:52:10.701 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:10.701 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 25, 2024-09-19T07:52:10.701 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 4, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "6c86a709": { 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 4, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 131.2, 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:52:10.702 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:10.703 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fca380a3550 msgr2=0x7fca380a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fca380a3550 0x7fca380a5a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca400cd060 tx=0x7fca40097d80 comp rx=0 tx=0).stop 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 msgr2=0x7fca50198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 0x7fca50198600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca4000d770 tx=0x7fca4000dc30 comp rx=0 tx=0).stop 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 shutdown_connections 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fca380a3550 0x7fca380a5a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.702+0000 7fca55a93640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca50106f50 0x7fca5019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.703+0000 7fca55a93640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fca50100ca0 0x7fca50198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.703+0000 7fca55a93640 1 --2- 172.21.15.76:0/3619043682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca501002f0 0x7fca50198600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.703+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 >> 172.21.15.76:0/3619043682 conn(0x7fca50077210 msgr2=0x7fca501057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.703+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 shutdown_connections 2024-09-19T07:52:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:10.704+0000 7fca55a93640 1 -- 172.21.15.76:0/3619043682 wait complete. 2024-09-19T07:52:10.706 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:10.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:10 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:52:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:10 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:10 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:52:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:10 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:11.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:10 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:52:11.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:10 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:11.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:10 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:52:11.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:10 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:11.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:10 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:52:11.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:10 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:11.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:10 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:52:11.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:10 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:11.655 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6c86a709', total seconds elapsed: 16.0 2024-09-19T07:52:11.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.918+0000 7fe16335f640 1 -- 172.21.15.76:0/3104879517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 msgr2=0x7fe15c1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.918+0000 7fe16335f640 1 --2- 172.21.15.76:0/3104879517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c1108e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe154009ca0 tx=0x7fe15402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.918+0000 7fe16335f640 1 -- 172.21.15.76:0/3104879517 shutdown_connections 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 --2- 172.21.15.76:0/3104879517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c1108e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 --2- 172.21.15.76:0/3104879517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe15c1012f0 0x7fe15c10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 --2- 172.21.15.76:0/3104879517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 0x7fe15c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 -- 172.21.15.76:0/3104879517 >> 172.21.15.76:0/3104879517 conn(0x7fe15c0fc7d0 msgr2=0x7fe15c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 -- 172.21.15.76:0/3104879517 shutdown_connections 2024-09-19T07:52:11.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 -- 172.21.15.76:0/3104879517 wait complete. 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 Processor -- start 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.919+0000 7fe16335f640 1 -- start start 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe16335f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 0x7fe15c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe16335f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe15c1012f0 0x7fe15c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe16335f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe16335f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c1142c0 con 0x7fe15c10e4f0 2024-09-19T07:52:11.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe16335f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c114140 con 0x7fe15c100940 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe16335f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c114440 con 0x7fe15c1012f0 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c19dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37898/0 (socket says 172.21.15.76:37898) 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 -- 172.21.15.76:0/86650192 learned_addr learned my addr 172.21.15.76:0/86650192 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 0x7fe15c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1608fa640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe15c1012f0 0x7fe15c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 -- 172.21.15.76:0/86650192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe15c1012f0 msgr2=0x7fe15c19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe15c1012f0 0x7fe15c19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 -- 172.21.15.76:0/86650192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 msgr2=0x7fe15c19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 0x7fe15c19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1618fc640 1 -- 172.21.15.76:0/86650192 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c19e6d0 con 0x7fe15c10e4f0 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.920+0000 7fe1610fb640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 0x7fe15c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.921+0000 7fe1618fc640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c19dfa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe1540319f0 tx=0x7fe154031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.921+0000 7fe1527fc640 1 -- 172.21.15.76:0/86650192 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154003c30 con 0x7fe15c10e4f0 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.921+0000 7fe1527fc640 1 -- 172.21.15.76:0/86650192 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe154003dd0 con 0x7fe15c10e4f0 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.921+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c19e960 con 0x7fe15c10e4f0 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.921+0000 7fe1527fc640 1 -- 172.21.15.76:0/86650192 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15402fd50 con 0x7fe15c10e4f0 2024-09-19T07:52:11.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.921+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c1a7330 con 0x7fe15c10e4f0 2024-09-19T07:52:11.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.924+0000 7fe165738740 1 Processor -- start 2024-09-19T07:52:11.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.924+0000 7fe1527fc640 1 -- 172.21.15.76:0/86650192 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fe1540305c0 con 0x7fe15c10e4f0 2024-09-19T07:52:11.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 -- start start 2024-09-19T07:52:11.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 0x55da52432090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da5243c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5243ce90 0x55da5243f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55da5238f2e0 con 0x55da52431cb0 2024-09-19T07:52:11.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da52336ce0 con 0x55da5243ce90 2024-09-19T07:52:11.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe165738740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da5238b2a0 con 0x55da524325d0 2024-09-19T07:52:11.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe1608fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 0x55da52432090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe1608fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 0x55da52432090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37908/0 (socket says 172.21.15.76:37908) 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe1608fa640 1 -- 172.21.15.76:0/2986878065 learned_addr learned my addr 172.21.15.76:0/2986878065 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.925+0000 7fe1527fc640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe1480a3550 0x7fe1480a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1527fc640 1 -- 172.21.15.76:0/86650192 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fe1540f0fe0 con 0x7fe15c10e4f0 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1618fc640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe1480a3550 0x7fe1480a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1610fb640 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da5243c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1608fa640 1 -- 172.21.15.76:0/2986878065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 msgr2=0x55da5243c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:11.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1608fa640 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da5243c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1608fa640 1 -- 172.21.15.76:0/2986878065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5243ce90 msgr2=0x55da5243f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1608fa640 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5243ce90 0x55da5243f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1608fa640 1 -- 172.21.15.76:0/2986878065 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da5231b440 con 0x55da52431cb0 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1608fa640 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 0x55da52432090 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00b6c0 tx=0x7fe14c0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2652811c4beb50b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1477fe640 1 -- 172.21.15.76:0/2986878065 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0120d0 con 0x55da52431cb0 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1477fe640 1 -- 172.21.15.76:0/2986878065 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe14c016070 con 0x55da52431cb0 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.926+0000 7fe1477fe640 1 -- 172.21.15.76:0/2986878065 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c004a00 con 0x55da52431cb0 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 -- 172.21.15.76:0/2986878065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 msgr2=0x55da52432090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe1618fc640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe1480a3550 0x7fe1480a5a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1540ee720 tx=0x7fe1540095c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 0x55da52432090 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00b6c0 tx=0x7fe14c0127c0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 -- 172.21.15.76:0/2986878065 shutdown_connections 2024-09-19T07:52:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da5243ce90 0x55da5243f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da5243c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 --2- 172.21.15.76:0/2986878065 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52431cb0 0x55da52432090 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 -- 172.21.15.76:0/2986878065 >> 172.21.15.76:0/2986878065 conn(0x55da5242e240 msgr2=0x55da5242e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:11.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 -- 172.21.15.76:0/2986878065 shutdown_connections 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.927+0000 7fe165738740 1 -- 172.21.15.76:0/2986878065 wait complete. 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 -- start start 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 Processor -- start 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 0x55da52439d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 0x55da5243a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da5242c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55da5243fa60 con 0x55da5243ce90 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da5234a050 con 0x55da524325d0 2024-09-19T07:52:11.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da5243fbe0 con 0x55da5243a7a0 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe165738740 10 client.0 _ll_register_callbacks cb 0x55da5238a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.928+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 0x55da5243a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 0x55da5243a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37912/0 (socket says 172.21.15.76:37912) 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 -- 172.21.15.76:0/3471965288 learned_addr learned my addr 172.21.15.76:0/3471965288 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 -- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 msgr2=0x55da5242c450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da5242c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 -- 172.21.15.76:0/3471965288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 msgr2=0x55da52439d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 0x55da52439d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 -- 172.21.15.76:0/3471965288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da521003c0 con 0x55da5243ce90 2024-09-19T07:52:11.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe1610fb640 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 0x55da5243a260 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe158012e80 tx=0x7fe1580107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c7fc2099d428d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:11.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe144ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:11.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe144ff9640 1 -- 172.21.15.76:0/3471965288 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15801f060 con 0x55da5243ce90 2024-09-19T07:52:11.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe144ff9640 1 -- 172.21.15.76:0/3471965288 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fe15801a410 con 0x55da5243ce90 2024-09-19T07:52:11.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.929+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14c016070 con 0x55da5243ce90 2024-09-19T07:52:11.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe144ff9640 1 -- 172.21.15.76:0/3471965288 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe15801a610 con 0x55da5243ce90 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 10 client.15576 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da5242da00 con 0x55da5243ce90 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe144ff9640 1 -- 172.21.15.76:0/3471965288 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe14c016070 con 0x55da5243ce90 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe144ff9640 1 -- 172.21.15.76:0/3471965288 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe158019ab0 con 0x55da5243ce90 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 10 client.15576 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 20 client.15576 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524427b0 0x55da52444c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 4 client.15576 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.930+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da5239c850 con 0x55da524427b0 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.931+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524427b0 0x55da52444c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.931+0000 7fe144ff9640 10 client.15576 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.931+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524427b0 0x55da52444c50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=335ecc1ddbdb12aa server_cookie=3799105de59f9180 in_seq=0 out_seq=0 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe144ff9640 1 -- 172.21.15.76:0/3471965288 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da5239c850 con 0x55da524427b0 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe144ff9640 10 client.15576 handle_command_reply: tid=0 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 client.15576 shutdown 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 msgr2=0x55da5243a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 0x55da5243a260 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe158012e80 tx=0x7fe1580107a0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 shutdown_connections 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da5242c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524427b0 0x55da52444c50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe144ff9640 0 client.15576 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243ce90 0x55da5243a260 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 --2- 172.21.15.76:0/3471965288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 0x55da52439d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 >> 172.21.15.76:0/3471965288 conn(0x55da5242e240 msgr2=0x55da52424b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:11.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 shutdown_connections 2024-09-19T07:52:11.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 1 -- 172.21.15.76:0/3471965288 wait complete. 2024-09-19T07:52:11.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.932+0000 7fe165738740 20 client.15576 trim_cache size 0 max 16384 2024-09-19T07:52:11.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 Processor -- start 2024-09-19T07:52:11.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 -- start start 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 0x55da5242c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da52452560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 0x55da52429390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c072720 con 0x55da52452aa0 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06fff0 con 0x55da524325d0 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.950+0000 7fe165738740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06de60 con 0x55da5243a7a0 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1608fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 0x55da52429390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da52452560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da52452560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:39916/0 (socket says 172.21.15.76:39916) 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 -- 172.21.15.76:0/1042602533 learned_addr learned my addr 172.21.15.76:0/1042602533 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1608fa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 0x55da52429390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37924/0 (socket says 172.21.15.76:37924) 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 -- 172.21.15.76:0/1042602533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 msgr2=0x55da5242c880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 0x55da5242c880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 -- 172.21.15.76:0/1042602533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 msgr2=0x55da52429390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 0x55da52429390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 -- 172.21.15.76:0/1042602533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da524452d0 con 0x55da5243a7a0 2024-09-19T07:52:11.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1608fa640 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 0x55da52429390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:52:11.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.951+0000 7fe1610fb640 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da52452560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1580058c0 tx=0x7fe158012a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2fa68abc01c365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:11.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe146ffd640 1 -- 172.21.15.76:0/1042602533 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1580224a0 con 0x55da5243a7a0 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe146ffd640 1 -- 172.21.15.76:0/1042602533 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe158022640 con 0x55da5243a7a0 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe146ffd640 1 -- 172.21.15.76:0/1042602533 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15801aa10 con 0x55da5243a7a0 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 -- 172.21.15.76:0/1042602533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 msgr2=0x55da52452560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da52452560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1580058c0 tx=0x7fe158012a70 comp rx=0 tx=0).stop 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 -- 172.21.15.76:0/1042602533 shutdown_connections 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da52452aa0 0x55da52429390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da5243a7a0 0x55da52452560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 --2- 172.21.15.76:0/1042602533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524325d0 0x55da5242c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.952+0000 7fe165738740 1 -- 172.21.15.76:0/1042602533 >> 172.21.15.76:0/1042602533 conn(0x55da5242e240 msgr2=0x55da5243bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.953+0000 7fe165738740 1 -- 172.21.15.76:0/1042602533 shutdown_connections 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.953+0000 7fe165738740 1 -- 172.21.15.76:0/1042602533 wait complete. 2024-09-19T07:52:11.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.953+0000 7fe165738740 1 -- start start 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.953+0000 7fe165738740 1 Processor -- start 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe165738740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da524c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe165738740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 0x55da524c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe165738740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524c4f90 0x55da524c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 0x55da524c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 0x55da524c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37934/0 (socket says 172.21.15.76:37934) 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 -- 172.21.15.76:0/3071835475 learned_addr learned my addr 172.21.15.76:0/3071835475 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06e4b0 con 0x55da5243a7a0 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da524c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06f920 con 0x55da524c4f90 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06eb80 con 0x55da524325d0 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524c4f90 0x55da524c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 -- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 msgr2=0x55da524c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:11.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da524c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 -- 172.21.15.76:0/3071835475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524c4f90 msgr2=0x55da524c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:11.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524c4f90 0x55da524c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1610fb640 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da524c5a80 con 0x55da5243a7a0 2024-09-19T07:52:11.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.954+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524c4f90 0x55da524c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:11.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe165738740 10 client.0 _ll_register_callbacks cb 0x7fe15800aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:11.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe1610fb640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 0x55da524c99f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe158012e50 tx=0x7fe1580107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a38b3dafadbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:11.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe144ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:11.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe158022640 con 0x55da5243a7a0 2024-09-19T07:52:11.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe144ff9640 1 -- 172.21.15.76:0/3071835475 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15801f040 con 0x55da5243a7a0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe144ff9640 1 -- 172.21.15.76:0/3071835475 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fe158022db0 con 0x55da5243a7a0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe144ff9640 1 -- 172.21.15.76:0/3071835475 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe158022450 con 0x55da5243a7a0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe165738740 10 client.15582 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.955+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55da524d1f10 con 0x55da5243a7a0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe144ff9640 1 -- 172.21.15.76:0/3071835475 <== mon.0 v2:172.21.15.76:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe15801a7b0 con 0x55da5243a7a0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe165738740 10 client.15582 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe165738740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe165738740 20 client.15582 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe165738740 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524d24d0 0x55da524d48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe165738740 4 client.15582 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe158022640 con 0x55da524d24d0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.956+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524d24d0 0x55da524d48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:11.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe144ff9640 10 client.15582 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe1608fa640 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524d24d0 0x55da524d48f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13db5b1d7d08c50c server_cookie=f5aa48b0a66f22a5 in_seq=0 out_seq=0 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe144ff9640 1 -- 172.21.15.76:0/3071835475 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fe158022640 con 0x55da524d24d0 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe144ff9640 10 client.15582 handle_command_reply: tid=0 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 client.15582 shutdown 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 msgr2=0x55da524c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 0x55da524c99f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe158012e50 tx=0x7fe1580107a0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 shutdown_connections 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da524c4f90 0x55da524c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55da524d24d0 0x55da524d48f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55da5243a7a0 0x55da524c99f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 --2- 172.21.15.76:0/3071835475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da524325d0 0x55da524c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.957+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 >> 172.21.15.76:0/3071835475 conn(0x55da5242e240 msgr2=0x55da5243bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:11.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.958+0000 7fe144ff9640 0 client.15582 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.958+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 shutdown_connections 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.958+0000 7fe165738740 1 -- 172.21.15.76:0/3071835475 wait complete. 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: "20d668a4-01b8-4f26-bf72-6df998e1bafa": { 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "20d668a4-01b8-4f26-bf72-6df998e1bafa", 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:52:11.963 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:11.964 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:11.964 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:11.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.958+0000 7fe165738740 20 client.15582 trim_cache size 0 max 16384 2024-09-19T07:52:11.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.958+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe1480a3550 msgr2=0x7fe1480a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.958+0000 7fe16335f640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe1480a3550 0x7fe1480a5a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1540ee720 tx=0x7fe1540095c0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 msgr2=0x7fe15c19dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c19dfa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe1540319f0 tx=0x7fe154031a20 comp rx=0 tx=0).stop 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 shutdown_connections 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe1480a3550 0x7fe1480a5a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe15c10e4f0 0x7fe15c19dfa0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe15c1012f0 0x7fe15c19acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 --2- 172.21.15.76:0/86650192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c100940 0x7fe15c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 >> 172.21.15.76:0/86650192 conn(0x7fe15c0fc7d0 msgr2=0x7fe15c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 shutdown_connections 2024-09-19T07:52:11.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:11.959+0000 7fe16335f640 1 -- 172.21.15.76:0/86650192 wait complete. 2024-09-19T07:52:12.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:11 smithi076 ceph-mon[30930]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:52:12.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:11 smithi152 ceph-mon[35117]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:52:12.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:11 smithi137 ceph-mon[35309]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:52:12.774 INFO:tasks.cephfs.filesystem:scrub status for tag:20d668a4-01b8-4f26-bf72-6df998e1bafa - {'path': '/', 'tag': '20d668a4-01b8-4f26-bf72-6df998e1bafa', 'options': 'recursive,force'} 2024-09-19T07:52:13.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:12 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]: dispatch 2024-09-19T07:52:13.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:12 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T07:52:13.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:12 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-19T07:52:13.305 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:12 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]: dispatch 2024-09-19T07:52:13.305 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:12 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T07:52:13.305 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:12 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-19T07:52:13.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:12 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]: dispatch 2024-09-19T07:52:13.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:12 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T07:52:13.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:12 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-19T07:52:14.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:13 smithi076 ceph-mon[30930]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:52:14.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-09-19T07:52:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T07:52:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-19T07:52:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:13 smithi076 ceph-mon[30930]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:52:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:13 smithi152 ceph-mon[35117]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:52:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-09-19T07:52:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T07:52:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-19T07:52:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:13 smithi152 ceph-mon[35117]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:52:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:13 smithi137 ceph-mon[35309]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:52:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-09-19T07:52:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T07:52:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-19T07:52:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:13 smithi137 ceph-mon[35309]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:52:15.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:14 smithi076 ceph-mon[30930]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:52:15.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:14 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:52:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:14 smithi152 ceph-mon[35117]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:52:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:14 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:52:15.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:14 smithi137 ceph-mon[35309]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:52:15.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:14 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:52:16.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:15 smithi076 ceph-mon[30930]: pgmap v36: 97 pgs: 3 peering, 94 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-19T07:52:16.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:15 smithi076 ceph-mon[30930]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T07:52:16.212 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:15 smithi152 ceph-mon[35117]: pgmap v36: 97 pgs: 3 peering, 94 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-19T07:52:16.212 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:15 smithi152 ceph-mon[35117]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T07:52:16.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:15 smithi137 ceph-mon[35309]: pgmap v36: 97 pgs: 3 peering, 94 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-19T07:52:16.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:15 smithi137 ceph-mon[35309]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T07:52:18.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:17 smithi076 ceph-mon[30930]: pgmap v37: 97 pgs: 3 peering, 94 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-19T07:52:18.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:17 smithi152 ceph-mon[35117]: pgmap v37: 97 pgs: 3 peering, 94 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-19T07:52:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:17 smithi137 ceph-mon[35309]: pgmap v37: 97 pgs: 3 peering, 94 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 1 op/s 2024-09-19T07:52:19.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:18 smithi152 ceph-mon[35117]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T07:52:19.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:18 smithi152 ceph-mon[35117]: Cluster is now healthy 2024-09-19T07:52:19.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:18 smithi137 ceph-mon[35309]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T07:52:19.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:18 smithi137 ceph-mon[35309]: Cluster is now healthy 2024-09-19T07:52:19.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:18 smithi076 ceph-mon[30930]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T07:52:19.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:18 smithi076 ceph-mon[30930]: Cluster is now healthy 2024-09-19T07:52:20.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:19 smithi152 ceph-mon[35117]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 5 op/s; 333 B/s, 0 objects/s recovering 2024-09-19T07:52:20.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:19 smithi137 ceph-mon[35309]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 5 op/s; 333 B/s, 0 objects/s recovering 2024-09-19T07:52:20.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:19 smithi076 ceph-mon[30930]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 5 op/s; 333 B/s, 0 objects/s recovering 2024-09-19T07:52:22.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:22 smithi152 ceph-mon[35117]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 5 op/s; 333 B/s, 0 objects/s recovering 2024-09-19T07:52:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:52:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:52:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:52:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:52:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:22 smithi137 ceph-mon[35309]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 5 op/s; 333 B/s, 0 objects/s recovering 2024-09-19T07:52:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:52:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:52:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:52:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:52:22.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:22 smithi076 ceph-mon[30930]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 5 op/s; 333 B/s, 0 objects/s recovering 2024-09-19T07:52:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:52:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:52:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:52:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:52:24.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:24 smithi152 ceph-mon[35117]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 103 B/s wr, 4 op/s; 269 B/s, 0 objects/s recovering 2024-09-19T07:52:24.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:24 smithi137 ceph-mon[35309]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 103 B/s wr, 4 op/s; 269 B/s, 0 objects/s recovering 2024-09-19T07:52:24.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:24 smithi076 ceph-mon[30930]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 103 B/s wr, 4 op/s; 269 B/s, 0 objects/s recovering 2024-09-19T07:52:26.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:26 smithi152 ceph-mon[35117]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 244 B/s, 0 objects/s recovering 2024-09-19T07:52:26.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:26 smithi137 ceph-mon[35309]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 244 B/s, 0 objects/s recovering 2024-09-19T07:52:26.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:26 smithi076 ceph-mon[30930]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 244 B/s, 0 objects/s recovering 2024-09-19T07:52:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:28 smithi152 ceph-mon[35117]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 222 B/s, 0 objects/s recovering 2024-09-19T07:52:28.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:28 smithi137 ceph-mon[35309]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 222 B/s, 0 objects/s recovering 2024-09-19T07:52:28.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:28 smithi076 ceph-mon[30930]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 222 B/s, 0 objects/s recovering 2024-09-19T07:52:30.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:30 smithi152 ceph-mon[35117]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 222 B/s, 0 objects/s recovering 2024-09-19T07:52:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:30 smithi137 ceph-mon[35309]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 222 B/s, 0 objects/s recovering 2024-09-19T07:52:30.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:30 smithi076 ceph-mon[30930]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 222 B/s, 0 objects/s recovering 2024-09-19T07:52:32.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:32 smithi152 ceph-mon[35117]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:32.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:32 smithi137 ceph-mon[35309]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:32.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:32 smithi076 ceph-mon[30930]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:32.456 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:52:32.456 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T07:52:32.456 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:52:32.643 INFO:tasks.workunit.client.0.smithi076.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: git switch -c 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr:Or undo this operation with: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.644 INFO:tasks.workunit.client.0.smithi076.stderr: git switch - 2024-09-19T07:52:32.645 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.645 INFO:tasks.workunit.client.0.smithi076.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T07:52:32.645 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-09-19T07:52:32.645 INFO:tasks.workunit.client.0.smithi076.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T07:52:32.650 DEBUG:teuthology.orchestra.run.smithi076:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T07:52:32.678 INFO:tasks.workunit.client.0.smithi076.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T07:52:32.680 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T07:52:32.681 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T07:52:32.711 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:33.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 -- 172.21.15.76:0/3351333639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 msgr2=0x7f6e381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:33.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 --2- 172.21.15.76:0/3351333639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e381067e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009900 tx=0x7f6e2802a410 comp rx=0 tx=0).stop 2024-09-19T07:52:33.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 -- 172.21.15.76:0/3351333639 shutdown_connections 2024-09-19T07:52:33.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 --2- 172.21.15.76:0/3351333639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 0x7f6e3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 --2- 172.21.15.76:0/3351333639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e381067e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 --2- 172.21.15.76:0/3351333639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 0x7f6e381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 -- 172.21.15.76:0/3351333639 >> 172.21.15.76:0/3351333639 conn(0x7f6e380fd8c0 msgr2=0x7f6e380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:33.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 -- 172.21.15.76:0/3351333639 shutdown_connections 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.448+0000 7f6e403dc640 1 -- 172.21.15.76:0/3351333639 wait complete. 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 Processor -- start 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 -- start start 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 0x7f6e380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e38074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 0x7f6e38074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38112090 con 0x7f6e38102790 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38111f10 con 0x7f6e38106f10 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e403dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38112210 con 0x7f6e38101de0 2024-09-19T07:52:33.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e38074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e38074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42596/0 (socket says 172.21.15.76:42596) 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 -- 172.21.15.76:0/1172560951 learned_addr learned my addr 172.21.15.76:0/1172560951 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3e979640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 0x7f6e38074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3e178640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 0x7f6e380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 -- 172.21.15.76:0/1172560951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 msgr2=0x7f6e380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 0x7f6e380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 -- 172.21.15.76:0/1172560951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 msgr2=0x7f6e38074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 0x7f6e38074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3d977640 1 -- 172.21.15.76:0/1172560951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e381a6a00 con 0x7f6e38102790 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3e178640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 0x7f6e380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.449+0000 7f6e3e979640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 0x7f6e38074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:33.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.450+0000 7f6e3d977640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e38074a30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6e28006010 tx=0x7f6e280040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.450+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2803f030 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.450+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e280044c0 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.450+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e381a6c90 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.450+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28035070 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.450+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381a71c0 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.451+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e381021c0 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.452+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f6e28042030 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.453+0000 7f6e2f7fe640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e240a3550 0x7f6e240a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.453+0000 7f6e3e178640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e240a3550 0x7f6e240a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.453+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6e280f02e0 con 0x7f6e38102790 2024-09-19T07:52:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.453+0000 7f6e3e178640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e240a3550 0x7f6e240a5a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009b50 tx=0x7f6e34005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.457+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e280bcae0 con 0x7f6e38102790 2024-09-19T07:52:33.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.663+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e3810a150 con 0x7f6e38102790 2024-09-19T07:52:33.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.664+0000 7f6e2f7fe640 1 -- 172.21.15.76:0/1172560951 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f6e280bc3e0 con 0x7f6e38102790 2024-09-19T07:52:33.664 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:52:33.665 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:52:33.665 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:52:33.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e240a3550 msgr2=0x7f6e240a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:33.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e240a3550 0x7f6e240a5a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009b50 tx=0x7f6e34005f90 comp rx=0 tx=0).stop 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 msgr2=0x7f6e38074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e38074a30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6e28006010 tx=0x7f6e280040c0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 shutdown_connections 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e240a3550 0x7f6e240a5a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38106f10 0x7f6e38074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e38102790 0x7f6e38074a30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 --2- 172.21.15.76:0/1172560951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e38101de0 0x7f6e380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.666+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 >> 172.21.15.76:0/1172560951 conn(0x7f6e380fd8c0 msgr2=0x7f6e380feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.667+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 shutdown_connections 2024-09-19T07:52:33.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:33.667+0000 7f6e403dc640 1 -- 172.21.15.76:0/1172560951 wait complete. 2024-09-19T07:52:34.294 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T07:52:34.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:34 smithi152 ceph-mon[35117]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:34.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:34 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1172560951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:34 smithi137 ceph-mon[35309]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:34 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1172560951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:34.432 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T07:52:34.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:34 smithi076 ceph-mon[30930]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:34.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:34 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1172560951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:34.481 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T07:52:34.482 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T07:52:34.482 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T07:52:34.522 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T07:52:34.525 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T07:52:34.525 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T07:52:34.582 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-19T07:52:34.583 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-19T07:52:34.584 DEBUG:teuthology.orchestra.run.smithi076:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-19T07:52:34.645 INFO:tasks.workunit.client.0.smithi076.stderr:+ KERNEL=linux-4.0.5 2024-09-19T07:52:34.645 INFO:tasks.workunit.client.0.smithi076.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-19T07:52:34.662 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T07:52:34.662 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T07:52:34.949 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:35.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.444+0000 7f9694717640 1 -- 172.21.15.76:0/3332196161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c100a80 msgr2=0x7f968c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:35.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.444+0000 7f9694717640 1 --2- 172.21.15.76:0/3332196161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c100a80 0x7f968c100ee0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f967c009930 tx=0x7f967c02a420 comp rx=0 tx=0).stop 2024-09-19T07:52:35.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 -- 172.21.15.76:0/3332196161 shutdown_connections 2024-09-19T07:52:35.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 --2- 172.21.15.76:0/3332196161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f968c101420 0x7f968c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 --2- 172.21.15.76:0/3332196161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c100a80 0x7f968c100ee0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 --2- 172.21.15.76:0/3332196161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f968c106a80 0x7f968c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 -- 172.21.15.76:0/3332196161 >> 172.21.15.76:0/3332196161 conn(0x7f968c0fc7a0 msgr2=0x7f968c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 -- 172.21.15.76:0/3332196161 shutdown_connections 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 -- 172.21.15.76:0/3332196161 wait complete. 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 Processor -- start 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.445+0000 7f9694717640 1 -- start start 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f968c100a80 0x7f968c0fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f968c101420 0x7f968c0fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 0x7f968c0fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f968c110fe0 con 0x7f968c106a80 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f968c110e60 con 0x7f968c101420 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f968c111160 con 0x7f968c100a80 2024-09-19T07:52:35.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 0x7f968c0fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 0x7f968c0fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42618/0 (socket says 172.21.15.76:42618) 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 -- 172.21.15.76:0/3875381714 learned_addr learned my addr 172.21.15.76:0/3875381714 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9691cb2640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f968c101420 0x7f968c0fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f96924b3640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f968c100a80 0x7f968c0fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 -- 172.21.15.76:0/3875381714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f968c100a80 msgr2=0x7f968c0fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f968c100a80 0x7f968c0fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 -- 172.21.15.76:0/3875381714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f968c101420 msgr2=0x7f968c0fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f968c101420 0x7f968c0fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 -- 172.21.15.76:0/3875381714 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c1a6a40 con 0x7f968c106a80 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9692cb4640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 0x7f968c0fd7c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f968400d750 tx=0x7f968400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f96837fe640 1 -- 172.21.15.76:0/3875381714 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684017070 con 0x7f968c106a80 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f96837fe640 1 -- 172.21.15.76:0/3875381714 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9684005520 con 0x7f968c106a80 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c1a6d30 con 0x7f968c106a80 2024-09-19T07:52:35.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.446+0000 7f96837fe640 1 -- 172.21.15.76:0/3875381714 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684004e00 con 0x7f968c106a80 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.447+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1a71f0 con 0x7f968c106a80 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f96837fe640 1 -- 172.21.15.76:0/3875381714 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f9684004fa0 con 0x7f968c106a80 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f9696af0740 1 Processor -- start 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f9696af0740 1 -- start start 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f9696af0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f9696af0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f9696af0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.449+0000 7f9696af0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56267520b160 con 0x5626752a7170 2024-09-19T07:52:35.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9696af0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5626751b2720 con 0x5626752a6850 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9696af0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562675207120 con 0x5626752b1a30 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42622/0 (socket says 172.21.15.76:42622) 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 -- 172.21.15.76:0/2738349889 learned_addr learned my addr 172.21.15.76:0/2738349889 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96837fe640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96780a34d0 0x7f96780a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9691cb2640 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9691cb2640 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9692cb4640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96780a34d0 0x7f96780a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 -- 172.21.15.76:0/2738349889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 msgr2=0x5626752b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 -- 172.21.15.76:0/2738349889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 msgr2=0x5626752a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 -- 172.21.15.76:0/2738349889 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562674f7cba0 con 0x5626752a7170 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96837fe640 1 -- 172.21.15.76:0/3875381714 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f96840cfa40 con 0x7f968c106a80 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f96924b3640 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b14f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9688009fa0 tx=0x7f968800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e33985d21e24429 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9692cb4640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96780a34d0 0x7f96780a5990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96840cd010 tx=0x7f968406d7f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9680ff9640 1 -- 172.21.15.76:0/2738349889 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968801a070 con 0x5626752a7170 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9680ff9640 1 -- 172.21.15.76:0/2738349889 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9688015910 con 0x5626752a7170 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.450+0000 7f9680ff9640 1 -- 172.21.15.76:0/2738349889 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968800aa30 con 0x5626752a7170 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 -- 172.21.15.76:0/2738349889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 msgr2=0x5626752b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b14f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9688009fa0 tx=0x7f968800c8b0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 -- 172.21.15.76:0/2738349889 shutdown_connections 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b14f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 --2- 172.21.15.76:0/2738349889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 -- 172.21.15.76:0/2738349889 >> 172.21.15.76:0/2738349889 conn(0x5626752a2de0 msgr2=0x5626752a31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 -- 172.21.15.76:0/2738349889 shutdown_connections 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.451+0000 7f9696af0740 1 -- 172.21.15.76:0/2738349889 wait complete. 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 -- start start 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 Processor -- start 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5626752b4600 con 0x5626752a7170 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562675193900 con 0x5626752a6850 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5626752b4780 con 0x5626752b1a30 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9696af0740 10 client.0 _ll_register_callbacks cb 0x562675191780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42634/0 (socket says 172.21.15.76:42634) 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 -- 172.21.15.76:0/2402045333 learned_addr learned my addr 172.21.15.76:0/2402045333 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9691cb2640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f9691cb2640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 -- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 msgr2=0x5626752af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 -- 172.21.15.76:0/2402045333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 msgr2=0x5626752ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.452+0000 7f96924b3640 1 -- 172.21.15.76:0/2402045333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626751d3c50 con 0x5626752a7170 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f96924b3640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752aeea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f968800cfd0 tx=0x7f9688009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dffcc76f1ce92d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9675ffb640 1 -- 172.21.15.76:0/2402045333 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968801a040 con 0x5626752a7170 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9675ffb640 1 -- 172.21.15.76:0/2402045333 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9688015ac0 con 0x5626752a7170 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9688015910 con 0x5626752a7170 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9675ffb640 1 -- 172.21.15.76:0/2402045333 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f968802e050 con 0x5626752a7170 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 10 client.15600 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:35.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626752c0300 con 0x5626752a7170 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9675ffb640 1 -- 172.21.15.76:0/2402045333 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9688015910 con 0x5626752a7170 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9675ffb640 1 -- 172.21.15.76:0/2402045333 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9688020570 con 0x5626752a7170 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 10 client.15600 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 10 client.15600 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 20 client.15600 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5626752c17c0 0x5626752c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 4 client.15600 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.453+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562675218890 con 0x5626752c17c0 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.454+0000 7f9691cb2640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5626752c17c0 0x5626752c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.454+0000 7f9691cb2640 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5626752c17c0 0x5626752c3bb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e7e22ebdc93cf6 server_cookie=99ec25fc55b599eb in_seq=0 out_seq=0 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.454+0000 7f9675ffb640 10 client.15600 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9675ffb640 1 -- 172.21.15.76:0/2402045333 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562675218890 con 0x5626752c17c0 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9675ffb640 10 client.15600 handle_command_reply: tid=0 2024-09-19T07:52:35.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 client.15600 shutdown 2024-09-19T07:52:35.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 msgr2=0x5626752aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:35.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752aeea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f968800cfd0 tx=0x7f9688009d40 comp rx=0 tx=0).stop 2024-09-19T07:52:35.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 shutdown_connections 2024-09-19T07:52:35.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752b1a30 0x5626752af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5626752c17c0 0x5626752c3bb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752aeea0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 --2- 172.21.15.76:0/2402045333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9675ffb640 0 client.15600 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 >> 172.21.15.76:0/2402045333 conn(0x5626752a2de0 msgr2=0x5626752a8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 shutdown_connections 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 1 -- 172.21.15.76:0/2402045333 wait complete. 2024-09-19T07:52:35.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.455+0000 7f9696af0740 20 client.15600 trim_cache size 0 max 16384 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.472+0000 7f9696af0740 1 Processor -- start 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.472+0000 7f9696af0740 1 -- start start 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.472+0000 7f9696af0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9696af0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a7170 0x5626752ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9696af0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 0x5626752a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9696af0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1b2600 con 0x5626752b1a30 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9696af0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1afed0 con 0x5626752a6850 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9696af0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1add20 con 0x5626752a7170 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 0x5626752a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 0x5626752a92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42650/0 (socket says 172.21.15.76:42650) 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 -- 172.21.15.76:0/1077446048 learned_addr learned my addr 172.21.15.76:0/1077446048 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f96924b3640 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a7170 0x5626752ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 -- 172.21.15.76:0/1077446048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a7170 msgr2=0x5626752ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a7170 0x5626752ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 -- 172.21.15.76:0/1077446048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 msgr2=0x5626752b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 -- 172.21.15.76:0/1077446048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626752a6fa0 con 0x5626752b1a30 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9691cb2640 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 0x5626752a92b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f967c009930 tx=0x7f967c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dc52a8c5fec417 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9677fff640 1 -- 172.21.15.76:0/1077446048 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c035050 con 0x5626752b1a30 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9677fff640 1 -- 172.21.15.76:0/1077446048 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f967c005020 con 0x5626752b1a30 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.473+0000 7f9677fff640 1 -- 172.21.15.76:0/1077446048 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c004bc0 con 0x5626752b1a30 2024-09-19T07:52:35.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 -- 172.21.15.76:0/1077446048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 msgr2=0x5626752a92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 0x5626752a92b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f967c009930 tx=0x7f967c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 -- 172.21.15.76:0/1077446048 shutdown_connections 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752b1a30 0x5626752a92b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a7170 0x5626752ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 --2- 172.21.15.76:0/1077446048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752a6850 0x5626752b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 -- 172.21.15.76:0/1077446048 >> 172.21.15.76:0/1077446048 conn(0x5626752a2de0 msgr2=0x5626752af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 -- 172.21.15.76:0/1077446048 shutdown_connections 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 -- 172.21.15.76:0/1077446048 wait complete. 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 -- start start 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.474+0000 7f9696af0740 1 Processor -- start 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a6850 0x5626752b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752b1a30 0x56267532b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1ae390 con 0x5626752a7170 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1af800 con 0x5626752b1a30 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1aea60 con 0x5626752a6850 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 10 client.0 _ll_register_callbacks cb 0x7f9688018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:42652/0 (socket says 172.21.15.76:42652) 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 -- 172.21.15.76:0/4251994581 learned_addr learned my addr 172.21.15.76:0/4251994581 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9691cb2640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a6850 0x5626752b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9691cb2640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752b1a30 0x56267532b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 -- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a6850 msgr2=0x5626752b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a6850 0x5626752b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 -- 172.21.15.76:0/4251994581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752b1a30 msgr2=0x56267532b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752b1a30 0x56267532b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 -- 172.21.15.76:0/4251994581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267532b6c0 con 0x5626752a7170 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f96924b3640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b6300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9688004b90 tx=0x7f9688007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9304ac9863ae4fee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9675ffb640 1 -- 172.21.15.76:0/4251994581 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968801a070 con 0x5626752a7170 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9675ffb640 1 -- 172.21.15.76:0/4251994581 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9688020b30 con 0x5626752a7170 2024-09-19T07:52:35.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f967c005020 con 0x5626752a7170 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9675ffb640 1 -- 172.21.15.76:0/4251994581 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9688020d30 con 0x5626752a7170 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 10 client.15606 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.475+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56267532c900 con 0x5626752a7170 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9675ffb640 1 -- 172.21.15.76:0/4251994581 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f967c005020 con 0x5626752a7170 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9675ffb640 1 -- 172.21.15.76:0/4251994581 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f968800a720 con 0x5626752a7170 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9696af0740 10 client.15606 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9696af0740 10 client.15606 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9696af0740 20 client.15606 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9696af0740 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56267532cfa0 0x56267532f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:35.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9696af0740 4 client.15606 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T07:52:35.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x562675212be0 con 0x56267532cfa0 2024-09-19T07:52:35.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9691cb2640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56267532cfa0 0x56267532f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:35.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9691cb2640 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56267532cfa0 0x56267532f390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3018543bda23c1fa server_cookie=10231f96a351fa9 in_seq=0 out_seq=0 2024-09-19T07:52:35.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:35.476+0000 7f9675ffb640 10 client.15606 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:36.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.190+0000 7f9675ffb640 1 -- 172.21.15.76:0/4251994581 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562675212be0 con 0x56267532cfa0 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.190+0000 7f9675ffb640 10 client.15606 handle_command_reply: tid=0 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 client.15606 shutdown 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 msgr2=0x5626752b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b6300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9688004b90 tx=0x7f9688007000 comp rx=0 tx=0).stop 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 shutdown_connections 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5626752b1a30 0x56267532b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56267532cfa0 0x56267532f390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5626752a7170 0x5626752b6300 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 --2- 172.21.15.76:0/4251994581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626752a6850 0x5626752b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 >> 172.21.15.76:0/4251994581 conn(0x5626752a2de0 msgr2=0x5626752ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9675ffb640 0 client.15606 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 shutdown_connections 2024-09-19T07:52:36.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 1 -- 172.21.15.76:0/4251994581 wait complete. 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.191+0000 7f9696af0740 20 client.15606 trim_cache size 0 max 16384 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 25, 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 6, 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "5d538fe8": { 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 6, 2024-09-19T07:52:36.193 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 140.3, 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:36.194 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96780a34d0 msgr2=0x7f96780a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96780a34d0 0x7f96780a5990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96840cd010 tx=0x7f968406d7f0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 msgr2=0x7f968c0fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 0x7f968c0fd7c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f968400d750 tx=0x7f968400dc10 comp rx=0 tx=0).stop 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 shutdown_connections 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96780a34d0 0x7f96780a5990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f968c106a80 0x7f968c0fd7c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f968c101420 0x7f968c0fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 --2- 172.21.15.76:0/3875381714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f968c100a80 0x7f968c0fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 >> 172.21.15.76:0/3875381714 conn(0x7f968c0fc7a0 msgr2=0x7f968c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 shutdown_connections 2024-09-19T07:52:36.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:36.192+0000 7f9694717640 1 -- 172.21.15.76:0/3875381714 wait complete. 2024-09-19T07:52:36.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:36 smithi152 ceph-mon[35117]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:52:36.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:36 smithi137 ceph-mon[35309]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:52:36.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:36 smithi076 ceph-mon[30930]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:52:36.993 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5d538fe8', quiesce took 4.5 seconds. Will release after: 15.850000000000001 2024-09-19T07:52:38.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:38 smithi152 ceph-mon[35117]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:38.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:38 smithi137 ceph-mon[35309]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:38.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:38 smithi076 ceph-mon[30930]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:52:40.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:40 smithi152 ceph-mon[35117]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T07:52:40.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:40 smithi137 ceph-mon[35309]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T07:52:40.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:40 smithi076 ceph-mon[30930]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T07:52:42.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:42 smithi152 ceph-mon[35117]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-19T07:52:42.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:42 smithi137 ceph-mon[35309]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-19T07:52:42.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:42 smithi076 ceph-mon[30930]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-19T07:52:42.775 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:52:43.034 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:43.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 -- 172.21.15.76:0/2271868926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec100e20 msgr2=0x7f19ec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 --2- 172.21.15.76:0/2271868926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec100e20 0x7f19ec101200 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009900 tx=0x7f19dc02a480 comp rx=0 tx=0).stop 2024-09-19T07:52:43.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 -- 172.21.15.76:0/2271868926 shutdown_connections 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 --2- 172.21.15.76:0/2271868926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19ec102ef0 0x7f19ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 --2- 172.21.15.76:0/2271868926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec102570 0x7f19ec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 --2- 172.21.15.76:0/2271868926 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec100e20 0x7f19ec101200 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 -- 172.21.15.76:0/2271868926 >> 172.21.15.76:0/2271868926 conn(0x7f19ec0fc7d0 msgr2=0x7f19ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 -- 172.21.15.76:0/2271868926 shutdown_connections 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.549+0000 7f19f0963640 1 -- 172.21.15.76:0/2271868926 wait complete. 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 Processor -- start 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 -- start start 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec100e20 0x7f19ec197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 0x7f19ec1977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19ec102ef0 0x7f19ec197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1110a0 con 0x7f19ec102570 2024-09-19T07:52:43.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec110f20 con 0x7f19ec102ef0 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19f0963640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec111220 con 0x7f19ec100e20 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 0x7f19ec1977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 0x7f19ec1977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43716/0 (socket says 172.21.15.76:43716) 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 -- 172.21.15.76:0/2751962002 learned_addr learned my addr 172.21.15.76:0/2751962002 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19ead9d640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19ec102ef0 0x7f19ec197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19ea59c640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec100e20 0x7f19ec197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 -- 172.21.15.76:0/2751962002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec100e20 msgr2=0x7f19ec197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec100e20 0x7f19ec197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 -- 172.21.15.76:0/2751962002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19ec102ef0 msgr2=0x7f19ec197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19ec102ef0 0x7f19ec197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 -- 172.21.15.76:0/2751962002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec1a6ad0 con 0x7f19ec102570 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19ea59c640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec100e20 0x7f19ec197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:43.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.550+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 0x7f19ec1977a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f19d400d770 tx=0x7f19d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.551+0000 7f19e37fe640 1 -- 172.21.15.76:0/2751962002 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4017070 con 0x7f19ec102570 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.551+0000 7f19e37fe640 1 -- 172.21.15.76:0/2751962002 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19d4005520 con 0x7f19ec102570 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.551+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec1a6dc0 con 0x7f19ec102570 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.551+0000 7f19e37fe640 1 -- 172.21.15.76:0/2751962002 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4010460 con 0x7f19ec102570 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.551+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec1a7220 con 0x7f19ec102570 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.553+0000 7f19e37fe640 1 -- 172.21.15.76:0/2751962002 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f19d4010600 con 0x7f19ec102570 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.553+0000 7f19f2d3c740 1 Processor -- start 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19e37fe640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f19d80a34d0 0x7f19d80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 -- start start 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ead9d640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f19d80a34d0 0x7f19d80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baa5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19e37fe640 1 -- 172.21.15.76:0/2751962002 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f19d40cfb30 con 0x7f19ec102570 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bab0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244bab2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56244ba0b2e0 con 0x56244baa54a0 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56244b9b2ce0 con 0x56244baa5dc0 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56244ba072a0 con 0x56244bab0680 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baa5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baa5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43732/0 (socket says 172.21.15.76:43732) 2024-09-19T07:52:43.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 -- 172.21.15.76:0/3597073797 learned_addr learned my addr 172.21.15.76:0/3597073797 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bab0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ead9d640 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244bab2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 -- 172.21.15.76:0/3597073797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 msgr2=0x56244bab2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244bab2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 -- 172.21.15.76:0/3597073797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 msgr2=0x56244bab0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bab0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.554+0000 7f19ea59c640 1 -- 172.21.15.76:0/3597073797 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244b997440 con 0x56244baa54a0 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.555+0000 7f19ead9d640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f19d80a34d0 0x7f19d80a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19e4005fd0 tx=0x7f19e4003d40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.555+0000 7f19ea59c640 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baa5880 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f19dc033000 tx=0x7f19dc032c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d975fa8c3c9a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.555+0000 7f19e0ff9640 1 -- 172.21.15.76:0/3597073797 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc03f070 con 0x56244baa54a0 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.555+0000 7f19e0ff9640 1 -- 172.21.15.76:0/3597073797 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19dc032e40 con 0x56244baa54a0 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.555+0000 7f19e0ff9640 1 -- 172.21.15.76:0/3597073797 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc035070 con 0x56244baa54a0 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 -- 172.21.15.76:0/3597073797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 msgr2=0x56244baa5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baa5880 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f19dc033000 tx=0x7f19dc032c20 comp rx=0 tx=0).stop 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 -- 172.21.15.76:0/3597073797 shutdown_connections 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244bab2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bab0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/3597073797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baa5880 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 -- 172.21.15.76:0/3597073797 >> 172.21.15.76:0/3597073797 conn(0x56244baa1a30 msgr2=0x56244baa1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:43.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 -- 172.21.15.76:0/3597073797 shutdown_connections 2024-09-19T07:52:43.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 -- 172.21.15.76:0/3597073797 wait complete. 2024-09-19T07:52:43.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.556+0000 7f19f2d3c740 1 -- start start 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 Processor -- start 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baaff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244baad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244baad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56244bab3250 con 0x56244baa54a0 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56244b9c6050 con 0x56244baa5dc0 2024-09-19T07:52:43.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56244bab33d0 con 0x56244bab0680 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19ea59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baaff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19f2d3c740 10 client.0 _ll_register_callbacks cb 0x56244ba06160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19ea59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baaff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43742/0 (socket says 172.21.15.76:43742) 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19ea59c640 1 -- 172.21.15.76:0/112225976 learned_addr learned my addr 172.21.15.76:0/112225976 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244baad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19ea59c640 1 -- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 msgr2=0x56244baad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19ead9d640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244baad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.557+0000 7f19ea59c640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244baad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19ea59c640 1 -- 172.21.15.76:0/112225976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 msgr2=0x56244baad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19ea59c640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244baad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19ea59c640 1 -- 172.21.15.76:0/112225976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56244b77c3c0 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19ea59c640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baaff00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f19dc02a9a0 tx=0x7f19dc0318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77b382f976155a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19d1ffb640 1 -- 172.21.15.76:0/112225976 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc04a020 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19d1ffb640 1 -- 172.21.15.76:0/112225976 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f19dc0035f0 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56244ba18850 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19d1ffb640 1 -- 172.21.15.76:0/112225976 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19dc055050 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19f2d3c740 10 client.15618 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56244babeb40 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.558+0000 7f19d1ffb640 1 -- 172.21.15.76:0/112225976 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x56244ba18850 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19d1ffb640 1 -- 172.21.15.76:0/112225976 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f19dc004c20 con 0x56244baa54a0 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19f2d3c740 10 client.15618 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:43.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19f2d3c740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19f2d3c740 20 client.15618 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244babfe90 0x56244bac2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19f2d3c740 4 client.15618 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56244ba12d60 con 0x56244babfe90 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.559+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244babfe90 0x56244bac2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.560+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244babfe90 0x56244bac2280 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40bb709ca1070e3 server_cookie=5e8d9675c8ed47b2 in_seq=0 out_seq=0 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.560+0000 7f19d1ffb640 10 client.15618 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.560+0000 7f19d1ffb640 1 -- 172.21.15.76:0/112225976 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56244ba12d60 con 0x56244babfe90 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.560+0000 7f19d1ffb640 10 client.15618 handle_command_reply: tid=0 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.560+0000 7f19f2d3c740 1 client.15618 shutdown 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 msgr2=0x56244baaff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baaff00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f19dc02a9a0 tx=0x7f19dc0318e0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 shutdown_connections 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244bab0680 0x56244baad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244baad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244babfe90 0x56244bac2280 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/112225976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244baa54a0 0x56244baaff00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19d1ffb640 0 client.15618 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 >> 172.21.15.76:0/112225976 conn(0x56244baa1a30 msgr2=0x56244baa7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 shutdown_connections 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 1 -- 172.21.15.76:0/112225976 wait complete. 2024-09-19T07:52:43.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.561+0000 7f19f2d3c740 20 client.15618 trim_cache size 0 max 16384 2024-09-19T07:52:43.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 Processor -- start 2024-09-19T07:52:43.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 -- start start 2024-09-19T07:52:43.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa54a0 0x56244babc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bac7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bac7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1b24f0 con 0x56244bab0680 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1afdc0 con 0x56244baa5dc0 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1adc10 con 0x56244baa54a0 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bac7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bac7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43748/0 (socket says 172.21.15.76:43748) 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 -- 172.21.15.76:0/473520433 learned_addr learned my addr 172.21.15.76:0/473520433 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ea59c640 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa54a0 0x56244babc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bac7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 -- 172.21.15.76:0/473520433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa54a0 msgr2=0x56244babc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa54a0 0x56244babc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 -- 172.21.15.76:0/473520433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 msgr2=0x56244bac7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.593+0000 7f19ead9d640 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bac7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.594+0000 7f19ead9d640 1 -- 172.21.15.76:0/473520433 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244baa1860 con 0x56244bab0680 2024-09-19T07:52:43.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.594+0000 7f19ead9d640 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bac7dc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19e4003fd0 tx=0x7f19e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723bface36afa6f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:43.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.594+0000 7f19d3fff640 1 -- 172.21.15.76:0/473520433 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4020620 con 0x56244bab0680 2024-09-19T07:52:43.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.594+0000 7f19d3fff640 1 -- 172.21.15.76:0/473520433 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19e4011e50 con 0x56244bab0680 2024-09-19T07:52:43.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.594+0000 7f19d3fff640 1 -- 172.21.15.76:0/473520433 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e401fd10 con 0x56244bab0680 2024-09-19T07:52:43.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- 172.21.15.76:0/473520433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 msgr2=0x56244bac7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bac7dc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19e4003fd0 tx=0x7f19e4018000 comp rx=0 tx=0).stop 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- 172.21.15.76:0/473520433 shutdown_connections 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bac7dc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa5dc0 0x56244bac7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/473520433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa54a0 0x56244babc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- 172.21.15.76:0/473520433 >> 172.21.15.76:0/473520433 conn(0x56244baa1a30 msgr2=0x56244baa8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- 172.21.15.76:0/473520433 shutdown_connections 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- 172.21.15.76:0/473520433 wait complete. 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- start start 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 Processor -- start 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa54a0 0x56244bab3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa5dc0 0x56244bab40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bb28840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1ae280 con 0x56244bab0680 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1af6f0 con 0x56244baa54a0 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec1ae950 con 0x56244baa5dc0 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19f2d3c740 10 client.0 _ll_register_callbacks cb 0x7f19dc031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.595+0000 7f19ead9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bb28840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bb28840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43764/0 (socket says 172.21.15.76:43764) 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 -- 172.21.15.76:0/2310865660 learned_addr learned my addr 172.21.15.76:0/2310865660 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19e9d9b640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa5dc0 0x56244bab40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ea59c640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa54a0 0x56244bab3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 -- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa5dc0 msgr2=0x56244bab40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa5dc0 0x56244bab40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 -- 172.21.15.76:0/2310865660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa54a0 msgr2=0x56244bab3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa54a0 0x56244bab3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 -- 172.21.15.76:0/2310865660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56244bb28d80 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19ead9d640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bb28840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f19e401f4b0 tx=0x7f19e401f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a57bcd182fc25bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19d1ffb640 1 -- 172.21.15.76:0/2310865660 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4004e50 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19d1ffb640 1 -- 172.21.15.76:0/2310865660 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f19e401f990 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e4011e50 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19d1ffb640 1 -- 172.21.15.76:0/2310865660 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19e401fb90 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19f2d3c740 10 client.15624 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.596+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56244bb2a060 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19d1ffb640 1 -- 172.21.15.76:0/2310865660 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19e4011e50 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19d1ffb640 1 -- 172.21.15.76:0/2310865660 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f19e4030070 con 0x56244bab0680 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19f2d3c740 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19f2d3c740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:43.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19f2d3c740 20 client.15624 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244bb2a7a0 0x56244bb2cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19f2d3c740 4 client.15624 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56244baada80 con 0x56244bb2a7a0 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.597+0000 7f19ea59c640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244bb2a7a0 0x56244bb2cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19d1ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19ea59c640 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244bb2a7a0 0x56244bb2cbc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61818ae7f98849ad server_cookie=de570aa74fa03f79 in_seq=0 out_seq=0 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19d1ffb640 1 -- 172.21.15.76:0/2310865660 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56244baada80 con 0x56244bb2a7a0 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19d1ffb640 10 client.15624 handle_command_reply: tid=0 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 client.15624 shutdown 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 msgr2=0x56244bb28840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bb28840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f19e401f4b0 tx=0x7f19e401f4e0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 shutdown_connections 2024-09-19T07:52:43.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56244bb2a7a0 0x56244bb2cbc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56244bab0680 0x56244bb28840 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56244baa5dc0 0x56244bab40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 --2- 172.21.15.76:0/2310865660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56244baa54a0 0x56244bab3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 >> 172.21.15.76:0/2310865660 conn(0x56244baa1a30 msgr2=0x56244baa0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19d1ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 shutdown_connections 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 1 -- 172.21.15.76:0/2310865660 wait complete. 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.598+0000 7f19f2d3c740 20 client.15624 trim_cache size 0 max 16384 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:52:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:52:43.605 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:43.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f19d80a34d0 msgr2=0x7f19d80a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f19d80a34d0 0x7f19d80a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19e4005fd0 tx=0x7f19e4003d40 comp rx=0 tx=0).stop 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 msgr2=0x7f19ec1977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 0x7f19ec1977a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f19d400d770 tx=0x7f19d400dc30 comp rx=0 tx=0).stop 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 shutdown_connections 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f19d80a34d0 0x7f19d80a5990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19ec102ef0 0x7f19ec197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19ec102570 0x7f19ec1977a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 --2- 172.21.15.76:0/2751962002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19ec100e20 0x7f19ec197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 >> 172.21.15.76:0/2751962002 conn(0x7f19ec0fc7d0 msgr2=0x7f19ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 shutdown_connections 2024-09-19T07:52:43.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:43.599+0000 7f19f0963640 1 -- 172.21.15.76:0/2751962002 wait complete. 2024-09-19T07:52:44.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:44 smithi152 ceph-mon[35117]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-19T07:52:44.327 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:44 smithi076 ceph-mon[30930]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-19T07:52:44.355 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:52:44.355 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:52:44.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:44 smithi137 ceph-mon[35309]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-09-19T07:52:44.610 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:45.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 -- 172.21.15.76:0/396513756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 msgr2=0x7f01401031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:45.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 --2- 172.21.15.76:0/396513756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f01401031c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0130009900 tx=0x7f013002a480 comp rx=0 tx=0).stop 2024-09-19T07:52:45.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 -- 172.21.15.76:0/396513756 shutdown_connections 2024-09-19T07:52:45.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 --2- 172.21.15.76:0/396513756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014010c180 0x7f014010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 --2- 172.21.15.76:0/396513756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0140103700 0x7f014010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 --2- 172.21.15.76:0/396513756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f01401031c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.090+0000 7f014777f640 1 -- 172.21.15.76:0/396513756 >> 172.21.15.76:0/396513756 conn(0x7f01400fc7a0 msgr2=0x7f01400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 -- 172.21.15.76:0/396513756 shutdown_connections 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 -- 172.21.15.76:0/396513756 wait complete. 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 Processor -- start 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 -- start start 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f0140198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0140103700 0x7f01401989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014010c180 0x7f014019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0140112090 con 0x7f0140102de0 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0140111f10 con 0x7f0140103700 2024-09-19T07:52:45.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014777f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0140112210 con 0x7f014010c180 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.091+0000 7f014551b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f0140198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f0140198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43772/0 (socket says 172.21.15.76:43772) 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 -- 172.21.15.76:0/97676682 learned_addr learned my addr 172.21.15.76:0/97676682 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f0144d1a640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0140103700 0x7f01401989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f0145d1c640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014010c180 0x7f014019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 -- 172.21.15.76:0/97676682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014010c180 msgr2=0x7f014019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:45.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014010c180 0x7f014019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 -- 172.21.15.76:0/97676682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0140103700 msgr2=0x7f01401989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0140103700 0x7f01401989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 -- 172.21.15.76:0/97676682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014019d440 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014551b640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f0140198490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0130006010 tx=0x7f01300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013003f030 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014019d6d0 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0130003d00 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130035070 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.092+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01401a5010 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.093+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01401031c0 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.094+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0130042030 con 0x7f0140102de0 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.095+0000 7f01367fc640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f012c0a33b0 0x7f012c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:45.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.095+0000 7f0144d1a640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f012c0a33b0 0x7f012c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:45.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.095+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f01300f01e0 con 0x7f0140102de0 2024-09-19T07:52:45.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.096+0000 7f0144d1a640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f012c0a33b0 0x7f012c0a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f014010d540 tx=0x7f013c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:45.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.100+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01300bcb00 con 0x7f0140102de0 2024-09-19T07:52:45.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.302+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0140107200 con 0x7f0140102de0 2024-09-19T07:52:45.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.303+0000 7f01367fc640 1 -- 172.21.15.76:0/97676682 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f01300bc400 con 0x7f0140102de0 2024-09-19T07:52:45.303 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:52:45.304 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:52:45.304 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.305+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f012c0a33b0 msgr2=0x7f012c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.305+0000 7f014777f640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f012c0a33b0 0x7f012c0a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f014010d540 tx=0x7f013c005f90 comp rx=0 tx=0).stop 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.305+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 msgr2=0x7f0140198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.305+0000 7f014777f640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f0140198490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0130006010 tx=0x7f01300042f0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 shutdown_connections 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f012c0a33b0 0x7f012c0a5870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014010c180 0x7f014019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0140103700 0x7f01401989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 --2- 172.21.15.76:0/97676682 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0140102de0 0x7f0140198490 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:45.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 >> 172.21.15.76:0/97676682 conn(0x7f01400fc7a0 msgr2=0x7f01400fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:45.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 shutdown_connections 2024-09-19T07:52:45.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:45.306+0000 7f014777f640 1 -- 172.21.15.76:0/97676682 wait complete. 2024-09-19T07:52:45.981 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:52:46.227 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:46.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:46 smithi152 ceph-mon[35117]: pgmap v51: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 178 KiB/s wr, 9 op/s 2024-09-19T07:52:46.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:46 smithi152 ceph-mon[35117]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-19T07:52:46.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:46 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/97676682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:46.349 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:46 smithi076 ceph-mon[30930]: pgmap v51: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 178 KiB/s wr, 9 op/s 2024-09-19T07:52:46.349 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:46 smithi076 ceph-mon[30930]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-19T07:52:46.349 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:46 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/97676682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:46.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:46 smithi137 ceph-mon[35309]: pgmap v51: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 178 KiB/s wr, 9 op/s 2024-09-19T07:52:46.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:46 smithi137 ceph-mon[35309]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-19T07:52:46.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:46 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/97676682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:46.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 -- 172.21.15.76:0/757031808 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480100b30 msgr2=0x7f5480100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 --2- 172.21.15.76:0/757031808 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480100b30 0x7f5480100f10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f547c009900 tx=0x7f547c02a470 comp rx=0 tx=0).stop 2024-09-19T07:52:46.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 -- 172.21.15.76:0/757031808 shutdown_connections 2024-09-19T07:52:46.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 --2- 172.21.15.76:0/757031808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5480105f40 0x7f54801063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 --2- 172.21.15.76:0/757031808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5480101450 0x7f5480105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 --2- 172.21.15.76:0/757031808 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480100b30 0x7f5480100f10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.655+0000 7f5487e67640 1 -- 172.21.15.76:0/757031808 >> 172.21.15.76:0/757031808 conn(0x7f54800fc7a0 msgr2=0x7f54800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.656+0000 7f5487e67640 1 -- 172.21.15.76:0/757031808 shutdown_connections 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.656+0000 7f5487e67640 1 -- 172.21.15.76:0/757031808 wait complete. 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.656+0000 7f5487e67640 1 Processor -- start 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.656+0000 7f5487e67640 1 -- start start 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5480100b30 0x7f54801a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 0x7f54801a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5480105f40 0x7f548019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f54801186f0 con 0x7f5480101450 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5480118570 con 0x7f5480105f40 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5480118870 con 0x7f5480100b30 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 0x7f54801a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 0x7f54801a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43796/0 (socket says 172.21.15.76:43796) 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 -- 172.21.15.76:0/1373692271 learned_addr learned my addr 172.21.15.76:0/1373692271 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5486404640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5480105f40 0x7f548019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485c03640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5480100b30 0x7f54801a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 -- 172.21.15.76:0/1373692271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5480100b30 msgr2=0x7f54801a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5480100b30 0x7f54801a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 -- 172.21.15.76:0/1373692271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5480105f40 msgr2=0x7f548019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5480105f40 0x7f548019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 -- 172.21.15.76:0/1373692271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548019f090 con 0x7f5480101450 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5485402640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 0x7f54801a4ce0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f547000d750 tx=0x7f547000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5476ffd640 1 -- 172.21.15.76:0/1373692271 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470017070 con 0x7f5480101450 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548019f380 con 0x7f5480101450 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5476ffd640 1 -- 172.21.15.76:0/1373692271 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5470005020 con 0x7f5480101450 2024-09-19T07:52:46.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.657+0000 7f5476ffd640 1 -- 172.21.15.76:0/1373692271 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470004dd0 con 0x7f5480101450 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.658+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54801ab670 con 0x7f5480101450 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f5476ffd640 1 -- 172.21.15.76:0/1373692271 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f54700051d0 con 0x7f5480101450 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 Processor -- start 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 -- start start 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb44090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb44a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb51760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564abbaaa2f0 con 0x564abbb45b40 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564abba51cf0 con 0x564abbb4f370 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f548a240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564abbaa62b0 con 0x564abbb445d0 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.660+0000 7f5476ffd640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f546c0a33b0 0x7f546c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb44090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb44090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43804/0 (socket says 172.21.15.76:43804) 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 -- 172.21.15.76:0/1249888563 learned_addr learned my addr 172.21.15.76:0/1249888563 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f546c0a33b0 0x7f546c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5476ffd640 1 -- 172.21.15.76:0/1373692271 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f54700cf6b0 con 0x7f5480101450 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5485402640 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb51760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5485c03640 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb44a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 -- 172.21.15.76:0/1249888563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 msgr2=0x564abbb44a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb44a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 -- 172.21.15.76:0/1249888563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 msgr2=0x564abbb51760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb51760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 -- 172.21.15.76:0/1249888563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564abba363a0 con 0x564abbb45b40 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb44090 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5478012d50 tx=0x7f5478010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cde8889383cf8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f5486404640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f546c0a33b0 0x7f546c0a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5478010c40 tx=0x7f5478014000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:46.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f546bfff640 1 -- 172.21.15.76:0/1249888563 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547800eb80 con 0x564abbb45b40 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f546bfff640 1 -- 172.21.15.76:0/1249888563 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f547800ed20 con 0x564abbb45b40 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.661+0000 7f546bfff640 1 -- 172.21.15.76:0/1249888563 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54780253a0 con 0x564abbb45b40 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 -- 172.21.15.76:0/1249888563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 msgr2=0x564abbb44090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb44090 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5478012d50 tx=0x7f5478010740 comp rx=0 tx=0).stop 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 -- 172.21.15.76:0/1249888563 shutdown_connections 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb51760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb44a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 --2- 172.21.15.76:0/1249888563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb44090 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 -- 172.21.15.76:0/1249888563 >> 172.21.15.76:0/1249888563 conn(0x564abbb0d310 msgr2=0x564abbb40c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 -- 172.21.15.76:0/1249888563 shutdown_connections 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.662+0000 7f548a240740 1 -- 172.21.15.76:0/1249888563 wait complete. 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 -- start start 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 Processor -- start 2024-09-19T07:52:46.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb4c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb4c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564abbb52010 con 0x564abbb45b40 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564abba65060 con 0x564abbb4f370 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564abbb52190 con 0x564abbb445d0 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f548a240740 10 client.0 _ll_register_callbacks cb 0x564abb7b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f5485402640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb4c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f5485402640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb4c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43810/0 (socket says 172.21.15.76:43810) 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f5485402640 1 -- 172.21.15.76:0/1139525480 learned_addr learned my addr 172.21.15.76:0/1139525480 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f5486404640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb4c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.663+0000 7f5485c03640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f5485402640 1 -- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 msgr2=0x564abbb4eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f5485402640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb4eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f5485402640 1 -- 172.21.15.76:0/1139525480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 msgr2=0x564abbb4c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f5485402640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb4c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f5485402640 1 -- 172.21.15.76:0/1139525480 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564abb81b3c0 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f5485402640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb4c050 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f54700983b0 tx=0x7f547009a190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb40b5dfbdca069c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f54697fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f54697fa640 1 -- 172.21.15.76:0/1139525480 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470020040 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f54697fa640 1 -- 172.21.15.76:0/1139525480 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5470098050 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f547800ed20 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f54697fa640 1 -- 172.21.15.76:0/1139525480 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f54700046c0 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 10 client.15642 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564abbb5daf0 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f54697fa640 1 -- 172.21.15.76:0/1139525480 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f547800ed20 con 0x564abbb45b40 2024-09-19T07:52:46.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f54697fa640 1 -- 172.21.15.76:0/1139525480 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5470084ce0 con 0x564abbb45b40 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 10 client.15642 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 10 client.15642 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 20 client.15642 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbb5efa0 0x564abbb61390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 4 client.15642 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.664+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564abbab7860 con 0x564abbb5efa0 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.665+0000 7f5485c03640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbb5efa0 0x564abbb61390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.665+0000 7f54697fa640 10 client.15642 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.665+0000 7f5485c03640 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbb5efa0 0x564abbb61390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=797905808ace1d7d server_cookie=cef24be3cee300ac in_seq=0 out_seq=0 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f54697fa640 1 -- 172.21.15.76:0/1139525480 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564abbab7860 con 0x564abbb5efa0 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f54697fa640 10 client.15642 handle_command_reply: tid=0 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 client.15642 shutdown 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 msgr2=0x564abbb4c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb4c050 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f54700983b0 tx=0x7f547009a190 comp rx=0 tx=0).stop 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 shutdown_connections 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbb5efa0 0x564abbb61390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb4c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb45b40 0x564abbb4c050 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f54697fa640 0 client.15642 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 --2- 172.21.15.76:0/1139525480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb4eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 >> 172.21.15.76:0/1139525480 conn(0x564abbb0d310 msgr2=0x564abbb46960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 shutdown_connections 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 1 -- 172.21.15.76:0/1139525480 wait complete. 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.666+0000 7f548a240740 20 client.15642 trim_cache size 0 max 16384 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 Processor -- start 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 -- start start 2024-09-19T07:52:46.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb66c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb45b40 0x564abbb671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 0x564abbb49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f54801b6920 con 0x564abbb4f370 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54801b41f0 con 0x564abbb45b40 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f548a240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54801b2040 con 0x564abbb445d0 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 0x564abbb49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 0x564abbb49330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43812/0 (socket says 172.21.15.76:43812) 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 -- 172.21.15.76:0/1315771222 learned_addr learned my addr 172.21.15.76:0/1315771222 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5485c03640 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb66c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 -- 172.21.15.76:0/1315771222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 msgr2=0x564abbb66c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb66c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 -- 172.21.15.76:0/1315771222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb45b40 msgr2=0x564abbb671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5485402640 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb45b40 0x564abbb671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb45b40 0x564abbb671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5486404640 1 -- 172.21.15.76:0/1315771222 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564abbb51ad0 con 0x564abbb4f370 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.679+0000 7f5485c03640 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb66c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f5486404640 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 0x564abbb49330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5478012c20 tx=0x7f547801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15dc4f260e61ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f546b7fe640 1 -- 172.21.15.76:0/1315771222 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547801b040 con 0x564abbb4f370 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f546b7fe640 1 -- 172.21.15.76:0/1315771222 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5478005bd0 con 0x564abbb4f370 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f546b7fe640 1 -- 172.21.15.76:0/1315771222 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547801e810 con 0x564abbb4f370 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 -- 172.21.15.76:0/1315771222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 msgr2=0x564abbb49330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 0x564abbb49330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5478012c20 tx=0x7f547801eb30 comp rx=0 tx=0).stop 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 -- 172.21.15.76:0/1315771222 shutdown_connections 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb4f370 0x564abbb49330 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb45b40 0x564abbb671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 --2- 172.21.15.76:0/1315771222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb445d0 0x564abbb66c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.680+0000 7f548a240740 1 -- 172.21.15.76:0/1315771222 >> 172.21.15.76:0/1315771222 conn(0x564abbb0d310 msgr2=0x564abbb4b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 -- 172.21.15.76:0/1315771222 shutdown_connections 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 -- 172.21.15.76:0/1315771222 wait complete. 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 -- start start 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 Processor -- start 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 0x564abbb57420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb45b40 0x564abbb57960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f54801b26b0 con 0x564abbb445d0 2024-09-19T07:52:46.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54801b3b20 con 0x564abbb4f370 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54801b2d80 con 0x564abbb45b40 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f548a240740 10 client.0 _ll_register_callbacks cb 0x7f547000d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f5485c03640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 0x564abbb57420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f5485c03640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 0x564abbb57420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43826/0 (socket says 172.21.15.76:43826) 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.681+0000 7f5485c03640 1 -- 172.21.15.76:0/1193545820 learned_addr learned my addr 172.21.15.76:0/1193545820 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5486404640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485402640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb45b40 0x564abbb57960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485c03640 1 -- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb45b40 msgr2=0x564abbb57960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485c03640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb45b40 0x564abbb57960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485c03640 1 -- 172.21.15.76:0/1193545820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 msgr2=0x564abbb543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485c03640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485c03640 1 -- 172.21.15.76:0/1193545820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564abbb57fd0 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f5485c03640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 0x564abbb57420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f547c006010 tx=0x7f547c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8d6d6913f2ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f54697fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f54697fa640 1 -- 172.21.15.76:0/1193545820 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c04a020 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f54697fa640 1 -- 172.21.15.76:0/1193545820 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f547c005510 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5478005bd0 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f54697fa640 1 -- 172.21.15.76:0/1193545820 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f547c055050 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f548a240740 10 client.15648 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564abbbca180 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.682+0000 7f54697fa640 1 -- 172.21.15.76:0/1193545820 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5478005bd0 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f54697fa640 1 -- 172.21.15.76:0/1193545820 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f547c031970 con 0x564abbb445d0 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f548a240740 10 client.15648 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f548a240740 10 client.15648 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f548a240740 20 client.15648 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:46.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f548a240740 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbbca900 0x564abbbccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f548a240740 4 client.15648 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564abbab1d70 con 0x564abbbca900 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.683+0000 7f5485402640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbbca900 0x564abbbccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f54697fa640 10 client.15648 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f5485402640 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbbca900 0x564abbbccd20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65ace4a65cfcba85 server_cookie=7650934a6eab74a4 in_seq=0 out_seq=0 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f54697fa640 1 -- 172.21.15.76:0/1193545820 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564abbab1d70 con 0x564abbbca900 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f54697fa640 10 client.15648 handle_command_reply: tid=0 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 client.15648 shutdown 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 msgr2=0x564abbb57420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 0x564abbb57420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f547c006010 tx=0x7f547c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 shutdown_connections 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564abbbca900 0x564abbbccd20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564abbb4f370 0x564abbb543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564abbb45b40 0x564abbb57960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f54697fa640 0 client.15648 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 --2- 172.21.15.76:0/1193545820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564abbb445d0 0x564abbb57420 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 >> 172.21.15.76:0/1193545820 conn(0x564abbb0d310 msgr2=0x564abbb3f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 shutdown_connections 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 1 -- 172.21.15.76:0/1193545820 wait complete. 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.684+0000 7f548a240740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T07:52:46.701 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:52:46.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f546c0a33b0 msgr2=0x7f546c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f546c0a33b0 0x7f546c0a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5478010c40 tx=0x7f5478014000 comp rx=0 tx=0).stop 2024-09-19T07:52:46.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 msgr2=0x7f54801a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:46.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 0x7f54801a4ce0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f547000d750 tx=0x7f547000dc10 comp rx=0 tx=0).stop 2024-09-19T07:52:46.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 shutdown_connections 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f546c0a33b0 0x7f546c0a5870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5480105f40 0x7f548019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5480101450 0x7f54801a4ce0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 --2- 172.21.15.76:0/1373692271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5480100b30 0x7f54801a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 >> 172.21.15.76:0/1373692271 conn(0x7f54800fc7a0 msgr2=0x7f54801038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 shutdown_connections 2024-09-19T07:52:46.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:46.685+0000 7f5487e67640 1 -- 172.21.15.76:0/1373692271 wait complete. 2024-09-19T07:52:47.305 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:52:47.550 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:48.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 -- 172.21.15.76:0/437366549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d01008d0 msgr2=0x7f88d0100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 --2- 172.21.15.76:0/437366549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d01008d0 0x7f88d0100d30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009930 tx=0x7f88c402a420 comp rx=0 tx=0).stop 2024-09-19T07:52:48.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 -- 172.21.15.76:0/437366549 shutdown_connections 2024-09-19T07:52:48.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 --2- 172.21.15.76:0/437366549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88d0101270 0x7f88d010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 --2- 172.21.15.76:0/437366549 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d01008d0 0x7f88d0100d30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 --2- 172.21.15.76:0/437366549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01068d0 0x7f88d0106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 -- 172.21.15.76:0/437366549 >> 172.21.15.76:0/437366549 conn(0x7f88d00fc610 msgr2=0x7f88d00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 -- 172.21.15.76:0/437366549 shutdown_connections 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 -- 172.21.15.76:0/437366549 wait complete. 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.022+0000 7f88d4a01640 1 Processor -- start 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 -- start start 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01008d0 0x7f88d019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 0x7f88d019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88d01068d0 0x7f88d019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88d0111fb0 con 0x7f88d0101270 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88d0111e30 con 0x7f88d01068d0 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88d4a01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88d0112130 con 0x7f88d01008d0 2024-09-19T07:52:48.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 0x7f88d019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 0x7f88d019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43842/0 (socket says 172.21.15.76:43842) 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 -- 172.21.15.76:0/803216632 learned_addr learned my addr 172.21.15.76:0/803216632 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88cf59e640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88d01068d0 0x7f88d019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ced9d640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01008d0 0x7f88d019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 -- 172.21.15.76:0/803216632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01008d0 msgr2=0x7f88d019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01008d0 0x7f88d019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 -- 172.21.15.76:0/803216632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88d01068d0 msgr2=0x7f88d019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88d01068d0 0x7f88d019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.023+0000 7f88ce59c640 1 -- 172.21.15.76:0/803216632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d019f640 con 0x7f88d0101270 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.024+0000 7f88ce59c640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 0x7f88d019abd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009a50 tx=0x7f88c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.024+0000 7f88b7fff640 1 -- 172.21.15.76:0/803216632 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c403f030 con 0x7f88d0101270 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.024+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d019f8d0 con 0x7f88d0101270 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.024+0000 7f88b7fff640 1 -- 172.21.15.76:0/803216632 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88c4003af0 con 0x7f88d0101270 2024-09-19T07:52:48.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.024+0000 7f88b7fff640 1 -- 172.21.15.76:0/803216632 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4035070 con 0x7f88d0101270 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.024+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d01a7210 con 0x7f88d0101270 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88b7fff640 1 -- 172.21.15.76:0/803216632 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f88c4042030 con 0x7f88d0101270 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 Processor -- start 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 -- start start 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368a9d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a9dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aaa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558368a032f0 con 0x558368aa8550 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583689aacf0 con 0x558368a9ed20 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88d75db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583689ff2b0 con 0x558368a9d7b0 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aaa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aaa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43858/0 (socket says 172.21.15.76:43858) 2024-09-19T07:52:48.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88ce59c640 1 -- 172.21.15.76:0/1067710971 learned_addr learned my addr 172.21.15.76:0/1067710971 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88cf59e640 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368a9d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.027+0000 7f88ced9d640 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a9dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88ce59c640 1 -- 172.21.15.76:0/1067710971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 msgr2=0x558368a9dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88ce59c640 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a9dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88ce59c640 1 -- 172.21.15.76:0/1067710971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 msgr2=0x558368a9d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88ce59c640 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368a9d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88ce59c640 1 -- 172.21.15.76:0/1067710971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836898f3a0 con 0x558368aa8550 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88b7fff640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88b80a33b0 0x7f88b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88cf59e640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88b80a33b0 0x7f88b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88ce59c640 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aaa940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f88c40edbd0 tx=0x7f88c40f6810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783f35a19ab8e8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88b7fff640 1 -- 172.21.15.76:0/803216632 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f88c40f0570 con 0x7f88d0101270 2024-09-19T07:52:48.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88b57fa640 1 -- 172.21.15.76:0/1067710971 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4049070 con 0x558368aa8550 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88b57fa640 1 -- 172.21.15.76:0/1067710971 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88c40bcef0 con 0x558368aa8550 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.028+0000 7f88b57fa640 1 -- 172.21.15.76:0/1067710971 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c40bc5c0 con 0x558368aa8550 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 -- 172.21.15.76:0/1067710971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 msgr2=0x558368aaa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88cf59e640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88b80a33b0 0x7f88b80a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88c800a400 tx=0x7f88c800d040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aaa940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f88c40edbd0 tx=0x7f88c40f6810 comp rx=0 tx=0).stop 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 -- 172.21.15.76:0/1067710971 shutdown_connections 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aaa940 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a9dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 --2- 172.21.15.76:0/1067710971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368a9d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 -- 172.21.15.76:0/1067710971 >> 172.21.15.76:0/1067710971 conn(0x558368a66310 msgr2=0x558368a99e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 -- 172.21.15.76:0/1067710971 shutdown_connections 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 -- 172.21.15.76:0/1067710971 wait complete. 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 -- start start 2024-09-19T07:52:48.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.029+0000 7f88d75db740 1 Processor -- start 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368aa7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368aa51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aa57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558368aab010 con 0x558368aa8550 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583689be060 con 0x558368a9ed20 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558368aab190 con 0x558368a9d7b0 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 10 client.0 _ll_register_callbacks cb 0x5583687118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aa57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aa57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43860/0 (socket says 172.21.15.76:43860) 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 -- 172.21.15.76:0/4218494381 learned_addr learned my addr 172.21.15.76:0/4218494381 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88ce59c640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368aa51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88ced9d640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368aa7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 -- 172.21.15.76:0/4218494381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 msgr2=0x558368aa7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368aa7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 -- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 msgr2=0x558368aa51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368aa51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 -- 172.21.15.76:0/4218494381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583687743c0 con 0x558368aa8550 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88cf59e640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aa57b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f88c8018ed0 tx=0x7f88c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ebd4a417fbbd98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88b2ff5640 1 -- 172.21.15.76:0/4218494381 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8028060 con 0x558368aa8550 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88b2ff5640 1 -- 172.21.15.76:0/4218494381 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f88c80177d0 con 0x558368aa8550 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.030+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c40bcef0 con 0x558368aa8550 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88b2ff5640 1 -- 172.21.15.76:0/4218494381 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f88c8016e40 con 0x558368aa8550 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:48.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558368ab6a30 con 0x558368aa8550 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88b2ff5640 1 -- 172.21.15.76:0/4218494381 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88c40bcef0 con 0x558368aa8550 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88b2ff5640 1 -- 172.21.15.76:0/4218494381 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f88c8023c50 con 0x558368aa8550 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 10 client.15660 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 20 client.15660 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368ab7e40 0x558368aba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 4 client.15660 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558368a10860 con 0x558368ab7e40 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.031+0000 7f88ced9d640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368ab7e40 0x558368aba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.032+0000 7f88b2ff5640 10 client.15660 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.032+0000 7f88ced9d640 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368ab7e40 0x558368aba230 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a96353dc4aa28c88 server_cookie=f389c9f4e8308bc4 in_seq=0 out_seq=0 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.032+0000 7f88b2ff5640 1 -- 172.21.15.76:0/4218494381 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558368a10860 con 0x558368ab7e40 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.032+0000 7f88b2ff5640 10 client.15660 handle_command_reply: tid=0 2024-09-19T07:52:48.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.032+0000 7f88d75db740 1 client.15660 shutdown 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 msgr2=0x558368aa57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aa57b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f88c8018ed0 tx=0x7f88c8004a40 comp rx=0 tx=0).stop 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 shutdown_connections 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368ab7e40 0x558368aba230 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368aa8550 0x558368aa57b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368a9ed20 0x558368aa51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 --2- 172.21.15.76:0/4218494381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368aa7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 >> 172.21.15.76:0/4218494381 conn(0x558368a66310 msgr2=0x558368a9fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88b2ff5640 0 client.15660 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 shutdown_connections 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 1 -- 172.21.15.76:0/4218494381 wait complete. 2024-09-19T07:52:48.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.033+0000 7f88d75db740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 Processor -- start 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 -- start start 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a99ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368ab4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01b24e0 con 0x558368a9ed20 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01afdb0 con 0x558368aa8550 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88d75db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01adc00 con 0x558368a9d7b0 2024-09-19T07:52:48.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368ab4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368ab4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43868/0 (socket says 172.21.15.76:43868) 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 -- 172.21.15.76:0/4103886278 learned_addr learned my addr 172.21.15.76:0/4103886278 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88cf59e640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ced9d640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a99ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 -- 172.21.15.76:0/4103886278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 msgr2=0x558368a99ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a99ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 -- 172.21.15.76:0/4103886278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 msgr2=0x558368aa0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ce59c640 1 -- 172.21.15.76:0/4103886278 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558368a9afb0 con 0x558368a9ed20 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88ced9d640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.048+0000 7f88cf59e640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88ce59c640 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368ab4270 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009900 tx=0x7f88c403bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bf1255c3a0cd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:48.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88b4ff9640 1 -- 172.21.15.76:0/4103886278 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4049030 con 0x558368a9ed20 2024-09-19T07:52:48.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88b4ff9640 1 -- 172.21.15.76:0/4103886278 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88c40bcef0 con 0x558368a9ed20 2024-09-19T07:52:48.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88b4ff9640 1 -- 172.21.15.76:0/4103886278 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c40bc150 con 0x558368a9ed20 2024-09-19T07:52:48.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 -- 172.21.15.76:0/4103886278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 msgr2=0x558368ab4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368ab4270 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009900 tx=0x7f88c403bf10 comp rx=0 tx=0).stop 2024-09-19T07:52:48.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 -- 172.21.15.76:0/4103886278 shutdown_connections 2024-09-19T07:52:48.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368ab4270 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 --2- 172.21.15.76:0/4103886278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368a99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 -- 172.21.15.76:0/4103886278 >> 172.21.15.76:0/4103886278 conn(0x558368a66310 msgr2=0x558368a998e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.049+0000 7f88d75db740 1 -- 172.21.15.76:0/4103886278 shutdown_connections 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 -- 172.21.15.76:0/4103886278 wait complete. 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 -- start start 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 Processor -- start 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368ab07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368aa1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01ae270 con 0x558368a9ed20 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01af6e0 con 0x558368aa8550 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01ae940 con 0x558368a9d7b0 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88d75db740 10 client.0 _ll_register_callbacks cb 0x7f88c8009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368aa1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368aa1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43884/0 (socket says 172.21.15.76:43884) 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 -- 172.21.15.76:0/2829405082 learned_addr learned my addr 172.21.15.76:0/2829405082 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ced9d640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368ab07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 -- 172.21.15.76:0/2829405082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 msgr2=0x558368ab07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368ab07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 -- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 msgr2=0x558368aa2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.050+0000 7f88ce59c640 1 -- 172.21.15.76:0/2829405082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558368aa2640 con 0x558368a9ed20 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88ced9d640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368ab07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88ce59c640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368aa1bc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f88c4046040 tx=0x7f88c40a70c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c80a25bd07ced0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88b2ff5640 1 -- 172.21.15.76:0/2829405082 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4049070 con 0x558368a9ed20 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88b2ff5640 1 -- 172.21.15.76:0/2829405082 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f88c40f6250 con 0x558368a9ed20 2024-09-19T07:52:48.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c40bcef0 con 0x558368a9ed20 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88b2ff5640 1 -- 172.21.15.76:0/2829405082 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f88c40bc330 con 0x558368a9ed20 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 10 client.15666 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558368b226d0 con 0x558368a9ed20 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88b2ff5640 1 -- 172.21.15.76:0/2829405082 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88c40bcef0 con 0x558368a9ed20 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88b2ff5640 1 -- 172.21.15.76:0/2829405082 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f88c40edee0 con 0x558368a9ed20 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 10 client.15666 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 10 client.15666 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 20 client.15666 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368b22a60 0x558368b24e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 4 client.15666 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.051+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558368a0ad70 con 0x558368b22a60 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.052+0000 7f88ced9d640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368b22a60 0x558368b24e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.052+0000 7f88b2ff5640 10 client.15666 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:48.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.052+0000 7f88ced9d640 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368b22a60 0x558368b24e50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6aa2880ffed148f server_cookie=8d96d2ac1b69467f in_seq=0 out_seq=0 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.052+0000 7f88b2ff5640 1 -- 172.21.15.76:0/2829405082 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558368a0ad70 con 0x558368b22a60 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.052+0000 7f88b2ff5640 10 client.15666 handle_command_reply: tid=0 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.052+0000 7f88d75db740 1 client.15666 shutdown 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 msgr2=0x558368aa1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368aa1bc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f88c4046040 tx=0x7f88c40a70c0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 shutdown_connections 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x558368b22a60 0x558368b24e50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558368aa8550 0x558368aa2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558368a9ed20 0x558368aa1bc0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 --2- 172.21.15.76:0/2829405082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558368a9d7b0 0x558368ab07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88b2ff5640 0 client.15666 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 >> 172.21.15.76:0/2829405082 conn(0x558368a66310 msgr2=0x558368aa6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 shutdown_connections 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 1 -- 172.21.15.76:0/2829405082 wait complete. 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d75db740 20 client.15666 trim_cache size 0 max 16384 2024-09-19T07:52:48.059 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88b80a33b0 msgr2=0x7f88b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88b80a33b0 0x7f88b80a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88c800a400 tx=0x7f88c800d040 comp rx=0 tx=0).stop 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 msgr2=0x7f88d019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 0x7f88d019abd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009a50 tx=0x7f88c4004270 comp rx=0 tx=0).stop 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 shutdown_connections 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88b80a33b0 0x7f88b80a5870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88d01068d0 0x7f88d019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88d0101270 0x7f88d019abd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 --2- 172.21.15.76:0/803216632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01008d0 0x7f88d019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:48.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.053+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 >> 172.21.15.76:0/803216632 conn(0x7f88d00fc610 msgr2=0x7f88d010bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:48.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.054+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 shutdown_connections 2024-09-19T07:52:48.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:48.054+0000 7f88d4a01640 1 -- 172.21.15.76:0/803216632 wait complete. 2024-09-19T07:52:48.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:48 smithi076 ceph-mon[30930]: pgmap v52: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 178 KiB/s wr, 6 op/s 2024-09-19T07:52:48.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:48 smithi152 ceph-mon[35117]: pgmap v52: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 178 KiB/s wr, 6 op/s 2024-09-19T07:52:48.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:48 smithi137 ceph-mon[35309]: pgmap v52: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 178 KiB/s wr, 6 op/s 2024-09-19T07:52:48.745 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:52:48.993 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 -- 172.21.15.76:0/747500375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 msgr2=0x7f2254103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 --2- 172.21.15.76:0/747500375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254103190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2244009900 tx=0x7f224402a480 comp rx=0 tx=0).stop 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 -- 172.21.15.76:0/747500375 shutdown_connections 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 --2- 172.21.15.76:0/747500375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f225410c190 0x7f225410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 --2- 172.21.15.76:0/747500375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22541036d0 0x7f225410bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 --2- 172.21.15.76:0/747500375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254103190 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 -- 172.21.15.76:0/747500375 >> 172.21.15.76:0/747500375 conn(0x7f22540fc7d0 msgr2=0x7f22540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.462+0000 7f225a616640 1 -- 172.21.15.76:0/747500375 shutdown_connections 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 -- 172.21.15.76:0/747500375 wait complete. 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 Processor -- start 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 -- start start 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22541036d0 0x7f2254198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f225410c190 0x7f225419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f22541120f0 con 0x7f2254102db0 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2254111f70 con 0x7f22541036d0 2024-09-19T07:52:49.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f225a616640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2254112270 con 0x7f225410c190 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f2253fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f2253fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43910/0 (socket says 172.21.15.76:43910) 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.463+0000 7f2253fff640 1 -- 172.21.15.76:0/389924014 learned_addr learned my addr 172.21.15.76:0/389924014 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2258bb3640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f225410c190 0x7f225419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2253fff640 1 -- 172.21.15.76:0/389924014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f225410c190 msgr2=0x7f225419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2253fff640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f225410c190 0x7f225419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f224bfff640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22541036d0 0x7f2254198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2253fff640 1 -- 172.21.15.76:0/389924014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22541036d0 msgr2=0x7f2254198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2253fff640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22541036d0 0x7f2254198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2253fff640 1 -- 172.21.15.76:0/389924014 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225419d500 con 0x7f2254102db0 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2258bb3640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f225410c190 0x7f225419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f224bfff640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22541036d0 0x7f2254198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2253fff640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254198550 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2244006010 tx=0x7f22440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2251ffb640 1 -- 172.21.15.76:0/389924014 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224403f030 con 0x7f2254102db0 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2251ffb640 1 -- 172.21.15.76:0/389924014 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2244003d00 con 0x7f2254102db0 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225419d790 con 0x7f2254102db0 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f2251ffb640 1 -- 172.21.15.76:0/389924014 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244035070 con 0x7f2254102db0 2024-09-19T07:52:49.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.464+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541a50d0 con 0x7f2254102db0 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.466+0000 7f2251ffb640 1 -- 172.21.15.76:0/389924014 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2244042030 con 0x7f2254102db0 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 Processor -- start 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 -- start start 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcc2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dccf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b2dc282f0 con 0x561b2dcc25d0 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b2dbcfcf0 con 0x561b2dccd370 2024-09-19T07:52:49.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f225c9ef740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561b2dc242b0 con 0x561b2dcc3b40 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2251ffb640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f22400a77c0 0x7f22400a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2253fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2258bb3640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f22400a77c0 0x7f22400a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2253fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcc2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43920/0 (socket says 172.21.15.76:43920) 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2253fff640 1 -- 172.21.15.76:0/2995251766 learned_addr learned my addr 172.21.15.76:0/2995251766 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2258bb3640 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcc2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f2251ffb640 1 -- 172.21.15.76:0/389924014 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f22440f0750 con 0x7f2254102db0 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.467+0000 7f224bfff640 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dccf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2253fff640 1 -- 172.21.15.76:0/2995251766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 msgr2=0x561b2dcc2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2253fff640 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcc2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2253fff640 1 -- 172.21.15.76:0/2995251766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 msgr2=0x561b2dccf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2253fff640 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dccf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2253fff640 1 -- 172.21.15.76:0/2995251766 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2dbb43a0 con 0x561b2dcc25d0 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f224bfff640 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dccf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2253fff640 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcc2a10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f22440bc960 tx=0x7f224403b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6375e7ed95c5416b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f2258bb3640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f22400a77c0 0x7f22400a9c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f224c005fd0 tx=0x7f224c00a420 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f224a7fc640 1 -- 172.21.15.76:0/2995251766 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244049040 con 0x561b2dcc25d0 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f224a7fc640 1 -- 172.21.15.76:0/2995251766 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f224403be30 con 0x561b2dcc25d0 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.468+0000 7f224a7fc640 1 -- 172.21.15.76:0/2995251766 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440b9040 con 0x561b2dcc25d0 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 -- 172.21.15.76:0/2995251766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 msgr2=0x561b2dcc2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcc2a10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f22440bc960 tx=0x7f224403b460 comp rx=0 tx=0).stop 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 -- 172.21.15.76:0/2995251766 shutdown_connections 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dccf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcc2a10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2995251766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcc2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 -- 172.21.15.76:0/2995251766 >> 172.21.15.76:0/2995251766 conn(0x561b2dc8b310 msgr2=0x561b2dcbec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 -- 172.21.15.76:0/2995251766 shutdown_connections 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 -- 172.21.15.76:0/2995251766 wait complete. 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 -- start start 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.469+0000 7f225c9ef740 1 Processor -- start 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dcca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b2dc282f0 con 0x561b2dcc25d0 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b2dbe3060 con 0x561b2dccd370 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561b2dccfe30 con 0x561b2dcc3b40 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 10 client.0 _ll_register_callbacks cb 0x561b2d9368c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43926/0 (socket says 172.21.15.76:43926) 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 -- 172.21.15.76:0/2941177372 learned_addr learned my addr 172.21.15.76:0/2941177372 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2258bb3640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dcca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f224bfff640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 -- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 msgr2=0x561b2dcca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 -- 172.21.15.76:0/2941177372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 msgr2=0x561b2dcca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dcca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 -- 172.21.15.76:0/2941177372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2d9993c0 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f2253fff640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcccd80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f22440edef0 tx=0x7f22440eddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a106b1bef8e68eed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f22337fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f22337fe640 1 -- 172.21.15.76:0/2941177372 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244049070 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f22337fe640 1 -- 172.21.15.76:0/2941177372 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f224403b4f0 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.470+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f224403be30 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f22337fe640 1 -- 172.21.15.76:0/2941177372 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f22440bd0d0 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 10 client.15678 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b2dcdb780 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f22337fe640 1 -- 172.21.15.76:0/2941177372 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f224403be30 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f22337fe640 1 -- 172.21.15.76:0/2941177372 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f22440c51b0 con 0x561b2dcc25d0 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 10 client.15678 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:49.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 20 client.15678 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dcdcad0 0x561b2dcdeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 4 client.15678 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b2dc35860 con 0x561b2dcdcad0 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.471+0000 7f224bfff640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dcdcad0 0x561b2dcdeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.472+0000 7f224bfff640 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dcdcad0 0x561b2dcdeec0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853c7b9276ba040f server_cookie=ac43c6e4fa616b16 in_seq=0 out_seq=0 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.472+0000 7f22337fe640 10 client.15678 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.472+0000 7f22337fe640 1 -- 172.21.15.76:0/2941177372 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b2dc35860 con 0x561b2dcdcad0 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.472+0000 7f22337fe640 10 client.15678 handle_command_reply: tid=0 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.472+0000 7f225c9ef740 1 client.15678 shutdown 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 msgr2=0x561b2dcccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcccd80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f22440edef0 tx=0x7f22440eddb0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 shutdown_connections 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dccd370 0x561b2dcca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dcdcad0 0x561b2dcdeec0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 --2- 172.21.15.76:0/2941177372 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dcc25d0 0x561b2dcccd80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 >> 172.21.15.76:0/2941177372 conn(0x561b2dc8b310 msgr2=0x561b2dcc4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f22337fe640 0 client.15678 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 shutdown_connections 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 1 -- 172.21.15.76:0/2941177372 wait complete. 2024-09-19T07:52:49.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.473+0000 7f225c9ef740 20 client.15678 trim_cache size 0 max 16384 2024-09-19T07:52:49.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.485+0000 7f225c9ef740 1 Processor -- start 2024-09-19T07:52:49.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.485+0000 7f225c9ef740 1 -- start start 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc25d0 0x561b2dcca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc3b40 0x561b2dcd8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcc5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f225c9ef740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f22541ae170 con 0x561b2dccd370 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f225c9ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22541aba40 con 0x561b2dcc3b40 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f225c9ef740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a9890 con 0x561b2dcc25d0 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcc5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcc5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43934/0 (socket says 172.21.15.76:43934) 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 -- 172.21.15.76:0/529887035 learned_addr learned my addr 172.21.15.76:0/529887035 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2253fff640 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc25d0 0x561b2dcca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f224bfff640 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc3b40 0x561b2dcd8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 -- 172.21.15.76:0/529887035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc25d0 msgr2=0x561b2dcca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc25d0 0x561b2dcca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 -- 172.21.15.76:0/529887035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc3b40 msgr2=0x561b2dcd8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc3b40 0x561b2dcd8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 -- 172.21.15.76:0/529887035 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2dcc8580 con 0x561b2dccd370 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2258bb3640 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcc5120 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f224c00db00 tx=0x7f224c005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5114e949a36d6583 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.486+0000 7f2249ffb640 1 -- 172.21.15.76:0/529887035 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c01fbe0 con 0x561b2dccd370 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f2249ffb640 1 -- 172.21.15.76:0/529887035 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f224c01fd80 con 0x561b2dccd370 2024-09-19T07:52:49.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f2249ffb640 1 -- 172.21.15.76:0/529887035 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c010930 con 0x561b2dccd370 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 -- 172.21.15.76:0/529887035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 msgr2=0x561b2dcc5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcc5120 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f224c00db00 tx=0x7f224c005f40 comp rx=0 tx=0).stop 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 -- 172.21.15.76:0/529887035 shutdown_connections 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcc5120 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc3b40 0x561b2dcd8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 --2- 172.21.15.76:0/529887035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc25d0 0x561b2dcca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 -- 172.21.15.76:0/529887035 >> 172.21.15.76:0/529887035 conn(0x561b2dc8b310 msgr2=0x561b2dcc98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 -- 172.21.15.76:0/529887035 shutdown_connections 2024-09-19T07:52:49.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 -- 172.21.15.76:0/529887035 wait complete. 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.487+0000 7f225c9ef740 1 -- start start 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 Processor -- start 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc25d0 0x561b2dcd55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcd08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcd0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a9f00 con 0x561b2dccd370 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22541ab370 con 0x561b2dcc25d0 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22541aa5d0 con 0x561b2dcc3b40 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f225c9ef740 10 client.0 _ll_register_callbacks cb 0x7f22440bc3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcd0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcd0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43948/0 (socket says 172.21.15.76:43948) 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 -- 172.21.15.76:0/64680583 learned_addr learned my addr 172.21.15.76:0/64680583 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2253fff640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc25d0 0x561b2dcd55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f224bfff640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcd08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 -- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 msgr2=0x561b2dcd08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcd08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 -- 172.21.15.76:0/64680583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc25d0 msgr2=0x561b2dcd55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc25d0 0x561b2dcd55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2258bb3640 1 -- 172.21.15.76:0/64680583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2dcd13e0 con 0x561b2dccd370 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.488+0000 7f2253fff640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc25d0 0x561b2dcd55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f2258bb3640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcd0e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f224c010410 tx=0x7f224c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328678946a938f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f22337fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f22337fe640 1 -- 172.21.15.76:0/64680583 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037020 con 0x561b2dccd370 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f224c01fd80 con 0x561b2dccd370 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f22337fe640 1 -- 172.21.15.76:0/64680583 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f224c0106b0 con 0x561b2dccd370 2024-09-19T07:52:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f22337fe640 1 -- 172.21.15.76:0/64680583 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f224c042050 con 0x561b2dccd370 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 10 client.15684 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561b2dd473b0 con 0x561b2dccd370 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f22337fe640 1 -- 172.21.15.76:0/64680583 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f224c01fd80 con 0x561b2dccd370 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f22337fe640 1 -- 172.21.15.76:0/64680583 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f224c01b040 con 0x561b2dccd370 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 10 client.15684 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 20 client.15684 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dd47a80 0x561b2dd49e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 4 client.15684 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.489+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b2dc2fd70 con 0x561b2dd47a80 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f2253fff640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dd47a80 0x561b2dd49e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f22337fe640 10 client.15684 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:49.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f2253fff640 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dd47a80 0x561b2dd49e70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9d0f22da2575daf server_cookie=fffb7be0af19cac0 in_seq=0 out_seq=0 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f22337fe640 1 -- 172.21.15.76:0/64680583 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b2dc2fd70 con 0x561b2dd47a80 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f22337fe640 10 client.15684 handle_command_reply: tid=0 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 client.15684 shutdown 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 msgr2=0x561b2dcd0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcd0e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f224c010410 tx=0x7f224c004ab0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 shutdown_connections 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561b2dd47a80 0x561b2dd49e70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b2dccd370 0x561b2dcd0e20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b2dcc3b40 0x561b2dcd08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 --2- 172.21.15.76:0/64680583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b2dcc25d0 0x561b2dcd55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f22337fe640 0 client.15684 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.490+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 >> 172.21.15.76:0/64680583 conn(0x561b2dc8b310 msgr2=0x561b2dcbd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 shutdown_connections 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225c9ef740 1 -- 172.21.15.76:0/64680583 wait complete. 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225c9ef740 20 client.15684 trim_cache size 0 max 16384 2024-09-19T07:52:49.498 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f22400a77c0 msgr2=0x7f22400a9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f22400a77c0 0x7f22400a9c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f224c005fd0 tx=0x7f224c00a420 comp rx=0 tx=0).stop 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 msgr2=0x7f2254198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254198550 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2244006010 tx=0x7f22440042f0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 shutdown_connections 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f22400a77c0 0x7f22400a9c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f225410c190 0x7f225419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22541036d0 0x7f2254198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 --2- 172.21.15.76:0/389924014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2254102db0 0x7f2254198550 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:49.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 >> 172.21.15.76:0/389924014 conn(0x7f22540fc7d0 msgr2=0x7f22540fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:49.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 shutdown_connections 2024-09-19T07:52:49.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:49.491+0000 7f225a616640 1 -- 172.21.15.76:0/389924014 wait complete. 2024-09-19T07:52:50.171 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:50 smithi076 ceph-mon[30930]: pgmap v53: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 178 KiB/s wr, 9 op/s 2024-09-19T07:52:50.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:50 smithi152 ceph-mon[35117]: pgmap v53: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 178 KiB/s wr, 9 op/s 2024-09-19T07:52:50.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:50 smithi137 ceph-mon[35309]: pgmap v53: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 178 KiB/s wr, 9 op/s 2024-09-19T07:52:51.202 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:52:51.202 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:52:51.465 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:51.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 -- 172.21.15.76:0/519440678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924106f10 msgr2=0x7f792410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 --2- 172.21.15.76:0/519440678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924106f10 0x7f792410ea90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f791c009ca0 tx=0x7f791c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 -- 172.21.15.76:0/519440678 shutdown_connections 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 --2- 172.21.15.76:0/519440678 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924106f10 0x7f792410ea90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 --2- 172.21.15.76:0/519440678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924102790 0x7f79241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 --2- 172.21.15.76:0/519440678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924101de0 0x7f79241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 -- 172.21.15.76:0/519440678 >> 172.21.15.76:0/519440678 conn(0x7f79240fd8c0 msgr2=0x7f79240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 -- 172.21.15.76:0/519440678 shutdown_connections 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.909+0000 7f7929120640 1 -- 172.21.15.76:0/519440678 wait complete. 2024-09-19T07:52:51.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 Processor -- start 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 -- start start 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 0x7f7924198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924102790 0x7f7924198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924106f10 0x7f792419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7924112090 con 0x7f7924101de0 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7924111f10 con 0x7f7924106f10 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7929120640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7924112210 con 0x7f7924102790 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 0x7f7924198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 0x7f7924198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43968/0 (socket says 172.21.15.76:43968) 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 -- 172.21.15.76:0/1228702651 learned_addr learned my addr 172.21.15.76:0/1228702651 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f792259c640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924102790 0x7f7924198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f792359e640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924106f10 0x7f792419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 -- 172.21.15.76:0/1228702651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924102790 msgr2=0x7f7924198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924102790 0x7f7924198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 -- 172.21.15.76:0/1228702651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924106f10 msgr2=0x7f792419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.910+0000 7f7922d9d640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924106f10 0x7f792419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f7922d9d640 1 -- 172.21.15.76:0/1228702651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792419d3b0 con 0x7f7924101de0 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f792359e640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924106f10 0x7f792419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f7922d9d640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 0x7f7924198400 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f791400d950 tx=0x7f791400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f791bfff640 1 -- 172.21.15.76:0/1228702651 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914017070 con 0x7f7924101de0 2024-09-19T07:52:51.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792419d6a0 con 0x7f7924101de0 2024-09-19T07:52:51.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f791bfff640 1 -- 172.21.15.76:0/1228702651 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f791400de80 con 0x7f7924101de0 2024-09-19T07:52:51.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f791bfff640 1 -- 172.21.15.76:0/1228702651 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400f620 con 0x7f7924101de0 2024-09-19T07:52:51.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.911+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79241a4f80 con 0x7f7924101de0 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.914+0000 7f791bfff640 1 -- 172.21.15.76:0/1228702651 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7914009c30 con 0x7f7924101de0 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.914+0000 7f792b4f9740 1 Processor -- start 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.914+0000 7f792b4f9740 1 -- start start 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.914+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbc0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.914+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.914+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbcbd40 0x562b3bbce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792b4f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b3bb26280 con 0x562b3bbc1480 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792b4f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562b3bacdb10 con 0x562b3bbcbd40 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792b4f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562b3bb22240 con 0x562b3bbc0b60 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbc0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43972/0 (socket says 172.21.15.76:43972) 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbc0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:56514/0 (socket says 172.21.15.76:56514) 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 -- 172.21.15.76:0/462789568 learned_addr learned my addr 172.21.15.76:0/462789568 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792259c640 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbcbd40 0x562b3bbce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f791bfff640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79100a3430 0x7f79100a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 -- 172.21.15.76:0/462789568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 msgr2=0x562b3bbc0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbc0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 -- 172.21.15.76:0/462789568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbcbd40 msgr2=0x562b3bbce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbcbd40 0x562b3bbce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 -- 172.21.15.76:0/462789568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3bada1f0 con 0x562b3bbc1480 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792359e640 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbc0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f792359e640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79100a3430 0x7f79100a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f791bfff640 1 -- 172.21.15.76:0/1228702651 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f79140cfa40 con 0x7f7924101de0 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.915+0000 7f7922d9d640 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcb800 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f79140cd0a0 tx=0x7f791405bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea5f796a9acec46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f79197fa640 1 -- 172.21.15.76:0/462789568 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791409b800 con 0x562b3bbc1480 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f792359e640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79100a3430 0x7f79100a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f791c009a60 tx=0x7f791c0095c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f79197fa640 1 -- 172.21.15.76:0/462789568 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f791409c3c0 con 0x562b3bbc1480 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f79197fa640 1 -- 172.21.15.76:0/462789568 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791407a640 con 0x562b3bbc1480 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f792b4f9740 1 -- 172.21.15.76:0/462789568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 msgr2=0x562b3bbcb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f792b4f9740 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcb800 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f79140cd0a0 tx=0x7f791405bb20 comp rx=0 tx=0).stop 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.916+0000 7f792b4f9740 1 -- 172.21.15.76:0/462789568 shutdown_connections 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbcbd40 0x562b3bbce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcb800 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 --2- 172.21.15.76:0/462789568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbc0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- 172.21.15.76:0/462789568 >> 172.21.15.76:0/462789568 conn(0x562b3bbbd0f0 msgr2=0x562b3bbbd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- 172.21.15.76:0/462789568 shutdown_connections 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- 172.21.15.76:0/462789568 wait complete. 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- start start 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 Processor -- start 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 0x562b3bbc8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbc90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbc9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562b3bbce910 con 0x562b3bbc0b60 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562b3bae0f10 con 0x562b3bbc1480 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562b3bbcea90 con 0x562b3bbcbd40 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f792b4f9740 10 client.0 _ll_register_callbacks cb 0x562b3baa9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:51.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f7922d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 0x562b3bbc8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f7922d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 0x562b3bbc8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43980/0 (socket says 172.21.15.76:43980) 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.917+0000 7f7922d9d640 1 -- 172.21.15.76:0/3694868340 learned_addr learned my addr 172.21.15.76:0/3694868340 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f792359e640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbc9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f792259c640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbc90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f7922d9d640 1 -- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 msgr2=0x562b3bbc9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f7922d9d640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbc9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f7922d9d640 1 -- 172.21.15.76:0/3694868340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 msgr2=0x562b3bbc90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f7922d9d640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbc90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f7922d9d640 1 -- 172.21.15.76:0/3694868340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3b8976a0 con 0x562b3bbc0b60 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f792259c640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbc90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f7922d9d640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 0x562b3bbc8bb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79140cd1e0 tx=0x7f79140a49a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934cd07de2e7210f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f790a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f790a7fc640 1 -- 172.21.15.76:0/3694868340 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914020070 con 0x562b3bbc0b60 2024-09-19T07:52:51.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f790a7fc640 1 -- 172.21.15.76:0/3694868340 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f79140d3220 con 0x562b3bbc0b60 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f791409c3c0 con 0x562b3bbc0b60 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f790a7fc640 1 -- 172.21.15.76:0/3694868340 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f791409b620 con 0x562b3bbc0b60 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f792b4f9740 10 client.15696 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b3bbda4a0 con 0x562b3bbc0b60 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f790a7fc640 1 -- 172.21.15.76:0/3694868340 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f791409c3c0 con 0x562b3bbc0b60 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.918+0000 7f790a7fc640 1 -- 172.21.15.76:0/3694868340 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f79140cd3b0 con 0x562b3bbc0b60 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792b4f9740 10 client.15696 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792b4f9740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792b4f9740 20 client.15696 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bbdb620 0x562b3bbdda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792b4f9740 4 client.15696 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:51.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b3bb337f0 con 0x562b3bbdb620 2024-09-19T07:52:51.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792259c640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bbdb620 0x562b3bbdda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f790a7fc640 10 client.15696 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:51.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.919+0000 7f792259c640 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bbdb620 0x562b3bbdda10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f38437550c90224 server_cookie=769c54844871fdb6 in_seq=0 out_seq=0 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f790a7fc640 1 -- 172.21.15.76:0/3694868340 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b3bb337f0 con 0x562b3bbdb620 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f790a7fc640 10 client.15696 handle_command_reply: tid=0 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 client.15696 shutdown 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 msgr2=0x562b3bbc8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 0x562b3bbc8bb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f79140cd1e0 tx=0x7f79140a49a0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 shutdown_connections 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbc9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbc90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bbdb620 0x562b3bbdda10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3694868340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc0b60 0x562b3bbc8bb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f790a7fc640 0 client.15696 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:51.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 >> 172.21.15.76:0/3694868340 conn(0x562b3bbbd0f0 msgr2=0x562b3bbbc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:51.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.920+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 shutdown_connections 2024-09-19T07:52:51.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.921+0000 7f792b4f9740 1 -- 172.21.15.76:0/3694868340 wait complete. 2024-09-19T07:52:51.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.921+0000 7f792b4f9740 20 client.15696 trim_cache size 0 max 16384 2024-09-19T07:52:51.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.937+0000 7f792b4f9740 1 Processor -- start 2024-09-19T07:52:51.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.937+0000 7f792b4f9740 1 -- start start 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbcaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbe3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 0x562b3bbe3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792b4f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b0360 con 0x562b3bbcbd40 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792b4f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79241adc30 con 0x562b3bbc1480 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792b4f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79241aba80 con 0x562b3bbc0b60 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 0x562b3bbe3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 0x562b3bbe3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43994/0 (socket says 172.21.15.76:43994) 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 -- 172.21.15.76:0/482518801 learned_addr learned my addr 172.21.15.76:0/482518801 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792259c640 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbe3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 -- 172.21.15.76:0/482518801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 msgr2=0x562b3bbcaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbcaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 -- 172.21.15.76:0/482518801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 msgr2=0x562b3bbe3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbe3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 -- 172.21.15.76:0/482518801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3bbb7680 con 0x562b3bbcbd40 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792259c640 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbe3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f792359e640 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 0x562b3bbe3580 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f791c0039c0 tx=0x7f791c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf347d21a1376326 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.938+0000 7f7918ff9640 1 -- 172.21.15.76:0/482518801 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c031510 con 0x562b3bbcbd40 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f7918ff9640 1 -- 172.21.15.76:0/482518801 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f791c036040 con 0x562b3bbcbd40 2024-09-19T07:52:51.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f7918ff9640 1 -- 172.21.15.76:0/482518801 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c02f870 con 0x562b3bbcbd40 2024-09-19T07:52:51.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 -- 172.21.15.76:0/482518801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 msgr2=0x562b3bbe3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 0x562b3bbe3580 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f791c0039c0 tx=0x7f791c042000 comp rx=0 tx=0).stop 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 -- 172.21.15.76:0/482518801 shutdown_connections 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbcbd40 0x562b3bbe3580 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc1480 0x562b3bbe3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 --2- 172.21.15.76:0/482518801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbc0b60 0x562b3bbcaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 -- 172.21.15.76:0/482518801 >> 172.21.15.76:0/482518801 conn(0x562b3bbbd0f0 msgr2=0x562b3bbca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 -- 172.21.15.76:0/482518801 shutdown_connections 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.939+0000 7f792b4f9740 1 -- 172.21.15.76:0/482518801 wait complete. 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 -- start start 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 Processor -- start 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc0b60 0x562b3bbd45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbd0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f79241ac0f0 con 0x562b3bbc1480 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79241ad560 con 0x562b3bbc0b60 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79241ac7c0 con 0x562b3bbcbd40 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792b4f9740 10 client.0 _ll_register_callbacks cb 0x7f79140d1f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43998/0 (socket says 172.21.15.76:43998) 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 -- 172.21.15.76:0/3829194373 learned_addr learned my addr 172.21.15.76:0/3829194373 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f7922d9d640 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc0b60 0x562b3bbd45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 -- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 msgr2=0x562b3bbd0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbd0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 -- 172.21.15.76:0/3829194373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc0b60 msgr2=0x562b3bbd45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:51.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc0b60 0x562b3bbd45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.940+0000 7f792259c640 1 -- 172.21.15.76:0/3829194373 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3bc45010 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792259c640 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcf8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f790c005e10 tx=0x7f790c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91012aed03500fca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f790a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f790a7fc640 1 -- 172.21.15.76:0/3829194373 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c022070 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f790a7fc640 1 -- 172.21.15.76:0/3829194373 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f790c01d8f0 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f791c036040 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f790a7fc640 1 -- 172.21.15.76:0/3829194373 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f790c02b050 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 10 client.15702 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b3bc461f0 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f790a7fc640 1 -- 172.21.15.76:0/3829194373 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f791c036040 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f790a7fc640 1 -- 172.21.15.76:0/3829194373 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f790c025020 con 0x562b3bbc1480 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 10 client.15702 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:51.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 20 client.15702 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bc46970 0x562b3bc48d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 4 client.15702 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562b3bb2dd00 con 0x562b3bc46970 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.941+0000 7f7922d9d640 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bc46970 0x562b3bc48d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.942+0000 7f7922d9d640 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bc46970 0x562b3bc48d90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4133ae204b0f129 server_cookie=44d78c583320e6a6 in_seq=0 out_seq=0 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.942+0000 7f790a7fc640 10 client.15702 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f790a7fc640 1 -- 172.21.15.76:0/3829194373 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562b3bb2dd00 con 0x562b3bc46970 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f790a7fc640 10 client.15702 handle_command_reply: tid=0 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 client.15702 shutdown 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 msgr2=0x562b3bbcf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcf8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f790c005e10 tx=0x7f790c011b00 comp rx=0 tx=0).stop 2024-09-19T07:52:51.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 shutdown_connections 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b3bbcbd40 0x562b3bbd0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562b3bc46970 0x562b3bc48d90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562b3bbc1480 0x562b3bbcf8f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 --2- 172.21.15.76:0/3829194373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562b3bbc0b60 0x562b3bbd45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f790a7fc640 0 client.15702 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 >> 172.21.15.76:0/3829194373 conn(0x562b3bbbd0f0 msgr2=0x562b3bbbc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 shutdown_connections 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 1 -- 172.21.15.76:0/3829194373 wait complete. 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.943+0000 7f792b4f9740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T07:52:51.948 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:51.949 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:52:51.949 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "29960d49-ddaa-40b5-95e6-f7bfef6bf2c0", 2024-09-19T07:52:51.949 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:52:51.949 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79100a3430 msgr2=0x7f79100a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79100a3430 0x7f79100a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f791c009a60 tx=0x7f791c0095c0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 msgr2=0x7f7924198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 0x7f7924198400 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f791400d950 tx=0x7f791400dd50 comp rx=0 tx=0).stop 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 shutdown_connections 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f79100a3430 0x7f79100a58f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7924106f10 0x7f792419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7924102790 0x7f7924198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 --2- 172.21.15.76:0/1228702651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7924101de0 0x7f7924198400 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 >> 172.21.15.76:0/1228702651 conn(0x7f79240fd8c0 msgr2=0x7f79240febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 shutdown_connections 2024-09-19T07:52:51.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:51.944+0000 7f7929120640 1 -- 172.21.15.76:0/1228702651 wait complete. 2024-09-19T07:52:52.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:52 smithi076 ceph-mon[30930]: pgmap v54: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 176 KiB/s wr, 6 op/s 2024-09-19T07:52:52.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:52 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:52:52.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:52 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:52.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:52 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:52:52.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:52 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:52.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:52 smithi152 ceph-mon[35117]: pgmap v54: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 176 KiB/s wr, 6 op/s 2024-09-19T07:52:52.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:52 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:52:52.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:52 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:52.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:52 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:52:52.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:52 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:52 smithi137 ceph-mon[35309]: pgmap v54: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 176 KiB/s wr, 6 op/s 2024-09-19T07:52:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:52 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:52:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:52 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:52 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:52:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:52 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:52:52.676 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:52:52.844 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:52:52.929 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:53.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 -- 172.21.15.76:0/1135958656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8101420 msgr2=0x7f23e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 --2- 172.21.15.76:0/1135958656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8101420 0x7f23e810d950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009cd0 tx=0x7f23e002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 -- 172.21.15.76:0/1135958656 shutdown_connections 2024-09-19T07:52:53.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 --2- 172.21.15.76:0/1135958656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8101420 0x7f23e810d950 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 --2- 172.21.15.76:0/1135958656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23e8100a80 0x7f23e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 --2- 172.21.15.76:0/1135958656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 0x7f23e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 -- 172.21.15.76:0/1135958656 >> 172.21.15.76:0/1135958656 conn(0x7f23e80fc7a0 msgr2=0x7f23e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 -- 172.21.15.76:0/1135958656 shutdown_connections 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.426+0000 7f23ee83b640 1 -- 172.21.15.76:0/1135958656 wait complete. 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 Processor -- start 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 -- start start 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 0x7f23e80fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23e8101420 0x7f23e80fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 0x7f23e80fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8110fa0 con 0x7f23e8100a80 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8110e20 con 0x7f23e8106a80 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.427+0000 7f23ee83b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8111120 con 0x7f23e8101420 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 0x7f23e80fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 0x7f23e80fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44872/0 (socket says 172.21.15.76:44872) 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 -- 172.21.15.76:0/4151165534 learned_addr learned my addr 172.21.15.76:0/4151165534 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e77fe640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23e8101420 0x7f23e80fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 0x7f23e80fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 -- 172.21.15.76:0/4151165534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23e8101420 msgr2=0x7f23e80fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23e8101420 0x7f23e80fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 -- 172.21.15.76:0/4151165534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 msgr2=0x7f23e80fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 0x7f23e80fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 -- 172.21.15.76:0/4151165534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e81a6910 con 0x7f23e8100a80 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 0x7f23e80fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e7fff640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 0x7f23e80fccf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c920 tx=0x7f23d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e57fa640 1 -- 172.21.15.76:0/4151165534 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8007c70 con 0x7f23e8100a80 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e57fa640 1 -- 172.21.15.76:0/4151165534 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23d8007e10 con 0x7f23e8100a80 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e81a6c00 con 0x7f23e8100a80 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23e57fa640 1 -- 172.21.15.76:0/4151165534 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8018940 con 0x7f23e8100a80 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.428+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e81a7140 con 0x7f23e8100a80 2024-09-19T07:52:53.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.430+0000 7f23e57fa640 1 -- 172.21.15.76:0/4151165534 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f23d8018b20 con 0x7f23e8100a80 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 Processor -- start 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 -- start start 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e57fa640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f23d00a33b0 0x7f23d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 0x55b416f0f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f1a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f1a680 0x55b416f1ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b416e752e0 con 0x55b416f0f4a0 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b416e1cce0 con 0x55b416f0fdc0 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23f0c14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b416e712a0 con 0x55b416f1a680 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 0x55b416f0f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f23d00a33b0 0x7f23d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 0x55b416f0f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44874/0 (socket says 172.21.15.76:44874) 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e7fff640 1 -- 172.21.15.76:0/2893147930 learned_addr learned my addr 172.21.15.76:0/2893147930 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e57fa640 1 -- 172.21.15.76:0/4151165534 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f23d80cfe50 con 0x7f23e8100a80 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e77fe640 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f1a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f1a680 0x55b416f1ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e7fff640 1 -- 172.21.15.76:0/2893147930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f1a680 msgr2=0x55b416f1ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e7fff640 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f1a680 0x55b416f1ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.431+0000 7f23e7fff640 1 -- 172.21.15.76:0/2893147930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 msgr2=0x55b416f1a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23e7fff640 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f1a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23e7fff640 1 -- 172.21.15.76:0/2893147930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b416e01440 con 0x55b416f0f4a0 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f23d00a33b0 0x7f23d00a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23e0031040 tx=0x7f23e00317c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:53.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23e7fff640 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 0x55b416f0f880 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f23d809bdd0 tx=0x7f23d8013b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96eb0e39683bef78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:53.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23ce7fc640 1 -- 172.21.15.76:0/2893147930 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d80b54b0 con 0x55b416f0f4a0 2024-09-19T07:52:53.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23ce7fc640 1 -- 172.21.15.76:0/2893147930 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23d809c7d0 con 0x55b416f0f4a0 2024-09-19T07:52:53.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.432+0000 7f23ce7fc640 1 -- 172.21.15.76:0/2893147930 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d80b52d0 con 0x55b416f0f4a0 2024-09-19T07:52:53.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 -- 172.21.15.76:0/2893147930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 msgr2=0x55b416f0f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 0x55b416f0f880 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f23d809bdd0 tx=0x7f23d8013b80 comp rx=0 tx=0).stop 2024-09-19T07:52:53.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 -- 172.21.15.76:0/2893147930 shutdown_connections 2024-09-19T07:52:53.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f1a680 0x55b416f1ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f1a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2893147930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0f4a0 0x55b416f0f880 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 -- 172.21.15.76:0/2893147930 >> 172.21.15.76:0/2893147930 conn(0x55b416f0ba30 msgr2=0x55b416f0be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:53.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 -- 172.21.15.76:0/2893147930 shutdown_connections 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 -- 172.21.15.76:0/2893147930 wait complete. 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 -- start start 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.433+0000 7f23f0c14740 1 Processor -- start 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f19ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f17170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 0x55b416f176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b416f1d250 con 0x55b416f1a680 2024-09-19T07:52:53.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b416e30050 con 0x55b416f0fdc0 2024-09-19T07:52:53.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b416f1d3d0 con 0x55b416f0f4a0 2024-09-19T07:52:53.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 10 client.0 _ll_register_callbacks cb 0x55b416e70160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:53.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 0x55b416f176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 0x55b416f176b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44878/0 (socket says 172.21.15.76:44878) 2024-09-19T07:52:53.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 -- 172.21.15.76:0/3504896499 learned_addr learned my addr 172.21.15.76:0/3504896499 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23e77fe640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f17170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23e7fff640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f19ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 -- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 msgr2=0x55b416f19ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f19ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 -- 172.21.15.76:0/3504896499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 msgr2=0x55b416f17170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f17170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 -- 172.21.15.76:0/3504896499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b416be63c0 con 0x55b416f1a680 2024-09-19T07:52:53.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 0x55b416f176b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23e0035000 tx=0x7f23e002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454f62ad28725ab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:53.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:53.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23c77fe640 1 -- 172.21.15.76:0/3504896499 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e004e070 con 0x55b416f1a680 2024-09-19T07:52:53.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23c77fe640 1 -- 172.21.15.76:0/3504896499 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f23e0004740 con 0x55b416f1a680 2024-09-19T07:52:53.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.434+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d809c7d0 con 0x55b416f1a680 2024-09-19T07:52:53.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23c77fe640 1 -- 172.21.15.76:0/3504896499 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23e005a050 con 0x55b416f1a680 2024-09-19T07:52:53.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 10 client.15714 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:53.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b416f28b10 con 0x55b416f1a680 2024-09-19T07:52:53.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23c77fe640 1 -- 172.21.15.76:0/3504896499 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23d809c7d0 con 0x55b416f1a680 2024-09-19T07:52:53.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23c77fe640 1 -- 172.21.15.76:0/3504896499 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f23e0030070 con 0x55b416f1a680 2024-09-19T07:52:53.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 10 client.15714 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:53.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:53.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 20 client.15714 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:53.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f29f90 0x55b416f2c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 4 client.15714 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:53.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b416e82850 con 0x55b416f29f90 2024-09-19T07:52:53.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.435+0000 7f23e7fff640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f29f90 0x55b416f2c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.436+0000 7f23c77fe640 10 client.15714 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:53.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.436+0000 7f23e7fff640 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f29f90 0x55b416f2c3f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a73e838f558b573 server_cookie=b55ce2a974d908b8 in_seq=0 out_seq=0 2024-09-19T07:52:53.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.436+0000 7f23c77fe640 1 -- 172.21.15.76:0/3504896499 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b416e82850 con 0x55b416f29f90 2024-09-19T07:52:53.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.436+0000 7f23c77fe640 10 client.15714 handle_command_reply: tid=0 2024-09-19T07:52:53.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.436+0000 7f23f0c14740 1 client.15714 shutdown 2024-09-19T07:52:53.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 msgr2=0x55b416f176b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 0x55b416f176b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23e0035000 tx=0x7f23e002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 shutdown_connections 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f29f90 0x55b416f2c3f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f1a680 0x55b416f176b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f17170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23c77fe640 0 client.15714 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 --2- 172.21.15.76:0/3504896499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f19ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 >> 172.21.15.76:0/3504896499 conn(0x55b416f0ba30 msgr2=0x55b416f11760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:53.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 shutdown_connections 2024-09-19T07:52:53.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 1 -- 172.21.15.76:0/3504896499 wait complete. 2024-09-19T07:52:53.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.437+0000 7f23f0c14740 20 client.15714 trim_cache size 0 max 16384 2024-09-19T07:52:53.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 Processor -- start 2024-09-19T07:52:53.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 -- start start 2024-09-19T07:52:53.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 0x55b416f190e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f31cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f32200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81b25d0 con 0x55b416f0ba30 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81afea0 con 0x55b416f0fdc0 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23f0c14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81adcf0 con 0x55b416f0f4a0 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 0x55b416f190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 0x55b416f190e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44890/0 (socket says 172.21.15.76:44890) 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.454+0000 7f23e7fff640 1 -- 172.21.15.76:0/1832892374 learned_addr learned my addr 172.21.15.76:0/1832892374 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f32200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e77fe640 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f31cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e7fff640 1 -- 172.21.15.76:0/1832892374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 msgr2=0x55b416f31cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e7fff640 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f31cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e7fff640 1 -- 172.21.15.76:0/1832892374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 msgr2=0x55b416f32200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e7fff640 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f32200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e7fff640 1 -- 172.21.15.76:0/1832892374 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b416f1a230 con 0x55b416f0ba30 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23e7fff640 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 0x55b416f190e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f23d80cdb40 tx=0x7f23d809f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d947a71e9f9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23cdffb640 1 -- 172.21.15.76:0/1832892374 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8018e10 con 0x55b416f0ba30 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23cdffb640 1 -- 172.21.15.76:0/1832892374 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23d809a3d0 con 0x55b416f0ba30 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.455+0000 7f23cdffb640 1 -- 172.21.15.76:0/1832892374 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8098740 con 0x55b416f0ba30 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 -- 172.21.15.76:0/1832892374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 msgr2=0x55b416f190e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 0x55b416f190e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f23d80cdb40 tx=0x7f23d809f040 comp rx=0 tx=0).stop 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 -- 172.21.15.76:0/1832892374 shutdown_connections 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0fdc0 0x55b416f32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f31cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 --2- 172.21.15.76:0/1832892374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0ba30 0x55b416f190e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 -- 172.21.15.76:0/1832892374 >> 172.21.15.76:0/1832892374 conn(0x55b416f17810 msgr2=0x55b416f189d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 -- 172.21.15.76:0/1832892374 shutdown_connections 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 -- 172.21.15.76:0/1832892374 wait complete. 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.456+0000 7f23f0c14740 1 -- start start 2024-09-19T07:52:53.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 Processor -- start 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0ba30 0x55b416f20320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f20860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 0x55b416f20da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81ae360 con 0x55b416f0fdc0 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81af7d0 con 0x55b416f0ba30 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81aea30 con 0x55b416f0f4a0 2024-09-19T07:52:53.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23f0c14740 10 client.0 _ll_register_callbacks cb 0x7f23e0031ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23ecdd8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 0x55b416f20da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23ecdd8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 0x55b416f20da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44898/0 (socket says 172.21.15.76:44898) 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23ecdd8640 1 -- 172.21.15.76:0/2730433997 learned_addr learned my addr 172.21.15.76:0/2730433997 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23e7fff640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0ba30 0x55b416f20320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23e77fe640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f20860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23ecdd8640 1 -- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 msgr2=0x55b416f20860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.457+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f20860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23ecdd8640 1 -- 172.21.15.76:0/2730433997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0ba30 msgr2=0x55b416f20320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0ba30 0x55b416f20320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23ecdd8640 1 -- 172.21.15.76:0/2730433997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b416f93ca0 con 0x55b416f0fdc0 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23e77fe640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f20860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:53.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23ecdd8640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 0x55b416f20da0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f23e0031fd0 tx=0x7f23e003d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed46c5cfcdc4157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23c77fe640 1 -- 172.21.15.76:0/2730433997 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e003de60 con 0x55b416f0fdc0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23c77fe640 1 -- 172.21.15.76:0/2730433997 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f23e0004610 con 0x55b416f0fdc0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d809a3d0 con 0x55b416f0fdc0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23c77fe640 1 -- 172.21.15.76:0/2730433997 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23e006d050 con 0x55b416f0fdc0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23f0c14740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b416f94e80 con 0x55b416f0fdc0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.458+0000 7f23c77fe640 1 -- 172.21.15.76:0/2730433997 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23d809a3d0 con 0x55b416f0fdc0 2024-09-19T07:52:53.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23c77fe640 1 -- 172.21.15.76:0/2730433997 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f23e0053440 con 0x55b416f0fdc0 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23f0c14740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23f0c14740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23f0c14740 20 client.15720 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f1a680 0x55b416f97580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23f0c14740 4 client.15720 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b416e7cd60 con 0x55b416f1a680 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.459+0000 7f23e7fff640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f1a680 0x55b416f97580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23c77fe640 10 client.15720 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23e7fff640 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f1a680 0x55b416f97580 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1971f6eb2c4c3e54 server_cookie=190a6c9912960a90 in_seq=0 out_seq=0 2024-09-19T07:52:53.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23c77fe640 1 -- 172.21.15.76:0/2730433997 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b416e7cd60 con 0x55b416f1a680 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23c77fe640 10 client.15720 handle_command_reply: tid=0 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 client.15720 shutdown 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 msgr2=0x55b416f20da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 0x55b416f20da0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f23e0031fd0 tx=0x7f23e003d650 comp rx=0 tx=0).stop 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 shutdown_connections 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b416f1a680 0x55b416f97580 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b416f0fdc0 0x55b416f20da0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b416f0f4a0 0x55b416f20860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 --2- 172.21.15.76:0/2730433997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b416f0ba30 0x55b416f20320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23c77fe640 0 client.15720 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 >> 172.21.15.76:0/2730433997 conn(0x55b416f17810 msgr2=0x55b416f0a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 shutdown_connections 2024-09-19T07:52:53.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 1 -- 172.21.15.76:0/2730433997 wait complete. 2024-09-19T07:52:53.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.460+0000 7f23f0c14740 20 client.15720 trim_cache size 0 max 16384 2024-09-19T07:52:53.484 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:53.484 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:52:53.484 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:52:53.484 INFO:teuthology.orchestra.run.smithi076.stdout: "29960d49-ddaa-40b5-95e6-f7bfef6bf2c0": { 2024-09-19T07:52:53.484 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:52:53.485 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "29960d49-ddaa-40b5-95e6-f7bfef6bf2c0", 2024-09-19T07:52:53.485 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:52:53.485 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:53.485 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:53.485 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f23d00a33b0 msgr2=0x7f23d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f23d00a33b0 0x7f23d00a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23e0031040 tx=0x7f23e00317c0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 msgr2=0x7f23e80fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 0x7f23e80fccf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c920 tx=0x7f23d800cde0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 shutdown_connections 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f23d00a33b0 0x7f23d00a5870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e8106a80 0x7f23e80fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23e8101420 0x7f23e80fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 --2- 172.21.15.76:0/4151165534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f23e8100a80 0x7f23e80fccf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:53.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 >> 172.21.15.76:0/4151165534 conn(0x7f23e80fc7a0 msgr2=0x7f23e806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:53.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 shutdown_connections 2024-09-19T07:52:53.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:53.461+0000 7f23ee83b640 1 -- 172.21.15.76:0/4151165534 wait complete. 2024-09-19T07:52:54.092 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:54 smithi076 ceph-mon[30930]: pgmap v55: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 176 KiB/s wr, 6 op/s 2024-09-19T07:52:54.092 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:54 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:52:54.120 INFO:tasks.cephfs.filesystem:scrub status for tag:29960d49-ddaa-40b5-95e6-f7bfef6bf2c0 - {'path': '/', 'tag': '29960d49-ddaa-40b5-95e6-f7bfef6bf2c0', 'options': 'recursive,force'} 2024-09-19T07:52:54.124 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:54.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:54 smithi152 ceph-mon[35117]: pgmap v55: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 176 KiB/s wr, 6 op/s 2024-09-19T07:52:54.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:54 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:52:54.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:54 smithi137 ceph-mon[35309]: pgmap v55: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 176 KiB/s wr, 6 op/s 2024-09-19T07:52:54.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:54 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:52:54.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 -- 172.21.15.76:0/4209790180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c101de0 msgr2=0x7f813c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:54.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 --2- 172.21.15.76:0/4209790180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c101de0 0x7f813c1021c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c02a410 comp rx=0 tx=0).stop 2024-09-19T07:52:54.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 -- 172.21.15.76:0/4209790180 shutdown_connections 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 --2- 172.21.15.76:0/4209790180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f813c106f10 0x7f813c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 --2- 172.21.15.76:0/4209790180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f813c102790 0x7f813c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 --2- 172.21.15.76:0/4209790180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c101de0 0x7f813c1021c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 -- 172.21.15.76:0/4209790180 >> 172.21.15.76:0/4209790180 conn(0x7f813c0fd8c0 msgr2=0x7f813c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 -- 172.21.15.76:0/4209790180 shutdown_connections 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.617+0000 7f8141cf6640 1 -- 172.21.15.76:0/4209790180 wait complete. 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.618+0000 7f8141cf6640 1 Processor -- start 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.618+0000 7f8141cf6640 1 -- start start 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.618+0000 7f8141cf6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f813c101de0 0x7f813c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:54.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 0x7f813c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f813c106f10 0x7f813c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f813c112090 con 0x7f813c102790 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f813c111f10 con 0x7f813c101de0 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f813c112210 con 0x7f813c106f10 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 0x7f813c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 0x7f813c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44920/0 (socket says 172.21.15.76:44920) 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 -- 172.21.15.76:0/2716831089 learned_addr learned my addr 172.21.15.76:0/2716831089 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813b7fe640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f813c101de0 0x7f813c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813bfff640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f813c106f10 0x7f813c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 -- 172.21.15.76:0/2716831089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f813c106f10 msgr2=0x7f813c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:54.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f813c106f10 0x7f813c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 -- 172.21.15.76:0/2716831089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f813c101de0 msgr2=0x7f813c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f813c101de0 0x7f813c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 -- 172.21.15.76:0/2716831089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c19d4c0 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f813affd640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 0x7f813c198a50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f813000d770 tx=0x7f813000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130017070 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8130005520 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130010460 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c19d7b0 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.619+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c1a5090 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.620+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c1021c0 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.622+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8130004ea0 con 0x7f813c102790 2024-09-19T07:52:54.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.622+0000 7f8138ff9640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81240a33b0 0x7f81240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:54.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.622+0000 7f813b7fe640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81240a33b0 0x7f81240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:54.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.622+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81300cf8b0 con 0x7f813c102790 2024-09-19T07:52:54.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.623+0000 7f813b7fe640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81240a33b0 0x7f81240a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f812c009230 tx=0x7f812c0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:54.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.626+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f813009c230 con 0x7f813c102790 2024-09-19T07:52:54.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.834+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f813c109b60 con 0x7f813c102790 2024-09-19T07:52:54.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.835+0000 7f8138ff9640 1 -- 172.21.15.76:0/2716831089 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f813009bb30 con 0x7f813c102790 2024-09-19T07:52:54.836 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:52:54.836 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:52:54.836 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:52:54.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81240a33b0 msgr2=0x7f81240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:54.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81240a33b0 0x7f81240a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f812c009230 tx=0x7f812c0058d0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 msgr2=0x7f813c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 0x7f813c198a50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f813000d770 tx=0x7f813000dc30 comp rx=0 tx=0).stop 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 shutdown_connections 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81240a33b0 0x7f81240a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f813c106f10 0x7f813c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f813c102790 0x7f813c198a50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 --2- 172.21.15.76:0/2716831089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f813c101de0 0x7f813c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 >> 172.21.15.76:0/2716831089 conn(0x7f813c0fd8c0 msgr2=0x7f813c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 shutdown_connections 2024-09-19T07:52:54.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:54.837+0000 7f8141cf6640 1 -- 172.21.15.76:0/2716831089 wait complete. 2024-09-19T07:52:55.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:55 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2716831089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:55.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:55 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2716831089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:55.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:55 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2716831089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:55.514 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db --set-id 5d538fe8 --release --await' 2024-09-19T07:52:55.514 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db --set-id 5d538fe8 --release --await 2024-09-19T07:52:55.801 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:56.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:56 smithi076 ceph-mon[30930]: pgmap v56: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 176 KiB/s wr, 8 op/s 2024-09-19T07:52:56.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.308+0000 7efc254c4640 1 -- 172.21.15.76:0/175567231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102570 msgr2=0x7efc201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.308+0000 7efc254c4640 1 --2- 172.21.15.76:0/175567231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102570 0x7efc201029b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efc14009900 tx=0x7efc1402a480 comp rx=0 tx=0).stop 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 -- 172.21.15.76:0/175567231 shutdown_connections 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 --2- 172.21.15.76:0/175567231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102ef0 0x7efc2010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 --2- 172.21.15.76:0/175567231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102570 0x7efc201029b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 --2- 172.21.15.76:0/175567231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc20100e20 0x7efc20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 -- 172.21.15.76:0/175567231 >> 172.21.15.76:0/175567231 conn(0x7efc200fc7d0 msgr2=0x7efc200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 -- 172.21.15.76:0/175567231 shutdown_connections 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 -- 172.21.15.76:0/175567231 wait complete. 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 Processor -- start 2024-09-19T07:52:56.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.309+0000 7efc254c4640 1 -- start start 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc20100e20 0x7efc20198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102570 0x7efc20198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 0x7efc2019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efc201110a0 con 0x7efc20102ef0 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc20110f20 con 0x7efc20102570 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc20111220 con 0x7efc20100e20 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 0x7efc2019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 0x7efc2019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44924/0 (socket says 172.21.15.76:44924) 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 -- 172.21.15.76:0/1316435176 learned_addr learned my addr 172.21.15.76:0/1316435176 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1effd640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc20100e20 0x7efc20198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102570 0x7efc20198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 -- 172.21.15.76:0/1316435176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc20100e20 msgr2=0x7efc20198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc20100e20 0x7efc20198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 -- 172.21.15.76:0/1316435176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102570 msgr2=0x7efc20198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102570 0x7efc20198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 -- 172.21.15.76:0/1316435176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2019d5f0 con 0x7efc20102ef0 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102570 0x7efc20198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:56.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc1f7fe640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 0x7efc2019cf10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d750 tx=0x7efc1800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc07fff640 1 -- 172.21.15.76:0/1316435176 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18017070 con 0x7efc20102ef0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc07fff640 1 -- 172.21.15.76:0/1316435176 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc18005520 con 0x7efc20102ef0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2019d8e0 con 0x7efc20102ef0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc07fff640 1 -- 172.21.15.76:0/1316435176 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18004e00 con 0x7efc20102ef0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.310+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201a51c0 con 0x7efc20102ef0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.312+0000 7efc07fff640 1 -- 172.21.15.76:0/1316435176 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efc18004fa0 con 0x7efc20102ef0 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 Processor -- start 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 -- start start 2024-09-19T07:52:56.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1060 0x55d2377f1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d2377fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377fe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d237756620 con 0x55d2377fc240 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d2376fde50 con 0x55d2377f1980 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc2789d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d2377525e0 con 0x55d2377f1060 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc07fff640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efc080a33b0 0x7efc080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44930/0 (socket says 172.21.15.76:44930) 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc1e7fc640 1 -- 172.21.15.76:0/1755646130 learned_addr learned my addr 172.21.15.76:0/1755646130 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc1f7fe640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efc080a33b0 0x7efc080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1060 0x55d2377f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.313+0000 7efc1effd640 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d2377fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1e7fc640 1 -- 172.21.15.76:0/1755646130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1060 msgr2=0x55d2377f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1060 0x55d2377f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1e7fc640 1 -- 172.21.15.76:0/1755646130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 msgr2=0x55d2377fbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d2377fbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc07fff640 1 -- 172.21.15.76:0/1316435176 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7efc180cf700 con 0x7efc20102ef0 2024-09-19T07:52:56.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1e7fc640 1 -- 172.21.15.76:0/1755646130 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2376eed40 con 0x55d2377fc240 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377fe630 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efc14005ec0 tx=0x7efc14005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a05cac39c705c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc1f7fe640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efc080a33b0 0x7efc080a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc1809b680 tx=0x7efc1806d700 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc057fa640 1 -- 172.21.15.76:0/1755646130 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14043020 con 0x55d2377fc240 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc057fa640 1 -- 172.21.15.76:0/1755646130 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc14031960 con 0x55d2377fc240 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.314+0000 7efc057fa640 1 -- 172.21.15.76:0/1755646130 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14035040 con 0x55d2377fc240 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 -- 172.21.15.76:0/1755646130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 msgr2=0x55d2377fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377fe630 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efc14005ec0 tx=0x7efc14005750 comp rx=0 tx=0).stop 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 -- 172.21.15.76:0/1755646130 shutdown_connections 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377fe630 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d2377fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 --2- 172.21.15.76:0/1755646130 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1060 0x55d2377f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 -- 172.21.15.76:0/1755646130 >> 172.21.15.76:0/1755646130 conn(0x55d2377ed5f0 msgr2=0x55d2377ed9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 -- 172.21.15.76:0/1755646130 shutdown_connections 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 -- 172.21.15.76:0/1755646130 wait complete. 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 -- start start 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.315+0000 7efc2789d740 1 Processor -- start 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1060 0x55d2377f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d2377f9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d2377fee10 con 0x55d2377fc240 2024-09-19T07:52:56.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d2376def10 con 0x55d2377f1060 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d2377fef90 con 0x55d2377f1980 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 10 client.0 _ll_register_callbacks cb 0x55d237702db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44934/0 (socket says 172.21.15.76:44934) 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3195308856 learned_addr learned my addr 172.21.15.76:0/3195308856 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1effd640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d2377f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1060 0x55d2377f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 msgr2=0x55d2377f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d2377f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3195308856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1060 msgr2=0x55d2377f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1060 0x55d2377f91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3195308856 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d237465580 con 0x55d2377fc240 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377f9c60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc14000c00 tx=0x7efc140055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830df8840837b421 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc02ff5640 1 -- 172.21.15.76:0/3195308856 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14050020 con 0x55d2377fc240 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc02ff5640 1 -- 172.21.15.76:0/3195308856 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7efc14003a00 con 0x55d2377fc240 2024-09-19T07:52:56.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc14031960 con 0x55d2377fc240 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.316+0000 7efc02ff5640 1 -- 172.21.15.76:0/3195308856 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efc1405b050 con 0x55d2377fc240 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 10 client.15738 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d23752f960 con 0x55d2377fc240 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc02ff5640 1 -- 172.21.15.76:0/3195308856 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc14031960 con 0x55d2377fc240 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc02ff5640 1 -- 172.21.15.76:0/3195308856 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efc1403a040 con 0x55d2377fc240 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 10 client.15738 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 10 client.15738 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 20 client.15738 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d23780bce0 0x55d23780e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 4 client.15738 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:56.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d237763b90 con 0x55d23780bce0 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.317+0000 7efc1effd640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d23780bce0 0x55d23780e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc1effd640 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d23780bce0 0x55d23780e0d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b62920ddb5d997 server_cookie=7f737044e9d38dec in_seq=0 out_seq=0 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc02ff5640 10 client.15738 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc02ff5640 1 -- 172.21.15.76:0/3195308856 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d237763b90 con 0x55d23780bce0 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc02ff5640 10 client.15738 handle_command_reply: tid=0 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 client.15738 shutdown 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 msgr2=0x55d2377f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377f9c60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc14000c00 tx=0x7efc140055c0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 shutdown_connections 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d23780bce0 0x55d23780e0d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377fc240 0x55d2377f9c60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d2377f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 --2- 172.21.15.76:0/3195308856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1060 0x55d2377f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.319+0000 7efc02ff5640 0 client.15738 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:56.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.318+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 >> 172.21.15.76:0/3195308856 conn(0x55d2377ed5f0 msgr2=0x55d2377f32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:56.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.319+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 shutdown_connections 2024-09-19T07:52:56.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.319+0000 7efc2789d740 1 -- 172.21.15.76:0/3195308856 wait complete. 2024-09-19T07:52:56.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.319+0000 7efc2789d740 20 client.15738 trim_cache size 0 max 16384 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 Processor -- start 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 -- start start 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d2377f8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d237810d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377fc240 0x55d237811250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b02f0 con 0x55d2377f1060 2024-09-19T07:52:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc201adbc0 con 0x55d2377fc240 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc2789d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc201aba10 con 0x55d2377f1980 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.335+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d2377f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d2377f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44942/0 (socket says 172.21.15.76:44942) 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3495289352 learned_addr learned my addr 172.21.15.76:0/3495289352 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1effd640 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d237810d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3495289352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 msgr2=0x55d237810d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d237810d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3495289352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377fc240 msgr2=0x55d237811250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377fc240 0x55d237811250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3495289352 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2377ebbb0 con 0x55d2377f1060 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d2377f8140 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efc14040040 tx=0x7efc140314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6c9fdd9936e80f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:56.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc04ff9640 1 -- 172.21.15.76:0/3495289352 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14035070 con 0x55d2377f1060 2024-09-19T07:52:56.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc04ff9640 1 -- 172.21.15.76:0/3495289352 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc14049dd0 con 0x55d2377f1060 2024-09-19T07:52:56.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.336+0000 7efc04ff9640 1 -- 172.21.15.76:0/3495289352 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14050040 con 0x55d2377f1060 2024-09-19T07:52:56.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- 172.21.15.76:0/3495289352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 msgr2=0x55d2377f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d2377f8140 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efc14040040 tx=0x7efc140314e0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- 172.21.15.76:0/3495289352 shutdown_connections 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377fc240 0x55d237811250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377f1980 0x55d237810d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- 172.21.15.76:0/3495289352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d2377f8140 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- 172.21.15.76:0/3495289352 >> 172.21.15.76:0/3495289352 conn(0x55d2377ed5f0 msgr2=0x55d2377fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- 172.21.15.76:0/3495289352 shutdown_connections 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- 172.21.15.76:0/3495289352 wait complete. 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- start start 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 Processor -- start 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d23780eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d23780f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377fc240 0x55d237875620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efc201ac080 con 0x55d2377f1060 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc201ad4f0 con 0x55d2377f1980 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc201ac750 con 0x55d2377fc240 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc2789d740 10 client.0 _ll_register_callbacks cb 0x7efc14004480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.337+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d23780eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d23780eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44954/0 (socket says 172.21.15.76:44954) 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3355378334 learned_addr learned my addr 172.21.15.76:0/3355378334 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377fc240 0x55d237875620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1effd640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d23780f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377fc240 msgr2=0x55d237875620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377fc240 0x55d237875620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3355378334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 msgr2=0x55d23780f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:56.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d23780f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 -- 172.21.15.76:0/3355378334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d237875b60 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1effd640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d23780f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc1e7fc640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d23780eed0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efc14005ec0 tx=0x7efc140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b1f71ffee93872 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc02ff5640 1 -- 172.21.15.76:0/3355378334 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14050070 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc02ff5640 1 -- 172.21.15.76:0/3355378334 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7efc140498d0 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc14049dd0 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc02ff5640 1 -- 172.21.15.76:0/3355378334 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efc14035040 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc2789d740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.338+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d237876d80 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc02ff5640 1 -- 172.21.15.76:0/3355378334 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc14049dd0 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc02ff5640 1 -- 172.21.15.76:0/3355378334 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efc1403d9e0 con 0x55d2377f1060 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc2789d740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:56.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc2789d740 10 client.15744 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc2789d740 20 client.15744 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc2789d740 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d237877330 0x55d237879720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc2789d740 4 client.15744 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5d538fe8", "release": true, "await": true}] 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5d538fe8", "release": true, "await": true}) -- 0x55d23775e0a0 con 0x55d237877330 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc1effd640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d237877330 0x55d237879720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc02ff5640 10 client.15744 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:56.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.339+0000 7efc1effd640 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d237877330 0x55d237879720 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88d18d59c7ea0041 server_cookie=bb42df7159afc0e in_seq=0 out_seq=0 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.341+0000 7efc02ff5640 1 -- 172.21.15.76:0/3355378334 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d23775e0a0 con 0x55d237877330 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.341+0000 7efc02ff5640 10 client.15744 handle_command_reply: tid=0 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.341+0000 7efc2789d740 1 client.15744 shutdown 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.341+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 msgr2=0x55d23780eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.341+0000 7efc2789d740 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d23780eed0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efc14005ec0 tx=0x7efc140046c0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 shutdown_connections 2024-09-19T07:52:56.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2377fc240 0x55d237875620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2377f1980 0x55d23780f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d237877330 0x55d237879720 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 --2- 172.21.15.76:0/3355378334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2377f1060 0x55d23780eed0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 >> 172.21.15.76:0/3355378334 conn(0x55d2377ed5f0 msgr2=0x55d2378071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc02ff5640 0 client.15744 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 shutdown_connections 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 1 -- 172.21.15.76:0/3355378334 wait complete. 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc2789d740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:56.347 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 25, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 8, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "5d538fe8": { 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 8, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 140.3, 2024-09-19T07:52:56.348 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:56.349 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efc080a33b0 msgr2=0x7efc080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efc080a33b0 0x7efc080a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc1809b680 tx=0x7efc1806d700 comp rx=0 tx=0).stop 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 msgr2=0x7efc2019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 0x7efc2019cf10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d750 tx=0x7efc1800dc10 comp rx=0 tx=0).stop 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 shutdown_connections 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efc080a33b0 0x7efc080a5870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efc20102ef0 0x7efc2019cf10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc20102570 0x7efc20198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 --2- 172.21.15.76:0/1316435176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc20100e20 0x7efc20198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:56.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.342+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 >> 172.21.15.76:0/1316435176 conn(0x7efc200fc7d0 msgr2=0x7efc2006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:56.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.343+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 shutdown_connections 2024-09-19T07:52:56.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:56.343+0000 7efc254c4640 1 -- 172.21.15.76:0/1316435176 wait complete. 2024-09-19T07:52:56.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:56 smithi137 ceph-mon[35309]: pgmap v56: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 176 KiB/s wr, 8 op/s 2024-09-19T07:52:56.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:56 smithi152 ceph-mon[35117]: pgmap v56: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 176 KiB/s wr, 8 op/s 2024-09-19T07:52:57.116 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5d538fe8', total seconds elapsed: 24.7 2024-09-19T07:52:57.116 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T07:52:57.117 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:52:57.366 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:57.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 -- 172.21.15.76:0/1214031520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 msgr2=0x7f5db4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/1214031520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db4103180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009900 tx=0x7f5da402a480 comp rx=0 tx=0).stop 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 -- 172.21.15.76:0/1214031520 shutdown_connections 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/1214031520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5db410c180 0x7f5db410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/1214031520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5db41036c0 0x7f5db410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/1214031520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db4103180 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 -- 172.21.15.76:0/1214031520 >> 172.21.15.76:0/1214031520 conn(0x7f5db40fc7a0 msgr2=0x7f5db40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 -- 172.21.15.76:0/1214031520 shutdown_connections 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.839+0000 7f5db8cbb640 1 -- 172.21.15.76:0/1214031520 wait complete. 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 Processor -- start 2024-09-19T07:52:57.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 -- start start 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5db41036c0 0x7f5db4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5db410c180 0x7f5db419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5db41120e0 con 0x7f5db4102da0 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4111f60 con 0x7f5db410c180 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db8cbb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4112260 con 0x7f5db41036c0 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44980/0 (socket says 172.21.15.76:44980) 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 -- 172.21.15.76:0/3248857972 learned_addr learned my addr 172.21.15.76:0/3248857972 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db1d9b640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5db41036c0 0x7f5db4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db2d9d640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5db410c180 0x7f5db419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:57.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 -- 172.21.15.76:0/3248857972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5db41036c0 msgr2=0x7f5db4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5db41036c0 0x7f5db4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 -- 172.21.15.76:0/3248857972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5db410c180 msgr2=0x7f5db419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5db410c180 0x7f5db419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.840+0000 7f5db259c640 1 -- 172.21.15.76:0/3248857972 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db419d570 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.841+0000 7f5db259c640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db41985c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006010 tx=0x7f5da40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.841+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da403f030 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.841+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5da4003d00 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.841+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db419d800 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.841+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4035070 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.841+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db41a5140 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.842+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db406b010 con 0x7f5db4102da0 2024-09-19T07:52:57.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.843+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5da4042030 con 0x7f5db4102da0 2024-09-19T07:52:57.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.844+0000 7f5dab7fe640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5da00a33b0 0x7f5da00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:57.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.844+0000 7f5db1d9b640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5da00a33b0 0x7f5da00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:57.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.844+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5da40f0440 con 0x7f5db4102da0 2024-09-19T07:52:57.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.844+0000 7f5db1d9b640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5da00a33b0 0x7f5da00a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c005fd0 tx=0x7f5d9c005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:57.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:57.848+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5da40bce80 con 0x7f5db4102da0 2024-09-19T07:52:58.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.054+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5db4107200 con 0x7f5db4102da0 2024-09-19T07:52:58.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.055+0000 7f5dab7fe640 1 -- 172.21.15.76:0/3248857972 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f5da40bc780 con 0x7f5db4102da0 2024-09-19T07:52:58.056 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:52:58.056 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:52:58.057 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:52:58.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5da00a33b0 msgr2=0x7f5da00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:58.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5da00a33b0 0x7f5da00a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c005fd0 tx=0x7f5d9c005850 comp rx=0 tx=0).stop 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 msgr2=0x7f5db41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db41985c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006010 tx=0x7f5da40042f0 comp rx=0 tx=0).stop 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 shutdown_connections 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5da00a33b0 0x7f5da00a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5db410c180 0x7f5db419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5db41036c0 0x7f5db4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 --2- 172.21.15.76:0/3248857972 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5db4102da0 0x7f5db41985c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 >> 172.21.15.76:0/3248857972 conn(0x7f5db40fc7a0 msgr2=0x7f5db40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.057+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 shutdown_connections 2024-09-19T07:52:58.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:58.058+0000 7f5db8cbb640 1 -- 172.21.15.76:0/3248857972 wait complete. 2024-09-19T07:52:58.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:58 smithi137 ceph-mon[35309]: pgmap v57: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T07:52:58.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:52:58 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3248857972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:58.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:58 smithi076 ceph-mon[30930]: pgmap v57: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T07:52:58.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:52:58 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3248857972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:58.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:58 smithi152 ceph-mon[35117]: pgmap v57: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T07:52:58.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:52:58 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3248857972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:52:58.683 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T07:52:58.684 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T07:52:58.933 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:52:59.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 -- 172.21.15.76:0/3164336349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 msgr2=0x7fd21c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 --2- 172.21.15.76:0/3164336349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c10d950 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd214009cd0 tx=0x7fd21402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 -- 172.21.15.76:0/3164336349 shutdown_connections 2024-09-19T07:52:59.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 --2- 172.21.15.76:0/3164336349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c10d950 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 --2- 172.21.15.76:0/3164336349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 0x7fd21c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 --2- 172.21.15.76:0/3164336349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd21c106a80 0x7fd21c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 -- 172.21.15.76:0/3164336349 >> 172.21.15.76:0/3164336349 conn(0x7fd21c0fc7a0 msgr2=0x7fd21c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 -- 172.21.15.76:0/3164336349 shutdown_connections 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 -- 172.21.15.76:0/3164336349 wait complete. 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 Processor -- start 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.446+0000 7fd222b92640 1 -- start start 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 0x7fd21c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd21c106a80 0x7fd21c1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c110fe0 con 0x7fd21c101420 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c110e60 con 0x7fd21c100a80 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111160 con 0x7fd21c106a80 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44990/0 (socket says 172.21.15.76:44990) 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 -- 172.21.15.76:0/2021051840 learned_addr learned my addr 172.21.15.76:0/2021051840 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd22092e640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 0x7fd21c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 -- 172.21.15.76:0/2021051840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd21c106a80 msgr2=0x7fd21c1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd21c106a80 0x7fd21c1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 -- 172.21.15.76:0/2021051840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 msgr2=0x7fd21c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 0x7fd21c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 -- 172.21.15.76:0/2021051840 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1a48f0 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd22092e640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 0x7fd21c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd213fff640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c199870 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00b4a0 tx=0x7fd20c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd211ffb640 1 -- 172.21.15.76:0/2021051840 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c014070 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd211ffb640 1 -- 172.21.15.76:0/2021051840 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd20c010b10 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.447+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1a4ac0 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.448+0000 7fd211ffb640 1 -- 172.21.15.76:0/2021051840 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c017d60 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.448+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1a5000 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd211ffb640 1 -- 172.21.15.76:0/2021051840 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd20c017070 con 0x7fd21c101420 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd224f6b740 1 Processor -- start 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd224f6b740 1 -- start start 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd211ffb640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd2040a3430 0x7fd2040a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b91eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91f070 0x55c83b92d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.450+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b930230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd224f6b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c83b883160 con 0x55c83b92de40 2024-09-19T07:52:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd224f6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c83b82a720 con 0x55c83b91f070 2024-09-19T07:52:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd224f6b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c83b87f120 con 0x55c83b91e750 2024-09-19T07:52:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd2040a3430 0x7fd2040a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b930230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b930230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44994/0 (socket says 172.21.15.76:44994) 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 -- 172.21.15.76:0/4170763533 learned_addr learned my addr 172.21.15.76:0/4170763533 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd211ffb640 1 -- 172.21.15.76:0/2021051840 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd20c0cf000 con 0x7fd21c101420 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22092e640 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b91eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd213fff640 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91f070 0x55c83b92d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 -- 172.21.15.76:0/4170763533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 msgr2=0x55c83b91eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b91eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 -- 172.21.15.76:0/4170763533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91f070 msgr2=0x55c83b92d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91f070 0x55c83b92d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 -- 172.21.15.76:0/4170763533 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83b5f4ba0 con 0x55c83b92de40 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd213fff640 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91f070 0x55c83b92d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b930230 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd214031d10 tx=0x7fd214031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e0c6e27abfb9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd22112f640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd2040a3430 0x7fd2040a58f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd214031db0 tx=0x7fd214041000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.451+0000 7fd202ffd640 1 -- 172.21.15.76:0/4170763533 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214004b40 con 0x55c83b92de40 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd202ffd640 1 -- 172.21.15.76:0/4170763533 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd214036070 con 0x55c83b92de40 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd202ffd640 1 -- 172.21.15.76:0/4170763533 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21403b400 con 0x55c83b92de40 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 -- 172.21.15.76:0/4170763533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 msgr2=0x55c83b930230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b930230 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd214031d10 tx=0x7fd214031d40 comp rx=0 tx=0).stop 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 -- 172.21.15.76:0/4170763533 shutdown_connections 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b930230 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91f070 0x55c83b92d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4170763533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b91eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 -- 172.21.15.76:0/4170763533 >> 172.21.15.76:0/4170763533 conn(0x55c83b91ade0 msgr2=0x55c83b91b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:59.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 -- 172.21.15.76:0/4170763533 shutdown_connections 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.452+0000 7fd224f6b740 1 -- 172.21.15.76:0/4170763533 wait complete. 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 -- start start 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 Processor -- start 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b92adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b92b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b92b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c83b930a10 con 0x55c83b92de40 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c83b80b900 con 0x55c83b91e750 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c83b930b90 con 0x55c83b91f070 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd224f6b740 10 client.0 _ll_register_callbacks cb 0x55c83b809780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd22112f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b92b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd22112f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b92b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45010/0 (socket says 172.21.15.76:45010) 2024-09-19T07:52:59.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd22112f640 1 -- 172.21.15.76:0/2328937925 learned_addr learned my addr 172.21.15.76:0/2328937925 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.453+0000 7fd213fff640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b92b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22092e640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b92adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22112f640 1 -- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 msgr2=0x55c83b92b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22112f640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b92b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22112f640 1 -- 172.21.15.76:0/2328937925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 msgr2=0x55c83b92adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22112f640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b92adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22112f640 1 -- 172.21.15.76:0/2328937925 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83b84bc50 con 0x55c83b92de40 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22092e640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b92adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd22112f640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b92b830 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd214031040 tx=0x7fd214004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6cdd9ff8e4b2d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd1fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:59.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2328937925 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214056070 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2328937925 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd214005260 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd214036070 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2328937925 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd214062050 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd224f6b740 10 client.15762 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c83b93c7b0 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.454+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2328937925 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd214036070 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2328937925 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd214046070 con 0x55c83b92de40 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd224f6b740 10 client.15762 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd224f6b740 10 client.15762 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:59.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd224f6b740 20 client.15762 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b93db00 0x55c83b93fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd224f6b740 4 client.15762 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c83b890890 con 0x55c83b93db00 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd22092e640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b93db00 0x55c83b93fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd1fbfff640 10 client.15762 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.455+0000 7fd22092e640 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b93db00 0x55c83b93fef0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ff3e129a8ed1c4 server_cookie=8588497456fdec0b in_seq=0 out_seq=0 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2328937925 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c83b890890 con 0x55c83b93db00 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd1fbfff640 10 client.15762 handle_command_reply: tid=0 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 client.15762 shutdown 2024-09-19T07:52:59.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 msgr2=0x55c83b92b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b92b830 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd214031040 tx=0x7fd214004d70 comp rx=0 tx=0).stop 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 shutdown_connections 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b93db00 0x55c83b93fef0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b92de40 0x55c83b92b830 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b92b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2328937925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b92adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 >> 172.21.15.76:0/2328937925 conn(0x55c83b91ade0 msgr2=0x55c83b920b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.456+0000 7fd1fbfff640 0 client.15762 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.457+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 shutdown_connections 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.457+0000 7fd224f6b740 1 -- 172.21.15.76:0/2328937925 wait complete. 2024-09-19T07:52:59.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.457+0000 7fd224f6b740 20 client.15762 trim_cache size 0 max 16384 2024-09-19T07:52:59.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 Processor -- start 2024-09-19T07:52:59.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 -- start start 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91ade0 0x55c83b945490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b9459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 0x55c83b928010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1ae1e0 con 0x55c83b91f070 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1abab0 con 0x55c83b91ade0 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd224f6b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1a9900 con 0x55c83b91e750 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd22112f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 0x55c83b928010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd22112f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 0x55c83b928010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45024/0 (socket says 172.21.15.76:45024) 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.473+0000 7fd22112f640 1 -- 172.21.15.76:0/4133994420 learned_addr learned my addr 172.21.15.76:0/4133994420 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22112f640 1 -- 172.21.15.76:0/4133994420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 msgr2=0x55c83b9459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22112f640 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b9459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22112f640 1 -- 172.21.15.76:0/4133994420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91ade0 msgr2=0x55c83b945490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22092e640 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91ade0 0x55c83b945490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22112f640 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91ade0 0x55c83b945490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22112f640 1 -- 172.21.15.76:0/4133994420 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83b929300 con 0x55c83b91f070 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd22112f640 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 0x55c83b928010 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd214005020 tx=0x7fd2140095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fed9abc3116f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd2027fc640 1 -- 172.21.15.76:0/4133994420 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214056040 con 0x55c83b91f070 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd2027fc640 1 -- 172.21.15.76:0/4133994420 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd214036040 con 0x55c83b91f070 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd2027fc640 1 -- 172.21.15.76:0/4133994420 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21403be60 con 0x55c83b91f070 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 -- 172.21.15.76:0/4133994420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 msgr2=0x55c83b928010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 0x55c83b928010 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd214005020 tx=0x7fd2140095c0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 -- 172.21.15.76:0/4133994420 shutdown_connections 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91f070 0x55c83b928010 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91e750 0x55c83b9459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 --2- 172.21.15.76:0/4133994420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91ade0 0x55c83b945490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.474+0000 7fd224f6b740 1 -- 172.21.15.76:0/4133994420 >> 172.21.15.76:0/4133994420 conn(0x55c83b9267a0 msgr2=0x55c83b92ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 -- 172.21.15.76:0/4133994420 shutdown_connections 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 -- 172.21.15.76:0/4133994420 wait complete. 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 -- start start 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 Processor -- start 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 0x55c83b931c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b9321c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b932700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1a9f70 con 0x55c83b91ade0 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1ab3e0 con 0x55c83b91e750 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c1aa640 con 0x55c83b91f070 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd224f6b740 10 client.0 _ll_register_callbacks cb 0x7fd21800b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:52:59.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd22092e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 0x55c83b931c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd22092e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 0x55c83b931c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45028/0 (socket says 172.21.15.76:45028) 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.475+0000 7fd22092e640 1 -- 172.21.15.76:0/2195632573 learned_addr learned my addr 172.21.15.76:0/2195632573 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22112f640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b932700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd213fff640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b9321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22092e640 1 -- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 msgr2=0x55c83b932700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22092e640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b932700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22092e640 1 -- 172.21.15.76:0/2195632573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 msgr2=0x55c83b9321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22092e640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b9321c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22092e640 1 -- 172.21.15.76:0/2195632573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83b9a7530 con 0x55c83b91ade0 2024-09-19T07:52:59.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd22092e640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 0x55c83b931c80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd21801afd0 tx=0x7fd2180118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e708a785b63d7c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd1fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2195632573 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21801a850 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2195632573 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd21801a9f0 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd214036040 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2195632573 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd21802a050 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd224f6b740 10 client.15768 fetch_fsmap learned FSMap version 25 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c83b9a8850 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.476+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2195632573 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd214036040 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2195632573 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd21800f420 con 0x55c83b91ade0 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd224f6b740 10 client.15768 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd224f6b740 10 client.15768 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd224f6b740 20 client.15768 populate_metadata read hostname 'smithi076' 2024-09-19T07:52:59.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b92de40 0x55c83b9ab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:52:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd224f6b740 4 client.15768 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T07:52:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55c83b88abe0 con 0x55c83b92de40 2024-09-19T07:52:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd213fff640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b92de40 0x55c83b9ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:52:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd1fbfff640 10 client.15768 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.477+0000 7fd213fff640 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b92de40 0x55c83b9ab050 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9af69760faf3d7a server_cookie=3b34e48eae3ffe5e in_seq=0 out_seq=0 2024-09-19T07:52:59.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd1fbfff640 1 -- 172.21.15.76:0/2195632573 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c83b88abe0 con 0x55c83b92de40 2024-09-19T07:52:59.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd1fbfff640 10 client.15768 handle_command_reply: tid=0 2024-09-19T07:52:59.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 client.15768 shutdown 2024-09-19T07:52:59.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 msgr2=0x55c83b931c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 0x55c83b931c80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd21801afd0 tx=0x7fd2180118d0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 shutdown_connections 2024-09-19T07:52:59.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c83b91f070 0x55c83b932700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c83b91e750 0x55c83b9321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c83b92de40 0x55c83b9ab050 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 --2- 172.21.15.76:0/2195632573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c83b91ade0 0x55c83b931c80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd1fbfff640 0 client.15768 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:52:59.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.493+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 >> 172.21.15.76:0/2195632573 conn(0x55c83b9267a0 msgr2=0x55c83b9202d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:59.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 shutdown_connections 2024-09-19T07:52:59.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd224f6b740 1 -- 172.21.15.76:0/2195632573 wait complete. 2024-09-19T07:52:59.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd224f6b740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T07:52:59.497 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:52:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 25, 2024-09-19T07:52:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:52:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 10, 2024-09-19T07:52:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:52:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: "6a1022a4": { 2024-09-19T07:52:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 10, 2024-09-19T07:52:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:52:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:52:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:52:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:52:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 140.3, 2024-09-19T07:52:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:52:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:52:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:52:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:52:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:52:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:52:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:52:59.503 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:52:59.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd2040a3430 msgr2=0x7fd2040a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd2040a3430 0x7fd2040a58f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd214031db0 tx=0x7fd214041000 comp rx=0 tx=0).stop 2024-09-19T07:52:59.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 msgr2=0x7fd21c199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:52:59.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c199870 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00b4a0 tx=0x7fd20c00b960 comp rx=0 tx=0).stop 2024-09-19T07:52:59.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 shutdown_connections 2024-09-19T07:52:59.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd2040a3430 0x7fd2040a58f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd21c106a80 0x7fd21c1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd21c101420 0x7fd21c199870 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 --2- 172.21.15.76:0/2021051840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd21c100a80 0x7fd21c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:52:59.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.494+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 >> 172.21.15.76:0/2021051840 conn(0x7fd21c0fc7a0 msgr2=0x7fd21c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:52:59.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.495+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 shutdown_connections 2024-09-19T07:52:59.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:52:59.495+0000 7fd222b92640 1 -- 172.21.15.76:0/2021051840 wait complete. 2024-09-19T07:53:00.115 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:00 smithi076 ceph-mon[30930]: pgmap v58: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-19T07:53:00.144 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6a1022a4', quiesce took 3.0 seconds. Will release after: 17.35 2024-09-19T07:53:00.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:00 smithi137 ceph-mon[35309]: pgmap v58: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-19T07:53:00.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:00 smithi152 ceph-mon[35117]: pgmap v58: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-19T07:53:02.384 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:02 smithi076 ceph-mon[30930]: pgmap v59: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:53:02.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:02 smithi137 ceph-mon[35309]: pgmap v59: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:53:02.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:02 smithi152 ceph-mon[35117]: pgmap v59: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:53:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:04 smithi137 ceph-mon[35309]: pgmap v60: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:53:04.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:04 smithi076 ceph-mon[30930]: pgmap v60: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:53:04.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:04 smithi152 ceph-mon[35117]: pgmap v60: 97 pgs: 97 active+clean; 3.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:53:06.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:06 smithi137 ceph-mon[35309]: pgmap v61: 97 pgs: 97 active+clean; 3.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-19T07:53:06.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:06 smithi076 ceph-mon[30930]: pgmap v61: 97 pgs: 97 active+clean; 3.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-19T07:53:06.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:06 smithi152 ceph-mon[35117]: pgmap v61: 97 pgs: 97 active+clean; 3.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-19T07:53:08.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:08 smithi137 ceph-mon[35309]: pgmap v62: 97 pgs: 97 active+clean; 3.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-19T07:53:08.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:08 smithi076 ceph-mon[30930]: pgmap v62: 97 pgs: 97 active+clean; 3.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-19T07:53:08.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:08 smithi152 ceph-mon[35117]: pgmap v62: 97 pgs: 97 active+clean; 3.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-19T07:53:10.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:10 smithi137 ceph-mon[35309]: pgmap v63: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 836 KiB/s wr, 23 op/s 2024-09-19T07:53:10.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:10 smithi076 ceph-mon[30930]: pgmap v63: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 836 KiB/s wr, 23 op/s 2024-09-19T07:53:10.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:10 smithi152 ceph-mon[35117]: pgmap v63: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 836 KiB/s wr, 23 op/s 2024-09-19T07:53:12.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:12 smithi076 ceph-mon[30930]: pgmap v64: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 834 KiB/s wr, 20 op/s 2024-09-19T07:53:12.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:12 smithi137 ceph-mon[35309]: pgmap v64: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 834 KiB/s wr, 20 op/s 2024-09-19T07:53:12.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:12 smithi152 ceph-mon[35117]: pgmap v64: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 834 KiB/s wr, 20 op/s 2024-09-19T07:53:14.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:14 smithi137 ceph-mon[35309]: pgmap v65: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 834 KiB/s wr, 20 op/s 2024-09-19T07:53:14.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:14 smithi076 ceph-mon[30930]: pgmap v65: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 834 KiB/s wr, 20 op/s 2024-09-19T07:53:14.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:14 smithi152 ceph-mon[35117]: pgmap v65: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 834 KiB/s wr, 20 op/s 2024-09-19T07:53:16.363 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:16 smithi152 ceph-mon[35117]: pgmap v66: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 835 KiB/s wr, 23 op/s 2024-09-19T07:53:16.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:16 smithi137 ceph-mon[35309]: pgmap v66: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 835 KiB/s wr, 23 op/s 2024-09-19T07:53:16.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:16 smithi076 ceph-mon[30930]: pgmap v66: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 835 KiB/s wr, 23 op/s 2024-09-19T07:53:17.495 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:53:17.757 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:18.149 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:18 smithi076 ceph-mon[30930]: pgmap v67: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 813 KiB/s wr, 5 op/s 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.229+0000 7fa00810e640 1 -- 172.21.15.76:0/3387949836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000074eb0 msgr2=0x7fa000112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.229+0000 7fa00810e640 1 --2- 172.21.15.76:0/3387949836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000074eb0 0x7fa000112650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009900 tx=0x7f9ff402a480 comp rx=0 tx=0).stop 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- 172.21.15.76:0/3387949836 shutdown_connections 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 --2- 172.21.15.76:0/3387949836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa000112b90 0x7fa000114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 --2- 172.21.15.76:0/3387949836 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000074eb0 0x7fa000112650 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 --2- 172.21.15.76:0/3387949836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074590 0x7fa000074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- 172.21.15.76:0/3387949836 >> 172.21.15.76:0/3387949836 conn(0x7fa0000fd8c0 msgr2=0x7fa0000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:18.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- 172.21.15.76:0/3387949836 shutdown_connections 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- 172.21.15.76:0/3387949836 wait complete. 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 Processor -- start 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- start start 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa000074590 0x7fa0001a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074eb0 0x7fa0001a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 0x7fa00019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa000118790 con 0x7fa000112b90 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa000118610 con 0x7fa000074eb0 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.230+0000 7fa00810e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa000118910 con 0x7fa000074590 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 0x7fa00019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:18.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 0x7fa00019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58116/0 (socket says 172.21.15.76:58116) 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 -- 172.21.15.76:0/1342656633 learned_addr learned my addr 172.21.15.76:0/1342656633 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa005eaa640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa000074590 0x7fa0001a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0056a9640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074eb0 0x7fa0001a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 -- 172.21.15.76:0/1342656633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa000074590 msgr2=0x7fa0001a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa000074590 0x7fa0001a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 -- 172.21.15.76:0/1342656633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074eb0 msgr2=0x7fa0001a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074eb0 0x7fa0001a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 -- 172.21.15.76:0/1342656633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00019f230 con 0x7fa000112b90 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0056a9640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074eb0 0x7fa0001a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa0066ab640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 0x7fa00019eb00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800b9e0 tx=0x7f9ff800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:18.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8019070 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ff800cb20 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00019f520 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8012670 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.231+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0001ab810 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.232+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0000749f0 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.233+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9ff801c070 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.234+0000 7f9ffeffd640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9fe80a33b0 0x7f9fe80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.234+0000 7fa005eaa640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9fe80a33b0 0x7f9fe80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.234+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9ff80cf840 con 0x7fa000112b90 2024-09-19T07:53:18.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.234+0000 7fa005eaa640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9fe80a33b0 0x7f9fe80a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009890 tx=0x7f9ff0008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:18.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.237+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ff809c2d0 con 0x7fa000112b90 2024-09-19T07:53:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:18 smithi137 ceph-mon[35309]: pgmap v67: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 813 KiB/s wr, 5 op/s 2024-09-19T07:53:18.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.437+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa00019fff0 con 0x7fa000112b90 2024-09-19T07:53:18.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.438+0000 7f9ffeffd640 1 -- 172.21.15.76:0/1342656633 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7fa00019fff0 con 0x7fa000112b90 2024-09-19T07:53:18.438 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:53:18.439 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:53:18.439 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9fe80a33b0 msgr2=0x7f9fe80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9fe80a33b0 0x7f9fe80a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009890 tx=0x7f9ff0008040 comp rx=0 tx=0).stop 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 msgr2=0x7fa00019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 0x7fa00019eb00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800b9e0 tx=0x7f9ff800bea0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 shutdown_connections 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9fe80a33b0 0x7f9fe80a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa000112b90 0x7fa00019eb00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa000074eb0 0x7fa0001a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.440+0000 7fa00810e640 1 --2- 172.21.15.76:0/1342656633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa000074590 0x7fa0001a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.441+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 >> 172.21.15.76:0/1342656633 conn(0x7fa0000fd8c0 msgr2=0x7fa0000ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.441+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 shutdown_connections 2024-09-19T07:53:18.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:18.441+0000 7fa00810e640 1 -- 172.21.15.76:0/1342656633 wait complete. 2024-09-19T07:53:18.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:18 smithi152 ceph-mon[35117]: pgmap v67: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 813 KiB/s wr, 5 op/s 2024-09-19T07:53:19.118 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db --set-id 6a1022a4 --release --await' 2024-09-19T07:53:19.118 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db --set-id 6a1022a4 --release --await 2024-09-19T07:53:19.380 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:19.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:19 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1342656633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:19.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:19 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1342656633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:19.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:19 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1342656633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 -- 172.21.15.76:0/2409623849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 msgr2=0x7f730c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 --2- 172.21.15.76:0/2409623849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c1067e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7300009900 tx=0x7f730002a410 comp rx=0 tx=0).stop 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 -- 172.21.15.76:0/2409623849 shutdown_connections 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 --2- 172.21.15.76:0/2409623849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f730c106f10 0x7f730c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 --2- 172.21.15.76:0/2409623849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c1067e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 --2- 172.21.15.76:0/2409623849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c101de0 0x7f730c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 -- 172.21.15.76:0/2409623849 >> 172.21.15.76:0/2409623849 conn(0x7f730c0fd8c0 msgr2=0x7f730c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 -- 172.21.15.76:0/2409623849 shutdown_connections 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 -- 172.21.15.76:0/2409623849 wait complete. 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.839+0000 7f7312a39640 1 Processor -- start 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 -- start start 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c101de0 0x7f730c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f730c106f10 0x7f730c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112090 con 0x7f730c102790 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f730c111f10 con 0x7f730c101de0 2024-09-19T07:53:19.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7312a39640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f730c112210 con 0x7f730c106f10 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58134/0 (socket says 172.21.15.76:58134) 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 -- 172.21.15.76:0/2655208642 learned_addr learned my addr 172.21.15.76:0/2655208642 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f7310fd6640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f730c106f10 0x7f730c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730bfff640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c101de0 0x7f730c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 -- 172.21.15.76:0/2655208642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f730c106f10 msgr2=0x7f730c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f730c106f10 0x7f730c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 -- 172.21.15.76:0/2655208642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c101de0 msgr2=0x7f730c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c101de0 0x7f730c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.840+0000 7f730b7fe640 1 -- 172.21.15.76:0/2655208642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1a6970 con 0x7f730c102790 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.841+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c074a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7300006010 tx=0x7f73000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:19.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.841+0000 7f73097fa640 1 -- 172.21.15.76:0/2655208642 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730003f030 con 0x7f730c102790 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.841+0000 7f73097fa640 1 -- 172.21.15.76:0/2655208642 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7300003d00 con 0x7f730c102790 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.841+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1a6c00 con 0x7f730c102790 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.841+0000 7f73097fa640 1 -- 172.21.15.76:0/2655208642 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300035070 con 0x7f730c102790 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.841+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a70e0 con 0x7f730c102790 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.843+0000 7f73097fa640 1 -- 172.21.15.76:0/2655208642 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7300042030 con 0x7f730c102790 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.843+0000 7f7314e12740 1 Processor -- start 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 -- start start 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905ba3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905badd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564905b08620 con 0x564905bae240 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564905aafe50 con 0x564905ba3980 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7314e12740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564905b045e0 con 0x564905ba3060 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f73097fa640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f72f40a33b0 0x7f72f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905badd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905badd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:37458/0 (socket says 172.21.15.76:37458) 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 -- 172.21.15.76:0/2821448611 learned_addr learned my addr 172.21.15.76:0/2821448611 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7310fd6640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f72f40a33b0 0x7f72f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f7310fd6640 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905ba3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f73097fa640 1 -- 172.21.15.76:0/2655208642 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f73000f02b0 con 0x7f730c102790 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 -- 172.21.15.76:0/2821448611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 msgr2=0x564905ba3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905ba3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 -- 172.21.15.76:0/2821448611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 msgr2=0x564905bb0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730bfff640 1 -- 172.21.15.76:0/2821448611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564905aa0d40 con 0x564905ba3980 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.844+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f7310fd6640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f72f40a33b0 0x7f72f40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73040098b0 tx=0x7f7304009d90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f730bfff640 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905badd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00cc60 tx=0x7f72fc00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af72283e219a1d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f72f27fc640 1 -- 172.21.15.76:0/2821448611 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc014070 con 0x564905ba3980 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f72f27fc640 1 -- 172.21.15.76:0/2821448611 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72fc0047a0 con 0x564905ba3980 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f72f27fc640 1 -- 172.21.15.76:0/2821448611 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc010760 con 0x564905ba3980 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f7314e12740 1 -- 172.21.15.76:0/2821448611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 msgr2=0x564905badd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.845+0000 7f7314e12740 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905badd00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00cc60 tx=0x7f72fc00e720 comp rx=0 tx=0).stop 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- 172.21.15.76:0/2821448611 shutdown_connections 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905badd00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 --2- 172.21.15.76:0/2821448611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905ba3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- 172.21.15.76:0/2821448611 >> 172.21.15.76:0/2821448611 conn(0x564905b9f5f0 msgr2=0x564905b9f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- 172.21.15.76:0/2821448611 shutdown_connections 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- 172.21.15.76:0/2821448611 wait complete. 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- start start 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 Processor -- start 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905babb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564905bb0e10 con 0x564905ba3980 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564905a90f10 con 0x564905bae240 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564905bb0f90 con 0x564905ba3060 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f7314e12740 10 client.0 _ll_register_callbacks cb 0x564905ab4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58152/0 (socket says 172.21.15.76:58152) 2024-09-19T07:53:19.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.846+0000 7f730b7fe640 1 -- 172.21.15.76:0/1969967525 learned_addr learned my addr 172.21.15.76:0/1969967525 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730bfff640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f7310fd6640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905babb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730b7fe640 1 -- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 msgr2=0x564905bab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730b7fe640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730b7fe640 1 -- 172.21.15.76:0/1969967525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 msgr2=0x564905babb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730b7fe640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905babb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730b7fe640 1 -- 172.21.15.76:0/1969967525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564905817580 con 0x564905ba3980 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f730b7fe640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bab630 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f73000b8a50 tx=0x7f730008b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae2659f7f755f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f72eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f72eb7fe640 1 -- 172.21.15.76:0/1969967525 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300049040 con 0x564905ba3980 2024-09-19T07:53:19.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f72eb7fe640 1 -- 172.21.15.76:0/1969967525 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f73000edc20 con 0x564905ba3980 2024-09-19T07:53:19.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72fc0047a0 con 0x564905ba3980 2024-09-19T07:53:19.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f72eb7fe640 1 -- 172.21.15.76:0/1969967525 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73000dc040 con 0x564905ba3980 2024-09-19T07:53:19.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f7314e12740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:19.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5649058e1960 con 0x564905ba3980 2024-09-19T07:53:19.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.847+0000 7f72eb7fe640 1 -- 172.21.15.76:0/1969967525 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72fc0047a0 con 0x564905ba3980 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f72eb7fe640 1 -- 172.21.15.76:0/1969967525 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f73000b8c60 con 0x564905ba3980 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f7314e12740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f7314e12740 10 client.15786 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f7314e12740 20 client.15786 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f7314e12740 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905bbdc80 0x564905bc00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f7314e12740 4 client.15786 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564905b15b90 con 0x564905bbdc80 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f730bfff640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905bbdc80 0x564905bc00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f730bfff640 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905bbdc80 0x564905bc00c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576e059692ab0148 server_cookie=49131f0be86b6f06 in_seq=0 out_seq=0 2024-09-19T07:53:19.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.848+0000 7f72eb7fe640 10 client.15786 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f72eb7fe640 1 -- 172.21.15.76:0/1969967525 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564905b15b90 con 0x564905bbdc80 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f72eb7fe640 10 client.15786 handle_command_reply: tid=0 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 client.15786 shutdown 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 msgr2=0x564905bab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bab630 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f73000b8a50 tx=0x7f730008b3a0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 shutdown_connections 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905babb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905bbdc80 0x564905bc00c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bab630 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 --2- 172.21.15.76:0/1969967525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 >> 172.21.15.76:0/1969967525 conn(0x564905b9f5f0 msgr2=0x564905ba52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f72eb7fe640 0 client.15786 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 shutdown_connections 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 1 -- 172.21.15.76:0/1969967525 wait complete. 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.849+0000 7f7314e12740 20 client.15786 trim_cache size 0 max 16384 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 Processor -- start 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 -- start start 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bc59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905bc5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1b24d0 con 0x564905ba3980 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1afda0 con 0x564905bae240 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7314e12740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1adbf0 con 0x564905ba3060 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bc59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bc59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58158/0 (socket says 172.21.15.76:58158) 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 -- 172.21.15.76:0/2377902939 learned_addr learned my addr 172.21.15.76:0/2377902939 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7310fd6640 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905bc5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 -- 172.21.15.76:0/2377902939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 msgr2=0x564905bad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 -- 172.21.15.76:0/2377902939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 msgr2=0x564905bc5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905bc5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f730b7fe640 1 -- 172.21.15.76:0/2377902939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564905baa0a0 con 0x564905ba3980 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.866+0000 7f7310fd6640 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905bc5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:19.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f730b7fe640 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bc59d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f73000c5260 tx=0x7f730002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b4e11ce97e5722 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f72f1ffb640 1 -- 172.21.15.76:0/2377902939 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73000d9070 con 0x564905ba3980 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f72f1ffb640 1 -- 172.21.15.76:0/2377902939 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f730003b600 con 0x564905ba3980 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f72f1ffb640 1 -- 172.21.15.76:0/2377902939 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73000c09a0 con 0x564905ba3980 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 -- 172.21.15.76:0/2377902939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 msgr2=0x564905bc59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bc59d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f73000c5260 tx=0x7f730002a410 comp rx=0 tx=0).stop 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 -- 172.21.15.76:0/2377902939 shutdown_connections 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905bae240 0x564905bc5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905ba3980 0x564905bc59d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 --2- 172.21.15.76:0/2377902939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.867+0000 7f7314e12740 1 -- 172.21.15.76:0/2377902939 >> 172.21.15.76:0/2377902939 conn(0x564905b9f5f0 msgr2=0x564905bac950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 -- 172.21.15.76:0/2377902939 shutdown_connections 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 -- 172.21.15.76:0/2377902939 wait complete. 2024-09-19T07:53:19.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 -- start start 2024-09-19T07:53:19.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 Processor -- start 2024-09-19T07:53:19.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bb28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905bb2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1ae260 con 0x564905bae240 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1af6d0 con 0x564905ba3980 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1ae930 con 0x564905ba3060 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7314e12740 10 client.0 _ll_register_callbacks cb 0x7f7300003eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:19.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.868+0000 7f7310fd6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f730bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bb28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:58160/0 (socket says 172.21.15.76:58160) 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905bb2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 -- 172.21.15.76:0/176897232 learned_addr learned my addr 172.21.15.76:0/176897232 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 -- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 msgr2=0x564905bb28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bb28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 -- 172.21.15.76:0/176897232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 msgr2=0x564905bb2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905bb2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 -- 172.21.15.76:0/176897232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564905ba37b0 con 0x564905bae240 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7310fd6640 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb5ea0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7304010ec0 tx=0x7f7304009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d291f9ed913dd4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f72eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:19.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f72eb7fe640 1 -- 172.21.15.76:0/176897232 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304004b20 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f72eb7fe640 1 -- 172.21.15.76:0/176897232 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7304004cc0 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f730003b600 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f72eb7fe640 1 -- 172.21.15.76:0/176897232 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7304004240 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7314e12740 10 client.15792 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564905c291d0 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.869+0000 7f72eb7fe640 1 -- 172.21.15.76:0/176897232 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f730003b600 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f72eb7fe640 1 -- 172.21.15.76:0/176897232 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7304029030 con 0x564905bae240 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f7314e12740 10 client.15792 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f7314e12740 10 client.15792 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f7314e12740 20 client.15792 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f7314e12740 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905c298f0 0x564905c2bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:19.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f7314e12740 4 client.15792 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6a1022a4", "release": true, "await": true}] 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6a1022a4", "release": true, "await": true}) -- 0x564905b100a0 con 0x564905c298f0 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.870+0000 7f730bfff640 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905c298f0 0x564905c2bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.871+0000 7f72eb7fe640 10 client.15792 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.871+0000 7f730bfff640 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905c298f0 0x564905c2bd10 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f1861f5572f4fca server_cookie=978551ac85574854 in_seq=0 out_seq=0 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.872+0000 7f72eb7fe640 1 -- 172.21.15.76:0/176897232 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564905b100a0 con 0x564905c298f0 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.872+0000 7f72eb7fe640 10 client.15792 handle_command_reply: tid=0 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 client.15792 shutdown 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 msgr2=0x564905bb5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb5ea0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7304010ec0 tx=0x7f7304009600 comp rx=0 tx=0).stop 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 shutdown_connections 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564905c298f0 0x564905c2bd10 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564905bae240 0x564905bb5ea0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564905ba3980 0x564905bb2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 --2- 172.21.15.76:0/176897232 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564905ba3060 0x564905bb28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 >> 172.21.15.76:0/176897232 conn(0x564905b9f5f0 msgr2=0x564905bab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f72eb7fe640 0 client.15792 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 shutdown_connections 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 1 -- 172.21.15.76:0/176897232 wait complete. 2024-09-19T07:53:19.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.873+0000 7f7314e12740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 25, 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 12, 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "6a1022a4": { 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 12, 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:53:19.892 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 140.3, 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:19.893 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:19.894 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:19.894 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:19.894 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:19.894 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f72f40a33b0 msgr2=0x7f72f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f72f40a33b0 0x7f72f40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73040098b0 tx=0x7f7304009d90 comp rx=0 tx=0).stop 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 msgr2=0x7f730c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c074a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7300006010 tx=0x7f73000042f0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 shutdown_connections 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f72f40a33b0 0x7f72f40a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f730c106f10 0x7f730c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f730c102790 0x7f730c074a30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 --2- 172.21.15.76:0/2655208642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f730c101de0 0x7f730c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 >> 172.21.15.76:0/2655208642 conn(0x7f730c0fd8c0 msgr2=0x7f730c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:19.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 shutdown_connections 2024-09-19T07:53:19.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:19.874+0000 7f7312a39640 1 -- 172.21.15.76:0/2655208642 wait complete. 2024-09-19T07:53:20.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:20 smithi137 ceph-mon[35309]: pgmap v68: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 813 KiB/s wr, 8 op/s 2024-09-19T07:53:20.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:20 smithi076 ceph-mon[30930]: pgmap v68: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 813 KiB/s wr, 8 op/s 2024-09-19T07:53:20.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:20 smithi152 ceph-mon[35117]: pgmap v68: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 813 KiB/s wr, 8 op/s 2024-09-19T07:53:20.565 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6a1022a4', total seconds elapsed: 23.4 2024-09-19T07:53:22.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: pgmap v69: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: pgmap v69: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.445 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: pgmap v69: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:23.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:23 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:53:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:23 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:53:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:23 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:23.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:23 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:53:23.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:23 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:53:23.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:23 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:23.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:23 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:53:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:23 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:53:23.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:23 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:53:24.121 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:53:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:24.776 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:24 smithi076 ceph-mon[30930]: pgmap v70: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:53:24.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:24 smithi152 ceph-mon[35117]: pgmap v70: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 -- 172.21.15.76:0/1254781860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c103740 msgr2=0x7fc36c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 --2- 172.21.15.76:0/1254781860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c103740 0x7fc36c107b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc360009cd0 tx=0x7fc36002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 -- 172.21.15.76:0/1254781860 shutdown_connections 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 --2- 172.21.15.76:0/1254781860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 0x7fc36c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 --2- 172.21.15.76:0/1254781860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c103740 0x7fc36c107b80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 --2- 172.21.15.76:0/1254781860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c102d90 0x7fc36c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 -- 172.21.15.76:0/1254781860 >> 172.21.15.76:0/1254781860 conn(0x7fc36c0fc7d0 msgr2=0x7fc36c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 -- 172.21.15.76:0/1254781860 shutdown_connections 2024-09-19T07:53:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.860+0000 7fc371029640 1 -- 172.21.15.76:0/1254781860 wait complete. 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 Processor -- start 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 -- start start 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 0x7fc36c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c103740 0x7fc36c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 0x7fc36c19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1121b0 con 0x7fc36c102d90 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c112030 con 0x7fc36c103740 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc371029640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c112330 con 0x7fc36c108290 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 0x7fc36c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 0x7fc36c198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36368/0 (socket says 172.21.15.76:36368) 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 -- 172.21.15.76:0/2311016986 learned_addr learned my addr 172.21.15.76:0/2311016986 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36b59e640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 0x7fc36c19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36a59c640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c103740 0x7fc36c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 -- 172.21.15.76:0/2311016986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 msgr2=0x7fc36c19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 0x7fc36c19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 -- 172.21.15.76:0/2311016986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c103740 msgr2=0x7fc36c198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c103740 0x7fc36c198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36ad9d640 1 -- 172.21.15.76:0/2311016986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c19d5c0 con 0x7fc36c102d90 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.861+0000 7fc36b59e640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 0x7fc36c19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.862+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 0x7fc36c198610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc36400d950 tx=0x7fc36400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.862+0000 7fc353fff640 1 -- 172.21.15.76:0/2311016986 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364017070 con 0x7fc36c102d90 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.862+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c19d8b0 con 0x7fc36c102d90 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.862+0000 7fc353fff640 1 -- 172.21.15.76:0/2311016986 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc364009c30 con 0x7fc36c102d90 2024-09-19T07:53:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.862+0000 7fc353fff640 1 -- 172.21.15.76:0/2311016986 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36400f740 con 0x7fc36c102d90 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.862+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c1a5190 con 0x7fc36c102d90 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.864+0000 7fc353fff640 1 -- 172.21.15.76:0/2311016986 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc364010a80 con 0x7fc36c102d90 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 Processor -- start 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 -- start start 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdd4a0 0x562742fdd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742fe8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742feaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562742f432e0 con 0x562742fe8680 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562742eeace0 con 0x562742fdddc0 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc373402740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562742f3f2a0 con 0x562742fdd4a0 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc353fff640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3540a33b0 0x7fc3540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc36a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742feaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc36a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742feaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36382/0 (socket says 172.21.15.76:36382) 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc36a59c640 1 -- 172.21.15.76:0/1049808417 learned_addr learned my addr 172.21.15.76:0/1049808417 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc36b59e640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3540a33b0 0x7fc3540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc353fff640 1 -- 172.21.15.76:0/2311016986 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fc3640cfae0 con 0x7fc36c102d90 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742fe8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.865+0000 7fc36b59e640 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdd4a0 0x562742fdd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36a59c640 1 -- 172.21.15.76:0/1049808417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdd4a0 msgr2=0x562742fdd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36a59c640 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdd4a0 0x562742fdd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36a59c640 1 -- 172.21.15.76:0/1049808417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 msgr2=0x562742fe8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36a59c640 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742fe8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36a59c640 1 -- 172.21.15.76:0/1049808417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562742ecf440 con 0x562742fe8680 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36b59e640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3540a33b0 0x7fc3540a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00de50 tx=0x7fc35c014840 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc36a59c640 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742feaa70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc360004ae0 tx=0x7fc360005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4486a99abb60a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc3517fa640 1 -- 172.21.15.76:0/1049808417 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360031770 con 0x562742fe8680 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc3517fa640 1 -- 172.21.15.76:0/1049808417 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc360036040 con 0x562742fe8680 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.866+0000 7fc3517fa640 1 -- 172.21.15.76:0/1049808417 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360004370 con 0x562742fe8680 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 -- 172.21.15.76:0/1049808417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 msgr2=0x562742feaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742feaa70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc360004ae0 tx=0x7fc360005ef0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 -- 172.21.15.76:0/1049808417 shutdown_connections 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742feaa70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742fe8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- 172.21.15.76:0/1049808417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdd4a0 0x562742fdd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 -- 172.21.15.76:0/1049808417 >> 172.21.15.76:0/1049808417 conn(0x562742fd9a30 msgr2=0x562742fd9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 -- 172.21.15.76:0/1049808417 shutdown_connections 2024-09-19T07:53:24.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 -- 172.21.15.76:0/1049808417 wait complete. 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 -- start start 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 Processor -- start 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fe7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562742fe5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.867+0000 7fc373402740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742fe5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc373402740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562742feb250 con 0x562742fe8680 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc373402740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562742efe050 con 0x562742fdd4a0 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc373402740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562742feb3d0 con 0x562742fdddc0 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc373402740 10 client.0 _ll_register_callbacks cb 0x562742f3e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742fe5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742fe5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36398/0 (socket says 172.21.15.76:36398) 2024-09-19T07:53:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 -- 172.21.15.76:0/3038125600 learned_addr learned my addr 172.21.15.76:0/3038125600 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fe7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36a59c640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562742fe5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 -- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 msgr2=0x562742fe5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562742fe5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 -- 172.21.15.76:0/3038125600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 msgr2=0x562742fe7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fe7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 -- 172.21.15.76:0/3038125600 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562742cb43c0 con 0x562742fe8680 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc36b59e640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742fe5760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc35c011470 tx=0x7fc35c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e5dd5d5cba9acf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc34eff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc34eff5640 1 -- 172.21.15.76:0/3038125600 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c005220 con 0x562742fe8680 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc34eff5640 1 -- 172.21.15.76:0/3038125600 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fc35c0053c0 con 0x562742fe8680 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.868+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc360036040 con 0x562742fe8680 2024-09-19T07:53:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc34eff5640 1 -- 172.21.15.76:0/3038125600 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc35c0055c0 con 0x562742fe8680 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562742fff430 con 0x562742fe8680 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc34eff5640 1 -- 172.21.15.76:0/3038125600 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc360036040 con 0x562742fe8680 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc34eff5640 1 -- 172.21.15.76:0/3038125600 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc35c01d070 con 0x562742fe8680 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 20 client.15804 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5627430008f0 0x562743002d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 4 client.15804 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562742f50850 con 0x5627430008f0 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.869+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5627430008f0 0x562743002d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.870+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5627430008f0 0x562743002d60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820c6b0ef261aea1 server_cookie=3281f9089c020d10 in_seq=0 out_seq=0 2024-09-19T07:53:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.870+0000 7fc34eff5640 10 client.15804 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc34eff5640 1 -- 172.21.15.76:0/3038125600 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562742f50850 con 0x5627430008f0 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc34eff5640 10 client.15804 handle_command_reply: tid=0 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 client.15804 shutdown 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 msgr2=0x562742fe5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742fe5760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc35c011470 tx=0x7fc35c016040 comp rx=0 tx=0).stop 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 shutdown_connections 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5627430008f0 0x562743002d60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562742fe5760 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562742fe5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc34eff5640 0 client.15804 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 --2- 172.21.15.76:0/3038125600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fe7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 >> 172.21.15.76:0/3038125600 conn(0x562742fd9a30 msgr2=0x562742fdf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 shutdown_connections 2024-09-19T07:53:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 1 -- 172.21.15.76:0/3038125600 wait complete. 2024-09-19T07:53:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.871+0000 7fc373402740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 Processor -- start 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 -- start start 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562743008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562743008bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1ae210 con 0x562742fe8680 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1abae0 con 0x562742fdd4a0 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc373402740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1a9930 con 0x562742fdddc0 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562743008bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562743008bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36400/0 (socket says 172.21.15.76:36400) 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 -- 172.21.15.76:0/1219215350 learned_addr learned my addr 172.21.15.76:0/1219215350 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 -- 172.21.15.76:0/1219215350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 msgr2=0x562743008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562743008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 -- 172.21.15.76:0/1219215350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 msgr2=0x562742fede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36b59e640 1 -- 172.21.15.76:0/1219215350 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627430033e0 con 0x562742fe8680 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.888+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc36b59e640 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562743008bc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc35c012c50 tx=0x7fc35c015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6508fc494db3f7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc350ff9640 1 -- 172.21.15.76:0/1219215350 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c03b070 con 0x562742fe8680 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc350ff9640 1 -- 172.21.15.76:0/1219215350 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc35c011c40 con 0x562742fe8680 2024-09-19T07:53:24.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc350ff9640 1 -- 172.21.15.76:0/1219215350 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c032070 con 0x562742fe8680 2024-09-19T07:53:24.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 -- 172.21.15.76:0/1219215350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 msgr2=0x562743008bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562743008bc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc35c012c50 tx=0x7fc35c015f20 comp rx=0 tx=0).stop 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 -- 172.21.15.76:0/1219215350 shutdown_connections 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fe8680 0x562743008bc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fdddc0 0x562743008680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 --2- 172.21.15.76:0/1219215350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdd4a0 0x562742fede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.889+0000 7fc373402740 1 -- 172.21.15.76:0/1219215350 >> 172.21.15.76:0/1219215350 conn(0x562742fd9a30 msgr2=0x562742fe7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 -- 172.21.15.76:0/1219215350 shutdown_connections 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 -- 172.21.15.76:0/1219215350 wait complete. 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 -- start start 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 Processor -- start 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 0x562742ffb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742ffb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fe8680 0x562742ffbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1a9fa0 con 0x562742fdd4a0 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1ab410 con 0x562742fdddc0 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1aa670 con 0x562742fe8680 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc373402740 10 client.0 _ll_register_callbacks cb 0x7fc35c005f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc36ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 0x562742ffb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc36ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 0x562742ffb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36404/0 (socket says 172.21.15.76:36404) 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc36ad9d640 1 -- 172.21.15.76:0/1730500274 learned_addr learned my addr 172.21.15.76:0/1730500274 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.890+0000 7fc36b59e640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fe8680 0x562742ffbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36a59c640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742ffb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36ad9d640 1 -- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fe8680 msgr2=0x562742ffbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fe8680 0x562742ffbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36ad9d640 1 -- 172.21.15.76:0/1730500274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 msgr2=0x562742ffb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742ffb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36ad9d640 1 -- 172.21.15.76:0/1730500274 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274306a6b0 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc36ad9d640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 0x562742ffb260 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc364098160 tx=0x7fc364010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e378ea2420c7d5df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc34eff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc34eff5640 1 -- 172.21.15.76:0/1730500274 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364020040 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc34eff5640 1 -- 172.21.15.76:0/1730500274 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fc3640cd3f0 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc35c011c40 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc34eff5640 1 -- 172.21.15.76:0/1730500274 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc3640cd5f0 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc373402740 10 client.15810 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56274306b970 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc34eff5640 1 -- 172.21.15.76:0/1730500274 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc35c011c40 con 0x562742fdd4a0 2024-09-19T07:53:24.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.891+0000 7fc34eff5640 1 -- 172.21.15.76:0/1730500274 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc36409abc0 con 0x562742fdd4a0 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 10 client.15810 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 20 client.15810 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56274306c0c0 0x56274306e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 4 client.15810 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562742f4ad60 con 0x56274306c0c0 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc36a59c640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56274306c0c0 0x56274306e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc34eff5640 10 client.15810 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc36a59c640 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56274306c0c0 0x56274306e4e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6084cdcdde3878 server_cookie=1f72efda67f68692 in_seq=0 out_seq=0 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc34eff5640 1 -- 172.21.15.76:0/1730500274 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562742f4ad60 con 0x56274306c0c0 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc34eff5640 10 client.15810 handle_command_reply: tid=0 2024-09-19T07:53:24.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.892+0000 7fc373402740 1 client.15810 shutdown 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 msgr2=0x562742ffb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 0x562742ffb260 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc364098160 tx=0x7fc364010e20 comp rx=0 tx=0).stop 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 shutdown_connections 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562742fe8680 0x562742ffbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562742fdddc0 0x562742ffb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56274306c0c0 0x56274306e4e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 --2- 172.21.15.76:0/1730500274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562742fdd4a0 0x562742ffb260 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 >> 172.21.15.76:0/1730500274 conn(0x562742fd9a30 msgr2=0x562742fd8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc34eff5640 0 client.15810 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 shutdown_connections 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 1 -- 172.21.15.76:0/1730500274 wait complete. 2024-09-19T07:53:24.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc373402740 20 client.15810 trim_cache size 0 max 16384 2024-09-19T07:53:24.902 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:53:24.902 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:53:24.902 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:53:24.902 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3540a33b0 msgr2=0x7fc3540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc371029640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3540a33b0 0x7fc3540a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00de50 tx=0x7fc35c014840 comp rx=0 tx=0).stop 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 msgr2=0x7fc36c198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.893+0000 7fc371029640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 0x7fc36c198610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc36400d950 tx=0x7fc36400de10 comp rx=0 tx=0).stop 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 shutdown_connections 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3540a33b0 0x7fc3540a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc36c108290 0x7fc36c19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc36c103740 0x7fc36c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 --2- 172.21.15.76:0/2311016986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc36c102d90 0x7fc36c198610 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:24.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 >> 172.21.15.76:0/2311016986 conn(0x7fc36c0fc7d0 msgr2=0x7fc36c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:24.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 shutdown_connections 2024-09-19T07:53:24.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:24.894+0000 7fc371029640 1 -- 172.21.15.76:0/2311016986 wait complete. 2024-09-19T07:53:24.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:24 smithi137 ceph-mon[35309]: pgmap v70: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T07:53:25.652 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:53:25.652 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:53:25.902 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 -- 172.21.15.76:0/3296251255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c1027a0 msgr2=0x7fcf4c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 --2- 172.21.15.76:0/3296251255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c1067f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009900 tx=0x7fcf4002a410 comp rx=0 tx=0).stop 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 -- 172.21.15.76:0/3296251255 shutdown_connections 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 --2- 172.21.15.76:0/3296251255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c106f20 0x7fcf4c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 --2- 172.21.15.76:0/3296251255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c1067f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 --2- 172.21.15.76:0/3296251255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf4c101df0 0x7fcf4c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 -- 172.21.15.76:0/3296251255 >> 172.21.15.76:0/3296251255 conn(0x7fcf4c0fd8b0 msgr2=0x7fcf4c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 -- 172.21.15.76:0/3296251255 shutdown_connections 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.341+0000 7fcf51b24640 1 -- 172.21.15.76:0/3296251255 wait complete. 2024-09-19T07:53:26.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 Processor -- start 2024-09-19T07:53:26.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 -- start start 2024-09-19T07:53:26.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 0x7fcf4c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:26.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:26.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf4c106f20 0x7fcf4c19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c112160 con 0x7fcf4c101df0 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c111fe0 con 0x7fcf4c106f20 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf51b24640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c1122e0 con 0x7fcf4c1027a0 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf4b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 0x7fcf4c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf4b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 0x7fcf4c198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36426/0 (socket says 172.21.15.76:36426) 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf4b7fe640 1 -- 172.21.15.76:0/2798690167 learned_addr learned my addr 172.21.15.76:0/2798690167 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.342+0000 7fcf4affd640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4bfff640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf4c106f20 0x7fcf4c19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4b7fe640 1 -- 172.21.15.76:0/2798690167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c1027a0 msgr2=0x7fcf4c198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4b7fe640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4b7fe640 1 -- 172.21.15.76:0/2798690167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf4c106f20 msgr2=0x7fcf4c19bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:26.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4b7fe640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf4c106f20 0x7fcf4c19bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4b7fe640 1 -- 172.21.15.76:0/2798690167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c19c6b0 con 0x7fcf4c101df0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4affd640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf4b7fe640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 0x7fcf4c198760 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b4a0 tx=0x7fcf3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c014070 con 0x7fcf4c101df0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c19c9a0 con 0x7fcf4c101df0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcf3c010b10 con 0x7fcf4c101df0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c017d60 con 0x7fcf4c101df0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.343+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c1a5310 con 0x7fcf4c101df0 2024-09-19T07:53:26.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.344+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4c102250 con 0x7fcf4c101df0 2024-09-19T07:53:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.345+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcf3c017070 con 0x7fcf4c101df0 2024-09-19T07:53:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.346+0000 7fcf48ff9640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcf340a33b0 0x7fcf340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.346+0000 7fcf4affd640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcf340a33b0 0x7fcf340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.346+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fcf3c0cf0c0 con 0x7fcf4c101df0 2024-09-19T07:53:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.346+0000 7fcf4affd640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcf340a33b0 0x7fcf340a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c199da0 tx=0x7fcf40005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:26.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.350+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf3c09bb50 con 0x7fcf4c101df0 2024-09-19T07:53:26.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.554+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf4c10a100 con 0x7fcf4c101df0 2024-09-19T07:53:26.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.555+0000 7fcf48ff9640 1 -- 172.21.15.76:0/2798690167 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7fcf3c09b450 con 0x7fcf4c101df0 2024-09-19T07:53:26.556 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:53:26.556 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:53:26.556 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcf340a33b0 msgr2=0x7fcf340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcf340a33b0 0x7fcf340a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c199da0 tx=0x7fcf40005a20 comp rx=0 tx=0).stop 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 msgr2=0x7fcf4c198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 0x7fcf4c198760 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b4a0 tx=0x7fcf3c00b960 comp rx=0 tx=0).stop 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 shutdown_connections 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fcf340a33b0 0x7fcf340a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf4c106f20 0x7fcf4c19bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf4c1027a0 0x7fcf4c198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 --2- 172.21.15.76:0/2798690167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcf4c101df0 0x7fcf4c198760 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 >> 172.21.15.76:0/2798690167 conn(0x7fcf4c0fd8b0 msgr2=0x7fcf4c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 shutdown_connections 2024-09-19T07:53:26.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:26.557+0000 7fcf51b24640 1 -- 172.21.15.76:0/2798690167 wait complete. 2024-09-19T07:53:26.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:26 smithi076 ceph-mon[30930]: pgmap v71: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-19T07:53:26.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:26 smithi152 ceph-mon[35117]: pgmap v71: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-19T07:53:26.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:26 smithi137 ceph-mon[35309]: pgmap v71: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-19T07:53:27.211 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:53:27.461 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:27.723 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:27 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2798690167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:27.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:27 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2798690167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:27.905 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:27 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2798690167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:27.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.936+0000 7f41b7a87640 1 -- 172.21.15.76:0/467451168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0101df0 msgr2=0x7f41b01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.936+0000 7f41b7a87640 1 --2- 172.21.15.76:0/467451168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0101df0 0x7f41b01021d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009ca0 tx=0x7f41a002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- 172.21.15.76:0/467451168 shutdown_connections 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 --2- 172.21.15.76:0/467451168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41b0106f20 0x7f41b010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 --2- 172.21.15.76:0/467451168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b01027a0 0x7f41b01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 --2- 172.21.15.76:0/467451168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0101df0 0x7f41b01021d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- 172.21.15.76:0/467451168 >> 172.21.15.76:0/467451168 conn(0x7f41b00fd8f0 msgr2=0x7f41b00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:27.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- 172.21.15.76:0/467451168 shutdown_connections 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- 172.21.15.76:0/467451168 wait complete. 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 Processor -- start 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- start start 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41b0101df0 0x7f41b01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b01027a0 0x7f41b0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 0x7f41b019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01120e0 con 0x7f41b0106f20 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0111f60 con 0x7f41b0101df0 2024-09-19T07:53:27.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.937+0000 7f41b7a87640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0112260 con 0x7f41b01027a0 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 0x7f41b019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 0x7f41b019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36446/0 (socket says 172.21.15.76:36446) 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 -- 172.21.15.76:0/1254593064 learned_addr learned my addr 172.21.15.76:0/1254593064 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b5823640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41b0101df0 0x7f41b01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b5022640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b01027a0 0x7f41b0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 -- 172.21.15.76:0/1254593064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b01027a0 msgr2=0x7f41b0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b01027a0 0x7f41b0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 -- 172.21.15.76:0/1254593064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41b0101df0 msgr2=0x7f41b01985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41b0101df0 0x7f41b01985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 -- 172.21.15.76:0/1254593064 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b019d5a0 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b6024640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 0x7f41b019cec0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c970 tx=0x7f41a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41aeffd640 1 -- 172.21.15.76:0/1254593064 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a8007bb0 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41aeffd640 1 -- 172.21.15.76:0/1254593064 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41a8007d50 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41aeffd640 1 -- 172.21.15.76:0/1254593064 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a800f450 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b019d890 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.938+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b01a5170 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.941+0000 7f41aeffd640 1 -- 172.21.15.76:0/1254593064 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f41a8005020 con 0x7f41b0106f20 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.941+0000 7f41b9e60740 1 Processor -- start 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.941+0000 7f41b9e60740 1 -- start start 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a01090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a01a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a0e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b9e60740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e6d59672f0 con 0x55e6d5a0c370 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b9e60740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e6d590ecf0 con 0x55e6d5a015d0 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b9e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e6d59632b0 con 0x55e6d5a02b40 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a0e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a0e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36450/0 (socket says 172.21.15.76:36450) 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 -- 172.21.15.76:0/3402881418 learned_addr learned my addr 172.21.15.76:0/3402881418 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5823640 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a01a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41aeffd640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41980a3430 0x7f41980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a01090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 -- 172.21.15.76:0/3402881418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 msgr2=0x55e6d5a01090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b6024640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41980a3430 0x7f41980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a01090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 -- 172.21.15.76:0/3402881418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 msgr2=0x55e6d5a01a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a01a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 -- 172.21.15.76:0/3402881418 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d58f33a0 con 0x55e6d5a0c370 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41aeffd640 1 -- 172.21.15.76:0/1254593064 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f41a80cf9f0 con 0x7f41b0106f20 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.942+0000 7f41b5022640 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a0e760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009e70 tx=0x7f41a4009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb64f960b7027e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f4197fff640 1 -- 172.21.15.76:0/3402881418 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a401c070 con 0x55e6d5a0c370 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f4197fff640 1 -- 172.21.15.76:0/3402881418 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41a4010040 con 0x55e6d5a0c370 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f4197fff640 1 -- 172.21.15.76:0/3402881418 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4016720 con 0x55e6d5a0c370 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 -- 172.21.15.76:0/3402881418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 msgr2=0x55e6d5a0e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b6024640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41980a3430 0x7f41980a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41a809b970 tx=0x7f41a8066660 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a0e760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009e70 tx=0x7f41a4009420 comp rx=0 tx=0).stop 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 -- 172.21.15.76:0/3402881418 shutdown_connections 2024-09-19T07:53:27.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a0e760 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a01a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3402881418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a01090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.943+0000 7f41b9e60740 1 -- 172.21.15.76:0/3402881418 >> 172.21.15.76:0/3402881418 conn(0x55e6d59ca310 msgr2=0x55e6d59fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 -- 172.21.15.76:0/3402881418 shutdown_connections 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 -- 172.21.15.76:0/3402881418 wait complete. 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 -- start start 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 Processor -- start 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d5a0bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a09070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a09800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e6d5a0f070 con 0x55e6d5a02b40 2024-09-19T07:53:27.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e6d5922060 con 0x55e6d5a0c370 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e6d5a0f1f0 con 0x55e6d5a015d0 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b9e60740 10 client.0 _ll_register_callbacks cb 0x55e6d56758c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b5823640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a09070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.944+0000 7f41b5823640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a09070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36464/0 (socket says 172.21.15.76:36464) 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 -- 172.21.15.76:0/2517103544 learned_addr learned my addr 172.21.15.76:0/2517103544 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5022640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a09800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5022640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d5a0bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 -- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 msgr2=0x55e6d5a0bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d5a0bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 -- 172.21.15.76:0/2517103544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 msgr2=0x55e6d5a09800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a09800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 -- 172.21.15.76:0/2517103544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d56d83c0 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b5823640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a09070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009ca0 tx=0x7f41a0031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d0154397096bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41957fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41957fa640 1 -- 172.21.15.76:0/2517103544 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a002f810 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41957fa640 1 -- 172.21.15.76:0/2517103544 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f41a002f9b0 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41a4010040 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41957fa640 1 -- 172.21.15.76:0/2517103544 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f41a0053050 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b9e60740 10 client.15828 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.945+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6d5a1ab80 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41957fa640 1 -- 172.21.15.76:0/2517103544 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41a4010040 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41957fa640 1 -- 172.21.15.76:0/2517103544 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f41a004e030 con 0x55e6d5a02b40 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b9e60740 10 client.15828 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b9e60740 10 client.15828 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b9e60740 20 client.15828 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:27.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b9e60740 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a1c0e0 0x55e6d5a1e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b9e60740 4 client.15828 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:27.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6d5974860 con 0x55e6d5a1c0e0 2024-09-19T07:53:27.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.946+0000 7f41b5022640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a1c0e0 0x55e6d5a1e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.947+0000 7f41957fa640 10 client.15828 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:27.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.947+0000 7f41b5022640 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a1c0e0 0x55e6d5a1e500 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4da3658d0e33d7fe server_cookie=b2b5cdb1b0d20e4f in_seq=0 out_seq=0 2024-09-19T07:53:27.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41957fa640 1 -- 172.21.15.76:0/2517103544 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6d5974860 con 0x55e6d5a1c0e0 2024-09-19T07:53:27.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41957fa640 10 client.15828 handle_command_reply: tid=0 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 client.15828 shutdown 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 msgr2=0x55e6d5a09070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a09070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009ca0 tx=0x7f41a0031680 comp rx=0 tx=0).stop 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 shutdown_connections 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a1c0e0 0x55e6d5a1e500 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a09800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a09070 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 --2- 172.21.15.76:0/2517103544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d5a0bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41957fa640 0 client.15828 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 >> 172.21.15.76:0/2517103544 conn(0x55e6d59ca310 msgr2=0x55e6d5a03960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 shutdown_connections 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 1 -- 172.21.15.76:0/2517103544 wait complete. 2024-09-19T07:53:27.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.948+0000 7f41b9e60740 20 client.15828 trim_cache size 0 max 16384 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 Processor -- start 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 -- start start 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d59fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a23db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01b0560 con 0x55e6d5a02b40 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01ade30 con 0x55e6d5a0c370 2024-09-19T07:53:27.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b9e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01abc80 con 0x55e6d5a015d0 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b5823640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a08050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b5823640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a08050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36474/0 (socket says 172.21.15.76:36474) 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.961+0000 7f41b5823640 1 -- 172.21.15.76:0/3927206570 learned_addr learned my addr 172.21.15.76:0/3927206570 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5022640 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a23db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5022640 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d59fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5823640 1 -- 172.21.15.76:0/3927206570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 msgr2=0x55e6d59fdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5823640 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d59fdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5823640 1 -- 172.21.15.76:0/3927206570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 msgr2=0x55e6d5a23db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5823640 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a23db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5823640 1 -- 172.21.15.76:0/3927206570 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d59fd510 con 0x55e6d5a02b40 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41b5823640 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a08050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f41a002ade0 tx=0x7f41a002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d505c9e489ffb48c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:27.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41977fe640 1 -- 172.21.15.76:0/3927206570 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0009540 con 0x55e6d5a02b40 2024-09-19T07:53:27.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41977fe640 1 -- 172.21.15.76:0/3927206570 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41a0036040 con 0x55e6d5a02b40 2024-09-19T07:53:27.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.962+0000 7f41977fe640 1 -- 172.21.15.76:0/3927206570 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0030a40 con 0x55e6d5a02b40 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 -- 172.21.15.76:0/3927206570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 msgr2=0x55e6d5a08050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a08050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f41a002ade0 tx=0x7f41a002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 -- 172.21.15.76:0/3927206570 shutdown_connections 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a0c370 0x55e6d5a23db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a02b40 0x55e6d5a08050 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 --2- 172.21.15.76:0/3927206570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a015d0 0x55e6d59fdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 -- 172.21.15.76:0/3927206570 >> 172.21.15.76:0/3927206570 conn(0x55e6d59ca310 msgr2=0x55e6d5a07940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:27.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 -- 172.21.15.76:0/3927206570 shutdown_connections 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 -- 172.21.15.76:0/3927206570 wait complete. 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 -- start start 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.963+0000 7f41b9e60740 1 Processor -- start 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a14d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a05f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a06640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01ac2f0 con 0x55e6d5a0c370 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01ad760 con 0x55e6d5a015d0 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41b01ac9c0 con 0x55e6d5a02b40 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b9e60740 10 client.0 _ll_register_callbacks cb 0x7f41a00099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a06640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a06640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36478/0 (socket says 172.21.15.76:36478) 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 -- 172.21.15.76:0/1254210864 learned_addr learned my addr 172.21.15.76:0/1254210864 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a14d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5823640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a05f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 -- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 msgr2=0x55e6d5a05f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a05f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 -- 172.21.15.76:0/1254210864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 msgr2=0x55e6d5a14d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a14d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 -- 172.21.15.76:0/1254210864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d5a85d80 con 0x55e6d5a0c370 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5823640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a05f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41b5022640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a06640 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f41a400a010 tx=0x7f41a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e000ea333834cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:27.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41957fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.964+0000 7f41957fa640 1 -- 172.21.15.76:0/1254210864 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a401c040 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41a0036040 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41957fa640 1 -- 172.21.15.76:0/1254210864 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f41a4017820 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41957fa640 1 -- 172.21.15.76:0/1254210864 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f41a4017a20 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 10 client.15834 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6d5a86ec0 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41957fa640 1 -- 172.21.15.76:0/1254210864 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41a0036040 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41957fa640 1 -- 172.21.15.76:0/1254210864 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f41a403f410 con 0x55e6d5a0c370 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 10 client.15834 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 10 client.15834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 20 client.15834 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a871a0 0x55e6d5a89590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:27.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 4 client.15834 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6d596ed70 con 0x55e6d5a871a0 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.965+0000 7f41b5823640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a871a0 0x55e6d5a89590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b5823640 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a871a0 0x55e6d5a89590 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c718e4994a4c749 server_cookie=46189c5fdb23609a in_seq=0 out_seq=0 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41957fa640 10 client.15834 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41957fa640 1 -- 172.21.15.76:0/1254210864 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6d596ed70 con 0x55e6d5a871a0 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41957fa640 10 client.15834 handle_command_reply: tid=0 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 client.15834 shutdown 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 msgr2=0x55e6d5a06640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a06640 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f41a400a010 tx=0x7f41a4008040 comp rx=0 tx=0).stop 2024-09-19T07:53:27.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 shutdown_connections 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55e6d5a871a0 0x55e6d5a89590 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6d5a0c370 0x55e6d5a06640 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6d5a02b40 0x55e6d5a05f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41957fa640 0 client.15834 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 --2- 172.21.15.76:0/1254210864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6d5a015d0 0x55e6d5a14d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 >> 172.21.15.76:0/1254210864 conn(0x55e6d59ca310 msgr2=0x55e6d5a03110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 shutdown_connections 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.966+0000 7f41b9e60740 1 -- 172.21.15.76:0/1254210864 wait complete. 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b9e60740 20 client.15834 trim_cache size 0 max 16384 2024-09-19T07:53:27.973 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:53:27.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41980a3430 msgr2=0x7f41980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41980a3430 0x7f41980a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41a809b970 tx=0x7f41a8066660 comp rx=0 tx=0).stop 2024-09-19T07:53:27.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 msgr2=0x7f41b019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:27.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 0x7f41b019cec0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c970 tx=0x7f41a800ce30 comp rx=0 tx=0).stop 2024-09-19T07:53:27.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 shutdown_connections 2024-09-19T07:53:27.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41980a3430 0x7f41980a58f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f41b0106f20 0x7f41b019cec0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b01027a0 0x7f41b0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 --2- 172.21.15.76:0/1254593064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41b0101df0 0x7f41b01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:27.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 >> 172.21.15.76:0/1254593064 conn(0x7f41b00fd8f0 msgr2=0x7f41b00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:27.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 shutdown_connections 2024-09-19T07:53:27.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:27.967+0000 7f41b7a87640 1 -- 172.21.15.76:0/1254593064 wait complete. 2024-09-19T07:53:28.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:28 smithi076 ceph-mon[30930]: pgmap v72: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T07:53:28.655 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:53:28.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:28 smithi152 ceph-mon[35117]: pgmap v72: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T07:53:28.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:28 smithi137 ceph-mon[35309]: pgmap v72: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T07:53:28.904 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 -- 172.21.15.76:0/842279243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38102790 msgr2=0x7f2f381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/842279243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38102790 0x7f2f381067e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009900 tx=0x7f2f2002a410 comp rx=0 tx=0).stop 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 -- 172.21.15.76:0/842279243 shutdown_connections 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/842279243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f38106f10 0x7f2f3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/842279243 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38102790 0x7f2f381067e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/842279243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f38101de0 0x7f2f381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 -- 172.21.15.76:0/842279243 >> 172.21.15.76:0/842279243 conn(0x7f2f380fd8c0 msgr2=0x7f2f380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 -- 172.21.15.76:0/842279243 shutdown_connections 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.388+0000 7f2f3ca63640 1 -- 172.21.15.76:0/842279243 wait complete. 2024-09-19T07:53:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.389+0000 7f2f3ca63640 1 Processor -- start 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.389+0000 7f2f3ca63640 1 -- start start 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.389+0000 7f2f3ca63640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f38101de0 0x7f2f38198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.389+0000 7f2f3ca63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f38102790 0x7f2f381989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.389+0000 7f2f3ca63640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 0x7f2f3819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f3ca63640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38112090 con 0x7f2f38106f10 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f3ca63640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38111f10 con 0x7f2f38102790 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f3ca63640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38112210 con 0x7f2f38101de0 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 0x7f2f3819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 0x7f2f3819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36504/0 (socket says 172.21.15.76:36504) 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 -- 172.21.15.76:0/968781096 learned_addr learned my addr 172.21.15.76:0/968781096 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f38102790 0x7f2f381989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f3659c640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f38101de0 0x7f2f38198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 -- 172.21.15.76:0/968781096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f38101de0 msgr2=0x7f2f38198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f38101de0 0x7f2f38198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 -- 172.21.15.76:0/968781096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f38102790 msgr2=0x7f2f381989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f38102790 0x7f2f381989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 -- 172.21.15.76:0/968781096 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3819d420 con 0x7f2f38106f10 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 0x7f2f3819cd40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000cce0 tx=0x7f2f3000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f2ffff640 1 -- 172.21.15.76:0/968781096 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000f450 con 0x7f2f38106f10 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3819d710 con 0x7f2f38106f10 2024-09-19T07:53:29.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f2ffff640 1 -- 172.21.15.76:0/968781096 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f3000faf0 con 0x7f2f38106f10 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f2ffff640 1 -- 172.21.15.76:0/968781096 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30018cc0 con 0x7f2f38106f10 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.390+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f381a4ff0 con 0x7f2f38106f10 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.393+0000 7f2f3ee3c740 1 Processor -- start 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.393+0000 7f2f2ffff640 1 -- 172.21.15.76:0/968781096 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2f300213f0 con 0x7f2f38106f10 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 -- start start 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b35d0 0x5606507b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 0x5606507c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5606507192f0 con 0x5606507b4b40 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5606506c0cf0 con 0x5606507be370 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5606507152b0 con 0x5606507b35d0 2024-09-19T07:53:29.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36506/0 (socket says 172.21.15.76:36506) 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/2983377987 learned_addr learned my addr 172.21.15.76:0/2983377987 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f3659c640 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b35d0 0x5606507b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/2983377987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b35d0 msgr2=0x5606507b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b35d0 0x5606507b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/2983377987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 msgr2=0x5606507c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 0x5606507c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/2983377987 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606506a53a0 con 0x5606507b4b40 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.394+0000 7f2f2ffff640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2f240a33b0 0x7f2f240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507b3090 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2f2002a930 tx=0x7f2f200317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd7034bbad9cad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f3659c640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2f240a33b0 0x7f2f240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f2ffff640 1 -- 172.21.15.76:0/968781096 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2f300d0150 con 0x7f2f38106f10 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f2cd99640 1 -- 172.21.15.76:0/2983377987 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20040070 con 0x5606507b4b40 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f2cd99640 1 -- 172.21.15.76:0/2983377987 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f20031a70 con 0x5606507b4b40 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f2cd99640 1 -- 172.21.15.76:0/2983377987 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20035040 con 0x5606507b4b40 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/2983377987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 msgr2=0x5606507b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507b3090 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2f2002a930 tx=0x7f2f200317c0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.395+0000 7f2f3659c640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2f240a33b0 0x7f2f240a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005fd0 tx=0x7f2f28005f20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/2983377987 shutdown_connections 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 0x5606507c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b35d0 0x5606507b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/2983377987 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507b3090 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/2983377987 >> 172.21.15.76:0/2983377987 conn(0x56065077c310 msgr2=0x5606507afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/2983377987 shutdown_connections 2024-09-19T07:53:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/2983377987 wait complete. 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- start start 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 Processor -- start 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 0x5606507bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 0x5606507bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5606507c1010 con 0x5606507b35d0 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5606506d4060 con 0x5606507be370 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5606507c1190 con 0x5606507b4b40 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 0x5606507bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3ee3c740 10 client.0 _ll_register_callbacks cb 0x5606504278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 0x5606507bdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36510/0 (socket says 172.21.15.76:36510) 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.396+0000 7f2f3659c640 1 -- 172.21.15.76:0/63223604 learned_addr learned my addr 172.21.15.76:0/63223604 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3659c640 1 -- 172.21.15.76:0/63223604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 msgr2=0x5606507bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3659c640 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507bafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3659c640 1 -- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 msgr2=0x5606507bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3659c640 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 0x5606507bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3659c640 1 -- 172.21.15.76:0/63223604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56065048a3c0 con 0x5606507b35d0 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3659c640 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 0x5606507bdd30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2f28011b10 tx=0x7f2f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9058c7ab2b82e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f1dffb640 1 -- 172.21.15.76:0/63223604 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800ee20 con 0x5606507b35d0 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f20031a70 con 0x5606507b35d0 2024-09-19T07:53:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f1dffb640 1 -- 172.21.15.76:0/63223604 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2f2801e420 con 0x5606507b35d0 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f1dffb640 1 -- 172.21.15.76:0/63223604 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f2801e620 con 0x5606507b35d0 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3ee3c740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606507ccad0 con 0x5606507b35d0 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.397+0000 7f2f1dffb640 1 -- 172.21.15.76:0/63223604 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f20031a70 con 0x5606507b35d0 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f1dffb640 1 -- 172.21.15.76:0/63223604 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2f2802ea10 con 0x5606507b35d0 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f3ee3c740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f3ee3c740 10 client.15846 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f3ee3c740 20 client.15846 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5606507cdf90 0x5606507d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f3ee3c740 4 client.15846 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560650726860 con 0x5606507cdf90 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5606507cdf90 0x5606507d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f1dffb640 10 client.15846 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.398+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5606507cdf90 0x5606507d0420 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=414f8179903de336 server_cookie=b0d74b9649ec9f97 in_seq=0 out_seq=0 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f1dffb640 1 -- 172.21.15.76:0/63223604 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560650726860 con 0x5606507cdf90 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f1dffb640 10 client.15846 handle_command_reply: tid=0 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 client.15846 shutdown 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 msgr2=0x5606507bdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 0x5606507bdd30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2f28011b10 tx=0x7f2f280046c0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 shutdown_connections 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5606507cdf90 0x5606507d0420 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507be370 0x5606507bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f1dffb640 0 client.15846 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/63223604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b35d0 0x5606507bdd30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 >> 172.21.15.76:0/63223604 conn(0x56065077c310 msgr2=0x5606507b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 shutdown_connections 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.399+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/63223604 wait complete. 2024-09-19T07:53:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.400+0000 7f2f3ee3c740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.412+0000 7f2f3ee3c740 1 Processor -- start 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.412+0000 7f2f3ee3c740 1 -- start start 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 0x5606507d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381b02d0 con 0x5606507be370 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381adba0 con 0x5606507b35d0 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381ab9f0 con 0x5606507b4b40 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 0x5606507d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 0x5606507d5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36526/0 (socket says 172.21.15.76:36526) 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 -- 172.21.15.76:0/4112744448 learned_addr learned my addr 172.21.15.76:0/4112744448 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f3659c640 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 -- 172.21.15.76:0/4112744448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 msgr2=0x5606507aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 -- 172.21.15.76:0/4112744448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 msgr2=0x5606507ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 -- 172.21.15.76:0/4112744448 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606507b6120 con 0x5606507be370 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 0x5606507d5cf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2f3009c170 tx=0x7f2f3009be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abdbe7a73526e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.413+0000 7f2f1ffff640 1 -- 172.21.15.76:0/4112744448 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30018e60 con 0x5606507be370 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f1ffff640 1 -- 172.21.15.76:0/4112744448 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f300a0820 con 0x5606507be370 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f1ffff640 1 -- 172.21.15.76:0/4112744448 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000f5f0 con 0x5606507be370 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/4112744448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 msgr2=0x5606507d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 0x5606507d5cf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2f3009c170 tx=0x7f2f3009be90 comp rx=0 tx=0).stop 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/4112744448 shutdown_connections 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507be370 0x5606507d5cf0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507b4b40 0x5606507aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/4112744448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/4112744448 >> 172.21.15.76:0/4112744448 conn(0x56065077c310 msgr2=0x5606507ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/4112744448 shutdown_connections 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/4112744448 wait complete. 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.414+0000 7f2f3ee3c740 1 -- start start 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 Processor -- start 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507be370 0x5606507c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381ac060 con 0x5606507b4b40 2024-09-19T07:53:29.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381ad4d0 con 0x5606507b35d0 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381ac730 con 0x5606507be370 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3ee3c740 10 client.0 _ll_register_callbacks cb 0x7f2f2800c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36542/0 (socket says 172.21.15.76:36542) 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/3585460635 learned_addr learned my addr 172.21.15.76:0/3585460635 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3659c640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/3585460635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507be370 msgr2=0x5606507c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f36d9d640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507be370 0x5606507c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507be370 0x5606507c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 msgr2=0x5606507c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f2dd9b640 1 -- 172.21.15.76:0/3585460635 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606507c35e0 con 0x5606507b4b40 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.415+0000 7f2f3659c640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f2dd9b640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507c6d10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f20004810 tx=0x7f2f20005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953f985a2f5abe4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f1dffb640 1 -- 172.21.15.76:0/3585460635 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20035040 con 0x5606507b4b40 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f1dffb640 1 -- 172.21.15.76:0/3585460635 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2f20031a70 con 0x5606507b4b40 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f300a0820 con 0x5606507b4b40 2024-09-19T07:53:29.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f1dffb640 1 -- 172.21.15.76:0/3585460635 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f20040040 con 0x5606507b4b40 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 10 client.15852 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606508398b0 con 0x5606507b4b40 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f1dffb640 1 -- 172.21.15.76:0/3585460635 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f300a0820 con 0x5606507b4b40 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f1dffb640 1 -- 172.21.15.76:0/3585460635 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2f20057500 con 0x5606507b4b40 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 10 client.15852 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 10 client.15852 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 20 client.15852 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560650839cb0 0x56065083c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 4 client.15852 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.416+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560650720d70 con 0x560650839cb0 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3659c640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560650839cb0 0x56065083c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3659c640 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560650839cb0 0x56065083c0a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7af5049bec30ef76 server_cookie=9529660d4d32ccf3 in_seq=0 out_seq=0 2024-09-19T07:53:29.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f1dffb640 10 client.15852 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f1dffb640 1 -- 172.21.15.76:0/3585460635 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560650720d70 con 0x560650839cb0 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f1dffb640 10 client.15852 handle_command_reply: tid=0 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 client.15852 shutdown 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 msgr2=0x5606507c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507c6d10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f20004810 tx=0x7f2f20005de0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 shutdown_connections 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560650839cb0 0x56065083c0a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f1dffb640 0 client.15852 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5606507be370 0x5606507c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5606507b4b40 0x5606507c6d10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 --2- 172.21.15.76:0/3585460635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5606507b35d0 0x5606507c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 >> 172.21.15.76:0/3585460635 conn(0x56065077c310 msgr2=0x5606507aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:29.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 shutdown_connections 2024-09-19T07:53:29.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.417+0000 7f2f3ee3c740 1 -- 172.21.15.76:0/3585460635 wait complete. 2024-09-19T07:53:29.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ee3c740 20 client.15852 trim_cache size 0 max 16384 2024-09-19T07:53:29.434 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2f240a33b0 msgr2=0x7f2f240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2f240a33b0 0x7f2f240a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005fd0 tx=0x7f2f28005f20 comp rx=0 tx=0).stop 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 msgr2=0x7f2f3819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 0x7f2f3819cd40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000cce0 tx=0x7f2f3000a620 comp rx=0 tx=0).stop 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 shutdown_connections 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2f240a33b0 0x7f2f240a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f38106f10 0x7f2f3819cd40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f38102790 0x7f2f381989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 --2- 172.21.15.76:0/968781096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f38101de0 0x7f2f38198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 >> 172.21.15.76:0/968781096 conn(0x7f2f380fd8c0 msgr2=0x7f2f380fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 shutdown_connections 2024-09-19T07:53:29.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:29.418+0000 7f2f3ca63640 1 -- 172.21.15.76:0/968781096 wait complete. 2024-09-19T07:53:30.155 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:53:30.406 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:30.722 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:30 smithi076 ceph-mon[30930]: pgmap v73: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-19T07:53:30.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:30 smithi152 ceph-mon[35117]: pgmap v73: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-19T07:53:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:30 smithi137 ceph-mon[35309]: pgmap v73: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-19T07:53:30.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 -- 172.21.15.76:0/3380422411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f995410c170 msgr2=0x7f995410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 --2- 172.21.15.76:0/3380422411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f995410c170 0x7f995410e610 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f994c009ca0 tx=0x7f994c02a950 comp rx=0 tx=0).stop 2024-09-19T07:53:30.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 -- 172.21.15.76:0/3380422411 shutdown_connections 2024-09-19T07:53:30.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 --2- 172.21.15.76:0/3380422411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f995410c170 0x7f995410e610 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 --2- 172.21.15.76:0/3380422411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 0x7f995410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 --2- 172.21.15.76:0/3380422411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9954102d40 0x7f9954103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.922+0000 7f995a5cf640 1 -- 172.21.15.76:0/3380422411 >> 172.21.15.76:0/3380422411 conn(0x7f99540fc7a0 msgr2=0x7f99540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 -- 172.21.15.76:0/3380422411 shutdown_connections 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 -- 172.21.15.76:0/3380422411 wait complete. 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 Processor -- start 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 -- start start 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 0x7f9954198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 0x7f9954198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995410c170 0x7f995419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9954112140 con 0x7f9954102d40 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9954111fc0 con 0x7f9954103660 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.923+0000 7f995a5cf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f99541122c0 con 0x7f995410c170 2024-09-19T07:53:30.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 0x7f9954198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 0x7f9954198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36558/0 (socket says 172.21.15.76:36558) 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 -- 172.21.15.76:0/2002564116 learned_addr learned my addr 172.21.15.76:0/2002564116 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f99537fe640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 0x7f9954198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9958b6c640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995410c170 0x7f995419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 -- 172.21.15.76:0/2002564116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995410c170 msgr2=0x7f995419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995410c170 0x7f995419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 -- 172.21.15.76:0/2002564116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 msgr2=0x7f9954198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 0x7f9954198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 -- 172.21.15.76:0/2002564116 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995419d4d0 con 0x7f9954102d40 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f99537fe640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 0x7f9954198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f9953fff640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 0x7f9954198520 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f994400b4a0 tx=0x7f994400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f99517fa640 1 -- 172.21.15.76:0/2002564116 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944014070 con 0x7f9954102d40 2024-09-19T07:53:30.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f99517fa640 1 -- 172.21.15.76:0/2002564116 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9944010b10 con 0x7f9954102d40 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995419d7c0 con 0x7f9954102d40 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f99517fa640 1 -- 172.21.15.76:0/2002564116 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944017d60 con 0x7f9954102d40 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.924+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99541a50a0 con 0x7f9954102d40 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.927+0000 7f99517fa640 1 -- 172.21.15.76:0/2002564116 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9944017070 con 0x7f9954102d40 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.927+0000 7f995c9a8740 1 Processor -- start 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.927+0000 7f995c9a8740 1 -- start start 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e946090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e946a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e957b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f995c9a8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55fa3e8ac2f0 con 0x55fa3e947b40 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f995c9a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fa3e853cf0 con 0x55fa3e9465d0 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f995c9a8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fa3e8a82b0 con 0x55fa3e955780 2024-09-19T07:53:30.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e946090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e946090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36568/0 (socket says 172.21.15.76:36568) 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 -- 172.21.15.76:0/813322212 learned_addr learned my addr 172.21.15.76:0/813322212 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9953fff640 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e946a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f99517fa640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f99400a33b0 0x7f99400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f99537fe640 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e957b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 -- 172.21.15.76:0/813322212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 msgr2=0x55fa3e957b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e957b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 -- 172.21.15.76:0/813322212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 msgr2=0x55fa3e946a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e946a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 -- 172.21.15.76:0/813322212 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3e8383a0 con 0x55fa3e947b40 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f99537fe640 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e957b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f99517fa640 1 -- 172.21.15.76:0/2002564116 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f99440cf130 con 0x7f9954102d40 2024-09-19T07:53:30.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f99400a33b0 0x7f99400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.928+0000 7f9958b6c640 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e946090 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f994c004af0 tx=0x7f994c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c98b1c1e71c1440 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f994a7fc640 1 -- 172.21.15.76:0/813322212 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c040040 con 0x55fa3e947b40 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f994a7fc640 1 -- 172.21.15.76:0/813322212 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f994c003cb0 con 0x55fa3e947b40 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f994a7fc640 1 -- 172.21.15.76:0/813322212 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c034070 con 0x55fa3e947b40 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 -- 172.21.15.76:0/813322212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 msgr2=0x55fa3e946090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e946090 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f994c004af0 tx=0x7f994c02f450 comp rx=0 tx=0).stop 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f9958b6c640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f99400a33b0 0x7f99400a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f994c04b000 tx=0x7f994c04c000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 -- 172.21.15.76:0/813322212 shutdown_connections 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e957b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e946a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 --2- 172.21.15.76:0/813322212 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e946090 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 -- 172.21.15.76:0/813322212 >> 172.21.15.76:0/813322212 conn(0x55fa3e90f310 msgr2=0x55fa3e942c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:30.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 -- 172.21.15.76:0/813322212 shutdown_connections 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.929+0000 7f995c9a8740 1 -- 172.21.15.76:0/813322212 wait complete. 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 -- start start 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 Processor -- start 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e9465d0 0x55fa3e955170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e952420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e955780 0x55fa3e952a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55fa3e958480 con 0x55fa3e947b40 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fa3e867060 con 0x55fa3e955780 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fa3e958600 con 0x55fa3e9465d0 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f995c9a8740 10 client.0 _ll_register_callbacks cb 0x55fa3e5ba8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f99537fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e952420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f99537fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e952420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36572/0 (socket says 172.21.15.76:36572) 2024-09-19T07:53:30.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f99537fe640 1 -- 172.21.15.76:0/3152855197 learned_addr learned my addr 172.21.15.76:0/3152855197 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.930+0000 7f9953fff640 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e9465d0 0x55fa3e955170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99537fe640 1 -- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e9465d0 msgr2=0x55fa3e955170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99537fe640 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e9465d0 0x55fa3e955170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99537fe640 1 -- 172.21.15.76:0/3152855197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e955780 msgr2=0x55fa3e952a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99537fe640 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e955780 0x55fa3e952a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99537fe640 1 -- 172.21.15.76:0/3152855197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3e61d3c0 con 0x55fa3e947b40 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99537fe640 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e952420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f993c00bf60 tx=0x7f993c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3b213e9f1b4a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99337fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99337fe640 1 -- 172.21.15.76:0/3152855197 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c012920 con 0x55fa3e947b40 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f994c003cb0 con 0x55fa3e947b40 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99337fe640 1 -- 172.21.15.76:0/3152855197 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f993c012ac0 con 0x55fa3e947b40 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99337fe640 1 -- 172.21.15.76:0/3152855197 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f993c012cc0 con 0x55fa3e947b40 2024-09-19T07:53:30.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f995c9a8740 10 client.15864 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fa3e963fd0 con 0x55fa3e947b40 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99337fe640 1 -- 172.21.15.76:0/3152855197 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f994c003cb0 con 0x55fa3e947b40 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.931+0000 7f99337fe640 1 -- 172.21.15.76:0/3152855197 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f993c0255d0 con 0x55fa3e947b40 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f995c9a8740 10 client.15864 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f995c9a8740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f995c9a8740 20 client.15864 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e965430 0x55fa3e967870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f995c9a8740 4 client.15864 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa3e8b9860 con 0x55fa3e965430 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f9953fff640 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e965430 0x55fa3e967870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f99337fe640 10 client.15864 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.932+0000 7f9953fff640 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e965430 0x55fa3e967870 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6bc85138a9adee4 server_cookie=8ee4c94d61273705 in_seq=0 out_seq=0 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f99337fe640 1 -- 172.21.15.76:0/3152855197 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa3e8b9860 con 0x55fa3e965430 2024-09-19T07:53:30.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f99337fe640 10 client.15864 handle_command_reply: tid=0 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 client.15864 shutdown 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 msgr2=0x55fa3e952420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e952420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f993c00bf60 tx=0x7f993c00bf90 comp rx=0 tx=0).stop 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 shutdown_connections 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e955780 0x55fa3e952a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e965430 0x55fa3e967870 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e952420 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3152855197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e9465d0 0x55fa3e955170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f99337fe640 0 client.15864 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 >> 172.21.15.76:0/3152855197 conn(0x55fa3e90f310 msgr2=0x55fa3e948960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 shutdown_connections 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 1 -- 172.21.15.76:0/3152855197 wait complete. 2024-09-19T07:53:30.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.933+0000 7f995c9a8740 20 client.15864 trim_cache size 0 max 16384 2024-09-19T07:53:30.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 Processor -- start 2024-09-19T07:53:30.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 -- start start 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 0x55fa3e961720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e947b40 0x55fa3e951ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e96d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f99541ae210 con 0x55fa3e9465d0 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99541abae0 con 0x55fa3e947b40 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f995c9a8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f99541a9930 con 0x55fa3e955780 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 0x55fa3e961720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 0x55fa3e961720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36574/0 (socket says 172.21.15.76:36574) 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 -- 172.21.15.76:0/3643536712 learned_addr learned my addr 172.21.15.76:0/3643536712 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9958b6c640 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e96d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f99537fe640 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e947b40 0x55fa3e951ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 -- 172.21.15.76:0/3643536712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 msgr2=0x55fa3e96d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e96d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 -- 172.21.15.76:0/3643536712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e947b40 msgr2=0x55fa3e951ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e947b40 0x55fa3e951ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 -- 172.21.15.76:0/3643536712 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3e943960 con 0x55fa3e9465d0 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9953fff640 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 0x55fa3e961720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9944097920 tx=0x7f99440d16b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b0d6d6e111f061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9949ffb640 1 -- 172.21.15.76:0/3643536712 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994401e040 con 0x55fa3e9465d0 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9949ffb640 1 -- 172.21.15.76:0/3643536712 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9944099560 con 0x55fa3e9465d0 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.947+0000 7f9949ffb640 1 -- 172.21.15.76:0/3643536712 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944097b30 con 0x55fa3e9465d0 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 -- 172.21.15.76:0/3643536712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 msgr2=0x55fa3e961720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 0x55fa3e961720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9944097920 tx=0x7f99440d16b0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 -- 172.21.15.76:0/3643536712 shutdown_connections 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e96d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e947b40 0x55fa3e951ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 --2- 172.21.15.76:0/3643536712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e9465d0 0x55fa3e961720 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 -- 172.21.15.76:0/3643536712 >> 172.21.15.76:0/3643536712 conn(0x55fa3e90f310 msgr2=0x55fa3e950cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 -- 172.21.15.76:0/3643536712 shutdown_connections 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 -- 172.21.15.76:0/3643536712 wait complete. 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.948+0000 7f995c9a8740 1 -- start start 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 Processor -- start 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e95e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e959390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e9598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f99541a9fa0 con 0x55fa3e947b40 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99541ab410 con 0x55fa3e9465d0 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f99541aa670 con 0x55fa3e955780 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f995c9a8740 10 client.0 _ll_register_callbacks cb 0x7f995406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e959390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e959390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36578/0 (socket says 172.21.15.76:36578) 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 -- 172.21.15.76:0/4055594698 learned_addr learned my addr 172.21.15.76:0/4055594698 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f9953fff640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e95e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 -- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 msgr2=0x55fa3e9598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f9958b6c640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e9598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e9598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 -- 172.21.15.76:0/4055594698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 msgr2=0x55fa3e95e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:30.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e95e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f99537fe640 1 -- 172.21.15.76:0/4055594698 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3e95a120 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f9953fff640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e95e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.949+0000 7f9958b6c640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e9598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99537fe640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e959390 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f993c025a70 tx=0x7f993c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87324848cf8854ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99337fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99337fe640 1 -- 172.21.15.76:0/4055594698 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c000e60 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99337fe640 1 -- 172.21.15.76:0/4055594698 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f993c012720 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9944099560 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99337fe640 1 -- 172.21.15.76:0/4055594698 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f993c012960 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fa3e9d01a0 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99337fe640 1 -- 172.21.15.76:0/4055594698 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9944099560 con 0x55fa3e947b40 2024-09-19T07:53:30.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f99337fe640 1 -- 172.21.15.76:0/4055594698 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f993c02e630 con 0x55fa3e947b40 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 20 client.15870 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e9d0860 0x55fa3e9d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 4 client.15870 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.950+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa3e8b3d70 con 0x55fa3e9d0860 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f9953fff640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e9d0860 0x55fa3e9d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f9953fff640 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e9d0860 0x55fa3e9d2c50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea17c5d3d51e2be4 server_cookie=c10b4b3894c646a in_seq=0 out_seq=0 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f99337fe640 10 client.15870 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f99337fe640 1 -- 172.21.15.76:0/4055594698 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa3e8b3d70 con 0x55fa3e9d0860 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f99337fe640 10 client.15870 handle_command_reply: tid=0 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 client.15870 shutdown 2024-09-19T07:53:30.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 msgr2=0x55fa3e959390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e959390 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f993c025a70 tx=0x7f993c00b6d0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 shutdown_connections 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fa3e955780 0x55fa3e9598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fa3e9d0860 0x55fa3e9d2c50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fa3e947b40 0x55fa3e959390 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 --2- 172.21.15.76:0/4055594698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa3e9465d0 0x55fa3e95e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f99337fe640 0 client.15870 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 >> 172.21.15.76:0/4055594698 conn(0x55fa3e90f310 msgr2=0x55fa3e953c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 shutdown_connections 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.951+0000 7f995c9a8740 1 -- 172.21.15.76:0/4055594698 wait complete. 2024-09-19T07:53:30.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995c9a8740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T07:53:30.964 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:53:30.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f99400a33b0 msgr2=0x7f99400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f99400a33b0 0x7f99400a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f994c04b000 tx=0x7f994c04c000 comp rx=0 tx=0).stop 2024-09-19T07:53:30.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 msgr2=0x7f9954198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:30.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 0x7f9954198520 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f994400b4a0 tx=0x7f994400b960 comp rx=0 tx=0).stop 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 shutdown_connections 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f99400a33b0 0x7f99400a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995410c170 0x7f995419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9954103660 0x7f9954198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 --2- 172.21.15.76:0/2002564116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9954102d40 0x7f9954198520 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 >> 172.21.15.76:0/2002564116 conn(0x7f99540fc7a0 msgr2=0x7f99540fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 shutdown_connections 2024-09-19T07:53:30.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:30.952+0000 7f995a5cf640 1 -- 172.21.15.76:0/2002564116 wait complete. 2024-09-19T07:53:32.642 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:53:32.643 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:53:32.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:32 smithi152 ceph-mon[35117]: pgmap v74: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-19T07:53:32.904 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:32.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:32 smithi137 ceph-mon[35309]: pgmap v74: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-19T07:53:32.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:32 smithi076 ceph-mon[30930]: pgmap v74: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-19T07:53:33.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.410+0000 7f892ce67640 1 -- 172.21.15.76:0/4016952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89281027a0 msgr2=0x7f89281067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.410+0000 7f892ce67640 1 --2- 172.21.15.76:0/4016952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89281027a0 0x7f89281067f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c02a410 comp rx=0 tx=0).stop 2024-09-19T07:53:33.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 -- 172.21.15.76:0/4016952301 shutdown_connections 2024-09-19T07:53:33.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 --2- 172.21.15.76:0/4016952301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8928106f20 0x7f892810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 --2- 172.21.15.76:0/4016952301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89281027a0 0x7f89281067f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 --2- 172.21.15.76:0/4016952301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8928101df0 0x7f89281021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 -- 172.21.15.76:0/4016952301 >> 172.21.15.76:0/4016952301 conn(0x7f89280fd8b0 msgr2=0x7f89280ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 -- 172.21.15.76:0/4016952301 shutdown_connections 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 -- 172.21.15.76:0/4016952301 wait complete. 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 Processor -- start 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.411+0000 7f892ce67640 1 -- start start 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8928101df0 0x7f8928198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89281027a0 0x7f8928198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 0x7f892819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8928112160 con 0x7f8928106f20 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8928111fe0 con 0x7f89281027a0 2024-09-19T07:53:33.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89281122e0 con 0x7f8928101df0 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 0x7f892819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 0x7f892819bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41050/0 (socket says 172.21.15.76:41050) 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 -- 172.21.15.76:0/3327525779 learned_addr learned my addr 172.21.15.76:0/3327525779 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8925d9b640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89281027a0 0x7f8928198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892659c640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8928101df0 0x7f8928198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 -- 172.21.15.76:0/3327525779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8928101df0 msgr2=0x7f8928198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8928101df0 0x7f8928198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 -- 172.21.15.76:0/3327525779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89281027a0 msgr2=0x7f8928198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89281027a0 0x7f8928198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 -- 172.21.15.76:0/3327525779 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892819c6b0 con 0x7f8928106f20 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8925d9b640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89281027a0 0x7f8928198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:33.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f8926d9d640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 0x7f892819bf80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f892000b970 tx=0x7f892000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:33.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f89177fe640 1 -- 172.21.15.76:0/3327525779 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920019070 con 0x7f8928106f20 2024-09-19T07:53:33.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f89177fe640 1 -- 172.21.15.76:0/3327525779 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8920014440 con 0x7f8928106f20 2024-09-19T07:53:33.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f89177fe640 1 -- 172.21.15.76:0/3327525779 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89200075d0 con 0x7f8928106f20 2024-09-19T07:53:33.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.412+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892819c9a0 con 0x7f8928106f20 2024-09-19T07:53:33.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.413+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89281a5310 con 0x7f8928106f20 2024-09-19T07:53:33.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.415+0000 7f89177fe640 1 -- 172.21.15.76:0/3327525779 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f892001c070 con 0x7f8928106f20 2024-09-19T07:53:33.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 Processor -- start 2024-09-19T07:53:33.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 -- start start 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adcfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516addec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ade1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56516ad35280 con 0x56516addf150 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56516acdcb10 con 0x56516add0360 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892f240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56516ad31240 con 0x56516adcfa40 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ade1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ade1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41064/0 (socket says 172.21.15.76:41064) 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f8925d9b640 1 -- 172.21.15.76:0/2007101719 learned_addr learned my addr 172.21.15.76:0/2007101719 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f892659c640 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516addec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adcfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.416+0000 7f89177fe640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89100a33b0 0x7f89100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8925d9b640 1 -- 172.21.15.76:0/2007101719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 msgr2=0x56516adcfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adcfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8925d9b640 1 -- 172.21.15.76:0/2007101719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 msgr2=0x56516addec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516addec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8925d9b640 1 -- 172.21.15.76:0/2007101719 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56516ace91f0 con 0x56516addf150 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8926d9d640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89100a33b0 0x7f89100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ade1540 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f891c02a930 tx=0x7f891c0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31bd365033b95b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f89177fe640 1 -- 172.21.15.76:0/3327525779 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f89200cf160 con 0x7f8928106f20 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8914ff9640 1 -- 172.21.15.76:0/2007101719 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c035040 con 0x56516addf150 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8914ff9640 1 -- 172.21.15.76:0/2007101719 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f891c031810 con 0x56516addf150 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.417+0000 7f8914ff9640 1 -- 172.21.15.76:0/2007101719 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c0047a0 con 0x56516addf150 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 -- 172.21.15.76:0/2007101719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 msgr2=0x56516ade1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f8926d9d640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89100a33b0 0x7f89100a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89200ccab0 tx=0x7f8920014e00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:33.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ade1540 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f891c02a930 tx=0x7f891c0095e0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 -- 172.21.15.76:0/2007101719 shutdown_connections 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ade1540 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516addec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 --2- 172.21.15.76:0/2007101719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adcfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 -- 172.21.15.76:0/2007101719 >> 172.21.15.76:0/2007101719 conn(0x56516adcc0f0 msgr2=0x56516adcc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 -- 172.21.15.76:0/2007101719 shutdown_connections 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 -- 172.21.15.76:0/2007101719 wait complete. 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 -- start start 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.418+0000 7f892f240740 1 Processor -- start 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516adcfa40 0x56516addc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516add0360 0x56516addc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516addcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56516ade1d20 con 0x56516addf150 2024-09-19T07:53:33.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56516aceff10 con 0x56516adcfa40 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56516ade1ea0 con 0x56516add0360 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892f240740 10 client.0 _ll_register_callbacks cb 0x56516acb8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516addcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516addcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41080/0 (socket says 172.21.15.76:41080) 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 -- 172.21.15.76:0/2663590235 learned_addr learned my addr 172.21.15.76:0/2663590235 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f892659c640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516add0360 0x56516addc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516adcfa40 0x56516addc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 -- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516add0360 msgr2=0x56516addc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516add0360 0x56516addc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 -- 172.21.15.76:0/2663590235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516adcfa40 msgr2=0x56516addc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516adcfa40 0x56516addc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 -- 172.21.15.76:0/2663590235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56516aaa66a0 con 0x56516addf150 2024-09-19T07:53:33.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516addcb00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7ff743b687c538 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f890dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.419+0000 7f890dffb640 1 -- 172.21.15.76:0/2663590235 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c004de0 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f890dffb640 1 -- 172.21.15.76:0/2663590235 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f891c048480 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f891c031810 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f890dffb640 1 -- 172.21.15.76:0/2663590235 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f891c05c050 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 10 client.15882 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56516aded9c0 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f890dffb640 1 -- 172.21.15.76:0/2663590235 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f891c031810 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f890dffb640 1 -- 172.21.15.76:0/2663590235 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f891c03a040 con 0x56516addf150 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 10 client.15882 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:33.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 20 client.15882 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516adeed10 0x56516adf1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 4 client.15882 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56516ad427f0 con 0x56516adeed10 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.420+0000 7f892659c640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516adeed10 0x56516adf1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.421+0000 7f890dffb640 10 client.15882 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:33.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.421+0000 7f892659c640 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516adeed10 0x56516adf1100 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147a153fe42a3b28 server_cookie=7e89ff15316d86c2 in_seq=0 out_seq=0 2024-09-19T07:53:33.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.421+0000 7f890dffb640 1 -- 172.21.15.76:0/2663590235 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56516ad427f0 con 0x56516adeed10 2024-09-19T07:53:33.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.421+0000 7f890dffb640 10 client.15882 handle_command_reply: tid=0 2024-09-19T07:53:33.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 client.15882 shutdown 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 msgr2=0x56516addcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516addcb00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c0054a0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 shutdown_connections 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516adeed10 0x56516adf1100 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516addcb00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516add0360 0x56516addc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 --2- 172.21.15.76:0/2663590235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516adcfa40 0x56516addc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 >> 172.21.15.76:0/2663590235 conn(0x56516adcc0f0 msgr2=0x56516adcb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:33.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f890dffb640 0 client.15882 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:33.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 shutdown_connections 2024-09-19T07:53:33.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 1 -- 172.21.15.76:0/2663590235 wait complete. 2024-09-19T07:53:33.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.422+0000 7f892f240740 20 client.15882 trim_cache size 0 max 16384 2024-09-19T07:53:33.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 Processor -- start 2024-09-19T07:53:33.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 -- start start 2024-09-19T07:53:33.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516add92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f89281ae2e0 con 0x56516addf150 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89281abbb0 con 0x56516add0360 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f892f240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89281a9a00 con 0x56516adcfa40 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516add92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516add92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41090/0 (socket says 172.21.15.76:41090) 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.439+0000 7f8925d9b640 1 -- 172.21.15.76:0/909420714 learned_addr learned my addr 172.21.15.76:0/909420714 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f892659c640 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 -- 172.21.15.76:0/909420714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 msgr2=0x56516adf4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 -- 172.21.15.76:0/909420714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 msgr2=0x56516adf4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 -- 172.21.15.76:0/909420714 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56516add2560 con 0x56516addf150 2024-09-19T07:53:33.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f892659c640 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:33.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f8925d9b640 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516add92e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f891c006010 tx=0x7f891c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc25f3704ea034f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:33.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f890ffff640 1 -- 172.21.15.76:0/909420714 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c035070 con 0x56516addf150 2024-09-19T07:53:33.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f890ffff640 1 -- 172.21.15.76:0/909420714 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f891c053070 con 0x56516addf150 2024-09-19T07:53:33.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f890ffff640 1 -- 172.21.15.76:0/909420714 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c004e40 con 0x56516addf150 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f892f240740 1 -- 172.21.15.76:0/909420714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 msgr2=0x56516add92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.440+0000 7f892f240740 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516add92e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f891c006010 tx=0x7f891c001e50 comp rx=0 tx=0).stop 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- 172.21.15.76:0/909420714 shutdown_connections 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516add92e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 --2- 172.21.15.76:0/909420714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- 172.21.15.76:0/909420714 >> 172.21.15.76:0/909420714 conn(0x56516adcc0f0 msgr2=0x56516adddff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:33.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- 172.21.15.76:0/909420714 shutdown_connections 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- 172.21.15.76:0/909420714 wait complete. 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- start start 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 Processor -- start 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ae58650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f89281aa070 con 0x56516addf150 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89281ab4e0 con 0x56516add0360 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89281aa740 con 0x56516adcfa40 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f892f240740 10 client.0 _ll_register_callbacks cb 0x7f891c031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ae58650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f8925d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ae58650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41098/0 (socket says 172.21.15.76:41098) 2024-09-19T07:53:33.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.441+0000 7f8925d9b640 1 -- 172.21.15.76:0/2221212463 learned_addr learned my addr 172.21.15.76:0/2221212463 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f892659c640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 -- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 msgr2=0x56516adf26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 -- 172.21.15.76:0/2221212463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 msgr2=0x56516adf2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 -- 172.21.15.76:0/2221212463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56516ae58c90 con 0x56516addf150 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f892659c640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f8925d9b640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ae58650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f891c000c00 tx=0x7f891c03dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4255cb7e93efd8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f890dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f890dffb640 1 -- 172.21.15.76:0/2221212463 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c035040 con 0x56516addf150 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f890dffb640 1 -- 172.21.15.76:0/2221212463 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f891c004df0 con 0x56516addf150 2024-09-19T07:53:33.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f891c053070 con 0x56516addf150 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f890dffb640 1 -- 172.21.15.76:0/2221212463 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f891c0316f0 con 0x56516addf150 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f892f240740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56516ae59f20 con 0x56516addf150 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.442+0000 7f890dffb640 1 -- 172.21.15.76:0/2221212463 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f891c053070 con 0x56516addf150 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f890dffb640 1 -- 172.21.15.76:0/2221212463 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f891c003820 con 0x56516addf150 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892f240740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892f240740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892f240740 20 client.15888 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892f240740 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516ae5a5d0 0x56516ae5c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892f240740 4 client.15888 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:53:33.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56516ad3cd00 con 0x56516ae5a5d0 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892659c640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516ae5a5d0 0x56516ae5c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f890dffb640 10 client.15888 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.443+0000 7f892659c640 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516ae5a5d0 0x56516ae5c9c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297135a1692bd2fe server_cookie=f4226ecdb0ab3e1b in_seq=0 out_seq=0 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f890dffb640 1 -- 172.21.15.76:0/2221212463 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56516ad3cd00 con 0x56516ae5a5d0 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f890dffb640 10 client.15888 handle_command_reply: tid=0 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 client.15888 shutdown 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 msgr2=0x56516ae58650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ae58650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f891c000c00 tx=0x7f891c03dbc0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 shutdown_connections 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56516ae5a5d0 0x56516ae5c9c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56516addf150 0x56516ae58650 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56516add0360 0x56516adf2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 --2- 172.21.15.76:0/2221212463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56516adcfa40 0x56516adf26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 >> 172.21.15.76:0/2221212463 conn(0x56516adcc0f0 msgr2=0x56516add1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.444+0000 7f890dffb640 0 client.15888 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 shutdown_connections 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892f240740 1 -- 172.21.15.76:0/2221212463 wait complete. 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892f240740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:53:33.451 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:53:33.452 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "68ecce76-40bf-403e-8574-ed6da2980884", 2024-09-19T07:53:33.452 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:53:33.452 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89100a33b0 msgr2=0x7f89100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89100a33b0 0x7f89100a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89200ccab0 tx=0x7f8920014e00 comp rx=0 tx=0).stop 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 msgr2=0x7f892819bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 0x7f892819bf80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f892000b970 tx=0x7f892000bd70 comp rx=0 tx=0).stop 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 shutdown_connections 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89100a33b0 0x7f89100a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8928106f20 0x7f892819bf80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89281027a0 0x7f8928198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 --2- 172.21.15.76:0/3327525779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8928101df0 0x7f8928198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 >> 172.21.15.76:0/3327525779 conn(0x7f89280fd8b0 msgr2=0x7f89280febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:33.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.445+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 shutdown_connections 2024-09-19T07:53:33.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:33.446+0000 7f892ce67640 1 -- 172.21.15.76:0/3327525779 wait complete. 2024-09-19T07:53:34.236 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:53:34.485 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:34.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:34 smithi076 ceph-mon[30930]: pgmap v75: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-19T07:53:34.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:34 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:53:34.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:34 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:34.736 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:34 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:53:34.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:34 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:34.737 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:34 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:53:34.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:34 smithi152 ceph-mon[35117]: pgmap v75: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-19T07:53:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:34 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:53:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:34 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:34 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:53:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:34 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:34.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:34 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:53:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:34 smithi137 ceph-mon[35309]: pgmap v75: 97 pgs: 97 active+clean; 13 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2024-09-19T07:53:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:34 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:53:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:34 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:34 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:53:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:34 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:34 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:53:34.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 -- 172.21.15.76:0/901432597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 msgr2=0x7f040810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 --2- 172.21.15.76:0/901432597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f040810bb50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0404009900 tx=0x7f040402a480 comp rx=0 tx=0).stop 2024-09-19T07:53:34.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 -- 172.21.15.76:0/901432597 shutdown_connections 2024-09-19T07:53:34.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 --2- 172.21.15.76:0/901432597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 0x7f040810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 --2- 172.21.15.76:0/901432597 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f040810bb50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 --2- 172.21.15.76:0/901432597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408102d40 0x7f0408103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 -- 172.21.15.76:0/901432597 >> 172.21.15.76:0/901432597 conn(0x7f04080fc7a0 msgr2=0x7f04080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 -- 172.21.15.76:0/901432597 shutdown_connections 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.953+0000 7f04102e0640 1 -- 172.21.15.76:0/901432597 wait complete. 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 Processor -- start 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 -- start start 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408102d40 0x7f0408198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f0408198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 0x7f040819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04081120f0 con 0x7f0408103660 2024-09-19T07:53:34.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0408111f70 con 0x7f0408102d40 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f04102e0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0408112270 con 0x7f040810c170 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f040d87b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f0408198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f040d87b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f0408198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41122/0 (socket says 172.21.15.76:41122) 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f040d87b640 1 -- 172.21.15.76:0/2346861718 learned_addr learned my addr 172.21.15.76:0/2346861718 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f040e07c640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408102d40 0x7f0408198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.954+0000 7f040e87d640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 0x7f040819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040d87b640 1 -- 172.21.15.76:0/2346861718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 msgr2=0x7f040819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040d87b640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 0x7f040819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040d87b640 1 -- 172.21.15.76:0/2346861718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408102d40 msgr2=0x7f0408198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040d87b640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408102d40 0x7f0408198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040d87b640 1 -- 172.21.15.76:0/2346861718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040819d4e0 con 0x7f0408103660 2024-09-19T07:53:34.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040e87d640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 0x7f040819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f040d87b640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f0408198a70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0404006010 tx=0x7f04040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f03ff7fe640 1 -- 172.21.15.76:0/2346861718 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040403f030 con 0x7f0408103660 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040819d770 con 0x7f0408103660 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f03ff7fe640 1 -- 172.21.15.76:0/2346861718 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0404003d00 con 0x7f0408103660 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f03ff7fe640 1 -- 172.21.15.76:0/2346861718 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404035070 con 0x7f0408103660 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.955+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04081a50b0 con 0x7f0408103660 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.957+0000 7f03ff7fe640 1 -- 172.21.15.76:0/2346861718 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0404042030 con 0x7f0408103660 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 Processor -- start 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 -- start start 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c04880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c0f680 0x563a39c11a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563a39b6a2e0 con 0x563a39c044a0 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563a39b11ce0 con 0x563a39c04dc0 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f04126b9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563a39b662a0 con 0x563a39c0f680 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f040e87d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c04880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f040e87d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c04880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41138/0 (socket says 172.21.15.76:41138) 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f040e87d640 1 -- 172.21.15.76:0/3984607291 learned_addr learned my addr 172.21.15.76:0/3984607291 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.958+0000 7f03ff7fe640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03f40a33b0 0x7f03f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040d87b640 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c0f680 0x563a39c11a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e07c640 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03f40a33b0 0x7f03f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f03ff7fe640 1 -- 172.21.15.76:0/2346861718 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f04040f01c0 con 0x7f0408103660 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 -- 172.21.15.76:0/3984607291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c0f680 msgr2=0x563a39c11a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c0f680 0x563a39c11a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 -- 172.21.15.76:0/3984607291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 msgr2=0x563a39c0f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 -- 172.21.15.76:0/3984607291 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a39af6440 con 0x563a39c044a0 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c04880 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f040000cf80 tx=0x7f0400007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e2a7f9457d07f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f040e87d640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03f40a33b0 0x7f03f40a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0400007c40 tx=0x7f040001b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f03fcdea640 1 -- 172.21.15.76:0/3984607291 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400015050 con 0x563a39c044a0 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f03fcdea640 1 -- 172.21.15.76:0/3984607291 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0400016040 con 0x563a39c044a0 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.959+0000 7f03fcdea640 1 -- 172.21.15.76:0/3984607291 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040001bb60 con 0x563a39c044a0 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 -- 172.21.15.76:0/3984607291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 msgr2=0x563a39c04880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c04880 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f040000cf80 tx=0x7f0400007740 comp rx=0 tx=0).stop 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 -- 172.21.15.76:0/3984607291 shutdown_connections 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c0f680 0x563a39c11a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 --2- 172.21.15.76:0/3984607291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c04880 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 -- 172.21.15.76:0/3984607291 >> 172.21.15.76:0/3984607291 conn(0x563a39c00a30 msgr2=0x563a39c00e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 -- 172.21.15.76:0/3984607291 shutdown_connections 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 -- 172.21.15.76:0/3984607291 wait complete. 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 -- start start 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.960+0000 7f04126b9740 1 Processor -- start 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 0x563a39c0c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563a39c12250 con 0x563a39c0f680 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563a39b25050 con 0x563a39c04dc0 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563a39c123d0 con 0x563a39c044a0 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 10 client.0 _ll_register_callbacks cb 0x563a39b65160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 0x563a39c0c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 0x563a39c0c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41140/0 (socket says 172.21.15.76:41140) 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 -- 172.21.15.76:0/2728990176 learned_addr learned my addr 172.21.15.76:0/2728990176 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040d87b640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e07c640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 -- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 msgr2=0x563a39c0f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 -- 172.21.15.76:0/2728990176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 msgr2=0x563a39c0c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 -- 172.21.15.76:0/2728990176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a398db3c0 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f040e87d640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 0x563a39c0c880 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f040000c600 tx=0x7f040001b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbb1727d4ee89b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f03f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f03f1ffb640 1 -- 172.21.15.76:0/2728990176 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040001abe0 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f03f1ffb640 1 -- 172.21.15.76:0/2728990176 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f040001b840 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.961+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0400016040 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f03f1ffb640 1 -- 172.21.15.76:0/2728990176 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0400015070 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 10 client.15900 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a39c1dc60 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f03f1ffb640 1 -- 172.21.15.76:0/2728990176 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0400016040 con 0x563a39c0f680 2024-09-19T07:53:34.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f03f1ffb640 1 -- 172.21.15.76:0/2728990176 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f04000338f0 con 0x563a39c0f680 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 10 client.15900 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 20 client.15900 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c1f070 0x563a39c21460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 4 client.15900 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.962+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a39b77850 con 0x563a39c1f070 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.963+0000 7f040e07c640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c1f070 0x563a39c21460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.963+0000 7f03f1ffb640 10 client.15900 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:34.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.963+0000 7f040e07c640 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c1f070 0x563a39c21460 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a277fd865dbc8b server_cookie=954eb1496d7a4071 in_seq=0 out_seq=0 2024-09-19T07:53:34.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f03f1ffb640 1 -- 172.21.15.76:0/2728990176 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a39b77850 con 0x563a39c1f070 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f03f1ffb640 10 client.15900 handle_command_reply: tid=0 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 client.15900 shutdown 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 msgr2=0x563a39c0c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 0x563a39c0c880 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f040000c600 tx=0x7f040001b650 comp rx=0 tx=0).stop 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 shutdown_connections 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c1f070 0x563a39c21460 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c0f680 0x563a39c0c880 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c04dc0 0x563a39c0c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 --2- 172.21.15.76:0/2728990176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f03f1ffb640 0 client.15900 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 >> 172.21.15.76:0/2728990176 conn(0x563a39c00a30 msgr2=0x563a39bffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:34.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 shutdown_connections 2024-09-19T07:53:34.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 1 -- 172.21.15.76:0/2728990176 wait complete. 2024-09-19T07:53:34.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.964+0000 7f04126b9740 20 client.15900 trim_cache size 0 max 16384 2024-09-19T07:53:34.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 Processor -- start 2024-09-19T07:53:34.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 -- start start 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 0x563a39c17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c17f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04081b03f0 con 0x563a39c04dc0 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04081adcc0 con 0x563a39c0f680 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f04126b9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04081abb10 con 0x563a39c044a0 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f040d87b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 0x563a39c17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.981+0000 7f040d87b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 0x563a39c17a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41146/0 (socket says 172.21.15.76:41146) 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 -- 172.21.15.76:0/3537994805 learned_addr learned my addr 172.21.15.76:0/3537994805 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 -- 172.21.15.76:0/3537994805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 msgr2=0x563a39c0abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040e87d640 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c17f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 -- 172.21.15.76:0/3537994805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 msgr2=0x563a39c17f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c17f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 -- 172.21.15.76:0/3537994805 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a39c04bf0 con 0x563a39c04dc0 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040e87d640 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c17f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f040d87b640 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 0x563a39c17a00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f04040ed8b0 tx=0x7f04040044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36755e05cd0b7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f03f3fff640 1 -- 172.21.15.76:0/3537994805 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404049040 con 0x563a39c04dc0 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f03f3fff640 1 -- 172.21.15.76:0/3537994805 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04040bcae0 con 0x563a39c04dc0 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.982+0000 7f03f3fff640 1 -- 172.21.15.76:0/3537994805 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04040edad0 con 0x563a39c04dc0 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 -- 172.21.15.76:0/3537994805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 msgr2=0x563a39c17a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 0x563a39c17a00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f04040ed8b0 tx=0x7f04040044e0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 -- 172.21.15.76:0/3537994805 shutdown_connections 2024-09-19T07:53:34.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c17f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c04dc0 0x563a39c17a00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 --2- 172.21.15.76:0/3537994805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c044a0 0x563a39c0abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 -- 172.21.15.76:0/3537994805 >> 172.21.15.76:0/3537994805 conn(0x563a39c00a30 msgr2=0x563a39c0e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 -- 172.21.15.76:0/3537994805 shutdown_connections 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 -- 172.21.15.76:0/3537994805 wait complete. 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 -- start start 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.983+0000 7f04126b9740 1 Processor -- start 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c80f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c04dc0 0x563a39c81450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c85520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04081ac180 con 0x563a39c044a0 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04081ad5f0 con 0x563a39c0f680 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04081ac850 con 0x563a39c04dc0 2024-09-19T07:53:34.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 10 client.0 _ll_register_callbacks cb 0x7f03f800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c80f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c80f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41160/0 (socket says 172.21.15.76:41160) 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 -- 172.21.15.76:0/525532660 learned_addr learned my addr 172.21.15.76:0/525532660 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e87d640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c85520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 -- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c04dc0 msgr2=0x563a39c81450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040d87b640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c04dc0 0x563a39c81450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c04dc0 0x563a39c81450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 -- 172.21.15.76:0/525532660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 msgr2=0x563a39c85520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c85520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 -- 172.21.15.76:0/525532660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a39c85bc0 con 0x563a39c044a0 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f040e07c640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c80f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000c00 tx=0x7f03f800bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45249424b462cd92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:34.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f03f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f03f1ffb640 1 -- 172.21.15.76:0/525532660 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011440 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f03f1ffb640 1 -- 172.21.15.76:0/525532660 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f03f80115e0 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04040bcae0 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.984+0000 7f03f1ffb640 1 -- 172.21.15.76:0/525532660 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03f8011800 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 10 client.15906 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a39c8e130 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f03f1ffb640 1 -- 172.21.15.76:0/525532660 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04040bcae0 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f03f1ffb640 1 -- 172.21.15.76:0/525532660 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03f8026b60 con 0x563a39c044a0 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 10 client.15906 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 20 client.15906 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c8e8b0 0x563a39c90cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 4 client.15906 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:53:34.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a39b71d60 con 0x563a39c8e8b0 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f040d87b640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c8e8b0 0x563a39c90cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f040d87b640 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c8e8b0 0x563a39c90cd0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e658840361277047 server_cookie=5fce07921f715c5 in_seq=0 out_seq=0 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.985+0000 7f03f1ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f03f1ffb640 1 -- 172.21.15.76:0/525532660 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563a39b71d60 con 0x563a39c8e8b0 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f03f1ffb640 10 client.15906 handle_command_reply: tid=0 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 client.15906 shutdown 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 msgr2=0x563a39c80f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c80f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000c00 tx=0x7f03f800bd10 comp rx=0 tx=0).stop 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 shutdown_connections 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a39c0f680 0x563a39c85520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a39c04dc0 0x563a39c81450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x563a39c8e8b0 0x563a39c90cd0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 --2- 172.21.15.76:0/525532660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563a39c044a0 0x563a39c80f10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f03f1ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 >> 172.21.15.76:0/525532660 conn(0x563a39c00a30 msgr2=0x563a39bff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 shutdown_connections 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 1 -- 172.21.15.76:0/525532660 wait complete. 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.986+0000 7f04126b9740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:53:34.993 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:53:34.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03f40a33b0 msgr2=0x7f03f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03f40a33b0 0x7f03f40a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0400007c40 tx=0x7f040001b000 comp rx=0 tx=0).stop 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 msgr2=0x7f0408198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f0408198a70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0404006010 tx=0x7f04040042f0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 shutdown_connections 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03f40a33b0 0x7f03f40a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040810c170 0x7f040819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0408103660 0x7f0408198a70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 --2- 172.21.15.76:0/2346861718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408102d40 0x7f0408198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 >> 172.21.15.76:0/2346861718 conn(0x7f04080fc7a0 msgr2=0x7f04080fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 shutdown_connections 2024-09-19T07:53:34.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:34.987+0000 7f04102e0640 1 -- 172.21.15.76:0/2346861718 wait complete. 2024-09-19T07:53:35.888 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:53:35.888 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:53:36.135 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:36.514 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:36 smithi076 ceph-mon[30930]: pgmap v76: 97 pgs: 97 active+clean; 46 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-09-19T07:53:36.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 -- 172.21.15.76:0/3162861769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04106f10 msgr2=0x7fac0410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:36.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 --2- 172.21.15.76:0/3162861769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04106f10 0x7fac0410ea90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009ca0 tx=0x7fabfc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 -- 172.21.15.76:0/3162861769 shutdown_connections 2024-09-19T07:53:36.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 --2- 172.21.15.76:0/3162861769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04106f10 0x7fac0410ea90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 --2- 172.21.15.76:0/3162861769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04102790 0x7fac041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 --2- 172.21.15.76:0/3162861769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac04101de0 0x7fac041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 -- 172.21.15.76:0/3162861769 >> 172.21.15.76:0/3162861769 conn(0x7fac040fd8c0 msgr2=0x7fac040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 -- 172.21.15.76:0/3162861769 shutdown_connections 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.596+0000 7fac0a20c640 1 -- 172.21.15.76:0/3162861769 wait complete. 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 Processor -- start 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 -- start start 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04101de0 0x7fac041984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 0x7fac041989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac04106f10 0x7fac0419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fac04112090 con 0x7fac04102790 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac04111f10 con 0x7fac04106f10 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac0a20c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fac04112210 con 0x7fac04101de0 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 0x7fac041989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:36.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 0x7fac041989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41192/0 (socket says 172.21.15.76:41192) 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 -- 172.21.15.76:0/1004044255 learned_addr learned my addr 172.21.15.76:0/1004044255 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac03fff640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac04106f10 0x7fac0419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac037fe640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04101de0 0x7fac041984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 -- 172.21.15.76:0/1004044255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04101de0 msgr2=0x7fac041984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04101de0 0x7fac041984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 -- 172.21.15.76:0/1004044255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac04106f10 msgr2=0x7fac0419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac04106f10 0x7fac0419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac02ffd640 1 -- 172.21.15.76:0/1004044255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0419d460 con 0x7fac04102790 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.597+0000 7fac037fe640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04101de0 0x7fac041984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.598+0000 7fac02ffd640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 0x7fac041989f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fabf800d770 tx=0x7fabf800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.598+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8017070 con 0x7fac04102790 2024-09-19T07:53:36.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.598+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0419d750 con 0x7fac04102790 2024-09-19T07:53:36.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.598+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fabf8005520 con 0x7fac04102790 2024-09-19T07:53:36.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.598+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8010460 con 0x7fac04102790 2024-09-19T07:53:36.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.598+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac041a5030 con 0x7fac04102790 2024-09-19T07:53:36.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.599+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac041021c0 con 0x7fac04102790 2024-09-19T07:53:36.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.600+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fabf8004ea0 con 0x7fac04102790 2024-09-19T07:53:36.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.601+0000 7fac00ff9640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fabec0a33b0 0x7fabec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:36.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.601+0000 7fac037fe640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fabec0a33b0 0x7fabec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:36.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.601+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fabf80cf880 con 0x7fac04102790 2024-09-19T07:53:36.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.601+0000 7fac037fe640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fabec0a33b0 0x7fabec0a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009b40 tx=0x7fabf4005e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:36.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.605+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabf809c200 con 0x7fac04102790 2024-09-19T07:53:36.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:36 smithi152 ceph-mon[35117]: pgmap v76: 97 pgs: 97 active+clean; 46 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-09-19T07:53:36.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.813+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac041a52d0 con 0x7fac04102790 2024-09-19T07:53:36.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.814+0000 7fac00ff9640 1 -- 172.21.15.76:0/1004044255 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7fabf809bb00 con 0x7fac04102790 2024-09-19T07:53:36.814 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:53:36.814 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":25,"btime":"2024-09-19T07:51:11:753605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:51:11.703422+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:53:36.814 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 25 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fabec0a33b0 msgr2=0x7fabec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fabec0a33b0 0x7fabec0a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009b40 tx=0x7fabf4005e50 comp rx=0 tx=0).stop 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 msgr2=0x7fac041989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 0x7fac041989f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fabf800d770 tx=0x7fabf800dc30 comp rx=0 tx=0).stop 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 shutdown_connections 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fabec0a33b0 0x7fabec0a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac04106f10 0x7fac0419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac04102790 0x7fac041989f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 --2- 172.21.15.76:0/1004044255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac04101de0 0x7fac041984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:36.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 >> 172.21.15.76:0/1004044255 conn(0x7fac040fd8c0 msgr2=0x7fac040ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:36.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 shutdown_connections 2024-09-19T07:53:36.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:36.816+0000 7fac0a20c640 1 -- 172.21.15.76:0/1004044255 wait complete. 2024-09-19T07:53:36.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:36 smithi137 ceph-mon[35309]: pgmap v76: 97 pgs: 97 active+clean; 46 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-09-19T07:53:37.492 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:53:37.742 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:37.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:37 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1004044255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:37.862 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:37 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1004044255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:37.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:37 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1004044255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:53:38.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 -- 172.21.15.76:0/186608490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10101420 msgr2=0x7f0f1010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 --2- 172.21.15.76:0/186608490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10101420 0x7f0f1010d950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009cd0 tx=0x7f0f0802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 -- 172.21.15.76:0/186608490 shutdown_connections 2024-09-19T07:53:38.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 --2- 172.21.15.76:0/186608490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10101420 0x7f0f1010d950 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 --2- 172.21.15.76:0/186608490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10100a80 0x7f0f10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 --2- 172.21.15.76:0/186608490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 0x7f0f10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 -- 172.21.15.76:0/186608490 >> 172.21.15.76:0/186608490 conn(0x7f0f100fc7a0 msgr2=0x7f0f100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 -- 172.21.15.76:0/186608490 shutdown_connections 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 -- 172.21.15.76:0/186608490 wait complete. 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 Processor -- start 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.240+0000 7f0f18519640 1 -- start start 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 0x7f0f10199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10101420 0x7f0f101998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 0x7f0f101a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10110fe0 con 0x7f0f10100a80 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10110e60 con 0x7f0f10106a80 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10111160 con 0x7f0f10101420 2024-09-19T07:53:38.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 0x7f0f10199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 0x7f0f10199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41220/0 (socket says 172.21.15.76:41220) 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 -- 172.21.15.76:0/3505346424 learned_addr learned my addr 172.21.15.76:0/3505346424 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f15ab4640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10101420 0x7f0f101998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 0x7f0f101a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 -- 172.21.15.76:0/3505346424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10101420 msgr2=0x7f0f101998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10101420 0x7f0f101998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 -- 172.21.15.76:0/3505346424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 msgr2=0x7f0f101a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 0x7f0f101a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 -- 172.21.15.76:0/3505346424 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f101a4950 con 0x7f0f10100a80 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f15ab4640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10101420 0x7f0f101998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 0x7f0f101a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f162b5640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 0x7f0f10199390 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c890 tx=0x7f0f0c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:38.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f077fe640 1 -- 172.21.15.76:0/3505346424 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c004220 con 0x7f0f10100a80 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f077fe640 1 -- 172.21.15.76:0/3505346424 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f0c0043c0 con 0x7f0f10100a80 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f077fe640 1 -- 172.21.15.76:0/3505346424 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c004b10 con 0x7f0f10100a80 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f101a4b20 con 0x7f0f10100a80 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.241+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f101a5060 con 0x7f0f10100a80 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f077fe640 1 -- 172.21.15.76:0/3505346424 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0f0c0051b0 con 0x7f0f10100a80 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 Processor -- start 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 -- start start 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 0x55706afa1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afac370 0x55706afae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55706af072f0 con 0x55706afa15d0 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55706aeaecf0 con 0x55706afa2b40 2024-09-19T07:53:38.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55706af032b0 con 0x55706afac370 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.244+0000 7f0f162b5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 0x55706afa1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 0x55706afa1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41226/0 (socket says 172.21.15.76:41226) 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 -- 172.21.15.76:0/1847380214 learned_addr learned my addr 172.21.15.76:0/1847380214 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f077fe640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0efc0a3430 0x7f0efc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f15ab4640 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afac370 0x55706afae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0efc0a3430 0x7f0efc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f077fe640 1 -- 172.21.15.76:0/3505346424 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0f0c0cfe20 con 0x7f0f10100a80 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 -- 172.21.15.76:0/1847380214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afac370 msgr2=0x55706afae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afac370 0x55706afae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 -- 172.21.15.76:0/1847380214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 msgr2=0x55706afa1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 -- 172.21.15.76:0/1847380214 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55706ae933a0 con 0x55706afa15d0 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 0x55706afa1a10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0cd4b0 tx=0x7f0f0c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95725464b43e7909 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f04ff9640 1 -- 172.21.15.76:0/1847380214 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c01d050 con 0x55706afa15d0 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f04ff9640 1 -- 172.21.15.76:0/1847380214 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f0c09c7a0 con 0x55706afa15d0 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f04ff9640 1 -- 172.21.15.76:0/1847380214 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0cd790 con 0x55706afa15d0 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.245+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0efc0a3430 0x7f0efc0a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009ca0 tx=0x7f0f08031000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1847380214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 msgr2=0x55706afa1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 0x55706afa1a10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0cd4b0 tx=0x7f0f0c005550 comp rx=0 tx=0).stop 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1847380214 shutdown_connections 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afac370 0x55706afae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afa15d0 0x55706afa1a10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1847380214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1847380214 >> 172.21.15.76:0/1847380214 conn(0x55706af6a310 msgr2=0x55706af9dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1847380214 shutdown_connections 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1847380214 wait complete. 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.246+0000 7f0f1a8f2740 1 -- start start 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 Processor -- start 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706afabd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afa9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55706afaf010 con 0x55706afac370 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55706aec2060 con 0x55706afa15d0 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55706afaf190 con 0x55706afa2b40 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f1a8f2740 10 client.0 _ll_register_callbacks cb 0x55706ac158c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:38.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41228/0 (socket says 172.21.15.76:41228) 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 -- 172.21.15.76:0/1035343959 learned_addr learned my addr 172.21.15.76:0/1035343959 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706afabd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 -- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 msgr2=0x55706afa9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afa9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 -- 172.21.15.76:0/1035343959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 msgr2=0x55706afabd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706afabd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 -- 172.21.15.76:0/1035343959 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55706ac783c0 con 0x55706afac370 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706afabd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa95d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0f08003c20 tx=0x7f0f080095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acffae7ad839c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:38.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0ef9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.247+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/1035343959 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0804c030 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/1035343959 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0f08003d10 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f0c09c7a0 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/1035343959 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f08042040 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 10 client.15924 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55706afbaac0 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/1035343959 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f0c09c7a0 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/1035343959 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0f08030070 con 0x55706afac370 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 10 client.15924 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 10 client.15924 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 20 client.15924 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706afbbf90 0x55706afbe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 4 client.15924 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55706af14860 con 0x55706afbbf90 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.248+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706afbbf90 0x55706afbe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.249+0000 7f0f162b5640 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706afbbf90 0x55706afbe3e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=363f7525a74b09ee server_cookie=c2979bc054899d97 in_seq=0 out_seq=0 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.249+0000 7f0ef9ffb640 10 client.15924 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/1035343959 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55706af14860 con 0x55706afbbf90 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0ef9ffb640 10 client.15924 handle_command_reply: tid=0 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 client.15924 shutdown 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 msgr2=0x55706afa95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa95d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0f08003c20 tx=0x7f0f080095c0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 shutdown_connections 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706afbbf90 0x55706afbe3e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa95d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afa9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0ef9ffb640 0 client.15924 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/1035343959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706afabd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 >> 172.21.15.76:0/1035343959 conn(0x55706af6a310 msgr2=0x55706afa3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 shutdown_connections 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/1035343959 wait complete. 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.250+0000 7f0f1a8f2740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 Processor -- start 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 -- start start 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706af9de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afb82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101b04a0 con 0x55706afac370 2024-09-19T07:53:38.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101add70 con 0x55706afa15d0 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101abbc0 con 0x55706afa2b40 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41238/0 (socket says 172.21.15.76:41238) 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 -- 172.21.15.76:0/3741504331 learned_addr learned my addr 172.21.15.76:0/3741504331 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f15ab4640 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afb82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 -- 172.21.15.76:0/3741504331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 msgr2=0x55706afb82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afb82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 -- 172.21.15.76:0/3741504331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 msgr2=0x55706af9de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f162b5640 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706af9de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706af9de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f16ab6640 1 -- 172.21.15.76:0/3741504331 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55706afa7550 con 0x55706afac370 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.263+0000 7f0f162b5640 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706af9de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:38.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa4180 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009bf0 tx=0x7f0f08009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a377f115a10c6595 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0efbfff640 1 -- 172.21.15.76:0/3741504331 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0805d070 con 0x55706afac370 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0efbfff640 1 -- 172.21.15.76:0/3741504331 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f08036040 con 0x55706afac370 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0efbfff640 1 -- 172.21.15.76:0/3741504331 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0804c020 con 0x55706afac370 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/3741504331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 msgr2=0x55706afa4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa4180 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009bf0 tx=0x7f0f08009800 comp rx=0 tx=0).stop 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/3741504331 shutdown_connections 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa4180 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa2b40 0x55706afb82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/3741504331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa15d0 0x55706af9de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/3741504331 >> 172.21.15.76:0/3741504331 conn(0x55706af6a310 msgr2=0x55706af9d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/3741504331 shutdown_connections 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.264+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/3741504331 wait complete. 2024-09-19T07:53:38.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 -- start start 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 Processor -- start 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa15d0 0x55706afb4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101ac230 con 0x55706afac370 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101ad6a0 con 0x55706afa2b40 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101ac900 con 0x55706afa15d0 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f1a8f2740 10 client.0 _ll_register_callbacks cb 0x7f0f08009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41250/0 (socket says 172.21.15.76:41250) 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 -- 172.21.15.76:0/2641684049 learned_addr learned my addr 172.21.15.76:0/2641684049 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 -- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa15d0 msgr2=0x55706afb4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f15ab4640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa15d0 0x55706afb4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 -- 172.21.15.76:0/2641684049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 msgr2=0x55706afa5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f16ab6640 1 -- 172.21.15.76:0/2641684049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55706afa6b90 con 0x55706afac370 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.265+0000 7f0f15ab4640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f16ab6640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa6360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f0802a920 tx=0x7f0f08004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6810af609f531b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0ef9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/2641684049 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0804c030 con 0x55706afac370 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/2641684049 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0f08058820 con 0x55706afac370 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f08036040 con 0x55706afac370 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/2641684049 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f0805d070 con 0x55706afac370 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 10 client.15930 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:38.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55706b026cc0 con 0x55706afac370 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/2641684049 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f08036040 con 0x55706afac370 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/2641684049 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0f08005020 con 0x55706afac370 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 10 client.15930 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 10 client.15930 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 20 client.15930 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706b027320 0x55706b029730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 4 client.15930 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.266+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55706af0ed70 con 0x55706b027320 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f162b5640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706b027320 0x55706b029730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f162b5640 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706b027320 0x55706b029730 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=665ef1e42d3b4928 server_cookie=dc0756515b4e1a3e in_seq=0 out_seq=0 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0ef9ffb640 10 client.15930 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0ef9ffb640 1 -- 172.21.15.76:0/2641684049 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55706af0ed70 con 0x55706b027320 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0ef9ffb640 10 client.15930 handle_command_reply: tid=0 2024-09-19T07:53:38.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f1a8f2740 1 client.15930 shutdown 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 msgr2=0x55706afa6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa6360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f0802a920 tx=0x7f0f08004410 comp rx=0 tx=0).stop 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 shutdown_connections 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.267+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55706b027320 0x55706b029730 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55706afac370 0x55706afa6360 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55706afa2b40 0x55706afa5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 1 --2- 172.21.15.76:0/2641684049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706afa15d0 0x55706afb4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0ef9ffb640 0 client.15930 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 >> 172.21.15.76:0/2641684049 conn(0x55706af6a310 msgr2=0x55706afaa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 shutdown_connections 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 1 -- 172.21.15.76:0/2641684049 wait complete. 2024-09-19T07:53:38.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f1a8f2740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T07:53:38.285 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:53:38.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0efc0a3430 msgr2=0x7f0efc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0efc0a3430 0x7f0efc0a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009ca0 tx=0x7f0f08031000 comp rx=0 tx=0).stop 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 msgr2=0x7f0f10199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 0x7f0f10199390 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c890 tx=0x7f0f0c00cd50 comp rx=0 tx=0).stop 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 shutdown_connections 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0efc0a3430 0x7f0efc0a58f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f10106a80 0x7f0f101a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f10101420 0x7f0f101998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 --2- 172.21.15.76:0/3505346424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0f10100a80 0x7f0f10199390 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 >> 172.21.15.76:0/3505346424 conn(0x7f0f100fc7a0 msgr2=0x7f0f100fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 shutdown_connections 2024-09-19T07:53:38.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:38.268+0000 7f0f18519640 1 -- 172.21.15.76:0/3505346424 wait complete. 2024-09-19T07:53:38.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:38 smithi152 ceph-mon[35117]: pgmap v77: 97 pgs: 97 active+clean; 46 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 6 op/s 2024-09-19T07:53:38.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:38 smithi137 ceph-mon[35309]: pgmap v77: 97 pgs: 97 active+clean; 46 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 6 op/s 2024-09-19T07:53:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:38 smithi076 ceph-mon[30930]: pgmap v77: 97 pgs: 97 active+clean; 46 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 6 op/s 2024-09-19T07:53:39.149 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:53:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:40.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2580252574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4100e20 msgr2=0x7f24f4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2580252574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4100e20 0x7f24f4101200 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009900 tx=0x7f24e402a480 comp rx=0 tx=0).stop 2024-09-19T07:53:40.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2580252574 shutdown_connections 2024-09-19T07:53:40.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2580252574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102ef0 0x7f24f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2580252574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102570 0x7f24f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2580252574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4100e20 0x7f24f4101200 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2580252574 >> 172.21.15.76:0/2580252574 conn(0x7f24f40fc7d0 msgr2=0x7f24f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2580252574 shutdown_connections 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.050+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2580252574 wait complete. 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 Processor -- start 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 -- start start 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4100e20 0x7f24f41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 0x7f24f4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102ef0 0x7f24f41a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41110a0 con 0x7f24f4102570 2024-09-19T07:53:40.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4110f20 con 0x7f24f4100e20 2024-09-19T07:53:40.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f8e9a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4111220 con 0x7f24f4102ef0 2024-09-19T07:53:40.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 0x7f24f4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 0x7f24f4199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41258/0 (socket says 172.21.15.76:41258) 2024-09-19T07:53:40.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 -- 172.21.15.76:0/2598831605 learned_addr learned my addr 172.21.15.76:0/2598831605 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:40.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102ef0 0x7f24f41a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f259c640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4100e20 0x7f24f41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 -- 172.21.15.76:0/2598831605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102ef0 msgr2=0x7f24f41a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102ef0 0x7f24f41a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 -- 172.21.15.76:0/2598831605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4100e20 msgr2=0x7f24f41993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4100e20 0x7f24f41993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24ebfff640 1 -- 172.21.15.76:0/2598831605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f41a49b0 con 0x7f24f4102570 2024-09-19T07:53:40.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f259c640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4100e20 0x7f24f41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.051+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102ef0 0x7f24f41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.052+0000 7f24ebfff640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 0x7f24f4199930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00d770 tx=0x7f24dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.052+0000 7f24eb7fe640 1 -- 172.21.15.76:0/2598831605 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc017070 con 0x7f24f4102570 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.052+0000 7f24eb7fe640 1 -- 172.21.15.76:0/2598831605 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24dc005520 con 0x7f24f4102570 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.052+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f41a4b80 con 0x7f24f4102570 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.052+0000 7f24eb7fe640 1 -- 172.21.15.76:0/2598831605 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc010460 con 0x7f24f4102570 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.052+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f41a5040 con 0x7f24f4102570 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.054+0000 7f24eb7fe640 1 -- 172.21.15.76:0/2598831605 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f24dc004ea0 con 0x7f24f4102570 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.054+0000 7f24fb273740 1 Processor -- start 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.054+0000 7f24fb273740 1 -- start start 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24fb273740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff02090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24fb273740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff02a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24fb273740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff11780 0x560f6ff13b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24eb7fe640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24e00a33b0 0x7f24e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24fb273740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560f6fe682f0 con 0x560f6ff03b40 2024-09-19T07:53:40.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24fb273740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560f6fe0fcf0 con 0x560f6ff11780 2024-09-19T07:53:40.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24fb273740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f6fe642b0 con 0x560f6ff025d0 2024-09-19T07:53:40.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff02090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff02090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41272/0 (socket says 172.21.15.76:41272) 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 -- 172.21.15.76:0/1752398713 learned_addr learned my addr 172.21.15.76:0/1752398713 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24e00a33b0 0x7f24e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24eb7fe640 1 -- 172.21.15.76:0/2598831605 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f24dc0cf940 con 0x7f24f4102570 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24ebfff640 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff11780 0x560f6ff13b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f259c640 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff02a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 -- 172.21.15.76:0/1752398713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 msgr2=0x560f6ff02a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff02a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 -- 172.21.15.76:0/1752398713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff11780 msgr2=0x560f6ff13b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff11780 0x560f6ff13b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 -- 172.21.15.76:0/1752398713 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f6fdf43a0 con 0x560f6ff03b40 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f259c640 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff02a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff02090 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f24ec013e60 tx=0x7f24ec0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc99d4b13c7339c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.055+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24e00a33b0 0x7f24e00a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24ec010ca0 tx=0x7f24ec015000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24e8ff9640 1 -- 172.21.15.76:0/1752398713 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00ae10 con 0x560f6ff03b40 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24e8ff9640 1 -- 172.21.15.76:0/1752398713 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24ec007be0 con 0x560f6ff03b40 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24e8ff9640 1 -- 172.21.15.76:0/1752398713 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec01f730 con 0x560f6ff03b40 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 -- 172.21.15.76:0/1752398713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 msgr2=0x560f6ff02090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff02090 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f24ec013e60 tx=0x7f24ec0107a0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 -- 172.21.15.76:0/1752398713 shutdown_connections 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff11780 0x560f6ff13b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff02a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 --2- 172.21.15.76:0/1752398713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff02090 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 -- 172.21.15.76:0/1752398713 >> 172.21.15.76:0/1752398713 conn(0x560f6fecb310 msgr2=0x560f6fefec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.056+0000 7f24fb273740 1 -- 172.21.15.76:0/1752398713 shutdown_connections 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 -- 172.21.15.76:0/1752398713 wait complete. 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 -- start start 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 Processor -- start 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff0e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff11780 0x560f6ff0e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560f6ff14420 con 0x560f6ff03b40 2024-09-19T07:53:40.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560f6fe23060 con 0x560f6ff025d0 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f6ff145a0 con 0x560f6ff11780 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24fb273740 10 client.0 _ll_register_callbacks cb 0x560f6fb768c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff0e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff0e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41278/0 (socket says 172.21.15.76:41278) 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 -- 172.21.15.76:0/3472254782 learned_addr learned my addr 172.21.15.76:0/3472254782 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24f259c640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff11780 0x560f6ff0e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 -- 172.21.15.76:0/3472254782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff11780 msgr2=0x560f6ff0e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff11780 0x560f6ff0e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 -- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 msgr2=0x560f6ff110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.057+0000 7f24ebfff640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24ebfff640 1 -- 172.21.15.76:0/3472254782 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f6fbd93c0 con 0x560f6ff03b40 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24f259c640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24ebfff640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff0e440 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f24dc09bb50 tx=0x7f24dc09b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daab097e3b4feadb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24d9ffb640 1 -- 172.21.15.76:0/3472254782 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc020040 con 0x560f6ff03b40 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24d9ffb640 1 -- 172.21.15.76:0/3472254782 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f24dc098230 con 0x560f6ff03b40 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24ec007be0 con 0x560f6ff03b40 2024-09-19T07:53:40.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24d9ffb640 1 -- 172.21.15.76:0/3472254782 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24dc09bbc0 con 0x560f6ff03b40 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 10 client.15942 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f6ff1fe30 con 0x560f6ff03b40 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24d9ffb640 1 -- 172.21.15.76:0/3472254782 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24ec007be0 con 0x560f6ff03b40 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24d9ffb640 1 -- 172.21.15.76:0/3472254782 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24dc0af020 con 0x560f6ff03b40 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 10 client.15942 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 10 client.15942 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 20 client.15942 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff21180 0x560f6ff23570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 4 client.15942 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.058+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f6fe75860 con 0x560f6ff21180 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.059+0000 7f24f259c640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff21180 0x560f6ff23570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.059+0000 7f24d9ffb640 10 client.15942 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:40.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.059+0000 7f24f259c640 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff21180 0x560f6ff23570 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfdee587a5e61561 server_cookie=7870792c5e87138 in_seq=0 out_seq=0 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24d9ffb640 1 -- 172.21.15.76:0/3472254782 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f6fe75860 con 0x560f6ff21180 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24d9ffb640 10 client.15942 handle_command_reply: tid=0 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 client.15942 shutdown 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 msgr2=0x560f6ff0e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff0e440 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f24dc09bb50 tx=0x7f24dc09b700 comp rx=0 tx=0).stop 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 shutdown_connections 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff21180 0x560f6ff23570 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff11780 0x560f6ff0e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff03b40 0x560f6ff0e440 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 --2- 172.21.15.76:0/3472254782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 >> 172.21.15.76:0/3472254782 conn(0x560f6fecb310 msgr2=0x560f6ff04960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24d9ffb640 0 client.15942 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 shutdown_connections 2024-09-19T07:53:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 1 -- 172.21.15.76:0/3472254782 wait complete. 2024-09-19T07:53:40.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.060+0000 7f24fb273740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T07:53:40.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 Processor -- start 2024-09-19T07:53:40.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 -- start start 2024-09-19T07:53:40.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff1d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff03b40 0x560f6fefe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6fefea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41ae1a0 con 0x560f6ff11780 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41aba70 con 0x560f6ff025d0 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24fb273740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41a98e0 con 0x560f6ff03b40 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6fefea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6fefea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41288/0 (socket says 172.21.15.76:41288) 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 -- 172.21.15.76:0/15284945 learned_addr learned my addr 172.21.15.76:0/15284945 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24ebfff640 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff03b40 0x560f6fefe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f259c640 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff1d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 -- 172.21.15.76:0/15284945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff03b40 msgr2=0x560f6fefe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff03b40 0x560f6fefe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 -- 172.21.15.76:0/15284945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 msgr2=0x560f6ff1d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff1d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 -- 172.21.15.76:0/15284945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f6ff0ecd0 con 0x560f6ff11780 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f259c640 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff1d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.073+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6fefea50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f24ec010f70 tx=0x7f24ec010fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ea551a474b4086 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24dbfff640 1 -- 172.21.15.76:0/15284945 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00ac10 con 0x560f6ff11780 2024-09-19T07:53:40.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24dbfff640 1 -- 172.21.15.76:0/15284945 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24ec00adb0 con 0x560f6ff11780 2024-09-19T07:53:40.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24dbfff640 1 -- 172.21.15.76:0/15284945 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00e980 con 0x560f6ff11780 2024-09-19T07:53:40.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 -- 172.21.15.76:0/15284945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 msgr2=0x560f6fefea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6fefea50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f24ec010f70 tx=0x7f24ec010fa0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 -- 172.21.15.76:0/15284945 shutdown_connections 2024-09-19T07:53:40.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6fefea50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff03b40 0x560f6fefe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 --2- 172.21.15.76:0/15284945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff025d0 0x560f6ff1d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 -- 172.21.15.76:0/15284945 >> 172.21.15.76:0/15284945 conn(0x560f6fecb310 msgr2=0x560f6ff0d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:40.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 -- 172.21.15.76:0/15284945 shutdown_connections 2024-09-19T07:53:40.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.074+0000 7f24fb273740 1 -- 172.21.15.76:0/15284945 wait complete. 2024-09-19T07:53:40.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 -- start start 2024-09-19T07:53:40.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 Processor -- start 2024-09-19T07:53:40.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff19f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff03b40 0x560f6ff15270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6ff157b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41a9f30 con 0x560f6ff11780 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41ab3a0 con 0x560f6ff03b40 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41aa600 con 0x560f6ff025d0 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24fb273740 10 client.0 _ll_register_callbacks cb 0x7f24dc009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6ff157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6ff157b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41294/0 (socket says 172.21.15.76:41294) 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 -- 172.21.15.76:0/2701161702 learned_addr learned my addr 172.21.15.76:0/2701161702 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24ebfff640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff03b40 0x560f6ff15270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f259c640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff19f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 -- 172.21.15.76:0/2701161702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 msgr2=0x560f6ff19f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff19f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 -- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff03b40 msgr2=0x560f6ff15270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff03b40 0x560f6ff15270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.075+0000 7f24f2d9d640 1 -- 172.21.15.76:0/2701161702 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f6ff15fb0 con 0x560f6ff11780 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24ebfff640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff03b40 0x560f6ff15270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24f2d9d640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6ff157b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0076f0 tx=0x7f24ec00af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31ea3da54b7a61e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24d9ffb640 1 -- 172.21.15.76:0/2701161702 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec03d020 con 0x560f6ff11780 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24d9ffb640 1 -- 172.21.15.76:0/2701161702 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f24ec00e780 con 0x560f6ff11780 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24ec00adb0 con 0x560f6ff11780 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24d9ffb640 1 -- 172.21.15.76:0/2701161702 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24ec00ac10 con 0x560f6ff11780 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 10 client.15948 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:40.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f6ff8bd50 con 0x560f6ff11780 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24d9ffb640 1 -- 172.21.15.76:0/2701161702 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24ec00adb0 con 0x560f6ff11780 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24d9ffb640 1 -- 172.21.15.76:0/2701161702 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24ec005410 con 0x560f6ff11780 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 10 client.15948 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 10 client.15948 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 20 client.15948 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff8c2c0 0x560f6ff8e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 4 client.15948 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.076+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f6fe6fd70 con 0x560f6ff8c2c0 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24f259c640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff8c2c0 0x560f6ff8e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24f259c640 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff8c2c0 0x560f6ff8e6b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c05e92040027a4c server_cookie=985b960ae8436801 in_seq=0 out_seq=0 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24d9ffb640 10 client.15948 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24d9ffb640 1 -- 172.21.15.76:0/2701161702 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f6fe6fd70 con 0x560f6ff8c2c0 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24d9ffb640 10 client.15948 handle_command_reply: tid=0 2024-09-19T07:53:40.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 client.15948 shutdown 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 msgr2=0x560f6ff157b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6ff157b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0076f0 tx=0x7f24ec00af60 comp rx=0 tx=0).stop 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 shutdown_connections 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f6ff8c2c0 0x560f6ff8e6b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f6ff11780 0x560f6ff157b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f6ff03b40 0x560f6ff15270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24d9ffb640 0 client.15948 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 --2- 172.21.15.76:0/2701161702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f6ff025d0 0x560f6ff19f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.077+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 >> 172.21.15.76:0/2701161702 conn(0x560f6fecb310 msgr2=0x560f6ff0fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 shutdown_connections 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24fb273740 1 -- 172.21.15.76:0/2701161702 wait complete. 2024-09-19T07:53:40.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24fb273740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T07:53:40.091 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:53:40.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24e00a33b0 msgr2=0x7f24e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24e00a33b0 0x7f24e00a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24ec010ca0 tx=0x7f24ec015000 comp rx=0 tx=0).stop 2024-09-19T07:53:40.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 msgr2=0x7f24f4199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:40.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 0x7f24f4199930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00d770 tx=0x7f24dc00dc30 comp rx=0 tx=0).stop 2024-09-19T07:53:40.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 shutdown_connections 2024-09-19T07:53:40.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24e00a33b0 0x7f24e00a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4102ef0 0x7f24f41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4102570 0x7f24f4199930 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 --2- 172.21.15.76:0/2598831605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4100e20 0x7f24f41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:40.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 >> 172.21.15.76:0/2598831605 conn(0x7f24f40fc7d0 msgr2=0x7f24f4106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:40.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 shutdown_connections 2024-09-19T07:53:40.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:40.078+0000 7f24f8e9a640 1 -- 172.21.15.76:0/2598831605 wait complete. 2024-09-19T07:53:40.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:40 smithi152 ceph-mon[35117]: pgmap v78: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-09-19T07:53:40.869 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:40 smithi076 ceph-mon[30930]: pgmap v78: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-09-19T07:53:40.895 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:53:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:40 smithi137 ceph-mon[35309]: pgmap v78: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-09-19T07:53:41.145 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.603+0000 7f29b861a640 1 -- 172.21.15.76:0/1520138148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 msgr2=0x7f29b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.603+0000 7f29b861a640 1 --2- 172.21.15.76:0/1520138148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b010da40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009900 tx=0x7f29a802a480 comp rx=0 tx=0).stop 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 -- 172.21.15.76:0/1520138148 shutdown_connections 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 --2- 172.21.15.76:0/1520138148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b010da40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 --2- 172.21.15.76:0/1520138148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b0102570 0x7f29b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 --2- 172.21.15.76:0/1520138148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29b0100e20 0x7f29b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 -- 172.21.15.76:0/1520138148 >> 172.21.15.76:0/1520138148 conn(0x7f29b00fc7d0 msgr2=0x7f29b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 -- 172.21.15.76:0/1520138148 shutdown_connections 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 -- 172.21.15.76:0/1520138148 wait complete. 2024-09-19T07:53:41.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 Processor -- start 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.604+0000 7f29b861a640 1 -- start start 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29b0100e20 0x7f29b01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b0102570 0x7f29b0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01121c0 con 0x7f29b0102ef0 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112040 con 0x7f29b0100e20 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112340 con 0x7f29b0102570 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41300/0 (socket says 172.21.15.76:41300) 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 -- 172.21.15.76:0/3443066282 learned_addr learned my addr 172.21.15.76:0/3443066282 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b63b6640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29b0100e20 0x7f29b01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b0102570 0x7f29b0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 -- 172.21.15.76:0/3443066282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b0102570 msgr2=0x7f29b0198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b0102570 0x7f29b0198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 -- 172.21.15.76:0/3443066282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29b0100e20 msgr2=0x7f29b01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29b0100e20 0x7f29b01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 -- 172.21.15.76:0/3443066282 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b019d490 con 0x7f29b0102ef0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b6bb7640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b019cdb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f29a8032fd0 tx=0x7f29a8004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29af7fe640 1 -- 172.21.15.76:0/3443066282 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a803f030 con 0x7f29b0102ef0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29af7fe640 1 -- 172.21.15.76:0/3443066282 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29a8005000 con 0x7f29b0102ef0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29af7fe640 1 -- 172.21.15.76:0/3443066282 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8035070 con 0x7f29b0102ef0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.605+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b019d720 con 0x7f29b0102ef0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.606+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a5060 con 0x7f29b0102ef0 2024-09-19T07:53:41.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.608+0000 7f29af7fe640 1 -- 172.21.15.76:0/3443066282 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f29a8042030 con 0x7f29b0102ef0 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.608+0000 7f29ba9f3740 1 Processor -- start 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.608+0000 7f29ba9f3740 1 -- start start 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed5101b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5101ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed51028760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55ed50f812f0 con 0x55ed5101b5d0 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed50f28cf0 con 0x55ed51026370 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ed50f7d2b0 con 0x55ed5101cb40 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29af7fe640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f29980a3430 0x7f29980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b63b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5101ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b6bb7640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f29980a3430 0x7f29980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed5101b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed5101b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:47476/0 (socket says 172.21.15.76:47476) 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 -- 172.21.15.76:0/3419202785 learned_addr learned my addr 172.21.15.76:0/3419202785 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29af7fe640 1 -- 172.21.15.76:0/3443066282 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f29a80f0320 con 0x7f29b0102ef0 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed51028760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 -- 172.21.15.76:0/3419202785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 msgr2=0x55ed51028760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed51028760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 -- 172.21.15.76:0/3419202785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 msgr2=0x55ed5101ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.609+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5101ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29b5bb5640 1 -- 172.21.15.76:0/3419202785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed50f0d3a0 con 0x55ed5101cb40 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29b63b6640 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5101ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29b6bb7640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f29980a3430 0x7f29980a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29a80bc4d0 tx=0x7f29a808e2c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:41.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed5101b090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29a4012880 tx=0x7f29a400b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21421db4f2509916 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29acff9640 1 -- 172.21.15.76:0/3419202785 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a400ebe0 con 0x55ed5101cb40 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29acff9640 1 -- 172.21.15.76:0/3419202785 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29a400b940 con 0x55ed5101cb40 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.610+0000 7f29acff9640 1 -- 172.21.15.76:0/3419202785 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a400f620 con 0x55ed5101cb40 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- 172.21.15.76:0/3419202785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 msgr2=0x55ed5101b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed5101b090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29a4012880 tx=0x7f29a400b460 comp rx=0 tx=0).stop 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- 172.21.15.76:0/3419202785 shutdown_connections 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed51028760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5101ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/3419202785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed5101b090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- 172.21.15.76:0/3419202785 >> 172.21.15.76:0/3419202785 conn(0x55ed50fe4310 msgr2=0x55ed51017c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- 172.21.15.76:0/3419202785 shutdown_connections 2024-09-19T07:53:41.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- 172.21.15.76:0/3419202785 wait complete. 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- start start 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 Processor -- start 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101b5d0 0x55ed51025d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 0x55ed51023000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed510235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55ed51029070 con 0x55ed5101cb40 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed50f3c060 con 0x55ed51026370 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.611+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ed510291f0 con 0x55ed5101b5d0 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29ba9f3740 10 client.0 _ll_register_callbacks cb 0x55ed50c8f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 0x55ed51023000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 0x55ed51023000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41330/0 (socket says 172.21.15.76:41330) 2024-09-19T07:53:41.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 -- 172.21.15.76:0/2120980773 learned_addr learned my addr 172.21.15.76:0/2120980773 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed510235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 -- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101b5d0 msgr2=0x55ed51025d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101b5d0 0x55ed51025d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 -- 172.21.15.76:0/2120980773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 msgr2=0x55ed510235d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed510235d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 -- 172.21.15.76:0/2120980773 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed50cf23c0 con 0x55ed5101cb40 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed510235d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29b63b6640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 0x55ed51023000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f29a0010b70 tx=0x7f29a000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870b3f174a8b57b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f2995ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f2995ffb640 1 -- 172.21.15.76:0/2120980773 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a001e060 con 0x55ed5101cb40 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f2995ffb640 1 -- 172.21.15.76:0/2120980773 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f29a000e5c0 con 0x55ed5101cb40 2024-09-19T07:53:41.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a400b940 con 0x55ed5101cb40 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f2995ffb640 1 -- 172.21.15.76:0/2120980773 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29a000e7c0 con 0x55ed5101cb40 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29ba9f3740 10 client.15960 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.612+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ed51034b50 con 0x55ed5101cb40 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f2995ffb640 1 -- 172.21.15.76:0/2120980773 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29a400b940 con 0x55ed5101cb40 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f2995ffb640 1 -- 172.21.15.76:0/2120980773 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29a0021c70 con 0x55ed5101cb40 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29ba9f3740 10 client.15960 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29ba9f3740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29ba9f3740 20 client.15960 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed51036060 0x55ed51038490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29ba9f3740 4 client.15960 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed50f8e860 con 0x55ed51036060 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.613+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed51036060 0x55ed51038490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed51036060 0x55ed51038490 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=935fc9369da96ff7 server_cookie=c58ca8f1151f83ca in_seq=0 out_seq=0 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f2995ffb640 10 client.15960 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f2995ffb640 1 -- 172.21.15.76:0/2120980773 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed50f8e860 con 0x55ed51036060 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f2995ffb640 10 client.15960 handle_command_reply: tid=0 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 client.15960 shutdown 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 msgr2=0x55ed51023000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 0x55ed51023000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f29a0010b70 tx=0x7f29a000f7f0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 shutdown_connections 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed51026370 0x55ed510235d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed51036060 0x55ed51038490 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101cb40 0x55ed51023000 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/2120980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101b5d0 0x55ed51025d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f2995ffb640 0 client.15960 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 >> 172.21.15.76:0/2120980773 conn(0x55ed50fe4310 msgr2=0x55ed5101d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.614+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 shutdown_connections 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.615+0000 7f29ba9f3740 1 -- 172.21.15.76:0/2120980773 wait complete. 2024-09-19T07:53:41.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.615+0000 7f29ba9f3740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.627+0000 7f29ba9f3740 1 Processor -- start 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 -- start start 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101b5d0 0x55ed510228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed51032310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 0x55ed5103dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01b0340 con 0x55ed51026370 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01adc10 con 0x55ed5101b5d0 2024-09-19T07:53:41.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01aba60 con 0x55ed5101cb40 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 0x55ed5103dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 0x55ed5103dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41342/0 (socket says 172.21.15.76:41342) 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 -- 172.21.15.76:0/1757723312 learned_addr learned my addr 172.21.15.76:0/1757723312 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b63b6640 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed51032310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101b5d0 0x55ed510228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 -- 172.21.15.76:0/1757723312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 msgr2=0x55ed51032310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed51032310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 -- 172.21.15.76:0/1757723312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101b5d0 msgr2=0x55ed510228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101b5d0 0x55ed510228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 -- 172.21.15.76:0/1757723312 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed51038b10 con 0x55ed51026370 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b63b6640 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed51032310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.628+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 0x55ed5103dda0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f29a4012850 tx=0x7f29a4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d171b687bbea4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:41.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f2997fff640 1 -- 172.21.15.76:0/1757723312 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40050b0 con 0x55ed51026370 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f2997fff640 1 -- 172.21.15.76:0/1757723312 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29a4005250 con 0x55ed51026370 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f2997fff640 1 -- 172.21.15.76:0/1757723312 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4010940 con 0x55ed51026370 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 -- 172.21.15.76:0/1757723312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 msgr2=0x55ed5103dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 0x55ed5103dda0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f29a4012850 tx=0x7f29a4010c20 comp rx=0 tx=0).stop 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 -- 172.21.15.76:0/1757723312 shutdown_connections 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed51026370 0x55ed5103dda0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed5101cb40 0x55ed51032310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/1757723312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101b5d0 0x55ed510228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 -- 172.21.15.76:0/1757723312 >> 172.21.15.76:0/1757723312 conn(0x55ed50fe4310 msgr2=0x55ed510218d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 -- 172.21.15.76:0/1757723312 shutdown_connections 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.629+0000 7f29ba9f3740 1 -- 172.21.15.76:0/1757723312 wait complete. 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 -- start start 2024-09-19T07:53:41.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 Processor -- start 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5102e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101cb40 0x55ed5102ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed51026370 0x55ed51029db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01ac0d0 con 0x55ed5101b5d0 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01ad540 con 0x55ed5101cb40 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01ac7a0 con 0x55ed51026370 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29ba9f3740 10 client.0 _ll_register_callbacks cb 0x7f29a000aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5102e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5102e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41352/0 (socket says 172.21.15.76:41352) 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 -- 172.21.15.76:0/4208743645 learned_addr learned my addr 172.21.15.76:0/4208743645 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b63b6640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101cb40 0x55ed5102ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed51026370 0x55ed51029db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 -- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed51026370 msgr2=0x55ed51029db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed51026370 0x55ed51029db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 -- 172.21.15.76:0/4208743645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101cb40 msgr2=0x55ed5102ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101cb40 0x55ed5102ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 -- 172.21.15.76:0/4208743645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed5102a5e0 con 0x55ed5101b5d0 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f29b5bb5640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5102e830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f29a4010580 tx=0x7f29a4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134eaf7758893480 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.630+0000 7f2995ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f2995ffb640 1 -- 172.21.15.76:0/4208743645 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40050a0 con 0x55ed5101b5d0 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f2995ffb640 1 -- 172.21.15.76:0/4208743645 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f29a4012040 con 0x55ed5101b5d0 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a4005250 con 0x55ed5101b5d0 2024-09-19T07:53:41.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f2995ffb640 1 -- 172.21.15.76:0/4208743645 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29a403e050 con 0x55ed5101b5d0 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 10 client.15966 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ed510a09e0 con 0x55ed5101b5d0 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f2995ffb640 1 -- 172.21.15.76:0/4208743645 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29a4005250 con 0x55ed5101b5d0 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f2995ffb640 1 -- 172.21.15.76:0/4208743645 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29a4036020 con 0x55ed5101b5d0 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 10 client.15966 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 20 client.15966 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed510a0e50 0x55ed510a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 4 client.15966 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.631+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed50f88d70 con 0x55ed510a0e50 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29b63b6640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed510a0e50 0x55ed510a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29b63b6640 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed510a0e50 0x55ed510a3240 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12b68eda53df6f82 server_cookie=52df791a4f92ecc4 in_seq=0 out_seq=0 2024-09-19T07:53:41.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f2995ffb640 10 client.15966 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f2995ffb640 1 -- 172.21.15.76:0/4208743645 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed50f88d70 con 0x55ed510a0e50 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f2995ffb640 10 client.15966 handle_command_reply: tid=0 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 client.15966 shutdown 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 msgr2=0x55ed5102e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5102e830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f29a4010580 tx=0x7f29a4001e50 comp rx=0 tx=0).stop 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 shutdown_connections 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed51026370 0x55ed51029db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed5101cb40 0x55ed5102ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ed510a0e50 0x55ed510a3240 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 --2- 172.21.15.76:0/4208743645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ed5101b5d0 0x55ed5102e830 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 >> 172.21.15.76:0/4208743645 conn(0x55ed50fe4310 msgr2=0x55ed5101d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f2995ffb640 0 client.15966 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:41.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 shutdown_connections 2024-09-19T07:53:41.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 1 -- 172.21.15.76:0/4208743645 wait complete. 2024-09-19T07:53:41.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.632+0000 7f29ba9f3740 20 client.15966 trim_cache size 0 max 16384 2024-09-19T07:53:41.645 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f29980a3430 msgr2=0x7f29980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f29980a3430 0x7f29980a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29a80bc4d0 tx=0x7f29a808e2c0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 msgr2=0x7f29b019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b019cdb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f29a8032fd0 tx=0x7f29a8004b80 comp rx=0 tx=0).stop 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 shutdown_connections 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f29980a3430 0x7f29980a58f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0102ef0 0x7f29b019cdb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b0102570 0x7f29b0198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 --2- 172.21.15.76:0/3443066282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29b0100e20 0x7f29b01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:41.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 >> 172.21.15.76:0/3443066282 conn(0x7f29b00fc7d0 msgr2=0x7f29b01067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:41.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 shutdown_connections 2024-09-19T07:53:41.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:41.633+0000 7f29b861a640 1 -- 172.21.15.76:0/3443066282 wait complete. 2024-09-19T07:53:42.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:42 smithi152 ceph-mon[35117]: pgmap v79: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2024-09-19T07:53:42.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:42 smithi137 ceph-mon[35309]: pgmap v79: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2024-09-19T07:53:42.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:42 smithi076 ceph-mon[30930]: pgmap v79: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2024-09-19T07:53:43.482 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:53:43.483 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:53:43.746 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:44.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 -- 172.21.15.76:0/3792820095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102ef0 msgr2=0x7f495c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 --2- 172.21.15.76:0/3792820095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102ef0 0x7f495c10da40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4954009ca0 tx=0x7f495402a950 comp rx=0 tx=0).stop 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 -- 172.21.15.76:0/3792820095 shutdown_connections 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 --2- 172.21.15.76:0/3792820095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102ef0 0x7f495c10da40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 --2- 172.21.15.76:0/3792820095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c102570 0x7f495c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 --2- 172.21.15.76:0/3792820095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f495c100e20 0x7f495c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 -- 172.21.15.76:0/3792820095 >> 172.21.15.76:0/3792820095 conn(0x7f495c0fc7d0 msgr2=0x7f495c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 -- 172.21.15.76:0/3792820095 shutdown_connections 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.267+0000 7f49633a4640 1 -- 172.21.15.76:0/3792820095 wait complete. 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 Processor -- start 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 -- start start 2024-09-19T07:53:44.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c100e20 0x7f495c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 0x7f495c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f495c102ef0 0x7f495c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1110a0 con 0x7f495c102570 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f495c110f20 con 0x7f495c100e20 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f49633a4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f495c111220 con 0x7f495c102ef0 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f496093f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 0x7f495c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f496093f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 0x7f495c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60398/0 (socket says 172.21.15.76:60398) 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f496093f640 1 -- 172.21.15.76:0/612334690 learned_addr learned my addr 172.21.15.76:0/612334690 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f4961941640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f495c102ef0 0x7f495c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.268+0000 7f4961140640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c100e20 0x7f495c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f496093f640 1 -- 172.21.15.76:0/612334690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f495c102ef0 msgr2=0x7f495c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f496093f640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f495c102ef0 0x7f495c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f496093f640 1 -- 172.21.15.76:0/612334690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c100e20 msgr2=0x7f495c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f496093f640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c100e20 0x7f495c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f496093f640 1 -- 172.21.15.76:0/612334690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1a6970 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f4961140640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c100e20 0x7f495c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f496093f640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 0x7f495c0fd1c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c920 tx=0x7f494c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f49527fc640 1 -- 172.21.15.76:0/612334690 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c007c70 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f49527fc640 1 -- 172.21.15.76:0/612334690 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f494c007e10 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1a6c60 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f49527fc640 1 -- 172.21.15.76:0/612334690 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c018940 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.269+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1a71a0 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f49527fc640 1 -- 172.21.15.76:0/612334690 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f494c018b20 con 0x7f495c102570 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 Processor -- start 2024-09-19T07:53:44.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 -- start start 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 0x557115a68f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a69480 0x557115a73800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a76130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5571159ce280 con 0x557115a68b60 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557115975b10 con 0x557115a69480 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f496577d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5571159ca240 con 0x557115a73d40 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f4961941640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 0x557115a68f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f4961941640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 0x557115a68f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60408/0 (socket says 172.21.15.76:60408) 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f4961941640 1 -- 172.21.15.76:0/1552967099 learned_addr learned my addr 172.21.15.76:0/1552967099 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.272+0000 7f49527fc640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f49480a3430 0x7f49480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f496093f640 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a76130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961140640 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a69480 0x557115a73800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f49480a3430 0x7f49480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f49527fc640 1 -- 172.21.15.76:0/612334690 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f494c0cfe20 con 0x7f495c102570 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 -- 172.21.15.76:0/1552967099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 msgr2=0x557115a76130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a76130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 -- 172.21.15.76:0/1552967099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a69480 msgr2=0x557115a73800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a69480 0x557115a73800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 -- 172.21.15.76:0/1552967099 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571159821f0 con 0x557115a68b60 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f496093f640 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a76130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 0x557115a68f40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4954030040 tx=0x7f495402f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06c899fc9d00e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f49477fe640 1 -- 172.21.15.76:0/1552967099 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954043050 con 0x557115a68b60 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f4961941640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f49480a3430 0x7f49480a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f495404e000 tx=0x7f495404c000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f49477fe640 1 -- 172.21.15.76:0/1552967099 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4954044040 con 0x557115a68b60 2024-09-19T07:53:44.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.273+0000 7f49477fe640 1 -- 172.21.15.76:0/1552967099 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495404d020 con 0x557115a68b60 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 -- 172.21.15.76:0/1552967099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 msgr2=0x557115a68f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 0x557115a68f40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4954030040 tx=0x7f495402f4a0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 -- 172.21.15.76:0/1552967099 shutdown_connections 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a76130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a69480 0x557115a73800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 --2- 172.21.15.76:0/1552967099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a68b60 0x557115a68f40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 -- 172.21.15.76:0/1552967099 >> 172.21.15.76:0/1552967099 conn(0x557115a650f0 msgr2=0x557115a654d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 -- 172.21.15.76:0/1552967099 shutdown_connections 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 -- 172.21.15.76:0/1552967099 wait complete. 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 -- start start 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.274+0000 7f496577d740 1 Processor -- start 2024-09-19T07:53:44.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a68b60 0x557115a70c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a71140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a73d40 0x557115a71680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557115a76910 con 0x557115a69480 2024-09-19T07:53:44.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557115988f10 con 0x557115a73d40 2024-09-19T07:53:44.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557115a76a90 con 0x557115a68b60 2024-09-19T07:53:44.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496577d740 10 client.0 _ll_register_callbacks cb 0x557115951a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a71140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a71140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60424/0 (socket says 172.21.15.76:60424) 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 -- 172.21.15.76:0/1427108399 learned_addr learned my addr 172.21.15.76:0/1427108399 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f4961941640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a73d40 0x557115a71680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 -- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a68b60 msgr2=0x557115a70c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a68b60 0x557115a70c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 -- 172.21.15.76:0/1427108399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a73d40 msgr2=0x557115a71680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a73d40 0x557115a71680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 -- 172.21.15.76:0/1427108399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55711573f6a0 con 0x557115a69480 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f4961941640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a73d40 0x557115a71680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f496093f640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a71140 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f494c0cdb10 tx=0x7f494c06bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3869e1fc7d7e12f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:44.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f4944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.275+0000 7f4944ff9640 1 -- 172.21.15.76:0/1427108399 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c09c7a0 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f4944ff9640 1 -- 172.21.15.76:0/1427108399 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f494c0a00d0 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4954044040 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f4944ff9640 1 -- 172.21.15.76:0/1427108399 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f494c09c0a0 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 10 client.15978 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557115a82520 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f4944ff9640 1 -- 172.21.15.76:0/1427108399 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4954044040 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f4944ff9640 1 -- 172.21.15.76:0/1427108399 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f494c0b7080 con 0x557115a69480 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 10 client.15978 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 20 client.15978 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115a83930 0x557115a85da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 4 client.15978 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571159db7f0 con 0x557115a83930 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.276+0000 7f4961140640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115a83930 0x557115a85da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.277+0000 7f4961140640 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115a83930 0x557115a85da0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c4ca74087c9d02 server_cookie=41aa48aa1e694918 in_seq=0 out_seq=0 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.277+0000 7f4944ff9640 10 client.15978 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f4944ff9640 1 -- 172.21.15.76:0/1427108399 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571159db7f0 con 0x557115a83930 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f4944ff9640 10 client.15978 handle_command_reply: tid=0 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 client.15978 shutdown 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 msgr2=0x557115a71140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a71140 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f494c0cdb10 tx=0x7f494c06bcc0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 shutdown_connections 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a73d40 0x557115a71680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115a83930 0x557115a85da0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a71140 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 --2- 172.21.15.76:0/1427108399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a68b60 0x557115a70c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 >> 172.21.15.76:0/1427108399 conn(0x557115a650f0 msgr2=0x557115a6ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:44.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f4944ff9640 0 client.15978 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:44.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 shutdown_connections 2024-09-19T07:53:44.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 1 -- 172.21.15.76:0/1427108399 wait complete. 2024-09-19T07:53:44.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.278+0000 7f496577d740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 Processor -- start 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 -- start start 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a69480 0x557115a6fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 0x557115a8b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1b24d0 con 0x557115a73d40 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1afda0 con 0x557115a68b60 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496577d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1adbf0 con 0x557115a69480 2024-09-19T07:53:44.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 0x557115a8b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 0x557115a8b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60434/0 (socket says 172.21.15.76:60434) 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 -- 172.21.15.76:0/1922559113 learned_addr learned my addr 172.21.15.76:0/1922559113 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961140640 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496093f640 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a69480 0x557115a6fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 -- 172.21.15.76:0/1922559113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a69480 msgr2=0x557115a6fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a69480 0x557115a6fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 -- 172.21.15.76:0/1922559113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 msgr2=0x557115a6b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 -- 172.21.15.76:0/1922559113 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557115a734d0 con 0x557115a73d40 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f496093f640 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a69480 0x557115a6fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.296+0000 7f4961941640 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 0x557115a8b670 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f495402fe90 tx=0x7f4954009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3582f257f9ddcfa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f4946ffd640 1 -- 172.21.15.76:0/1922559113 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495404d070 con 0x557115a73d40 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f4946ffd640 1 -- 172.21.15.76:0/1922559113 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4954049e00 con 0x557115a73d40 2024-09-19T07:53:44.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f4946ffd640 1 -- 172.21.15.76:0/1922559113 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954043040 con 0x557115a73d40 2024-09-19T07:53:44.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 -- 172.21.15.76:0/1922559113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 msgr2=0x557115a8b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 0x557115a8b670 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f495402fe90 tx=0x7f4954009540 comp rx=0 tx=0).stop 2024-09-19T07:53:44.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 -- 172.21.15.76:0/1922559113 shutdown_connections 2024-09-19T07:53:44.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a73d40 0x557115a8b670 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a69480 0x557115a6fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 --2- 172.21.15.76:0/1922559113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 -- 172.21.15.76:0/1922559113 >> 172.21.15.76:0/1922559113 conn(0x557115a650f0 msgr2=0x557115a6f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 -- 172.21.15.76:0/1922559113 shutdown_connections 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.297+0000 7f496577d740 1 -- 172.21.15.76:0/1922559113 wait complete. 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 -- start start 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 Processor -- start 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a6e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1ae260 con 0x557115a69480 2024-09-19T07:53:44.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1af6d0 con 0x557115a68b60 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1ae930 con 0x557115a73d40 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496577d740 10 client.0 _ll_register_callbacks cb 0x7f494c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496093f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496093f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a6e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60438/0 (socket says 172.21.15.76:60438) 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f496093f640 1 -- 172.21.15.76:0/4157225868 learned_addr learned my addr 172.21.15.76:0/4157225868 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.298+0000 7f4961941640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a6e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4961140640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496093f640 1 -- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 msgr2=0x557115a6e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496093f640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a6e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496093f640 1 -- 172.21.15.76:0/4157225868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 msgr2=0x557115a6db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496093f640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496093f640 1 -- 172.21.15.76:0/4157225868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557115aed640 con 0x557115a69480 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4961941640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a6e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496093f640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a6e0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f494c098a70 tx=0x7f494c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80af96cb0d1586c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4944ff9640 1 -- 172.21.15.76:0/4157225868 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0ba060 con 0x557115a69480 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4944ff9640 1 -- 172.21.15.76:0/4157225868 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f494c0a4a90 con 0x557115a69480 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4954049e00 con 0x557115a69480 2024-09-19T07:53:44.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4944ff9640 1 -- 172.21.15.76:0/4157225868 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f494c098340 con 0x557115a69480 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496577d740 10 client.15984 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557115aee830 con 0x557115a69480 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.299+0000 7f4944ff9640 1 -- 172.21.15.76:0/4157225868 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4954049e00 con 0x557115a69480 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f4944ff9640 1 -- 172.21.15.76:0/4157225868 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f494c0bace0 con 0x557115a69480 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f496577d740 10 client.15984 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f496577d740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f496577d740 20 client.15984 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f496577d740 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115aeef60 0x557115af1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f496577d740 4 client.15984 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5571159d5d00 con 0x557115aeef60 2024-09-19T07:53:44.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f4961140640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115aeef60 0x557115af1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f4961140640 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115aeef60 0x557115af1380 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56efbd744f40c0f3 server_cookie=f6bd1a66172fa2b6 in_seq=0 out_seq=0 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.300+0000 7f4944ff9640 10 client.15984 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f4944ff9640 1 -- 172.21.15.76:0/4157225868 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5571159d5d00 con 0x557115aeef60 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f4944ff9640 10 client.15984 handle_command_reply: tid=0 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 client.15984 shutdown 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 msgr2=0x557115a6e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a6e0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f494c098a70 tx=0x7f494c00fe10 comp rx=0 tx=0).stop 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 shutdown_connections 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557115a73d40 0x557115a6e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557115aeef60 0x557115af1380 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f4944ff9640 0 client.15984 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557115a69480 0x557115a6e0a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 --2- 172.21.15.76:0/4157225868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557115a68b60 0x557115a6db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.301+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 >> 172.21.15.76:0/4157225868 conn(0x557115a650f0 msgr2=0x557115a6fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 shutdown_connections 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f496577d740 1 -- 172.21.15.76:0/4157225868 wait complete. 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f496577d740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T07:53:44.308 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:53:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:53:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "a4d45c69-3487-4671-b954-80ce4a27603d", 2024-09-19T07:53:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:53:44.309 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f49480a3430 msgr2=0x7f49480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f49480a3430 0x7f49480a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f495404e000 tx=0x7f495404c000 comp rx=0 tx=0).stop 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 msgr2=0x7f495c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 0x7f495c0fd1c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c920 tx=0x7f494c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 shutdown_connections 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f49480a3430 0x7f49480a58f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f495c102ef0 0x7f495c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f495c102570 0x7f495c0fd1c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 --2- 172.21.15.76:0/612334690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f495c100e20 0x7f495c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:44.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.302+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 >> 172.21.15.76:0/612334690 conn(0x7f495c0fc7d0 msgr2=0x7f495c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:44.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.303+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 shutdown_connections 2024-09-19T07:53:44.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:44.303+0000 7f49633a4640 1 -- 172.21.15.76:0/612334690 wait complete. 2024-09-19T07:53:44.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:44 smithi152 ceph-mon[35117]: pgmap v80: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2024-09-19T07:53:44.899 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:44 smithi076 ceph-mon[30930]: pgmap v80: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2024-09-19T07:53:44.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:44 smithi137 ceph-mon[35309]: pgmap v80: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2024-09-19T07:53:45.026 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:53:45.275 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:53:45.505 INFO:tasks.workunit.client.0.smithi076.stderr:+ mkdir untar_tar 2024-09-19T07:53:45.508 INFO:tasks.workunit.client.0.smithi076.stderr:+ cd untar_tar 2024-09-19T07:53:45.509 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-19T07:53:45.534 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ 2024-09-19T07:53:45.536 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-19T07:53:45.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-19T07:53:45.538 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-19T07:53:45.539 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-19T07:53:45.540 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-19T07:53:45.541 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-19T07:53:45.542 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-19T07:53:45.543 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-19T07:53:45.544 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-19T07:53:45.545 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-19T07:53:45.546 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-19T07:53:45.547 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-19T07:53:45.548 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-19T07:53:45.549 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-19T07:53:45.550 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-19T07:53:45.551 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-19T07:53:45.552 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-19T07:53:45.553 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-19T07:53:45.554 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-19T07:53:45.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-19T07:53:45.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-19T07:53:45.556 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-19T07:53:45.561 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-19T07:53:45.561 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-19T07:53:45.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-19T07:53:45.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-19T07:53:45.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-19T07:53:45.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-19T07:53:45.563 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-19T07:53:45.564 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-19T07:53:45.564 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-19T07:53:45.565 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-19T07:53:45.566 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-19T07:53:45.567 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-19T07:53:45.568 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-19T07:53:45.569 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-19T07:53:45.570 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-19T07:53:45.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-19T07:53:45.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-19T07:53:45.572 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-19T07:53:45.573 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-19T07:53:45.574 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-19T07:53:45.575 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-19T07:53:45.576 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-19T07:53:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-19T07:53:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-19T07:53:45.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-19T07:53:45.579 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-19T07:53:45.580 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-19T07:53:45.581 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-19T07:53:45.582 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-19T07:53:45.582 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-19T07:53:45.583 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-19T07:53:45.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-19T07:53:45.585 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-19T07:53:45.586 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-19T07:53:45.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-19T07:53:45.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-19T07:53:45.588 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-19T07:53:45.589 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-19T07:53:45.590 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-19T07:53:45.591 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-19T07:53:45.592 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-19T07:53:45.593 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-19T07:53:45.593 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-19T07:53:45.594 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-19T07:53:45.595 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-19T07:53:45.596 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-19T07:53:45.597 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-19T07:53:45.598 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-19T07:53:45.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-19T07:53:45.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-19T07:53:45.600 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-19T07:53:45.601 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-19T07:53:45.602 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-19T07:53:45.603 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-19T07:53:45.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-19T07:53:45.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-19T07:53:45.605 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-19T07:53:45.606 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-19T07:53:45.607 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-19T07:53:45.608 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-19T07:53:45.609 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-19T07:53:45.610 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-19T07:53:45.611 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-19T07:53:45.612 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-19T07:53:45.613 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-19T07:53:45.614 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-19T07:53:45.615 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-19T07:53:45.616 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-19T07:53:45.617 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-19T07:53:45.617 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-19T07:53:45.618 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-19T07:53:45.619 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-19T07:53:45.621 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-19T07:53:45.621 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-19T07:53:45.622 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-19T07:53:45.623 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-19T07:53:45.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-19T07:53:45.625 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-19T07:53:45.626 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-19T07:53:45.627 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-19T07:53:45.628 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-19T07:53:45.629 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-19T07:53:45.630 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-19T07:53:45.630 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-19T07:53:45.631 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-19T07:53:45.632 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-19T07:53:45.633 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-19T07:53:45.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-19T07:53:45.635 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-19T07:53:45.635 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-19T07:53:45.636 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-19T07:53:45.637 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-19T07:53:45.638 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-19T07:53:45.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-19T07:53:45.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-19T07:53:45.640 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-19T07:53:45.641 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-19T07:53:45.642 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-19T07:53:45.643 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-19T07:53:45.644 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-19T07:53:45.645 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-19T07:53:45.646 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-19T07:53:45.647 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-19T07:53:45.648 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-19T07:53:45.649 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-19T07:53:45.650 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-19T07:53:45.651 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-19T07:53:45.652 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-19T07:53:45.653 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-19T07:53:45.654 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-19T07:53:45.655 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-19T07:53:45.656 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-19T07:53:45.657 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-19T07:53:45.657 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-19T07:53:45.658 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-19T07:53:45.659 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-19T07:53:45.660 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-19T07:53:45.661 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-19T07:53:45.661 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-19T07:53:45.662 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-19T07:53:45.663 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-19T07:53:45.664 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-19T07:53:45.665 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-19T07:53:45.666 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-19T07:53:45.667 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-19T07:53:45.668 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-19T07:53:45.669 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-19T07:53:45.670 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-19T07:53:45.670 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-19T07:53:45.671 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-19T07:53:45.672 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-19T07:53:45.673 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-19T07:53:45.674 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-19T07:53:45.675 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-19T07:53:45.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-19T07:53:45.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-19T07:53:45.678 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-19T07:53:45.679 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-19T07:53:45.680 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-19T07:53:45.681 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-19T07:53:45.682 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-19T07:53:45.683 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-19T07:53:45.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:45 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:53:45.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:45 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:45.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:45 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:53:45.683 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:45 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:45.684 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-19T07:53:45.685 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-19T07:53:45.686 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-19T07:53:45.687 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-19T07:53:45.688 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-19T07:53:45.689 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-19T07:53:45.690 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-19T07:53:45.690 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-19T07:53:45.691 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-19T07:53:45.692 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-19T07:53:45.693 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-19T07:53:45.693 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-19T07:53:45.694 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-19T07:53:45.695 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-19T07:53:45.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-19T07:53:45.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-19T07:53:45.697 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-19T07:53:45.698 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-19T07:53:45.699 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-19T07:53:45.700 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-19T07:53:45.700 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-19T07:53:45.701 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-19T07:53:45.702 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-19T07:53:45.703 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-19T07:53:45.703 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-19T07:53:45.704 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-19T07:53:45.705 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-19T07:53:45.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-19T07:53:45.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-19T07:53:45.707 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-19T07:53:45.708 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-19T07:53:45.709 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-19T07:53:45.710 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-19T07:53:45.710 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-19T07:53:45.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 -- 172.21.15.76:0/1565797228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69101082a0 msgr2=0x7f691010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 --2- 172.21.15.76:0/1565797228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69101082a0 0x7f691010ec40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6908009930 tx=0x7f690802a420 comp rx=0 tx=0).stop 2024-09-19T07:53:45.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 -- 172.21.15.76:0/1565797228 shutdown_connections 2024-09-19T07:53:45.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 --2- 172.21.15.76:0/1565797228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f69101082a0 0x7f691010ec40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 --2- 172.21.15.76:0/1565797228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69101036e0 0x7f6910107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 --2- 172.21.15.76:0/1565797228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6910102d30 0x7f6910103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 -- 172.21.15.76:0/1565797228 >> 172.21.15.76:0/1565797228 conn(0x7f69100fc7d0 msgr2=0x7f69100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:45.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 -- 172.21.15.76:0/1565797228 shutdown_connections 2024-09-19T07:53:45.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 -- 172.21.15.76:0/1565797228 wait complete. 2024-09-19T07:53:45.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.767+0000 7f6915213640 1 Processor -- start 2024-09-19T07:53:45.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 -- start start 2024-09-19T07:53:45.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 0x7f69101985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69101036e0 0x7f6910198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69101082a0 0x7f691019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69101121c0 con 0x7f6910102d30 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6910112040 con 0x7f69101082a0 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f6915213640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6910112340 con 0x7f69101036e0 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 0x7f69101985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 0x7f69101985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60458/0 (socket says 172.21.15.76:60458) 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 -- 172.21.15.76:0/1333480134 learned_addr learned my addr 172.21.15.76:0/1333480134 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690e59c640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69101036e0 0x7f6910198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690f59e640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69101082a0 0x7f691019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 -- 172.21.15.76:0/1333480134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69101036e0 msgr2=0x7f6910198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69101036e0 0x7f6910198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 -- 172.21.15.76:0/1333480134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69101082a0 msgr2=0x7f691019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69101082a0 0x7f691019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 -- 172.21.15.76:0/1333480134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691019d5a0 con 0x7f6910102d30 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.768+0000 7f690ed9d640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 0x7f69101985f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f690000cce0 tx=0x7f690000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.769+0000 7f68f7fff640 1 -- 172.21.15.76:0/1333480134 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690000f650 con 0x7f6910102d30 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.769+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691019d890 con 0x7f6910102d30 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.769+0000 7f68f7fff640 1 -- 172.21.15.76:0/1333480134 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f690000fcf0 con 0x7f6910102d30 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.769+0000 7f68f7fff640 1 -- 172.21.15.76:0/1333480134 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900018d20 con 0x7f6910102d30 2024-09-19T07:53:45.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.769+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101a5170 con 0x7f6910102d30 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.771+0000 7f68f7fff640 1 -- 172.21.15.76:0/1333480134 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f690000f7f0 con 0x7f6910102d30 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.771+0000 7f69175ec740 1 Processor -- start 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.771+0000 7f69175ec740 1 -- start start 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f69175ec740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe2e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f69175ec740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 0x5565cbe39140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f69175ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe39680 0x5565cbe3ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f69175ec740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5565cbd942e0 con 0x5565cbe2edc0 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f69175ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5565cbd3bce0 con 0x5565cbe39680 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f69175ec740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5565cbd902a0 con 0x5565cbe2e4a0 2024-09-19T07:53:45.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 0x5565cbe39140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 0x5565cbe39140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60464/0 (socket says 172.21.15.76:60464) 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 -- 172.21.15.76:0/4219192668 learned_addr learned my addr 172.21.15.76:0/4219192668 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f68f7fff640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f68f80a33b0 0x7f68f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690e59c640 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe39680 0x5565cbe3ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690f59e640 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe2e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690f59e640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f68f80a33b0 0x7f68f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 -- 172.21.15.76:0/4219192668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 msgr2=0x5565cbe2e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe2e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 -- 172.21.15.76:0/4219192668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe39680 msgr2=0x5565cbe3ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe39680 0x5565cbe3ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f68f7fff640 1 -- 172.21.15.76:0/1333480134 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f69000d03b0 con 0x7f6910102d30 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 -- 172.21.15.76:0/4219192668 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cbd20440 con 0x5565cbe2edc0 2024-09-19T07:53:45.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.772+0000 7f690ed9d640 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 0x5565cbe39140 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6900098a90 tx=0x7f6900051870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da624abdecac456b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f68f57fa640 1 -- 172.21.15.76:0/4219192668 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690009c170 con 0x5565cbe2edc0 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f68f57fa640 1 -- 172.21.15.76:0/4219192668 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f690009cd30 con 0x5565cbe2edc0 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f68f57fa640 1 -- 172.21.15.76:0/4219192668 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690009bf90 con 0x5565cbe2edc0 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 -- 172.21.15.76:0/4219192668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 msgr2=0x5565cbe39140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 0x5565cbe39140 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6900098a90 tx=0x7f6900051870 comp rx=0 tx=0).stop 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f690f59e640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f68f80a33b0 0x7f68f80a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6908005ec0 tx=0x7f6908009260 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 -- 172.21.15.76:0/4219192668 shutdown_connections 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe39680 0x5565cbe3ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe2edc0 0x5565cbe39140 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 --2- 172.21.15.76:0/4219192668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe2e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 -- 172.21.15.76:0/4219192668 >> 172.21.15.76:0/4219192668 conn(0x5565cbe2aa30 msgr2=0x5565cbe2ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:45.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.773+0000 7f69175ec740 1 -- 172.21.15.76:0/4219192668 shutdown_connections 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 -- 172.21.15.76:0/4219192668 wait complete. 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 -- start start 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 Processor -- start 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe38fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe36880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5565cbe3c1f0 con 0x5565cbe39680 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5565cbd4f050 con 0x5565cbe2edc0 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5565cbe3c370 con 0x5565cbe2e4a0 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f69175ec740 10 client.0 _ll_register_callbacks cb 0x5565cbd8f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f690f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe36880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f690f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe36880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60480/0 (socket says 172.21.15.76:60480) 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f690f59e640 1 -- 172.21.15.76:0/2758744619 learned_addr learned my addr 172.21.15.76:0/2758744619 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f690ed9d640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe38fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.774+0000 7f690e59c640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690f59e640 1 -- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 msgr2=0x5565cbe38fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690f59e640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe38fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690f59e640 1 -- 172.21.15.76:0/2758744619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 msgr2=0x5565cbe362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690f59e640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe362e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690f59e640 1 -- 172.21.15.76:0/2758744619 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565cbb053c0 con 0x5565cbe39680 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690e59c640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f690f59e640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe36880 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6908033000 tx=0x7f6908005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba00b53e212b40d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f68f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:45.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f68f2ff5640 1 -- 172.21.15.76:0/2758744619 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908043070 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f68f2ff5640 1 -- 172.21.15.76:0/2758744619 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6908005020 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f690009cd30 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f68f2ff5640 1 -- 172.21.15.76:0/2758744619 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6908057050 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f69175ec740 10 client.15996 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565cbe47c00 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.775+0000 7f68f2ff5640 1 -- 172.21.15.76:0/2758744619 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f690009cd30 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f68f2ff5640 1 -- 172.21.15.76:0/2758744619 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f690803a040 con 0x5565cbe39680 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f69175ec740 10 client.15996 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f69175ec740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f69175ec740 20 client.15996 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f69175ec740 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbe49160 0x5565cbe4b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f69175ec740 4 client.15996 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:53:45.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565cbda1850 con 0x5565cbe49160 2024-09-19T07:53:45.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.776+0000 7f690ed9d640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbe49160 0x5565cbe4b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f68f2ff5640 10 client.15996 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f690ed9d640 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbe49160 0x5565cbe4b5a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d6d7971e6f409d server_cookie=6154027a9f8f12fd in_seq=0 out_seq=0 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f68f2ff5640 1 -- 172.21.15.76:0/2758744619 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565cbda1850 con 0x5565cbe49160 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f68f2ff5640 10 client.15996 handle_command_reply: tid=0 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 client.15996 shutdown 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 msgr2=0x5565cbe36880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe36880 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6908033000 tx=0x7f6908005d50 comp rx=0 tx=0).stop 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 shutdown_connections 2024-09-19T07:53:45.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbe49160 0x5565cbe4b5a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe36880 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 --2- 172.21.15.76:0/2758744619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe38fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 >> 172.21.15.76:0/2758744619 conn(0x5565cbe2aa30 msgr2=0x5565cbe30760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.777+0000 7f68f2ff5640 0 client.15996 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.778+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 shutdown_connections 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.778+0000 7f69175ec740 1 -- 172.21.15.76:0/2758744619 wait complete. 2024-09-19T07:53:45.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.778+0000 7f69175ec740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T07:53:45.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 Processor -- start 2024-09-19T07:53:45.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 -- start start 2024-09-19T07:53:45.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2e4a0 0x5565cbe50e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2edc0 0x5565cbe513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe33540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69101b25e0 con 0x5565cbe39680 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f69101afeb0 con 0x5565cbe2e4a0 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f69175ec740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69101add00 con 0x5565cbe2edc0 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f690f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe33540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f690f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe33540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60486/0 (socket says 172.21.15.76:60486) 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.794+0000 7f690f59e640 1 -- 172.21.15.76:0/3588204437 learned_addr learned my addr 172.21.15.76:0/3588204437 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690e59c640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2edc0 0x5565cbe513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690ed9d640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2e4a0 0x5565cbe50e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690f59e640 1 -- 172.21.15.76:0/3588204437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2edc0 msgr2=0x5565cbe513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690f59e640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2edc0 0x5565cbe513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690f59e640 1 -- 172.21.15.76:0/3588204437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2e4a0 msgr2=0x5565cbe50e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690f59e640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2e4a0 0x5565cbe50e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690f59e640 1 -- 172.21.15.76:0/3588204437 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cbe2bbc0 con 0x5565cbe39680 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690e59c640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2edc0 0x5565cbe513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690ed9d640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2e4a0 0x5565cbe50e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f690f59e640 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe33540 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6908004eb0 tx=0x7f690802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae6e8610fac9220 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f68f4ff9640 1 -- 172.21.15.76:0/3588204437 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690805f070 con 0x5565cbe39680 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f68f4ff9640 1 -- 172.21.15.76:0/3588204437 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6908031760 con 0x5565cbe39680 2024-09-19T07:53:45.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.795+0000 7f68f4ff9640 1 -- 172.21.15.76:0/3588204437 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908043050 con 0x5565cbe39680 2024-09-19T07:53:45.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- 172.21.15.76:0/3588204437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 msgr2=0x5565cbe33540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe33540 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6908004eb0 tx=0x7f690802a420 comp rx=0 tx=0).stop 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- 172.21.15.76:0/3588204437 shutdown_connections 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe33540 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2edc0 0x5565cbe513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- 172.21.15.76:0/3588204437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2e4a0 0x5565cbe50e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- 172.21.15.76:0/3588204437 >> 172.21.15.76:0/3588204437 conn(0x5565cbe2aa30 msgr2=0x5565cbe38360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- 172.21.15.76:0/3588204437 shutdown_connections 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- 172.21.15.76:0/3588204437 wait complete. 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- start start 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 Processor -- start 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe41ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe3f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe3fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f69101ae370 con 0x5565cbe39680 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f69101af7e0 con 0x5565cbe2edc0 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69101aea40 con 0x5565cbe2e4a0 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.796+0000 7f69175ec740 10 client.0 _ll_register_callbacks cb 0x7f6908009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe3fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe3fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60500/0 (socket says 172.21.15.76:60500) 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 -- 172.21.15.76:0/402440318 learned_addr learned my addr 172.21.15.76:0/402440318 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690ed9d640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe41ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 -- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 msgr2=0x5565cbe41ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe41ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 -- 172.21.15.76:0/402440318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 msgr2=0x5565cbe3f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:53:45.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690e59c640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe3f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe3f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 -- 172.21.15.76:0/402440318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565cbeb2e50 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690e59c640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe3f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f690f59e640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe3fa20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f69080095c0 tx=0x7f6908003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222f03d7f092e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f68f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f68f2ff5640 1 -- 172.21.15.76:0/402440318 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908068070 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f68f2ff5640 1 -- 172.21.15.76:0/402440318 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f69080049b0 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6908031760 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f68f2ff5640 1 -- 172.21.15.76:0/402440318 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6908074050 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f69175ec740 10 client.16002 fetch_fsmap learned FSMap version 25 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.797+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565cbeb3fb0 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f68f2ff5640 1 -- 172.21.15.76:0/402440318 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6908031760 con 0x5565cbe39680 2024-09-19T07:53:45.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f68f2ff5640 1 -- 172.21.15.76:0/402440318 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6908064450 con 0x5565cbe39680 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f69175ec740 10 client.16002 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f69175ec740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f69175ec740 20 client.16002 populate_metadata read hostname 'smithi076' 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f69175ec740 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbeb45c0 0x5565cbeb69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f69175ec740 4 client.16002 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565cbd9bd60 con 0x5565cbeb45c0 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f690ed9d640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbeb45c0 0x5565cbeb69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f690ed9d640 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbeb45c0 0x5565cbeb69b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2733f27eea67aa server_cookie=a2c7c357c6b6f1f4 in_seq=0 out_seq=0 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.798+0000 7f68f2ff5640 10 client.16002 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f68f2ff5640 1 -- 172.21.15.76:0/402440318 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565cbd9bd60 con 0x5565cbeb45c0 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f68f2ff5640 10 client.16002 handle_command_reply: tid=0 2024-09-19T07:53:45.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 client.16002 shutdown 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 msgr2=0x5565cbe3fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe3fa20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f69080095c0 tx=0x7f6908003fd0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 shutdown_connections 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5565cbeb45c0 0x5565cbeb69b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5565cbe39680 0x5565cbe3fa20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f68f2ff5640 0 client.16002 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5565cbe2edc0 0x5565cbe3f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 --2- 172.21.15.76:0/402440318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565cbe2e4a0 0x5565cbe41ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 >> 172.21.15.76:0/402440318 conn(0x5565cbe2aa30 msgr2=0x5565cbe29350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 shutdown_connections 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 1 -- 172.21.15.76:0/402440318 wait complete. 2024-09-19T07:53:45.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f69175ec740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: "a4d45c69-3487-4671-b954-80ce4a27603d": { 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "a4d45c69-3487-4671-b954-80ce4a27603d", 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:53:45.806 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:53:45.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f68f80a33b0 msgr2=0x7f68f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f6915213640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f68f80a33b0 0x7f68f80a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6908005ec0 tx=0x7f6908009260 comp rx=0 tx=0).stop 2024-09-19T07:53:45.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 msgr2=0x7f69101985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:53:45.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.799+0000 7f6915213640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 0x7f69101985f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f690000cce0 tx=0x7f690000a620 comp rx=0 tx=0).stop 2024-09-19T07:53:45.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 shutdown_connections 2024-09-19T07:53:45.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f68f80a33b0 0x7f68f80a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69101082a0 0x7f691019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69101036e0 0x7f6910198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 --2- 172.21.15.76:0/1333480134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6910102d30 0x7f69101985f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:53:45.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 >> 172.21.15.76:0/1333480134 conn(0x7f69100fc7d0 msgr2=0x7f69100fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:53:45.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 shutdown_connections 2024-09-19T07:53:45.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:53:45.800+0000 7f6915213640 1 -- 172.21.15.76:0/1333480134 wait complete. 2024-09-19T07:53:45.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:45 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:53:45.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:45 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:45.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:45 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:53:45.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:45 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:45 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:53:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:45 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:45 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:53:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:45 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:53:46.583 INFO:tasks.cephfs.filesystem:scrub status for tag:a4d45c69-3487-4671-b954-80ce4a27603d - {'path': '/', 'tag': 'a4d45c69-3487-4671-b954-80ce4a27603d', 'options': 'recursive,force'} 2024-09-19T07:53:46.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:46 smithi152 ceph-mon[35117]: pgmap v81: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-09-19T07:53:46.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:46 smithi137 ceph-mon[35309]: pgmap v81: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-09-19T07:53:46.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:46 smithi076 ceph-mon[30930]: pgmap v81: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 9 op/s 2024-09-19T07:53:48.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:48 smithi152 ceph-mon[35117]: pgmap v82: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 934 KiB/s wr, 5 op/s 2024-09-19T07:53:48.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:48 smithi137 ceph-mon[35309]: pgmap v82: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 934 KiB/s wr, 5 op/s 2024-09-19T07:53:48.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:48 smithi076 ceph-mon[30930]: pgmap v82: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 934 KiB/s wr, 5 op/s 2024-09-19T07:53:49.061 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-19T07:53:49.062 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-19T07:53:49.063 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-19T07:53:49.064 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-19T07:53:49.065 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-19T07:53:49.066 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-19T07:53:49.067 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-19T07:53:49.068 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-19T07:53:49.069 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-19T07:53:49.070 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-19T07:53:49.071 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-19T07:53:49.072 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-19T07:53:49.073 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-19T07:53:49.074 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-19T07:53:49.076 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-19T07:53:49.076 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-19T07:53:49.077 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-19T07:53:49.078 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-19T07:53:49.079 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-19T07:53:49.080 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-19T07:53:49.081 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-19T07:53:49.081 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-19T07:53:49.083 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-19T07:53:49.083 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-19T07:53:49.084 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-19T07:53:49.085 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-19T07:53:49.086 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-19T07:53:49.087 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-19T07:53:49.088 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-19T07:53:49.089 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-19T07:53:49.090 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-19T07:53:49.091 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-19T07:53:49.092 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-19T07:53:49.092 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-19T07:53:49.093 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-19T07:53:49.094 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-19T07:53:49.095 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-19T07:53:49.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-19T07:53:49.097 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-19T07:53:49.098 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-19T07:53:49.099 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-19T07:53:49.100 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-19T07:53:49.101 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-19T07:53:49.101 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-19T07:53:49.102 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-19T07:53:49.103 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-19T07:53:49.104 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-19T07:53:49.105 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-19T07:53:49.106 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-19T07:53:49.107 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-19T07:53:49.108 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-19T07:53:49.109 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-19T07:53:49.110 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-19T07:53:49.111 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-19T07:53:49.112 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-19T07:53:49.113 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-19T07:53:49.114 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-19T07:53:49.115 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-19T07:53:49.116 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-19T07:53:49.117 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-19T07:53:49.118 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-19T07:53:49.119 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-19T07:53:49.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-19T07:53:49.121 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/Changes 2024-09-19T07:53:49.122 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-19T07:53:49.123 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-19T07:53:49.124 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-19T07:53:49.125 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-19T07:53:49.126 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-19T07:53:49.126 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-19T07:53:49.127 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-19T07:53:49.128 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-19T07:53:49.129 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-19T07:53:49.130 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-19T07:53:49.131 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-19T07:53:49.132 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-19T07:53:49.132 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-19T07:53:49.133 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-19T07:53:49.134 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-19T07:53:49.135 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-19T07:53:49.137 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-19T07:53:49.138 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-19T07:53:49.139 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-19T07:53:49.140 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-19T07:53:49.141 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-19T07:53:49.142 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-19T07:53:49.143 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-19T07:53:49.144 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-19T07:53:49.145 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-19T07:53:49.146 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-19T07:53:49.146 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-19T07:53:49.147 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-19T07:53:49.148 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-19T07:53:49.149 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-19T07:53:49.150 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-19T07:53:49.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-19T07:53:49.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-19T07:53:49.152 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-19T07:53:49.153 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-19T07:53:49.154 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-19T07:53:49.155 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-19T07:53:49.156 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-19T07:53:49.157 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-19T07:53:49.158 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-19T07:53:49.159 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-19T07:53:49.160 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-19T07:53:49.161 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-19T07:53:49.162 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-19T07:53:49.163 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-19T07:53:49.164 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-19T07:53:49.165 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-19T07:53:49.167 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-19T07:53:49.168 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-19T07:53:49.169 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-19T07:53:49.170 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-19T07:53:49.171 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-19T07:53:49.172 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-19T07:53:49.172 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-19T07:53:49.174 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-19T07:53:49.174 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-19T07:53:49.175 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-19T07:53:49.176 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-19T07:53:49.178 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-19T07:53:49.180 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-19T07:53:49.181 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-19T07:53:49.182 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-19T07:53:49.184 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-19T07:53:49.184 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-19T07:53:49.185 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-19T07:53:49.186 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-19T07:53:49.187 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-19T07:53:49.188 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-19T07:53:49.189 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-19T07:53:49.190 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-19T07:53:49.191 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-19T07:53:49.192 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-19T07:53:49.193 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-19T07:53:49.194 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-19T07:53:49.194 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-19T07:53:49.195 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-19T07:53:49.196 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-19T07:53:49.197 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-19T07:53:49.198 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-19T07:53:49.199 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-19T07:53:49.200 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-19T07:53:49.201 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-19T07:53:49.201 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-19T07:53:49.202 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-19T07:53:49.203 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-19T07:53:49.204 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-19T07:53:49.205 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-19T07:53:49.206 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-19T07:53:49.207 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-19T07:53:49.208 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-19T07:53:49.209 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-19T07:53:49.210 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-19T07:53:49.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-19T07:53:49.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-19T07:53:49.212 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-19T07:53:49.213 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-19T07:53:49.214 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-19T07:53:49.215 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-19T07:53:49.216 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-19T07:53:49.217 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-19T07:53:49.218 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-19T07:53:49.219 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-19T07:53:49.220 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-19T07:53:49.221 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-19T07:53:49.222 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-19T07:53:49.223 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-19T07:53:49.224 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-19T07:53:49.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-19T07:53:49.226 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-19T07:53:49.227 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-19T07:53:49.228 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-19T07:53:49.229 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-19T07:53:49.234 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-19T07:53:49.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-19T07:53:49.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-19T07:53:49.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-19T07:53:49.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-19T07:53:49.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-19T07:53:49.236 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-19T07:53:49.237 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-19T07:53:49.238 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-19T07:53:49.239 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-19T07:53:49.240 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-19T07:53:49.241 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-19T07:53:49.242 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-19T07:53:49.243 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-19T07:53:49.244 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-19T07:53:49.245 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-19T07:53:49.246 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-19T07:53:49.247 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-19T07:53:49.248 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-19T07:53:49.249 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-19T07:53:49.250 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-19T07:53:49.251 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-19T07:53:49.252 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-19T07:53:49.253 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-19T07:53:49.254 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-19T07:53:49.255 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-19T07:53:49.256 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-19T07:53:49.257 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-19T07:53:49.258 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-19T07:53:49.259 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-19T07:53:49.260 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-19T07:53:49.261 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-19T07:53:49.262 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-19T07:53:49.263 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-19T07:53:49.264 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-19T07:53:49.265 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-19T07:53:49.266 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-19T07:53:49.267 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-19T07:53:49.268 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-19T07:53:49.269 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-19T07:53:49.270 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-19T07:53:49.271 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-19T07:53:49.272 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-19T07:53:49.273 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-19T07:53:49.274 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-19T07:53:49.275 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-19T07:53:49.276 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-19T07:53:49.277 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-19T07:53:49.278 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-19T07:53:49.279 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-19T07:53:49.279 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-19T07:53:49.280 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-19T07:53:49.281 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-19T07:53:49.282 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-19T07:53:49.283 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-19T07:53:49.284 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-19T07:53:49.285 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-19T07:53:49.286 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-19T07:53:49.287 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-19T07:53:49.288 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-19T07:53:49.289 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-19T07:53:49.289 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-19T07:53:49.290 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-19T07:53:49.291 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-19T07:53:49.292 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-19T07:53:49.293 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-19T07:53:49.294 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-19T07:53:49.295 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-19T07:53:49.296 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-19T07:53:49.296 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-19T07:53:49.297 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-19T07:53:49.299 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-19T07:53:49.299 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-19T07:53:49.300 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-19T07:53:49.301 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-19T07:53:49.302 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-19T07:53:49.303 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-19T07:53:49.304 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-19T07:53:49.305 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-19T07:53:49.306 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-19T07:53:49.307 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-19T07:53:49.308 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-19T07:53:49.309 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-19T07:53:49.310 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-19T07:53:49.311 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-19T07:53:49.312 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-19T07:53:49.313 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-19T07:53:49.314 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-19T07:53:49.315 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-19T07:53:49.316 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-19T07:53:49.317 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-19T07:53:49.318 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-19T07:53:49.319 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-19T07:53:49.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:49 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:53:49.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:49 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:53:49.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:49 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:53:50.681 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-19T07:53:50.681 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-19T07:53:50.682 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-19T07:53:50.683 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-19T07:53:50.684 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-19T07:53:50.685 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-19T07:53:50.686 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-19T07:53:50.687 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-19T07:53:50.688 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-19T07:53:50.689 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-19T07:53:50.690 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-19T07:53:50.691 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-19T07:53:50.692 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-19T07:53:50.693 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-19T07:53:50.694 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-19T07:53:50.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-19T07:53:50.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-19T07:53:50.697 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-19T07:53:50.698 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-19T07:53:50.699 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-19T07:53:50.700 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-19T07:53:50.701 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-19T07:53:50.702 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-19T07:53:50.703 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-19T07:53:50.704 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-19T07:53:50.705 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-19T07:53:50.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-19T07:53:50.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-19T07:53:50.707 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-19T07:53:50.709 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-19T07:53:50.709 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-19T07:53:50.712 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-19T07:53:50.713 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-19T07:53:50.714 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-19T07:53:50.715 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-19T07:53:50.716 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-19T07:53:50.716 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-19T07:53:50.717 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-19T07:53:50.718 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-19T07:53:50.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-19T07:53:50.720 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-19T07:53:50.721 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-19T07:53:50.722 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-19T07:53:50.722 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-19T07:53:50.723 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-19T07:53:50.724 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-19T07:53:50.725 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-19T07:53:50.726 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-19T07:53:50.727 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-19T07:53:50.728 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-19T07:53:50.729 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-19T07:53:50.730 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/Makefile 2024-09-19T07:53:50.731 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-19T07:53:50.732 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-19T07:53:50.733 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-19T07:53:50.734 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-19T07:53:50.734 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-19T07:53:50.735 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-19T07:53:50.736 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-19T07:53:50.737 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-19T07:53:50.738 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-19T07:53:50.739 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-19T07:53:50.740 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-19T07:53:50.741 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-19T07:53:50.742 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-19T07:53:50.743 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-19T07:53:50.744 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-19T07:53:50.745 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-19T07:53:50.746 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-19T07:53:50.746 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-19T07:53:50.747 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-19T07:53:50.748 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-19T07:53:50.749 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-19T07:53:50.750 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-19T07:53:50.751 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-19T07:53:50.752 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-19T07:53:50.753 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-19T07:53:50.754 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-19T07:53:50.755 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-19T07:53:50.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-19T07:53:50.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-19T07:53:50.757 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-19T07:53:50.758 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-19T07:53:50.759 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-19T07:53:50.760 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-19T07:53:50.761 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-19T07:53:50.762 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-19T07:53:50.763 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-19T07:53:50.764 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-19T07:53:50.765 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-19T07:53:50.765 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-19T07:53:50.766 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-19T07:53:50.767 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-19T07:53:50.768 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-19T07:53:50.769 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-19T07:53:50.770 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-19T07:53:50.771 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-19T07:53:50.771 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-19T07:53:50.772 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-19T07:53:50.773 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-19T07:53:50.774 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-19T07:53:50.775 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-19T07:53:50.776 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-19T07:53:50.777 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-19T07:53:50.778 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-19T07:53:50.779 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-19T07:53:50.780 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-19T07:53:50.781 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-19T07:53:50.782 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-19T07:53:50.783 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-19T07:53:50.784 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-19T07:53:50.785 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-19T07:53:50.785 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-19T07:53:50.786 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-19T07:53:50.787 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-19T07:53:50.788 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-19T07:53:50.789 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-19T07:53:50.790 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/ 2024-09-19T07:53:50.790 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-19T07:53:50.791 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-19T07:53:50.792 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-19T07:53:50.793 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-19T07:53:50.794 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-19T07:53:50.795 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-19T07:53:50.796 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-19T07:53:50.797 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-19T07:53:50.797 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-19T07:53:50.798 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-19T07:53:50.799 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-19T07:53:50.800 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-19T07:53:50.801 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-19T07:53:50.802 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-19T07:53:50.803 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-19T07:53:50.803 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/README 2024-09-19T07:53:50.804 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-19T07:53:50.805 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-19T07:53:50.806 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-19T07:53:50.807 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-19T07:53:50.808 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-19T07:53:50.809 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-19T07:53:50.809 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-19T07:53:50.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:50 smithi152 ceph-mon[35117]: pgmap v83: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 936 KiB/s wr, 8 op/s 2024-09-19T07:53:50.810 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-19T07:53:50.811 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-19T07:53:50.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-19T07:53:50.813 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-19T07:53:50.814 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-19T07:53:50.814 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-19T07:53:50.815 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-19T07:53:50.816 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-19T07:53:50.817 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-19T07:53:50.818 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-19T07:53:50.819 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-19T07:53:50.820 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-19T07:53:50.821 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-19T07:53:50.821 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-19T07:53:50.822 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-19T07:53:50.823 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-19T07:53:50.824 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-19T07:53:50.825 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-19T07:53:50.826 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-19T07:53:50.827 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-19T07:53:50.827 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-19T07:53:50.828 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-19T07:53:50.829 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-19T07:53:50.830 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-19T07:53:50.831 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-19T07:53:50.832 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-19T07:53:50.833 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-19T07:53:50.834 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-19T07:53:50.835 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-19T07:53:50.836 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-19T07:53:50.836 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-19T07:53:50.837 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-19T07:53:50.838 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-19T07:53:50.839 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-19T07:53:50.840 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-19T07:53:50.841 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-19T07:53:50.841 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-19T07:53:50.842 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-19T07:53:50.843 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-19T07:53:50.844 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-19T07:53:50.845 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-19T07:53:50.846 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-19T07:53:50.847 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-19T07:53:50.848 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-19T07:53:50.849 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-19T07:53:50.850 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-19T07:53:50.851 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-19T07:53:50.851 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-19T07:53:50.852 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-19T07:53:50.853 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-19T07:53:50.854 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-19T07:53:50.855 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-19T07:53:50.856 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-19T07:53:50.857 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-19T07:53:50.857 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-19T07:53:50.858 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-19T07:53:50.859 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-19T07:53:50.860 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-19T07:53:50.861 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-19T07:53:50.862 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-19T07:53:50.862 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-19T07:53:50.863 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-19T07:53:50.864 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-19T07:53:50.865 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-19T07:53:50.866 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-19T07:53:50.867 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-19T07:53:50.868 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-19T07:53:50.869 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-19T07:53:50.869 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-19T07:53:50.870 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-19T07:53:50.871 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-19T07:53:50.872 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-19T07:53:50.873 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-19T07:53:50.874 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-19T07:53:50.875 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-19T07:53:50.876 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-19T07:53:50.877 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-19T07:53:50.878 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-19T07:53:50.878 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-19T07:53:50.879 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-19T07:53:50.880 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-19T07:53:50.881 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-19T07:53:50.882 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-19T07:53:50.883 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-19T07:53:50.884 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-19T07:53:50.885 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-19T07:53:50.886 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-19T07:53:50.887 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-19T07:53:50.888 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-19T07:53:50.889 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-19T07:53:50.890 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-19T07:53:50.890 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-19T07:53:50.891 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/ 2024-09-19T07:53:50.892 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-19T07:53:50.893 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-19T07:53:50.894 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-19T07:53:50.895 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-19T07:53:50.896 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-19T07:53:50.897 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-19T07:53:50.898 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-19T07:53:50.899 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-19T07:53:50.900 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-19T07:53:50.901 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-19T07:53:50.902 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-19T07:53:50.903 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-19T07:53:50.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:50 smithi137 ceph-mon[35309]: pgmap v83: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 936 KiB/s wr, 8 op/s 2024-09-19T07:53:50.904 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-19T07:53:50.905 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-19T07:53:50.906 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-19T07:53:50.907 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-19T07:53:50.908 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-19T07:53:50.909 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-19T07:53:50.910 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-19T07:53:50.910 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-19T07:53:50.911 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-19T07:53:50.912 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-19T07:53:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-19T07:53:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-19T07:53:50.915 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-19T07:53:50.916 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-19T07:53:50.917 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-19T07:53:50.918 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-19T07:53:50.919 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-19T07:53:50.920 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-19T07:53:50.921 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-19T07:53:50.922 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-19T07:53:50.923 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-19T07:53:50.924 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-19T07:53:50.925 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-19T07:53:50.926 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-19T07:53:50.927 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-19T07:53:50.928 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-19T07:53:50.929 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-19T07:53:50.930 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-19T07:53:50.930 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-19T07:53:50.931 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-19T07:53:50.932 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-19T07:53:50.933 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-19T07:53:50.934 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-19T07:53:50.934 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-19T07:53:50.935 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-19T07:53:50.936 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-19T07:53:50.937 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-19T07:53:50.938 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-19T07:53:50.939 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-19T07:53:50.940 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-19T07:53:50.941 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-19T07:53:50.941 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-19T07:53:50.942 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-19T07:53:50.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:50 smithi076 ceph-mon[30930]: pgmap v83: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 936 KiB/s wr, 8 op/s 2024-09-19T07:53:50.943 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-19T07:53:50.944 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-19T07:53:50.945 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-19T07:53:50.946 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-19T07:53:50.947 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-19T07:53:50.948 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-19T07:53:50.948 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-19T07:53:50.949 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-19T07:53:50.950 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-19T07:53:50.951 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-19T07:53:50.952 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/connector/ 2024-09-19T07:53:50.953 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-19T07:53:50.953 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-19T07:53:50.954 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-19T07:53:50.955 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-19T07:53:50.956 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-19T07:53:50.956 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/console/ 2024-09-19T07:53:50.957 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-19T07:53:50.958 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-19T07:53:50.959 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-19T07:53:50.960 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-19T07:53:50.960 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-19T07:53:50.961 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-19T07:53:50.962 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-19T07:53:50.963 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-19T07:53:50.964 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-19T07:53:50.964 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-19T07:53:50.965 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-19T07:53:50.966 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-19T07:53:50.967 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-19T07:53:50.968 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-19T07:53:50.969 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-19T07:53:50.969 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-19T07:53:50.970 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-19T07:53:50.971 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-19T07:53:50.972 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-19T07:53:50.973 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-19T07:53:50.974 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-19T07:53:50.975 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-19T07:53:50.976 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cris/ 2024-09-19T07:53:50.977 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/cris/README 2024-09-19T07:53:50.978 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-19T07:53:50.979 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-19T07:53:50.979 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-19T07:53:50.980 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-19T07:53:50.981 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-19T07:53:50.982 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-19T07:53:50.983 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-19T07:53:50.984 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-19T07:53:50.985 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-19T07:53:50.986 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-19T07:53:50.987 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-19T07:53:50.988 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-19T07:53:50.989 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-19T07:53:50.990 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-19T07:53:50.990 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-19T07:53:50.991 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-19T07:53:50.992 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-19T07:53:50.993 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-19T07:53:50.994 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-19T07:53:50.995 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-19T07:53:50.996 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-19T07:53:50.997 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-19T07:53:50.998 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-19T07:53:50.999 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-19T07:53:51.000 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-19T07:53:51.001 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-19T07:53:51.002 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-19T07:53:51.002 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-19T07:53:51.003 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-19T07:53:51.004 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-19T07:53:51.005 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-19T07:53:51.006 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-19T07:53:51.006 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-19T07:53:51.008 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-19T07:53:51.009 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-19T07:53:51.009 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-19T07:53:51.010 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-19T07:53:51.011 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-19T07:53:51.012 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-19T07:53:51.013 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-19T07:53:51.014 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-19T07:53:51.015 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-19T07:53:51.016 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-19T07:53:51.018 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-19T07:53:51.019 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-19T07:53:51.020 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-19T07:53:51.020 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-19T07:53:51.021 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-19T07:53:51.022 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-19T07:53:51.023 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-19T07:53:51.024 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-19T07:53:51.025 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-19T07:53:51.026 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-19T07:53:51.027 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-19T07:53:51.027 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-19T07:53:51.028 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-19T07:53:51.029 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-19T07:53:51.030 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-19T07:53:51.031 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-19T07:53:51.032 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-19T07:53:51.033 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-19T07:53:51.034 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-19T07:53:51.035 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-19T07:53:51.036 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-19T07:53:51.037 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-19T07:53:51.038 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-19T07:53:51.038 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-19T07:53:51.039 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-19T07:53:51.040 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-19T07:53:51.041 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-19T07:53:51.042 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-19T07:53:51.043 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-19T07:53:51.044 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-19T07:53:51.045 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-19T07:53:51.046 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-19T07:53:51.047 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-19T07:53:51.048 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-19T07:53:51.049 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-19T07:53:51.050 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-19T07:53:51.051 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-19T07:53:51.052 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-19T07:53:51.053 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-19T07:53:51.054 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-19T07:53:51.055 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-19T07:53:51.056 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-19T07:53:51.057 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-19T07:53:51.058 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-19T07:53:51.059 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-19T07:53:51.060 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-19T07:53:51.061 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-19T07:53:51.062 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-19T07:53:51.063 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-19T07:53:51.064 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-19T07:53:51.065 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-19T07:53:51.066 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-19T07:53:51.067 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-19T07:53:51.068 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-19T07:53:51.068 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-19T07:53:51.069 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-19T07:53:51.070 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-19T07:53:51.071 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-19T07:53:51.072 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-19T07:53:51.073 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-19T07:53:51.074 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-19T07:53:51.075 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-19T07:53:51.076 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-19T07:53:51.077 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-19T07:53:51.078 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-19T07:53:51.079 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-19T07:53:51.080 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-19T07:53:51.081 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-19T07:53:51.082 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-19T07:53:51.083 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-19T07:53:51.084 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-19T07:53:51.085 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-19T07:53:51.086 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-19T07:53:51.087 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-19T07:53:51.088 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-19T07:53:51.089 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-19T07:53:51.090 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-19T07:53:51.091 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-19T07:53:51.092 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-19T07:53:51.092 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-19T07:53:51.093 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-19T07:53:51.094 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-19T07:53:51.095 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-19T07:53:51.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-19T07:53:51.097 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-19T07:53:51.098 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-19T07:53:51.099 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-19T07:53:51.100 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-19T07:53:51.101 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-19T07:53:51.102 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-19T07:53:51.102 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-19T07:53:51.103 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-19T07:53:51.104 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-19T07:53:51.105 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-19T07:53:51.106 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-19T07:53:51.107 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-19T07:53:51.107 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-19T07:53:51.108 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-19T07:53:51.109 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-19T07:53:51.110 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-19T07:53:51.111 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-19T07:53:51.111 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-19T07:53:51.112 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-19T07:53:51.113 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-19T07:53:51.114 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-19T07:53:51.115 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-19T07:53:51.115 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-19T07:53:51.116 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-19T07:53:51.117 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-19T07:53:51.118 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-19T07:53:51.119 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-19T07:53:51.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-19T07:53:51.121 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-19T07:53:51.122 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-19T07:53:51.123 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-19T07:53:51.124 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-19T07:53:51.124 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-19T07:53:51.125 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-19T07:53:51.126 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-19T07:53:51.127 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-19T07:53:51.128 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-19T07:53:51.128 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-19T07:53:51.129 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-19T07:53:51.130 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-19T07:53:51.131 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-19T07:53:51.132 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-19T07:53:51.133 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-19T07:53:51.133 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-19T07:53:51.134 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-19T07:53:51.135 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-19T07:53:51.136 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-19T07:53:51.136 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-19T07:53:51.137 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-19T07:53:51.138 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-19T07:53:51.139 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-19T07:53:51.139 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-19T07:53:51.140 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-19T07:53:51.141 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-19T07:53:51.142 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-19T07:53:51.143 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-19T07:53:51.143 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-19T07:53:51.144 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-19T07:53:51.145 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-19T07:53:51.146 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-19T07:53:51.147 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-19T07:53:51.148 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-19T07:53:51.149 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-19T07:53:51.150 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-19T07:53:51.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-19T07:53:51.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-19T07:53:51.152 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-19T07:53:51.153 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-19T07:53:51.154 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-19T07:53:51.155 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-19T07:53:51.155 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-19T07:53:51.156 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-19T07:53:51.157 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-19T07:53:51.158 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-19T07:53:51.158 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-19T07:53:51.338 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-19T07:53:51.339 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-19T07:53:51.340 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-19T07:53:51.341 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-19T07:53:51.342 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-19T07:53:51.343 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-19T07:53:51.344 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-19T07:53:51.345 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-19T07:53:51.346 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-19T07:53:51.347 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-19T07:53:51.347 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-19T07:53:51.348 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-19T07:53:51.349 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-19T07:53:51.350 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-19T07:53:51.351 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-19T07:53:51.352 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-19T07:53:51.353 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-19T07:53:51.354 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-19T07:53:51.355 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-19T07:53:51.356 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-19T07:53:51.357 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-19T07:53:51.358 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-19T07:53:51.359 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-19T07:53:51.360 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-19T07:53:51.360 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-19T07:53:51.361 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-19T07:53:51.362 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-19T07:53:51.363 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-19T07:53:51.364 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-19T07:53:51.365 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-19T07:53:51.365 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-19T07:53:51.366 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-19T07:53:51.367 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-19T07:53:51.368 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-19T07:53:51.369 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-19T07:53:51.370 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-19T07:53:51.371 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-19T07:53:51.372 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-19T07:53:51.372 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-19T07:53:51.373 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-19T07:53:51.374 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-19T07:53:51.375 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-19T07:53:51.376 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-19T07:53:51.377 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-19T07:53:51.377 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-19T07:53:51.378 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-19T07:53:51.379 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-19T07:53:51.380 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-19T07:53:51.380 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-19T07:53:51.381 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-19T07:53:51.382 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-19T07:53:51.383 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-19T07:53:51.384 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-19T07:53:51.385 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-19T07:53:51.386 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-19T07:53:51.386 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-19T07:53:51.387 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-19T07:53:51.388 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-19T07:53:51.389 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-19T07:53:51.390 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-19T07:53:51.391 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-19T07:53:51.392 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-19T07:53:51.393 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-19T07:53:51.394 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-19T07:53:51.394 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-19T07:53:51.395 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-19T07:53:51.396 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-19T07:53:51.397 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-19T07:53:51.398 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-19T07:53:51.399 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-19T07:53:51.400 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-19T07:53:51.401 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-19T07:53:51.402 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-19T07:53:51.403 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-19T07:53:51.404 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-19T07:53:51.405 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-19T07:53:51.406 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-19T07:53:51.407 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-19T07:53:51.408 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-19T07:53:51.409 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-19T07:53:51.410 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-19T07:53:51.411 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-19T07:53:51.412 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-19T07:53:51.413 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-19T07:53:51.414 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-19T07:53:51.415 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-19T07:53:51.415 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-19T07:53:51.416 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-19T07:53:51.417 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-19T07:53:51.418 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-19T07:53:51.419 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-19T07:53:51.420 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-19T07:53:51.421 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-19T07:53:51.422 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-19T07:53:51.423 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-19T07:53:51.424 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-19T07:53:51.426 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-19T07:53:51.426 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-19T07:53:51.427 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-19T07:53:51.428 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-19T07:53:51.428 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-19T07:53:51.429 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-19T07:53:51.430 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-19T07:53:51.431 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-19T07:53:51.432 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-19T07:53:51.433 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-19T07:53:51.433 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-19T07:53:51.434 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-19T07:53:51.435 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-19T07:53:51.436 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-19T07:53:51.437 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-19T07:53:51.438 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-19T07:53:51.439 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-19T07:53:51.440 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-19T07:53:51.441 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-19T07:53:51.442 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-19T07:53:51.443 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-19T07:53:51.443 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-19T07:53:51.444 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-19T07:53:51.445 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-19T07:53:51.446 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-19T07:53:51.447 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-19T07:53:51.448 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-19T07:53:51.449 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-19T07:53:51.450 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-19T07:53:51.451 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-19T07:53:51.452 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-19T07:53:51.453 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-19T07:53:51.453 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-19T07:53:51.454 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-19T07:53:51.455 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-19T07:53:51.456 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-19T07:53:51.457 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-19T07:53:51.458 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-19T07:53:51.459 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-19T07:53:51.460 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-19T07:53:51.460 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-19T07:53:51.461 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-19T07:53:51.462 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-19T07:53:51.463 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-19T07:53:51.464 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-19T07:53:51.465 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-19T07:53:51.465 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-19T07:53:51.466 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-19T07:53:51.467 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-19T07:53:51.468 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-19T07:53:51.469 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-19T07:53:51.470 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-19T07:53:51.471 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-19T07:53:51.471 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-19T07:53:51.473 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-19T07:53:51.474 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-19T07:53:51.475 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-19T07:53:51.475 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-19T07:53:51.477 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-19T07:53:51.477 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-19T07:53:51.477 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-19T07:53:51.478 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-19T07:53:51.479 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-19T07:53:51.479 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-19T07:53:51.480 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-19T07:53:51.481 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-19T07:53:51.482 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-19T07:53:51.484 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-19T07:53:51.484 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-19T07:53:51.485 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-19T07:53:51.486 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-19T07:53:51.487 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-19T07:53:51.488 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-19T07:53:51.489 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-19T07:53:51.490 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-19T07:53:51.491 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-19T07:53:51.492 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-19T07:53:51.493 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-19T07:53:51.493 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-19T07:53:51.494 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-19T07:53:51.495 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-19T07:53:51.496 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-19T07:53:51.497 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-19T07:53:51.498 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-19T07:53:51.499 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-19T07:53:51.500 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-19T07:53:51.501 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-19T07:53:51.502 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-19T07:53:51.503 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-19T07:53:51.504 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-19T07:53:51.505 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-19T07:53:51.506 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-19T07:53:51.507 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-19T07:53:51.507 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-19T07:53:51.508 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-19T07:53:51.509 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-19T07:53:51.510 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-19T07:53:51.511 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-19T07:53:51.512 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-19T07:53:51.514 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-19T07:53:51.514 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-19T07:53:51.515 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-19T07:53:51.516 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-19T07:53:51.517 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-19T07:53:51.518 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-19T07:53:51.518 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-19T07:53:51.519 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-19T07:53:51.520 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-19T07:53:51.521 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-19T07:53:51.522 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-19T07:53:51.523 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-19T07:53:51.524 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-19T07:53:51.525 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-19T07:53:51.526 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-19T07:53:51.527 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-19T07:53:51.528 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-19T07:53:51.529 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-19T07:53:51.529 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-19T07:53:51.530 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-19T07:53:51.531 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-19T07:53:51.532 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-19T07:53:51.533 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-19T07:53:51.534 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-19T07:53:51.535 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-19T07:53:51.536 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-19T07:53:51.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-19T07:53:51.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-19T07:53:51.538 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-19T07:53:51.539 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-19T07:53:51.540 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-19T07:53:51.541 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-19T07:53:51.541 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-19T07:53:51.542 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-19T07:53:51.543 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-19T07:53:51.544 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-19T07:53:51.545 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-19T07:53:51.546 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-19T07:53:51.547 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-19T07:53:51.547 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-19T07:53:51.548 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-19T07:53:51.549 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-19T07:53:51.550 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-19T07:53:51.550 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-19T07:53:51.551 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-19T07:53:51.552 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-19T07:53:51.553 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-19T07:53:51.554 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-19T07:53:51.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-19T07:53:51.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-19T07:53:51.556 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-19T07:53:51.557 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-19T07:53:51.557 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-19T07:53:51.558 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-19T07:53:51.559 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-19T07:53:51.560 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-19T07:53:51.561 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-19T07:53:51.561 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-19T07:53:51.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-19T07:53:51.563 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-19T07:53:51.564 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-19T07:53:51.565 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-19T07:53:51.566 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-19T07:53:51.566 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-19T07:53:51.567 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-19T07:53:51.568 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-19T07:53:51.568 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-19T07:53:51.569 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-19T07:53:51.570 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-19T07:53:51.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-19T07:53:51.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-19T07:53:51.572 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-19T07:53:51.573 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-19T07:53:51.574 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-19T07:53:51.575 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-19T07:53:51.575 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-19T07:53:51.576 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-19T07:53:51.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-19T07:53:51.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-19T07:53:51.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-19T07:53:51.579 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-19T07:53:51.580 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-19T07:53:51.581 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-19T07:53:51.581 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-19T07:53:51.582 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-19T07:53:51.583 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-19T07:53:51.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-19T07:53:51.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-19T07:53:51.585 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-19T07:53:51.586 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-19T07:53:51.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-19T07:53:51.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-19T07:53:51.588 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-19T07:53:51.589 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-19T07:53:51.590 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-19T07:53:51.591 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-19T07:53:51.592 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-19T07:53:51.593 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-19T07:53:51.594 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-19T07:53:51.595 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-19T07:53:51.596 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-19T07:53:51.597 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-19T07:53:51.598 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-19T07:53:51.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-19T07:53:51.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-19T07:53:51.600 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-19T07:53:51.601 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-19T07:53:51.602 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-19T07:53:51.603 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-19T07:53:51.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-19T07:53:51.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-19T07:53:51.605 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-19T07:53:51.606 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-19T07:53:51.607 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-19T07:53:51.608 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-19T07:53:51.608 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-19T07:53:51.609 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-19T07:53:51.610 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-19T07:53:51.611 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-19T07:53:51.612 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-19T07:53:51.613 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-19T07:53:51.614 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-19T07:53:51.615 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-19T07:53:51.617 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-19T07:53:51.618 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-19T07:53:51.619 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-19T07:53:51.620 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-19T07:53:51.620 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-19T07:53:51.621 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-19T07:53:51.622 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-19T07:53:51.623 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-19T07:53:51.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-19T07:53:51.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-19T07:53:51.625 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-19T07:53:51.626 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-19T07:53:51.627 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-19T07:53:51.628 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-19T07:53:51.629 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-19T07:53:51.630 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-19T07:53:51.631 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-19T07:53:51.632 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-19T07:53:51.633 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-19T07:53:51.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-19T07:53:51.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-19T07:53:51.635 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-19T07:53:51.636 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-19T07:53:51.637 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-19T07:53:51.638 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-19T07:53:51.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-19T07:53:51.640 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-19T07:53:51.641 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-19T07:53:51.642 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-19T07:53:51.643 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-19T07:53:51.643 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-19T07:53:51.644 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-19T07:53:51.646 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-19T07:53:51.647 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-19T07:53:51.647 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-19T07:53:51.648 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-19T07:53:51.649 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-19T07:53:51.650 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-19T07:53:51.651 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-19T07:53:51.652 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-19T07:53:51.652 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-19T07:53:51.653 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-19T07:53:51.654 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-19T07:53:51.656 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-19T07:53:51.656 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-19T07:53:51.657 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-19T07:53:51.658 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-19T07:53:51.659 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-19T07:53:51.660 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-19T07:53:51.661 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-19T07:53:51.662 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-19T07:53:51.663 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-19T07:53:51.663 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-19T07:53:51.664 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-19T07:53:51.665 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-19T07:53:51.666 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-19T07:53:51.667 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-19T07:53:51.668 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-19T07:53:51.668 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-19T07:53:51.669 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-19T07:53:51.670 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-19T07:53:51.671 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-19T07:53:51.672 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-19T07:53:51.673 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-19T07:53:51.674 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-19T07:53:51.675 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-19T07:53:51.676 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-19T07:53:51.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-19T07:53:51.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-19T07:53:51.678 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-19T07:53:51.679 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-19T07:53:51.680 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-19T07:53:51.681 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-19T07:53:51.682 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-19T07:53:51.683 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-19T07:53:51.684 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-19T07:53:51.685 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-19T07:53:51.686 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-19T07:53:51.687 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-19T07:53:51.688 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-19T07:53:51.689 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-19T07:53:51.689 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-19T07:53:51.690 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-19T07:53:51.692 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-19T07:53:51.692 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-19T07:53:51.693 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-19T07:53:51.694 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-19T07:53:51.695 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-19T07:53:51.695 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-19T07:53:51.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-19T07:53:51.697 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-19T07:53:51.698 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-19T07:53:51.699 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-19T07:53:51.699 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-19T07:53:51.700 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-19T07:53:51.701 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-19T07:53:51.702 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-19T07:53:51.703 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-19T07:53:51.704 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-19T07:53:51.705 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-19T07:53:51.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-19T07:53:51.707 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-19T07:53:51.708 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-19T07:53:51.709 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-19T07:53:51.710 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-19T07:53:51.711 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-19T07:53:51.712 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-19T07:53:51.712 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-19T07:53:51.713 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-19T07:53:51.714 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-19T07:53:51.715 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-19T07:53:51.715 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-19T07:53:51.716 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-19T07:53:51.717 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-19T07:53:51.718 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-19T07:53:51.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-19T07:53:51.720 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-19T07:53:51.721 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-19T07:53:51.722 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-19T07:53:51.722 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-19T07:53:51.723 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-19T07:53:51.724 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-19T07:53:51.725 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-19T07:53:51.726 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-19T07:53:51.727 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-19T07:53:51.728 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-19T07:53:51.729 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-19T07:53:51.730 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-19T07:53:51.731 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-19T07:53:51.732 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-19T07:53:51.733 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-19T07:53:51.734 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-19T07:53:51.735 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-19T07:53:51.735 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-19T07:53:51.736 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-19T07:53:51.738 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-19T07:53:51.738 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-19T07:53:51.739 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-19T07:53:51.740 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-19T07:53:51.741 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-19T07:53:51.742 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-19T07:53:51.743 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-19T07:53:51.744 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-19T07:53:51.745 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-19T07:53:51.745 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-19T07:53:51.747 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-19T07:53:51.747 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-19T07:53:51.748 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-19T07:53:51.749 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-19T07:53:51.750 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-19T07:53:51.751 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-19T07:53:51.752 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-19T07:53:51.753 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-19T07:53:51.754 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-19T07:53:51.755 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-19T07:53:51.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-19T07:53:51.757 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-19T07:53:51.758 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-19T07:53:51.759 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-19T07:53:51.760 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-19T07:53:51.761 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-19T07:53:51.762 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-19T07:53:51.763 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-19T07:53:51.764 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-19T07:53:51.765 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-19T07:53:51.766 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-19T07:53:51.767 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-19T07:53:51.768 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-19T07:53:51.769 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-19T07:53:51.770 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-19T07:53:51.771 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-19T07:53:51.772 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-19T07:53:51.773 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-19T07:53:51.774 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-19T07:53:51.774 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-19T07:53:51.775 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-19T07:53:51.776 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-19T07:53:51.777 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-19T07:53:51.778 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-19T07:53:51.779 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-19T07:53:51.780 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-19T07:53:51.781 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-19T07:53:51.782 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-19T07:53:51.783 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-19T07:53:51.985 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-19T07:53:51.986 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-19T07:53:51.987 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-19T07:53:51.988 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-19T07:53:51.989 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-19T07:53:51.990 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-19T07:53:51.990 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-19T07:53:51.991 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-19T07:53:51.992 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-19T07:53:51.993 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-19T07:53:51.994 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-19T07:53:51.994 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-19T07:53:51.995 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-19T07:53:51.996 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-19T07:53:51.997 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-19T07:53:51.998 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-19T07:53:51.998 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-19T07:53:51.999 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-19T07:53:52.000 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-19T07:53:52.001 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-19T07:53:52.002 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-19T07:53:52.003 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-19T07:53:52.004 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-19T07:53:52.005 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-19T07:53:52.006 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-19T07:53:52.007 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-19T07:53:52.008 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-19T07:53:52.008 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-19T07:53:52.009 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-19T07:53:52.010 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-19T07:53:52.011 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-19T07:53:52.012 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-19T07:53:52.013 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-19T07:53:52.014 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-19T07:53:52.015 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-19T07:53:52.015 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-19T07:53:52.016 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-19T07:53:52.017 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-19T07:53:52.018 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-19T07:53:52.019 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-19T07:53:52.020 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-19T07:53:52.021 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-19T07:53:52.022 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-19T07:53:52.023 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-19T07:53:52.024 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-19T07:53:52.025 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-19T07:53:52.026 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-19T07:53:52.027 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-19T07:53:52.029 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-19T07:53:52.030 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-19T07:53:52.031 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-19T07:53:52.031 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-19T07:53:52.032 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-19T07:53:52.033 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-19T07:53:52.034 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-19T07:53:52.035 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-19T07:53:52.036 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-19T07:53:52.036 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-19T07:53:52.037 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-19T07:53:52.038 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-19T07:53:52.039 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-19T07:53:52.040 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-19T07:53:52.041 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-19T07:53:52.042 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-19T07:53:52.043 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-19T07:53:52.044 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-19T07:53:52.045 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-19T07:53:52.046 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-19T07:53:52.047 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-19T07:53:52.047 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-19T07:53:52.048 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-19T07:53:52.049 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-19T07:53:52.050 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-19T07:53:52.051 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-19T07:53:52.052 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-19T07:53:52.053 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-19T07:53:52.054 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-19T07:53:52.054 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-19T07:53:52.056 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-19T07:53:52.057 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-19T07:53:52.058 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-19T07:53:52.059 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-19T07:53:52.059 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-19T07:53:52.060 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-19T07:53:52.061 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-19T07:53:52.062 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-19T07:53:52.063 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-19T07:53:52.064 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-19T07:53:52.065 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-19T07:53:52.066 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-19T07:53:52.066 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-19T07:53:52.067 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-19T07:53:52.068 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-19T07:53:52.069 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-19T07:53:52.070 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-19T07:53:52.071 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-19T07:53:52.072 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-19T07:53:52.073 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-19T07:53:52.074 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-19T07:53:52.075 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-19T07:53:52.076 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-19T07:53:52.077 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-19T07:53:52.078 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-19T07:53:52.079 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-19T07:53:52.080 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-19T07:53:52.081 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-19T07:53:52.082 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-19T07:53:52.082 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-19T07:53:52.083 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-19T07:53:52.084 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-19T07:53:52.085 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-19T07:53:52.086 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-19T07:53:52.087 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-19T07:53:52.088 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-19T07:53:52.088 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-19T07:53:52.089 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-19T07:53:52.090 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-19T07:53:52.091 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-19T07:53:52.092 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-19T07:53:52.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-19T07:53:52.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-19T07:53:52.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-19T07:53:52.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-19T07:53:52.097 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-19T07:53:52.098 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-19T07:53:52.099 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-19T07:53:52.100 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-19T07:53:52.101 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-19T07:53:52.102 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-19T07:53:52.103 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-19T07:53:52.104 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-19T07:53:52.105 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-19T07:53:52.106 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-19T07:53:52.106 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-19T07:53:52.107 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-19T07:53:52.108 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-19T07:53:52.109 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-19T07:53:52.110 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-19T07:53:52.111 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-19T07:53:52.111 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-19T07:53:52.112 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-19T07:53:52.113 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-19T07:53:52.114 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-19T07:53:52.115 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-19T07:53:52.116 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-19T07:53:52.116 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-19T07:53:52.117 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-19T07:53:52.118 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-19T07:53:52.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-19T07:53:52.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-19T07:53:52.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-19T07:53:52.121 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-19T07:53:52.124 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-19T07:53:52.125 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-19T07:53:52.126 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-19T07:53:52.128 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-19T07:53:52.129 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-19T07:53:52.130 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-19T07:53:52.132 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-19T07:53:52.133 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-19T07:53:52.135 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-19T07:53:52.136 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-19T07:53:52.138 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-19T07:53:52.139 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-19T07:53:52.141 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-19T07:53:52.143 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-19T07:53:52.144 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-19T07:53:52.145 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-19T07:53:52.147 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-19T07:53:52.148 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-19T07:53:52.150 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-19T07:53:52.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-19T07:53:52.153 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-19T07:53:52.155 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-19T07:53:52.156 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-19T07:53:52.158 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-19T07:53:52.159 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-19T07:53:52.160 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-19T07:53:52.161 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-19T07:53:52.162 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-19T07:53:52.163 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-19T07:53:52.164 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-19T07:53:52.165 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-19T07:53:52.166 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-19T07:53:52.166 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-19T07:53:52.167 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-19T07:53:52.168 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-19T07:53:52.169 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-19T07:53:52.170 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-19T07:53:52.170 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-19T07:53:52.171 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-19T07:53:52.172 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-19T07:53:52.173 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-19T07:53:52.174 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-19T07:53:52.175 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-19T07:53:52.176 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-19T07:53:52.177 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-19T07:53:52.177 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-19T07:53:52.178 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-19T07:53:52.179 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-19T07:53:52.180 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-19T07:53:52.181 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-19T07:53:52.182 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-19T07:53:52.183 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-19T07:53:52.183 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-19T07:53:52.184 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-19T07:53:52.185 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-19T07:53:52.186 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-19T07:53:52.187 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-19T07:53:52.188 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-19T07:53:52.189 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-19T07:53:52.189 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-19T07:53:52.190 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-19T07:53:52.191 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-19T07:53:52.192 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-19T07:53:52.193 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-19T07:53:52.193 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-19T07:53:52.194 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-19T07:53:52.195 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-19T07:53:52.196 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-19T07:53:52.197 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-19T07:53:52.198 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-19T07:53:52.198 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-19T07:53:52.199 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-19T07:53:52.200 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-19T07:53:52.201 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-19T07:53:52.202 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-19T07:53:52.202 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-19T07:53:52.203 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-19T07:53:52.204 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-19T07:53:52.205 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-19T07:53:52.206 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-19T07:53:52.207 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-19T07:53:52.208 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-19T07:53:52.209 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-19T07:53:52.210 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-19T07:53:52.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-19T07:53:52.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-19T07:53:52.212 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-19T07:53:52.213 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-19T07:53:52.214 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-19T07:53:52.215 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-19T07:53:52.216 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-19T07:53:52.217 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-19T07:53:52.217 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-19T07:53:52.218 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-19T07:53:52.219 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-19T07:53:52.220 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-19T07:53:52.220 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-19T07:53:52.221 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-19T07:53:52.222 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-19T07:53:52.223 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-19T07:53:52.224 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-19T07:53:52.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-19T07:53:52.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-19T07:53:52.226 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-19T07:53:52.227 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-19T07:53:52.228 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-19T07:53:52.229 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-19T07:53:52.230 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-19T07:53:52.231 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-19T07:53:52.232 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-19T07:53:52.233 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-19T07:53:52.233 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-19T07:53:52.234 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-19T07:53:52.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-19T07:53:52.236 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-19T07:53:52.237 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-19T07:53:52.238 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-19T07:53:52.239 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-19T07:53:52.239 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-19T07:53:52.240 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-19T07:53:52.241 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-19T07:53:52.242 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-19T07:53:52.243 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-19T07:53:52.244 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-19T07:53:52.244 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-19T07:53:52.245 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-19T07:53:52.246 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-19T07:53:52.247 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-19T07:53:52.247 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-19T07:53:52.248 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-19T07:53:52.249 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-19T07:53:52.250 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-19T07:53:52.251 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-19T07:53:52.252 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-19T07:53:52.253 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-19T07:53:52.254 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-19T07:53:52.255 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-19T07:53:52.256 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-19T07:53:52.256 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-19T07:53:52.257 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-19T07:53:52.258 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-19T07:53:52.259 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-19T07:53:52.259 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-19T07:53:52.260 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-19T07:53:52.261 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-19T07:53:52.262 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-19T07:53:52.263 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-19T07:53:52.264 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-19T07:53:52.265 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-19T07:53:52.266 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-19T07:53:52.266 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-19T07:53:52.267 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-19T07:53:52.268 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-19T07:53:52.269 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-19T07:53:52.270 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-19T07:53:52.271 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-19T07:53:52.272 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-19T07:53:52.273 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-19T07:53:52.273 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-19T07:53:52.274 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-19T07:53:52.275 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-19T07:53:52.276 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-19T07:53:52.276 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-19T07:53:52.277 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-19T07:53:52.278 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-19T07:53:52.279 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-19T07:53:52.280 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-19T07:53:52.281 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-19T07:53:52.281 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-19T07:53:52.282 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-19T07:53:52.283 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-19T07:53:52.284 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-19T07:53:52.285 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-19T07:53:52.285 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-19T07:53:52.286 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-19T07:53:52.287 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-19T07:53:52.288 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-19T07:53:52.289 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-19T07:53:52.289 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-19T07:53:52.290 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-19T07:53:52.291 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-19T07:53:52.292 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-19T07:53:52.293 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-19T07:53:52.293 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-19T07:53:52.294 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-19T07:53:52.295 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-19T07:53:52.296 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-19T07:53:52.297 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-19T07:53:52.298 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-19T07:53:52.299 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-19T07:53:52.300 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-19T07:53:52.301 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-19T07:53:52.302 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-19T07:53:52.304 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-19T07:53:52.304 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-19T07:53:52.305 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-19T07:53:52.306 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-19T07:53:52.307 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-19T07:53:52.308 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-19T07:53:52.310 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-19T07:53:52.311 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-19T07:53:52.312 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-19T07:53:52.313 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-19T07:53:52.314 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-19T07:53:52.315 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-19T07:53:52.316 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-19T07:53:52.318 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-19T07:53:52.319 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-19T07:53:52.320 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-19T07:53:52.321 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-19T07:53:52.322 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-19T07:53:52.324 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-19T07:53:52.325 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-19T07:53:52.326 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-19T07:53:52.327 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-19T07:53:52.328 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-19T07:53:52.330 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-19T07:53:52.331 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-19T07:53:52.332 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-19T07:53:52.333 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-19T07:53:52.334 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-19T07:53:52.336 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-19T07:53:52.337 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-19T07:53:52.339 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-19T07:53:52.340 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-19T07:53:52.341 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-19T07:53:52.343 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-19T07:53:52.344 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-19T07:53:52.346 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-19T07:53:52.347 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-19T07:53:52.349 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-19T07:53:52.350 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-19T07:53:52.351 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-19T07:53:52.352 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-19T07:53:52.353 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-19T07:53:52.354 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-19T07:53:52.356 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-19T07:53:52.357 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-19T07:53:52.358 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-19T07:53:52.359 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-19T07:53:52.360 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-19T07:53:52.362 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-19T07:53:52.363 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-19T07:53:52.364 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-19T07:53:52.365 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-19T07:53:52.366 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-19T07:53:52.367 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-19T07:53:52.368 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-19T07:53:52.369 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-19T07:53:52.371 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-19T07:53:52.372 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-19T07:53:52.373 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-19T07:53:52.374 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-19T07:53:52.375 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-19T07:53:52.376 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-19T07:53:52.377 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-19T07:53:52.379 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-19T07:53:52.380 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-19T07:53:52.381 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-19T07:53:52.382 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-19T07:53:52.383 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-19T07:53:52.384 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-19T07:53:52.385 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-19T07:53:52.386 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-19T07:53:52.387 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-19T07:53:52.388 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-19T07:53:52.389 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-19T07:53:52.390 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-19T07:53:52.391 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-19T07:53:52.392 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-19T07:53:52.393 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-19T07:53:52.394 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-19T07:53:52.395 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-19T07:53:52.396 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-19T07:53:52.397 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-19T07:53:52.398 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-19T07:53:52.399 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-19T07:53:52.400 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-19T07:53:52.401 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-19T07:53:52.402 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-19T07:53:52.403 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-19T07:53:52.404 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-19T07:53:52.405 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-19T07:53:52.407 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-19T07:53:52.407 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-19T07:53:52.409 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-19T07:53:52.409 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-19T07:53:52.410 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-19T07:53:52.411 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-19T07:53:52.412 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-19T07:53:52.413 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-19T07:53:52.414 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-19T07:53:52.415 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-19T07:53:52.416 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-19T07:53:52.417 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-19T07:53:52.418 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-19T07:53:52.419 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-19T07:53:52.420 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-19T07:53:52.421 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-19T07:53:52.422 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-19T07:53:52.423 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-19T07:53:52.424 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-19T07:53:52.425 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-19T07:53:52.426 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-19T07:53:52.427 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-19T07:53:52.428 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-19T07:53:52.430 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-19T07:53:52.431 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-19T07:53:52.432 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-19T07:53:52.433 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-19T07:53:52.434 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-19T07:53:52.435 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-19T07:53:52.436 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-19T07:53:52.437 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-19T07:53:52.438 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-19T07:53:52.439 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-19T07:53:52.440 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-19T07:53:52.441 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-19T07:53:52.442 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-19T07:53:52.443 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-19T07:53:52.444 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-19T07:53:52.445 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-19T07:53:52.446 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-19T07:53:52.447 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-19T07:53:52.448 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-19T07:53:52.449 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-19T07:53:52.450 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-19T07:53:52.451 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-19T07:53:52.452 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-19T07:53:52.453 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-19T07:53:52.454 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-19T07:53:52.455 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-19T07:53:52.456 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-19T07:53:52.457 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-19T07:53:52.458 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-19T07:53:52.459 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-19T07:53:52.460 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-19T07:53:52.461 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-19T07:53:52.462 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-19T07:53:52.463 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-19T07:53:52.464 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-19T07:53:52.465 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-19T07:53:52.466 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-19T07:53:52.467 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-19T07:53:52.468 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-19T07:53:52.469 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-19T07:53:52.470 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-19T07:53:52.471 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-19T07:53:52.472 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-19T07:53:52.473 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-19T07:53:52.474 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-19T07:53:52.475 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-19T07:53:52.476 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-19T07:53:52.477 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-19T07:53:52.478 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-19T07:53:52.479 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-19T07:53:52.480 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-19T07:53:52.481 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-19T07:53:52.482 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-19T07:53:52.483 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-19T07:53:52.484 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-19T07:53:52.486 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-19T07:53:52.486 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-19T07:53:52.487 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-19T07:53:52.489 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-19T07:53:52.490 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-19T07:53:52.491 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-19T07:53:52.492 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-19T07:53:52.493 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-19T07:53:52.494 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-19T07:53:52.494 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-19T07:53:52.496 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-19T07:53:52.497 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-19T07:53:52.497 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-19T07:53:52.498 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-19T07:53:52.500 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-19T07:53:52.501 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-19T07:53:52.502 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-19T07:53:52.502 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-19T07:53:52.503 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-19T07:53:52.505 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-19T07:53:52.508 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-19T07:53:52.508 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-19T07:53:52.508 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-19T07:53:52.509 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-19T07:53:52.510 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-19T07:53:52.511 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-19T07:53:52.512 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-19T07:53:52.513 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-19T07:53:52.514 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-19T07:53:52.515 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-19T07:53:52.516 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-19T07:53:52.517 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-19T07:53:52.518 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-19T07:53:52.519 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-19T07:53:52.520 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-19T07:53:52.521 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-19T07:53:52.522 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-19T07:53:52.523 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-19T07:53:52.524 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-19T07:53:52.525 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-19T07:53:52.526 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-19T07:53:52.527 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-19T07:53:52.528 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-19T07:53:52.529 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-19T07:53:52.530 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-19T07:53:52.531 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-19T07:53:52.532 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-19T07:53:52.533 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-19T07:53:52.534 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-19T07:53:52.535 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-19T07:53:52.536 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-19T07:53:52.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-19T07:53:52.538 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-19T07:53:52.539 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-19T07:53:52.540 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-19T07:53:52.541 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-19T07:53:52.542 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-19T07:53:52.543 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-19T07:53:52.545 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-19T07:53:52.545 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-19T07:53:52.547 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-19T07:53:52.548 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-19T07:53:52.549 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-19T07:53:52.550 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-19T07:53:52.551 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-19T07:53:52.552 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-19T07:53:52.553 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-19T07:53:52.554 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-19T07:53:52.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-19T07:53:52.556 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-19T07:53:52.557 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-19T07:53:52.558 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-19T07:53:52.559 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-19T07:53:52.560 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-19T07:53:52.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-19T07:53:52.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-19T07:53:52.563 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-19T07:53:52.565 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-19T07:53:52.566 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-19T07:53:52.567 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-19T07:53:52.568 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-19T07:53:52.569 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-19T07:53:52.570 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-19T07:53:52.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-19T07:53:52.572 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-19T07:53:52.573 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-19T07:53:52.574 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-19T07:53:52.575 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-19T07:53:52.576 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-19T07:53:52.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-19T07:53:52.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-19T07:53:52.579 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-19T07:53:52.580 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-19T07:53:52.581 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-19T07:53:52.583 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-19T07:53:52.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-19T07:53:52.585 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-19T07:53:52.586 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-19T07:53:52.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-19T07:53:52.588 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-19T07:53:52.589 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-19T07:53:52.590 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-19T07:53:52.591 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-19T07:53:52.592 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-19T07:53:52.594 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-19T07:53:52.595 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-19T07:53:52.596 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-19T07:53:52.597 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-19T07:53:52.598 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-19T07:53:52.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-19T07:53:52.600 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-19T07:53:52.601 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-19T07:53:52.602 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-19T07:53:52.603 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-19T07:53:52.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-19T07:53:52.605 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-19T07:53:52.606 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-19T07:53:52.607 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-19T07:53:52.608 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-19T07:53:52.610 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-19T07:53:52.611 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-19T07:53:52.612 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-19T07:53:52.613 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-19T07:53:52.614 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-19T07:53:52.615 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-19T07:53:52.616 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-19T07:53:52.617 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-19T07:53:52.620 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-19T07:53:52.621 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-19T07:53:52.622 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-19T07:53:52.623 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-19T07:53:52.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-19T07:53:52.626 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-19T07:53:52.627 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-19T07:53:52.628 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-19T07:53:52.629 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-19T07:53:52.630 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-19T07:53:52.631 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-19T07:53:52.632 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-19T07:53:52.633 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-19T07:53:52.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-19T07:53:52.635 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-19T07:53:52.636 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-19T07:53:52.637 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-19T07:53:52.638 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-19T07:53:52.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-19T07:53:52.640 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-19T07:53:52.641 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-19T07:53:52.642 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-19T07:53:52.643 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-19T07:53:52.645 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-19T07:53:52.646 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-19T07:53:52.647 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-19T07:53:52.648 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-19T07:53:52.649 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-19T07:53:52.650 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-19T07:53:52.651 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-19T07:53:52.652 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-19T07:53:52.653 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-19T07:53:52.654 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-19T07:53:52.655 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-19T07:53:52.656 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-19T07:53:52.657 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-19T07:53:52.658 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-19T07:53:52.659 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-19T07:53:52.660 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-19T07:53:52.661 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-19T07:53:52.662 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-19T07:53:52.663 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-19T07:53:52.664 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-19T07:53:52.665 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-19T07:53:52.666 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-19T07:53:52.667 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-19T07:53:52.667 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-19T07:53:52.668 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-19T07:53:52.669 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-19T07:53:52.670 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-19T07:53:52.671 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-19T07:53:52.672 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-19T07:53:52.673 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-19T07:53:52.674 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-19T07:53:52.675 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-19T07:53:52.676 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-19T07:53:52.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-19T07:53:52.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-19T07:53:52.678 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-19T07:53:52.679 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-19T07:53:52.680 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-19T07:53:52.681 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-19T07:53:52.682 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-19T07:53:52.683 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-19T07:53:52.684 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-19T07:53:52.685 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-19T07:53:52.685 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-19T07:53:52.686 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-19T07:53:52.687 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-19T07:53:52.688 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-19T07:53:52.688 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-19T07:53:52.689 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-19T07:53:52.690 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-19T07:53:52.691 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-19T07:53:52.691 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-19T07:53:52.692 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-19T07:53:52.693 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-19T07:53:52.694 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-19T07:53:52.695 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-19T07:53:52.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-19T07:53:52.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-19T07:53:52.697 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-19T07:53:52.698 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-19T07:53:52.699 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-19T07:53:52.700 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-19T07:53:52.700 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-19T07:53:52.701 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-19T07:53:52.702 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-19T07:53:52.703 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-19T07:53:52.704 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-19T07:53:52.705 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-19T07:53:52.705 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-19T07:53:52.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-19T07:53:52.707 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-19T07:53:52.708 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-19T07:53:52.709 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-19T07:53:52.710 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-19T07:53:52.711 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-19T07:53:52.713 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-19T07:53:52.713 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-19T07:53:52.718 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-19T07:53:52.718 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-19T07:53:52.718 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-19T07:53:52.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-19T07:53:52.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-19T07:53:52.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-19T07:53:52.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-19T07:53:52.720 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-19T07:53:52.720 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-19T07:53:52.721 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-19T07:53:52.722 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-19T07:53:52.723 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-19T07:53:52.724 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-19T07:53:52.724 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-19T07:53:52.725 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-19T07:53:52.726 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-19T07:53:52.727 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-19T07:53:52.727 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-19T07:53:52.728 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-19T07:53:52.729 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-19T07:53:52.730 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-19T07:53:52.730 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-19T07:53:52.731 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-19T07:53:52.732 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-19T07:53:52.733 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-19T07:53:52.733 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-19T07:53:52.734 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-19T07:53:52.735 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-19T07:53:52.736 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-19T07:53:52.737 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-19T07:53:52.738 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-19T07:53:52.739 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-19T07:53:52.739 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-19T07:53:52.740 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-19T07:53:52.741 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-19T07:53:52.742 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-19T07:53:52.743 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-19T07:53:52.744 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-19T07:53:52.745 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-19T07:53:52.746 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-19T07:53:52.747 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-19T07:53:52.748 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-19T07:53:52.749 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-19T07:53:52.749 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-19T07:53:52.750 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-19T07:53:52.751 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-19T07:53:52.752 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-19T07:53:52.752 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-19T07:53:52.753 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-19T07:53:52.754 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-19T07:53:52.755 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-19T07:53:52.755 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-19T07:53:52.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-19T07:53:52.757 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-19T07:53:52.758 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-19T07:53:52.759 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-19T07:53:52.760 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-19T07:53:52.760 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-19T07:53:52.761 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-19T07:53:52.762 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-19T07:53:52.763 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-19T07:53:52.763 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-19T07:53:52.764 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-19T07:53:52.765 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-19T07:53:52.766 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-19T07:53:52.767 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-19T07:53:52.767 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-19T07:53:52.768 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-19T07:53:52.769 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-19T07:53:52.770 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-19T07:53:52.770 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-19T07:53:52.771 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-19T07:53:52.772 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-19T07:53:52.773 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-19T07:53:52.774 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-19T07:53:52.775 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-19T07:53:52.776 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-19T07:53:52.776 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-19T07:53:52.777 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-19T07:53:52.778 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-19T07:53:52.779 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-19T07:53:52.779 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-19T07:53:52.781 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-19T07:53:52.781 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-19T07:53:52.782 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-19T07:53:52.783 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-19T07:53:52.784 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-19T07:53:52.785 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-19T07:53:52.786 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-19T07:53:52.787 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-19T07:53:52.788 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-19T07:53:52.789 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-19T07:53:52.790 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-19T07:53:52.791 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-19T07:53:52.791 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-19T07:53:52.792 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-19T07:53:52.793 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-19T07:53:52.794 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-19T07:53:52.794 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-19T07:53:52.795 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-19T07:53:52.796 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-19T07:53:52.797 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-19T07:53:52.797 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-19T07:53:52.798 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-19T07:53:52.799 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-19T07:53:52.800 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-19T07:53:52.801 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-19T07:53:52.802 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-19T07:53:52.802 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-19T07:53:52.803 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-19T07:53:52.804 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-19T07:53:52.805 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-19T07:53:52.806 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-19T07:53:52.807 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-19T07:53:52.807 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-19T07:53:52.808 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-19T07:53:52.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:52 smithi152 ceph-mon[35117]: pgmap v84: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-19T07:53:52.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-19T07:53:52.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-19T07:53:52.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-19T07:53:52.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-19T07:53:52.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-19T07:53:52.813 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-19T07:53:52.814 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-19T07:53:52.815 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-19T07:53:52.815 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-19T07:53:52.816 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-19T07:53:52.817 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-19T07:53:52.818 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-19T07:53:52.819 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-19T07:53:52.819 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-19T07:53:52.820 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-19T07:53:52.821 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-19T07:53:52.822 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-19T07:53:52.823 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-19T07:53:52.824 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-19T07:53:52.824 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-19T07:53:52.825 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-19T07:53:52.826 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-19T07:53:52.827 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-19T07:53:52.828 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-19T07:53:52.829 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-19T07:53:52.830 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-19T07:53:52.831 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-19T07:53:52.831 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-19T07:53:52.832 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-19T07:53:52.833 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-19T07:53:52.834 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-19T07:53:52.834 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-19T07:53:52.835 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-19T07:53:52.836 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-19T07:53:52.837 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-19T07:53:52.837 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-19T07:53:52.838 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-19T07:53:52.839 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-19T07:53:52.840 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-19T07:53:52.840 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-19T07:53:52.841 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-19T07:53:52.842 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-19T07:53:52.843 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-19T07:53:52.843 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-19T07:53:52.844 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-19T07:53:52.845 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-19T07:53:52.846 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-19T07:53:52.846 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-19T07:53:52.847 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-19T07:53:52.848 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-19T07:53:52.849 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-19T07:53:52.849 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-19T07:53:52.850 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-19T07:53:52.851 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-19T07:53:52.852 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-19T07:53:52.853 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-19T07:53:52.854 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-19T07:53:52.854 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-19T07:53:52.855 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-19T07:53:52.856 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-19T07:53:52.857 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-19T07:53:52.858 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-19T07:53:52.859 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-19T07:53:52.859 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-19T07:53:52.861 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-19T07:53:52.861 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-19T07:53:52.862 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-19T07:53:52.863 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-19T07:53:52.864 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-19T07:53:52.865 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-19T07:53:52.866 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-19T07:53:52.866 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-19T07:53:52.867 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-19T07:53:52.868 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-19T07:53:52.869 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-19T07:53:52.869 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-19T07:53:52.870 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-19T07:53:52.871 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-19T07:53:52.872 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-19T07:53:52.872 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-19T07:53:52.873 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-19T07:53:52.874 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-19T07:53:52.875 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-19T07:53:52.876 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-19T07:53:52.876 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-19T07:53:52.877 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-19T07:53:52.878 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-19T07:53:52.879 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-19T07:53:52.880 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-19T07:53:52.881 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-19T07:53:52.881 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-19T07:53:52.882 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-19T07:53:52.883 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-19T07:53:52.884 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-19T07:53:52.885 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-19T07:53:52.886 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-19T07:53:52.887 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-19T07:53:52.887 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-19T07:53:52.888 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-19T07:53:52.889 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-19T07:53:52.890 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-19T07:53:52.891 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-19T07:53:52.892 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-19T07:53:52.893 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-19T07:53:52.894 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-19T07:53:52.895 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-19T07:53:52.895 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-19T07:53:52.896 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-19T07:53:52.897 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-19T07:53:52.898 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-19T07:53:52.899 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-19T07:53:52.900 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-19T07:53:52.901 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-19T07:53:52.901 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-19T07:53:52.902 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-19T07:53:52.903 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-19T07:53:52.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:52 smithi137 ceph-mon[35309]: pgmap v84: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-19T07:53:52.905 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-19T07:53:52.905 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-19T07:53:52.906 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-19T07:53:52.907 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-19T07:53:52.907 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-19T07:53:52.908 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-19T07:53:52.909 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-19T07:53:52.910 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-19T07:53:52.911 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-19T07:53:52.912 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-19T07:53:52.913 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-19T07:53:52.914 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-19T07:53:52.915 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-19T07:53:52.916 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-19T07:53:52.917 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-19T07:53:52.917 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-19T07:53:52.920 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-19T07:53:52.921 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-19T07:53:52.921 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-19T07:53:52.921 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-19T07:53:52.923 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-19T07:53:52.923 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-19T07:53:52.924 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-19T07:53:52.925 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-19T07:53:52.926 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-19T07:53:52.927 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-19T07:53:52.928 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-19T07:53:52.929 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-19T07:53:52.930 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-19T07:53:52.931 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-19T07:53:52.932 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-19T07:53:52.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:52 smithi076 ceph-mon[30930]: pgmap v84: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-19T07:53:53.170 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-19T07:53:53.171 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-19T07:53:53.172 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-19T07:53:53.173 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-19T07:53:53.174 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-19T07:53:53.175 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-19T07:53:53.175 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-19T07:53:53.176 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-19T07:53:53.177 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-19T07:53:53.178 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-19T07:53:53.179 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-19T07:53:53.180 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-19T07:53:53.181 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-19T07:53:53.182 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-19T07:53:53.183 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-19T07:53:53.183 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-19T07:53:53.184 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-19T07:53:53.185 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-19T07:53:53.186 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-19T07:53:53.187 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-19T07:53:53.188 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-19T07:53:53.189 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-19T07:53:53.190 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-19T07:53:53.191 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-19T07:53:53.193 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-19T07:53:53.194 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-19T07:53:53.195 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-19T07:53:53.195 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-19T07:53:53.196 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-19T07:53:53.197 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-19T07:53:53.198 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-19T07:53:53.199 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-19T07:53:53.200 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-19T07:53:53.201 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-19T07:53:53.202 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-19T07:53:53.203 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-19T07:53:53.204 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-19T07:53:53.205 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-19T07:53:53.206 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-19T07:53:53.207 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-19T07:53:53.208 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-19T07:53:53.209 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-19T07:53:53.210 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-19T07:53:53.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-19T07:53:53.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-19T07:53:53.212 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-19T07:53:53.213 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-19T07:53:53.214 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-19T07:53:53.215 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-19T07:53:53.216 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-19T07:53:53.217 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-19T07:53:53.218 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-19T07:53:53.219 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-19T07:53:53.219 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-19T07:53:53.220 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-19T07:53:53.221 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-19T07:53:53.222 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-19T07:53:53.223 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-19T07:53:53.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-19T07:53:53.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-19T07:53:53.226 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-19T07:53:53.227 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-19T07:53:53.229 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-19T07:53:53.230 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-19T07:53:53.232 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-19T07:53:53.234 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-19T07:53:53.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-19T07:53:53.237 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-19T07:53:53.238 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-19T07:53:53.240 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-19T07:53:53.242 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-19T07:53:53.243 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-19T07:53:53.245 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-19T07:53:53.246 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-19T07:53:53.249 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-19T07:53:53.250 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-19T07:53:53.251 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-19T07:53:53.252 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-19T07:53:53.254 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-19T07:53:53.255 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-19T07:53:53.257 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-19T07:53:53.258 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-19T07:53:53.260 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-19T07:53:53.261 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-19T07:53:53.263 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-19T07:53:53.264 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-19T07:53:53.266 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-19T07:53:53.267 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-19T07:53:53.269 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-19T07:53:53.270 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-19T07:53:53.271 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-19T07:53:53.273 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-19T07:53:53.274 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-19T07:53:53.276 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-19T07:53:53.277 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-19T07:53:53.279 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-19T07:53:53.280 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-19T07:53:53.282 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-19T07:53:53.283 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-19T07:53:53.285 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-19T07:53:53.286 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-19T07:53:53.287 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-19T07:53:53.288 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-19T07:53:53.288 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-19T07:53:53.289 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-19T07:53:53.290 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-19T07:53:53.291 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-19T07:53:53.292 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-19T07:53:53.293 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-19T07:53:53.294 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-19T07:53:53.295 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-19T07:53:53.296 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-19T07:53:53.297 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-19T07:53:53.298 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-19T07:53:53.299 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-19T07:53:53.300 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-19T07:53:53.301 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-19T07:53:53.301 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-19T07:53:53.302 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/ 2024-09-19T07:53:53.303 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-19T07:53:53.304 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-19T07:53:53.305 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-19T07:53:53.306 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-19T07:53:53.307 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-19T07:53:53.308 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-19T07:53:53.308 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-19T07:53:53.309 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-19T07:53:53.310 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-19T07:53:53.311 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-19T07:53:53.312 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-19T07:53:53.313 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-19T07:53:53.314 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-19T07:53:53.315 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-19T07:53:53.315 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-19T07:53:53.316 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-19T07:53:53.317 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-19T07:53:53.318 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-19T07:53:53.319 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-19T07:53:53.320 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-19T07:53:53.321 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-19T07:53:53.322 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-19T07:53:53.323 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-19T07:53:53.324 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-19T07:53:53.325 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-19T07:53:53.326 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-19T07:53:53.328 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-19T07:53:53.328 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-19T07:53:53.329 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-19T07:53:53.330 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-19T07:53:53.331 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-19T07:53:53.332 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-19T07:53:53.333 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-19T07:53:53.334 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-19T07:53:53.335 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-19T07:53:53.336 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-19T07:53:53.337 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-19T07:53:53.338 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-19T07:53:53.339 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-19T07:53:53.340 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-19T07:53:53.340 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-19T07:53:53.341 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-19T07:53:53.342 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-19T07:53:53.343 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-19T07:53:53.344 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-19T07:53:53.345 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-19T07:53:53.346 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-19T07:53:53.347 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-19T07:53:53.348 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-19T07:53:53.349 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-19T07:53:53.350 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-19T07:53:53.351 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-19T07:53:53.352 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-19T07:53:53.352 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-19T07:53:53.353 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-19T07:53:53.354 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-19T07:53:53.355 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-19T07:53:53.356 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-19T07:53:53.357 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-19T07:53:53.358 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-19T07:53:53.359 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-19T07:53:53.360 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-19T07:53:53.361 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-19T07:53:53.362 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-19T07:53:53.363 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-19T07:53:53.363 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-19T07:53:53.364 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-19T07:53:53.365 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-19T07:53:53.366 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-19T07:53:53.367 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-19T07:53:53.368 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-19T07:53:53.369 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-19T07:53:53.370 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-19T07:53:53.371 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-19T07:53:53.372 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-19T07:53:53.373 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-19T07:53:53.374 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-19T07:53:53.375 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-19T07:53:53.375 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-19T07:53:53.376 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-19T07:53:53.377 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-19T07:53:53.378 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-19T07:53:53.379 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-19T07:53:53.380 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-19T07:53:53.381 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-19T07:53:53.382 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-19T07:53:53.383 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-19T07:53:53.384 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-19T07:53:53.385 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-19T07:53:53.386 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-19T07:53:53.387 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-19T07:53:53.388 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-19T07:53:53.389 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-19T07:53:53.389 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-19T07:53:53.390 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-19T07:53:53.391 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-19T07:53:53.392 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-19T07:53:53.393 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-19T07:53:53.394 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-19T07:53:53.395 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-19T07:53:53.396 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-19T07:53:53.397 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-19T07:53:53.398 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-19T07:53:53.399 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-19T07:53:53.400 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-19T07:53:53.401 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-19T07:53:53.401 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-19T07:53:53.402 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-19T07:53:53.403 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-19T07:53:53.404 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-19T07:53:53.405 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-19T07:53:53.406 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-19T07:53:53.407 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-19T07:53:53.408 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-19T07:53:53.409 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-19T07:53:53.410 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-19T07:53:53.411 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-19T07:53:53.412 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-19T07:53:53.413 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-19T07:53:53.414 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-19T07:53:53.415 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-19T07:53:53.416 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-19T07:53:53.417 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-19T07:53:53.418 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-19T07:53:53.418 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-19T07:53:53.419 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-19T07:53:53.420 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-19T07:53:53.421 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-19T07:53:53.422 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-19T07:53:53.423 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-19T07:53:53.424 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-19T07:53:53.425 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-19T07:53:53.425 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-19T07:53:53.426 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-19T07:53:53.427 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-19T07:53:53.428 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-19T07:53:53.429 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-19T07:53:53.429 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-19T07:53:53.430 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-19T07:53:53.431 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-19T07:53:53.432 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-19T07:53:53.433 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-19T07:53:53.434 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-19T07:53:53.435 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-19T07:53:53.436 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-19T07:53:53.437 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-19T07:53:53.438 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-19T07:53:53.439 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-19T07:53:53.440 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-19T07:53:53.441 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-19T07:53:53.442 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-19T07:53:53.443 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-19T07:53:53.444 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-19T07:53:53.445 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-19T07:53:53.446 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-19T07:53:53.447 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-19T07:53:53.448 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-19T07:53:53.449 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-19T07:53:53.450 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-19T07:53:53.450 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-19T07:53:53.451 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-19T07:53:53.452 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-19T07:53:53.453 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-19T07:53:53.454 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-19T07:53:53.455 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-19T07:53:53.456 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-19T07:53:53.457 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-19T07:53:53.458 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/ 2024-09-19T07:53:53.459 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-19T07:53:53.459 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-19T07:53:53.460 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-19T07:53:53.461 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-19T07:53:53.462 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-19T07:53:53.463 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-19T07:53:53.464 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-19T07:53:53.465 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-19T07:53:53.466 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-19T07:53:53.467 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-19T07:53:53.468 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-19T07:53:53.469 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-19T07:53:53.470 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-19T07:53:53.471 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-19T07:53:53.472 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-19T07:53:53.473 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-19T07:53:53.474 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-19T07:53:53.474 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-19T07:53:53.476 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-19T07:53:53.476 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-19T07:53:53.477 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-19T07:53:53.478 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hid/ 2024-09-19T07:53:53.479 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-19T07:53:53.480 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-19T07:53:53.481 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-19T07:53:53.482 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-19T07:53:53.482 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-19T07:53:53.483 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-19T07:53:53.484 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-19T07:53:53.485 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-19T07:53:53.486 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-19T07:53:53.487 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-19T07:53:53.488 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-19T07:53:53.489 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-19T07:53:53.490 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-19T07:53:53.491 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-19T07:53:53.492 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-19T07:53:53.493 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-19T07:53:53.494 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-19T07:53:53.494 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-19T07:53:53.495 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-19T07:53:53.496 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-19T07:53:53.497 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-19T07:53:53.498 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-19T07:53:53.499 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-19T07:53:53.500 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-19T07:53:53.500 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-19T07:53:53.501 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-19T07:53:53.502 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-19T07:53:53.503 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-19T07:53:53.504 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-19T07:53:53.505 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-19T07:53:53.506 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-19T07:53:53.507 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-19T07:53:53.508 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-19T07:53:53.509 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-19T07:53:53.510 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-19T07:53:53.511 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-19T07:53:53.512 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-19T07:53:53.512 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-19T07:53:53.513 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-19T07:53:53.514 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-19T07:53:53.515 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-19T07:53:53.516 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-19T07:53:53.517 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-19T07:53:53.517 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-19T07:53:53.518 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-19T07:53:53.519 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-19T07:53:53.520 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-19T07:53:53.521 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-19T07:53:53.522 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-19T07:53:53.523 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-19T07:53:53.523 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-19T07:53:53.524 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-19T07:53:53.525 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-19T07:53:53.526 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-19T07:53:53.527 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-19T07:53:53.528 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-19T07:53:53.529 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-19T07:53:53.529 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-19T07:53:53.530 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-19T07:53:53.531 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-19T07:53:53.532 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-19T07:53:53.533 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-19T07:53:53.534 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-19T07:53:53.535 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-19T07:53:53.536 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-19T07:53:53.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-19T07:53:53.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-19T07:53:53.538 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-19T07:53:53.539 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-19T07:53:53.540 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-19T07:53:53.541 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-19T07:53:53.542 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-19T07:53:53.543 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-19T07:53:53.544 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-19T07:53:53.545 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-19T07:53:53.546 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-19T07:53:53.547 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-19T07:53:53.548 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-19T07:53:53.548 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-19T07:53:53.549 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-19T07:53:53.550 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-19T07:53:53.551 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-19T07:53:53.553 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-19T07:53:53.554 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-19T07:53:53.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-19T07:53:53.556 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-19T07:53:53.557 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-19T07:53:53.558 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-19T07:53:53.559 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-19T07:53:53.559 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-19T07:53:53.560 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-19T07:53:53.561 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-19T07:53:53.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-19T07:53:53.563 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-19T07:53:53.564 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-19T07:53:53.565 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-19T07:53:53.565 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-19T07:53:53.566 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-19T07:53:53.567 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-19T07:53:53.568 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-19T07:53:53.569 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-19T07:53:53.569 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-19T07:53:53.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-19T07:53:53.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-19T07:53:53.572 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-19T07:53:53.573 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-19T07:53:53.574 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-19T07:53:53.575 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-19T07:53:53.576 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-19T07:53:53.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-19T07:53:53.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-19T07:53:53.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-19T07:53:53.579 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-19T07:53:53.580 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-19T07:53:53.581 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-19T07:53:53.582 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-19T07:53:53.583 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-19T07:53:53.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-19T07:53:53.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-19T07:53:53.585 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-19T07:53:53.586 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-19T07:53:53.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-19T07:53:53.588 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-19T07:53:53.589 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-19T07:53:53.590 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-19T07:53:53.590 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-19T07:53:53.591 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-19T07:53:53.592 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-19T07:53:53.593 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-19T07:53:53.594 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-19T07:53:53.595 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-19T07:53:53.596 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-19T07:53:53.597 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-19T07:53:53.597 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-19T07:53:53.598 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-19T07:53:53.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-19T07:53:53.600 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-19T07:53:53.601 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-19T07:53:53.602 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-19T07:53:53.603 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-19T07:53:53.603 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-19T07:53:53.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-19T07:53:53.605 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-19T07:53:53.606 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-19T07:53:53.607 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-19T07:53:53.608 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-19T07:53:53.609 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-19T07:53:53.609 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-19T07:53:53.610 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-19T07:53:53.611 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-19T07:53:53.612 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-19T07:53:53.613 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-19T07:53:53.613 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-19T07:53:53.614 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-19T07:53:53.615 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-19T07:53:53.616 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-19T07:53:53.617 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-19T07:53:53.618 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-19T07:53:53.618 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-19T07:53:53.619 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-19T07:53:53.622 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-19T07:53:53.623 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-19T07:53:53.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-19T07:53:53.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-19T07:53:53.625 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-19T07:53:53.627 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-19T07:53:53.628 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-19T07:53:53.628 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-19T07:53:53.629 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-19T07:53:53.630 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-19T07:53:53.631 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-19T07:53:53.632 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-19T07:53:53.633 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-19T07:53:53.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-19T07:53:53.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-19T07:53:53.635 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-19T07:53:53.636 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-19T07:53:53.637 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-19T07:53:53.638 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-19T07:53:53.638 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-19T07:53:53.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-19T07:53:53.640 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-19T07:53:53.641 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-19T07:53:53.642 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-19T07:53:53.643 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-19T07:53:53.644 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-19T07:53:53.644 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-19T07:53:53.645 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-19T07:53:53.646 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-19T07:53:53.647 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-19T07:53:53.648 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-19T07:53:53.648 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-19T07:53:53.649 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-19T07:53:53.815 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-19T07:53:53.816 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-19T07:53:53.816 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-19T07:53:53.817 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-19T07:53:53.818 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-19T07:53:53.819 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-19T07:53:53.820 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/ 2024-09-19T07:53:53.821 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-19T07:53:53.821 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-19T07:53:53.822 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-19T07:53:53.823 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-19T07:53:53.824 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-19T07:53:53.825 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-19T07:53:53.826 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-19T07:53:53.827 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-19T07:53:53.828 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-19T07:53:53.829 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-19T07:53:53.829 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-19T07:53:53.830 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-19T07:53:53.831 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-19T07:53:53.832 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/init.txt 2024-09-19T07:53:53.833 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-19T07:53:53.833 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/ 2024-09-19T07:53:53.834 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-19T07:53:53.835 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-19T07:53:53.836 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-19T07:53:53.836 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-19T07:53:53.837 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-19T07:53:53.838 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-19T07:53:53.839 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-19T07:53:53.839 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-19T07:53:53.840 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-19T07:53:53.841 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-19T07:53:53.841 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-19T07:53:53.842 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-19T07:53:53.843 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-19T07:53:53.844 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-19T07:53:53.844 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-19T07:53:53.845 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-19T07:53:53.846 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-19T07:53:53.847 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-19T07:53:53.848 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-19T07:53:53.848 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-19T07:53:53.849 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-19T07:53:53.850 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-19T07:53:53.851 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-19T07:53:53.852 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-19T07:53:53.852 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-19T07:53:53.853 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-19T07:53:53.854 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-19T07:53:53.855 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-19T07:53:53.855 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-19T07:53:53.856 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-19T07:53:53.857 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-19T07:53:53.858 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-19T07:53:53.859 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-19T07:53:53.860 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-19T07:53:53.861 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-19T07:53:53.861 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-19T07:53:53.862 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-19T07:53:53.863 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-19T07:53:53.864 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-19T07:53:53.865 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-19T07:53:53.866 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-19T07:53:53.867 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-19T07:53:53.868 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-19T07:53:53.869 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-19T07:53:53.870 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-19T07:53:53.871 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-19T07:53:53.871 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-19T07:53:53.872 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-19T07:53:53.873 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-19T07:53:53.874 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-19T07:53:53.875 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-19T07:53:53.876 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-19T07:53:53.877 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-19T07:53:53.878 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-19T07:53:53.878 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-19T07:53:53.879 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-19T07:53:53.880 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-19T07:53:53.881 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-19T07:53:53.882 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-19T07:53:53.882 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-19T07:53:53.883 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-19T07:53:53.884 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-19T07:53:53.885 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-19T07:53:53.886 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-19T07:53:53.887 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-19T07:53:53.887 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-19T07:53:53.888 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-19T07:53:53.889 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-19T07:53:53.890 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-19T07:53:53.891 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-19T07:53:53.891 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-19T07:53:53.892 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-19T07:53:53.893 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-19T07:53:53.893 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-19T07:53:53.894 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-19T07:53:53.895 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-19T07:53:53.896 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/java.txt 2024-09-19T07:53:53.897 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-19T07:53:53.898 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-19T07:53:53.899 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-19T07:53:53.900 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-19T07:53:53.901 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-19T07:53:53.902 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-19T07:53:53.902 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-19T07:53:53.903 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-19T07:53:53.904 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-19T07:53:53.905 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-19T07:53:53.906 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-19T07:53:53.907 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-19T07:53:53.907 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-19T07:53:53.908 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-19T07:53:53.909 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-19T07:53:53.911 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-19T07:53:53.912 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-19T07:53:53.913 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-19T07:53:53.914 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-19T07:53:53.915 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-19T07:53:53.915 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-19T07:53:53.916 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-19T07:53:53.917 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-19T07:53:53.918 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-19T07:53:53.919 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-19T07:53:53.920 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-19T07:53:53.921 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-19T07:53:53.922 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-19T07:53:53.923 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-19T07:53:53.924 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-19T07:53:53.924 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-19T07:53:53.925 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-19T07:53:53.926 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-19T07:53:53.926 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-19T07:53:53.927 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-19T07:53:53.928 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-19T07:53:53.929 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-19T07:53:53.930 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-19T07:53:53.930 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-19T07:53:53.931 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/ 2024-09-19T07:53:53.932 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-19T07:53:53.933 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-19T07:53:53.934 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-19T07:53:53.934 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-19T07:53:53.935 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-19T07:53:53.936 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-19T07:53:53.937 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-19T07:53:53.937 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-19T07:53:53.938 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-19T07:53:53.939 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-19T07:53:53.939 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-19T07:53:53.940 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-19T07:53:53.941 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/ 2024-09-19T07:53:53.942 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-19T07:53:53.942 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-19T07:53:53.943 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-19T07:53:53.944 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-19T07:53:53.945 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-19T07:53:53.945 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-19T07:53:53.946 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-19T07:53:53.947 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-19T07:53:53.947 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-19T07:53:53.948 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-19T07:53:53.949 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-19T07:53:53.950 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-19T07:53:53.951 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-19T07:53:53.952 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-19T07:53:53.952 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-19T07:53:53.953 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-19T07:53:53.954 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-19T07:53:53.955 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-19T07:53:53.955 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-19T07:53:53.956 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-19T07:53:53.957 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/md.txt 2024-09-19T07:53:53.958 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-19T07:53:53.959 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-19T07:53:54.040 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-19T07:53:54.041 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-19T07:53:54.041 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-19T07:53:54.042 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/metag/ 2024-09-19T07:53:54.043 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-19T07:53:54.044 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-19T07:53:54.044 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/ 2024-09-19T07:53:54.045 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-19T07:53:54.046 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-19T07:53:54.047 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-19T07:53:54.047 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-19T07:53:54.048 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-19T07:53:54.049 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-19T07:53:54.050 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-19T07:53:54.051 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-19T07:53:54.052 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-19T07:53:54.052 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-19T07:53:54.053 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mips/ 2024-09-19T07:53:54.054 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-19T07:53:54.055 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-19T07:53:54.055 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-19T07:53:54.056 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-19T07:53:54.057 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-19T07:53:54.058 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-19T07:53:54.058 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-19T07:53:54.059 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-19T07:53:54.060 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-19T07:53:54.061 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-19T07:53:54.062 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-19T07:53:54.063 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-19T07:53:54.064 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-19T07:53:54.065 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-19T07:53:54.066 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-19T07:53:54.066 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-19T07:53:54.067 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-19T07:53:54.068 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-19T07:53:54.069 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-19T07:53:54.070 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-19T07:53:54.070 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-19T07:53:54.071 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-19T07:53:54.072 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-19T07:53:54.073 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-19T07:53:54.074 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-19T07:53:54.074 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-19T07:53:54.075 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-19T07:53:54.076 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-19T07:53:54.076 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-19T07:53:54.077 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-19T07:53:54.078 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-19T07:53:54.079 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-19T07:53:54.080 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-19T07:53:54.080 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-19T07:53:54.081 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-19T07:53:54.082 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-19T07:53:54.083 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-19T07:53:54.085 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-19T07:53:54.086 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-19T07:53:54.087 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-19T07:53:54.088 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-19T07:53:54.090 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-19T07:53:54.091 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-19T07:53:54.093 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-19T07:53:54.094 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-19T07:53:54.095 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ 2024-09-19T07:53:54.096 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-19T07:53:54.097 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-19T07:53:54.098 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-19T07:53:54.099 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-19T07:53:54.099 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-19T07:53:54.100 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-19T07:53:54.101 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-19T07:53:54.102 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-19T07:53:54.103 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-19T07:53:54.104 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-19T07:53:54.105 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-19T07:53:54.106 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-19T07:53:54.107 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-19T07:53:54.108 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-19T07:53:54.109 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-19T07:53:54.112 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-19T07:53:54.112 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-19T07:53:54.112 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-19T07:53:54.113 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-19T07:53:54.114 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-19T07:53:54.115 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-19T07:53:54.116 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-19T07:53:54.117 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-19T07:53:54.117 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-19T07:53:54.118 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-19T07:53:54.119 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-19T07:53:54.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-19T07:53:54.120 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-19T07:53:54.121 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-19T07:53:54.122 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-19T07:53:54.123 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-19T07:53:54.124 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-19T07:53:54.125 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-19T07:53:54.126 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-19T07:53:54.127 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-19T07:53:54.128 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-19T07:53:54.129 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-19T07:53:54.130 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-19T07:53:54.131 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-19T07:53:54.132 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-19T07:53:54.133 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-19T07:53:54.133 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-19T07:53:54.134 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-19T07:53:54.135 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-19T07:53:54.135 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-19T07:53:54.136 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-19T07:53:54.137 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-19T07:53:54.138 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-19T07:53:54.139 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-19T07:53:54.139 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-19T07:53:54.140 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-19T07:53:54.141 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-19T07:53:54.142 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-19T07:53:54.142 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-19T07:53:54.143 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-19T07:53:54.144 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-19T07:53:54.145 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-19T07:53:54.146 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-19T07:53:54.147 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-19T07:53:54.147 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-19T07:53:54.148 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-19T07:53:54.149 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-19T07:53:54.150 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-19T07:53:54.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-19T07:53:54.151 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-19T07:53:54.152 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-19T07:53:54.153 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-19T07:53:54.154 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-19T07:53:54.154 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-19T07:53:54.155 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-19T07:53:54.156 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-19T07:53:54.157 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-19T07:53:54.157 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-19T07:53:54.158 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-19T07:53:54.159 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-19T07:53:54.160 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-19T07:53:54.160 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-19T07:53:54.161 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-19T07:53:54.162 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-19T07:53:54.162 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-19T07:53:54.163 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-19T07:53:54.164 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-19T07:53:54.165 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-19T07:53:54.165 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-19T07:53:54.166 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-19T07:53:54.167 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-19T07:53:54.167 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-19T07:53:54.168 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-19T07:53:54.169 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-19T07:53:54.170 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-19T07:53:54.170 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-19T07:53:54.171 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-19T07:53:54.172 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-19T07:53:54.173 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-19T07:53:54.174 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-19T07:53:54.175 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-19T07:53:54.175 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-19T07:53:54.176 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-19T07:53:54.177 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-19T07:53:54.178 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-19T07:53:54.179 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-19T07:53:54.179 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-19T07:53:54.180 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-19T07:53:54.181 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-19T07:53:54.181 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-19T07:53:54.182 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-19T07:53:54.183 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-19T07:53:54.184 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-19T07:53:54.184 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-19T07:53:54.185 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-19T07:53:54.186 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-19T07:53:54.187 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-19T07:53:54.188 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-19T07:53:54.189 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-19T07:53:54.189 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-19T07:53:54.190 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-19T07:53:54.191 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-19T07:53:54.192 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-19T07:53:54.192 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-19T07:53:54.193 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-19T07:53:54.194 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-19T07:53:54.195 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-19T07:53:54.196 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-19T07:53:54.196 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-19T07:53:54.197 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-19T07:53:54.198 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-19T07:53:54.199 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-19T07:53:54.200 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-19T07:53:54.200 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-19T07:53:54.201 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-19T07:53:54.202 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-19T07:53:54.203 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-19T07:53:54.204 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-19T07:53:54.205 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-19T07:53:54.205 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-19T07:53:54.206 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-19T07:53:54.207 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-19T07:53:54.208 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-19T07:53:54.209 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-19T07:53:54.210 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-19T07:53:54.211 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-19T07:53:54.212 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-19T07:53:54.212 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-19T07:53:54.213 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-19T07:53:54.214 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-19T07:53:54.215 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-19T07:53:54.215 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-19T07:53:54.216 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-19T07:53:54.217 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-19T07:53:54.218 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-19T07:53:54.219 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-19T07:53:54.220 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-19T07:53:54.221 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-19T07:53:54.222 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-19T07:53:54.222 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-19T07:53:54.223 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-19T07:53:54.224 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-19T07:53:54.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-19T07:53:54.225 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-19T07:53:54.226 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-19T07:53:54.227 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/phy/ 2024-09-19T07:53:54.228 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-19T07:53:54.229 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-19T07:53:54.230 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-19T07:53:54.231 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/platform/ 2024-09-19T07:53:54.232 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-19T07:53:54.233 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-19T07:53:54.233 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/ 2024-09-19T07:53:54.234 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-19T07:53:54.235 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-19T07:53:54.236 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-19T07:53:54.237 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-19T07:53:54.238 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-19T07:53:54.238 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-19T07:53:54.239 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-19T07:53:54.240 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-19T07:53:54.241 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-19T07:53:54.242 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-19T07:53:54.242 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-19T07:53:54.243 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-19T07:53:54.244 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-19T07:53:54.245 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-19T07:53:54.246 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-19T07:53:54.246 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-19T07:53:54.247 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-19T07:53:54.248 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-19T07:53:54.249 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-19T07:53:54.250 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-19T07:53:54.250 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-19T07:53:54.251 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-19T07:53:54.252 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-19T07:53:54.253 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-19T07:53:54.254 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-19T07:53:54.254 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-19T07:53:54.255 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-19T07:53:54.256 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-19T07:53:54.257 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-19T07:53:54.258 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-19T07:53:54.259 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-19T07:53:54.260 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-19T07:53:54.261 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-19T07:53:54.262 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-19T07:53:54.263 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-19T07:53:54.263 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-19T07:53:54.264 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-19T07:53:54.265 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-19T07:53:54.266 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-19T07:53:54.266 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-19T07:53:54.267 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-19T07:53:54.268 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-19T07:53:54.269 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-19T07:53:54.270 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-19T07:53:54.270 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-19T07:53:54.271 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-19T07:53:54.272 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pps/ 2024-09-19T07:53:54.273 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-19T07:53:54.274 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-19T07:53:54.275 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-19T07:53:54.275 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-19T07:53:54.276 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-19T07:53:54.277 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-19T07:53:54.278 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-19T07:53:54.279 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-19T07:53:54.279 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-19T07:53:54.280 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-19T07:53:54.281 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-19T07:53:54.282 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pti/ 2024-09-19T07:53:54.283 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-19T07:53:54.284 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-19T07:53:54.284 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-19T07:53:54.285 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-19T07:53:54.286 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-19T07:53:54.287 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-19T07:53:54.287 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-19T07:53:54.288 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-19T07:53:54.289 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-19T07:53:54.290 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-19T07:53:54.291 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-19T07:53:54.292 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-19T07:53:54.292 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-19T07:53:54.293 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-19T07:53:54.294 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-19T07:53:54.295 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-19T07:53:54.296 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-19T07:53:54.297 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-19T07:53:54.298 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-19T07:53:54.299 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-19T07:53:54.300 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/ 2024-09-19T07:53:54.301 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-19T07:53:54.302 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-19T07:53:54.303 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-19T07:53:54.304 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-19T07:53:54.306 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-19T07:53:54.307 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-19T07:53:54.309 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-19T07:53:54.310 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-19T07:53:54.311 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-19T07:53:54.313 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-19T07:53:54.314 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-19T07:53:54.316 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-19T07:53:54.317 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-19T07:53:54.319 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-19T07:53:54.320 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-19T07:53:54.321 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-19T07:53:54.323 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-19T07:53:54.324 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-19T07:53:54.326 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-19T07:53:54.327 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-19T07:53:54.329 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-19T07:53:54.330 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-19T07:53:54.332 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-19T07:53:54.333 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-19T07:53:54.335 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-19T07:53:54.336 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-19T07:53:54.338 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-19T07:53:54.339 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-19T07:53:54.340 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-19T07:53:54.342 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-19T07:53:54.344 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-19T07:53:54.345 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-19T07:53:54.346 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-19T07:53:54.349 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-19T07:53:54.350 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-19T07:53:54.351 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-19T07:53:54.352 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-19T07:53:54.353 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-19T07:53:54.354 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-19T07:53:54.355 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-19T07:53:54.355 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-19T07:53:54.356 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-19T07:53:54.357 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-19T07:53:54.358 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-19T07:53:54.358 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-19T07:53:54.359 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-19T07:53:54.360 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-19T07:53:54.361 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-19T07:53:54.362 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-19T07:53:54.363 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-19T07:53:54.364 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-19T07:53:54.365 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-19T07:53:54.365 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-19T07:53:54.366 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-19T07:53:54.367 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-19T07:53:54.368 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-19T07:53:54.369 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-19T07:53:54.370 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-19T07:53:54.371 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-19T07:53:54.372 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-19T07:53:54.373 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-19T07:53:54.374 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-19T07:53:54.375 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-19T07:53:54.375 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-19T07:53:54.376 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-19T07:53:54.377 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-19T07:53:54.378 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-19T07:53:54.379 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-19T07:53:54.380 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-19T07:53:54.381 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-19T07:53:54.382 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-19T07:53:54.383 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-19T07:53:54.383 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-19T07:53:54.384 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-19T07:53:54.386 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-19T07:53:54.386 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-19T07:53:54.387 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-19T07:53:54.388 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-19T07:53:54.389 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-19T07:53:54.390 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-19T07:53:54.391 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-19T07:53:54.392 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-19T07:53:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-19T07:53:54.394 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-19T07:53:54.395 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-19T07:53:54.395 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/ 2024-09-19T07:53:54.396 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-19T07:53:54.397 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-19T07:53:54.397 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-19T07:53:54.398 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-19T07:53:54.399 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-19T07:53:54.400 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-19T07:53:54.401 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-19T07:53:54.402 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-19T07:53:54.403 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-19T07:53:54.404 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-19T07:53:54.404 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-19T07:53:54.405 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-19T07:53:54.406 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-19T07:53:54.407 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-19T07:53:54.408 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/ 2024-09-19T07:53:54.409 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-19T07:53:54.410 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-19T07:53:54.411 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-19T07:53:54.412 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-19T07:53:54.413 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-19T07:53:54.414 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-19T07:53:54.414 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-19T07:53:54.415 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-19T07:53:54.416 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-19T07:53:54.417 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sh/ 2024-09-19T07:53:54.418 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-19T07:53:54.419 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-19T07:53:54.419 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-19T07:53:54.420 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/ 2024-09-19T07:53:54.421 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-19T07:53:54.422 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-19T07:53:54.423 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-19T07:53:54.424 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-19T07:53:54.425 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-19T07:53:54.426 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-19T07:53:54.426 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-19T07:53:54.427 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-19T07:53:54.428 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-19T07:53:54.429 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-19T07:53:54.430 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-19T07:53:54.430 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-19T07:53:54.431 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-19T07:53:54.432 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-19T07:53:54.433 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-19T07:53:54.434 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-19T07:53:54.435 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-19T07:53:54.436 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-19T07:53:54.437 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-19T07:53:54.438 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-19T07:53:54.438 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-19T07:53:54.439 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-19T07:53:54.440 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-19T07:53:54.441 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-19T07:53:54.442 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-19T07:53:54.443 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-19T07:53:54.444 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-19T07:53:54.445 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-19T07:53:54.445 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-19T07:53:54.446 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-19T07:53:54.447 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-19T07:53:54.448 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-19T07:53:54.449 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-19T07:53:54.450 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-19T07:53:54.451 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-19T07:53:54.452 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-19T07:53:54.453 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-19T07:53:54.454 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-19T07:53:54.455 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-19T07:53:54.456 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-19T07:53:54.457 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-19T07:53:54.458 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-19T07:53:54.459 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-19T07:53:54.460 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-19T07:53:54.461 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-19T07:53:54.462 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-19T07:53:54.463 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-19T07:53:54.464 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-19T07:53:54.465 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-19T07:53:54.466 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-19T07:53:54.467 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-19T07:53:54.468 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-19T07:53:54.469 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-19T07:53:54.470 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-19T07:53:54.471 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-19T07:53:54.472 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-19T07:53:54.473 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-19T07:53:54.474 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-19T07:53:54.475 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-19T07:53:54.476 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-19T07:53:54.477 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-19T07:53:54.478 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-19T07:53:54.479 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-19T07:53:54.480 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/ 2024-09-19T07:53:54.481 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-19T07:53:54.481 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-19T07:53:54.482 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-19T07:53:54.483 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-19T07:53:54.484 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-19T07:53:54.484 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-19T07:53:54.485 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-19T07:53:54.486 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-19T07:53:54.487 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-19T07:53:54.487 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-19T07:53:54.488 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-19T07:53:54.489 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-19T07:53:54.490 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-19T07:53:54.491 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-19T07:53:54.492 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-19T07:53:54.493 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-19T07:53:54.494 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-19T07:53:54.495 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-19T07:53:54.496 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-19T07:53:54.497 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-19T07:53:54.497 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-19T07:53:54.498 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-19T07:53:54.499 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-19T07:53:54.500 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-19T07:53:54.501 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-19T07:53:54.502 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-19T07:53:54.503 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-19T07:53:54.504 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/target/ 2024-09-19T07:53:54.505 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-19T07:53:54.506 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-19T07:53:54.507 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-19T07:53:54.508 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-19T07:53:54.509 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-19T07:53:54.509 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-19T07:53:54.510 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-19T07:53:54.511 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-19T07:53:54.512 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-19T07:53:54.513 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-19T07:53:54.514 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-19T07:53:54.515 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-19T07:53:54.516 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/ 2024-09-19T07:53:54.517 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-19T07:53:54.517 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-19T07:53:54.518 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-19T07:53:54.519 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-19T07:53:54.520 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-19T07:53:54.521 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-19T07:53:54.522 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-19T07:53:54.522 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-19T07:53:54.523 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-19T07:53:54.524 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-19T07:53:54.525 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-19T07:53:54.526 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-19T07:53:54.527 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-19T07:53:54.527 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/ 2024-09-19T07:53:54.528 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-19T07:53:54.529 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-19T07:53:54.530 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-19T07:53:54.531 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-19T07:53:54.531 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-19T07:53:54.532 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-19T07:53:54.533 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-19T07:53:54.535 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-19T07:53:54.535 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-19T07:53:54.536 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-19T07:53:54.537 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-19T07:53:54.538 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-19T07:53:54.539 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-19T07:53:54.540 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-19T07:53:54.540 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-19T07:53:54.541 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-19T07:53:54.542 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-19T07:53:54.543 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-19T07:53:54.544 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-19T07:53:54.545 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-19T07:53:54.546 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/ 2024-09-19T07:53:54.547 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-19T07:53:54.548 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-19T07:53:54.549 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-19T07:53:54.550 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-19T07:53:54.552 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-19T07:53:54.552 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-19T07:53:54.553 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-19T07:53:54.553 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-19T07:53:54.554 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-19T07:53:54.555 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-19T07:53:54.556 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-19T07:53:54.556 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-19T07:53:54.557 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-19T07:53:54.558 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-19T07:53:54.559 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-19T07:53:54.560 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-19T07:53:54.561 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-19T07:53:54.562 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-19T07:53:54.563 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-19T07:53:54.564 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-19T07:53:54.565 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-19T07:53:54.566 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-19T07:53:54.567 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-19T07:53:54.568 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-19T07:53:54.569 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-19T07:53:54.570 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-19T07:53:54.571 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-19T07:53:54.572 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-19T07:53:54.573 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-19T07:53:54.573 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-19T07:53:54.574 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-19T07:53:54.575 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-19T07:53:54.576 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-19T07:53:54.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-19T07:53:54.577 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-19T07:53:54.578 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-19T07:53:54.579 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-19T07:53:54.580 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-19T07:53:54.581 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-19T07:53:54.582 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-19T07:53:54.583 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-19T07:53:54.584 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-19T07:53:54.585 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-19T07:53:54.586 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-19T07:53:54.587 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-19T07:53:54.588 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-19T07:53:54.589 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-19T07:53:54.590 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-19T07:53:54.591 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-19T07:53:54.592 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-19T07:53:54.593 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-19T07:53:54.594 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-19T07:53:54.595 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-19T07:53:54.596 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-19T07:53:54.597 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-19T07:53:54.598 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-19T07:53:54.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-19T07:53:54.599 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-19T07:53:54.600 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-19T07:53:54.601 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-19T07:53:54.602 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-19T07:53:54.603 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-19T07:53:54.604 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-19T07:53:54.605 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-19T07:53:54.606 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-19T07:53:54.607 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-19T07:53:54.608 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-19T07:53:54.609 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-19T07:53:54.610 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-19T07:53:54.611 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-19T07:53:54.612 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-19T07:53:54.613 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-19T07:53:54.614 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-19T07:53:54.615 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-19T07:53:54.616 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-19T07:53:54.617 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-19T07:53:54.618 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-19T07:53:54.619 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-19T07:53:54.620 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-19T07:53:54.621 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-19T07:53:54.622 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-19T07:53:54.624 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-19T07:53:54.625 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-19T07:53:54.626 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-19T07:53:54.627 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-19T07:53:54.629 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-19T07:53:54.630 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-19T07:53:54.631 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-19T07:53:54.632 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-19T07:53:54.633 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-19T07:53:54.634 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-19T07:53:54.635 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-19T07:53:54.637 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-19T07:53:54.637 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-19T07:53:54.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-19T07:53:54.639 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-19T07:53:54.641 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-19T07:53:54.642 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-19T07:53:54.643 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-19T07:53:54.644 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-19T07:53:54.645 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-19T07:53:54.646 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-19T07:53:54.647 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-19T07:53:54.648 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-19T07:53:54.649 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-19T07:53:54.650 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-19T07:53:54.651 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-19T07:53:54.652 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-19T07:53:54.653 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-19T07:53:54.654 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-19T07:53:54.655 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-19T07:53:54.656 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-19T07:53:54.657 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-19T07:53:54.658 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-19T07:53:54.659 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-19T07:53:54.660 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-19T07:53:54.661 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-19T07:53:54.662 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-19T07:53:54.663 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-19T07:53:54.664 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-19T07:53:54.665 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-19T07:53:54.666 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-19T07:53:54.667 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-19T07:53:54.668 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-19T07:53:54.669 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-19T07:53:54.670 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-19T07:53:54.671 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-19T07:53:54.673 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-19T07:53:54.673 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-19T07:53:54.675 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-19T07:53:54.676 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-19T07:53:54.677 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-19T07:53:54.678 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-19T07:53:54.679 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-19T07:53:54.680 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-19T07:53:54.681 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-19T07:53:54.682 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-19T07:53:54.683 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-19T07:53:54.684 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-19T07:53:54.685 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-19T07:53:54.686 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-19T07:53:54.687 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-19T07:53:54.689 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-19T07:53:54.690 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-19T07:53:54.691 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-19T07:53:54.692 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-19T07:53:54.693 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-19T07:53:54.695 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-19T07:53:54.696 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-19T07:53:54.697 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-19T07:53:54.699 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/ 2024-09-19T07:53:54.701 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-19T07:53:54.702 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-19T07:53:54.703 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-19T07:53:54.704 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-19T07:53:54.706 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-19T07:53:54.707 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-19T07:53:54.708 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-19T07:53:54.709 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-19T07:53:54.710 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-19T07:53:54.711 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-19T07:53:54.712 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-19T07:53:54.713 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-19T07:53:54.715 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-19T07:53:54.716 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-19T07:53:54.717 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-19T07:53:54.718 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-19T07:53:54.719 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-19T07:53:54.720 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-19T07:53:54.721 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-19T07:53:54.722 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-19T07:53:54.724 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-19T07:53:54.725 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-19T07:53:54.726 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-19T07:53:54.727 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-19T07:53:54.728 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-19T07:53:54.729 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/ 2024-09-19T07:53:54.731 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-19T07:53:54.732 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-19T07:53:54.733 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-19T07:53:54.734 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-19T07:53:54.735 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-19T07:53:54.736 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-19T07:53:54.737 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-19T07:53:54.738 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-19T07:53:54.739 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-19T07:53:54.740 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-19T07:53:54.741 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-19T07:53:54.742 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-19T07:53:54.743 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-19T07:53:54.744 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-19T07:53:54.745 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-19T07:53:54.747 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-19T07:53:54.747 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-19T07:53:54.749 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-19T07:53:54.750 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-19T07:53:54.751 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-19T07:53:54.752 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-19T07:53:54.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-19T07:53:54.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-19T07:53:54.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-19T07:53:54.756 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-19T07:53:54.757 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-19T07:53:54.758 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-19T07:53:54.759 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-19T07:53:54.761 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-19T07:53:54.762 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-19T07:53:54.762 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-19T07:53:54.764 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-19T07:53:54.765 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-19T07:53:54.766 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-19T07:53:54.767 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/ 2024-09-19T07:53:54.768 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-19T07:53:54.769 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-19T07:53:54.770 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-19T07:53:54.771 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-19T07:53:54.772 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-19T07:53:54.773 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-19T07:53:54.774 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-19T07:53:54.776 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-19T07:53:54.777 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-19T07:53:54.778 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-19T07:53:54.779 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-19T07:53:54.780 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-19T07:53:54.781 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-19T07:53:54.782 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-19T07:53:54.783 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-19T07:53:54.784 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-19T07:53:54.785 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-19T07:53:54.786 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-19T07:53:54.787 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-19T07:53:54.788 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-19T07:53:54.789 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-19T07:53:54.791 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-19T07:53:54.791 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-19T07:53:54.792 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-19T07:53:54.794 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-19T07:53:54.795 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-19T07:53:54.796 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-19T07:53:54.797 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-19T07:53:54.798 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-19T07:53:54.799 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-19T07:53:54.800 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-19T07:53:54.801 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-19T07:53:54.802 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-19T07:53:54.803 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-19T07:53:54.804 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-19T07:53:54.805 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-19T07:53:54.806 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-19T07:53:54.807 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-19T07:53:54.808 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-19T07:53:54.809 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-19T07:53:54.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:54 smithi152 ceph-mon[35117]: pgmap v85: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-19T07:53:54.811 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-19T07:53:54.811 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-19T07:53:54.812 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-19T07:53:54.813 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-19T07:53:54.814 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-19T07:53:54.815 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-19T07:53:54.817 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-19T07:53:54.818 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-19T07:53:54.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:54 smithi137 ceph-mon[35309]: pgmap v85: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-19T07:53:54.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:54 smithi076 ceph-mon[30930]: pgmap v85: 97 pgs: 97 active+clean; 57 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-19T07:53:55.028 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-19T07:53:55.029 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-19T07:53:55.030 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-19T07:53:55.031 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-19T07:53:55.032 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-19T07:53:55.033 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-19T07:53:55.033 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-19T07:53:55.034 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-19T07:53:55.035 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-19T07:53:55.036 INFO:tasks.workunit.client.0.smithi076.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-19T07:53:56.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:56 smithi152 ceph-mon[35117]: pgmap v86: 97 pgs: 97 active+clean; 86 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.4 MiB/s wr, 14 op/s 2024-09-19T07:53:56.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:56 smithi137 ceph-mon[35309]: pgmap v86: 97 pgs: 97 active+clean; 86 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.4 MiB/s wr, 14 op/s 2024-09-19T07:53:56.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:56 smithi076 ceph-mon[30930]: pgmap v86: 97 pgs: 97 active+clean; 86 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.4 MiB/s wr, 14 op/s 2024-09-19T07:53:58.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:53:58 smithi152 ceph-mon[35117]: pgmap v87: 97 pgs: 97 active+clean; 86 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-19T07:53:58.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:53:58 smithi137 ceph-mon[35309]: pgmap v87: 97 pgs: 97 active+clean; 86 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-19T07:53:58.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:53:58 smithi076 ceph-mon[30930]: pgmap v87: 97 pgs: 97 active+clean; 86 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-19T07:53:59.788 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-19T07:54:00.788 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar xf doc.tar 2024-09-19T07:54:00.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:00 smithi152 ceph-mon[35117]: pgmap v88: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.7 MiB/s wr, 21 op/s 2024-09-19T07:54:00.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:00 smithi137 ceph-mon[35309]: pgmap v88: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.7 MiB/s wr, 21 op/s 2024-09-19T07:54:00.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:00 smithi076 ceph-mon[30930]: pgmap v88: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 2.7 MiB/s wr, 21 op/s 2024-09-19T07:54:02.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:02 smithi152 ceph-mon[35117]: pgmap v89: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 2.7 MiB/s wr, 18 op/s 2024-09-19T07:54:02.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:02 smithi137 ceph-mon[35309]: pgmap v89: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 2.7 MiB/s wr, 18 op/s 2024-09-19T07:54:02.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:02 smithi076 ceph-mon[30930]: pgmap v89: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 2.7 MiB/s wr, 18 op/s 2024-09-19T07:54:04.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:04 smithi152 ceph-mon[35117]: pgmap v90: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 2.7 MiB/s wr, 18 op/s 2024-09-19T07:54:04.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:04 smithi137 ceph-mon[35309]: pgmap v90: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 2.7 MiB/s wr, 18 op/s 2024-09-19T07:54:04.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:04 smithi076 ceph-mon[30930]: pgmap v90: 97 pgs: 97 active+clean; 88 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 2.7 MiB/s wr, 18 op/s 2024-09-19T07:54:05.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:05 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:05.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:05 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:05.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:05 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:06.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:06 smithi152 ceph-mon[35117]: pgmap v91: 97 pgs: 97 active+clean; 96 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 68 op/s 2024-09-19T07:54:06.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:06 smithi137 ceph-mon[35309]: pgmap v91: 97 pgs: 97 active+clean; 96 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 68 op/s 2024-09-19T07:54:06.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:06 smithi076 ceph-mon[30930]: pgmap v91: 97 pgs: 97 active+clean; 96 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 68 op/s 2024-09-19T07:54:08.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:08 smithi152 ceph-mon[35117]: pgmap v92: 97 pgs: 97 active+clean; 96 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 944 KiB/s wr, 59 op/s 2024-09-19T07:54:08.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:08 smithi137 ceph-mon[35309]: pgmap v92: 97 pgs: 97 active+clean; 96 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 944 KiB/s wr, 59 op/s 2024-09-19T07:54:08.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:08 smithi076 ceph-mon[30930]: pgmap v92: 97 pgs: 97 active+clean; 96 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 944 KiB/s wr, 59 op/s 2024-09-19T07:54:10.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:10 smithi152 ceph-mon[35117]: pgmap v93: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 69 op/s 2024-09-19T07:54:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:10 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:10.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:10 smithi137 ceph-mon[35309]: pgmap v93: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 69 op/s 2024-09-19T07:54:10.906 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:10 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:10.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:10 smithi076 ceph-mon[30930]: pgmap v93: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 69 op/s 2024-09-19T07:54:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:10 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:12.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:12 smithi152 ceph-mon[35117]: pgmap v94: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-09-19T07:54:12.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:12 smithi137 ceph-mon[35309]: pgmap v94: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-09-19T07:54:12.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:12 smithi076 ceph-mon[30930]: pgmap v94: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-09-19T07:54:14.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:14 smithi152 ceph-mon[35117]: pgmap v95: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-09-19T07:54:14.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:14 smithi137 ceph-mon[35309]: pgmap v95: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-09-19T07:54:14.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:14 smithi076 ceph-mon[30930]: pgmap v95: 97 pgs: 97 active+clean; 111 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-09-19T07:54:16.585 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:54:16.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:16 smithi152 ceph-mon[35117]: pgmap v96: 97 pgs: 97 active+clean; 178 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.9 MiB/s wr, 533 op/s 2024-09-19T07:54:16.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:16 smithi137 ceph-mon[35309]: pgmap v96: 97 pgs: 97 active+clean; 178 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.9 MiB/s wr, 533 op/s 2024-09-19T07:54:16.911 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:16.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:16 smithi076 ceph-mon[30930]: pgmap v96: 97 pgs: 97 active+clean; 178 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.9 MiB/s wr, 533 op/s 2024-09-19T07:54:17.320 INFO:tasks.workunit.client.0.smithi076.stderr:+ sync 2024-09-19T07:54:18.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:18 smithi152 ceph-mon[35117]: pgmap v97: 97 pgs: 97 active+clean; 178 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 483 op/s 2024-09-19T07:54:18.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:18 smithi137 ceph-mon[35309]: pgmap v97: 97 pgs: 97 active+clean; 178 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 483 op/s 2024-09-19T07:54:18.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:18 smithi076 ceph-mon[30930]: pgmap v97: 97 pgs: 97 active+clean; 178 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 483 op/s 2024-09-19T07:54:19.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 -- 172.21.15.76:0/415720606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8100d00 msgr2=0x7f76a8106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 --2- 172.21.15.76:0/415720606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8100d00 0x7f76a8106840 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f769c009930 tx=0x7f769c02a420 comp rx=0 tx=0).stop 2024-09-19T07:54:19.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 -- 172.21.15.76:0/415720606 shutdown_connections 2024-09-19T07:54:19.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 --2- 172.21.15.76:0/415720606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8106f50 0x7f76a810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 --2- 172.21.15.76:0/415720606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8100d00 0x7f76a8106840 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 --2- 172.21.15.76:0/415720606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76a8100350 0x7f76a8100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 -- 172.21.15.76:0/415720606 >> 172.21.15.76:0/415720606 conn(0x7f76a8077210 msgr2=0x7f76a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 -- 172.21.15.76:0/415720606 shutdown_connections 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.429+0000 7f76ae3da640 1 -- 172.21.15.76:0/415720606 wait complete. 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.430+0000 7f76ae3da640 1 Processor -- start 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.430+0000 7f76ae3da640 1 -- start start 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8100350 0x7f76a8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76a8100d00 0x7f76a8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 0x7f76a819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81120c0 con 0x7f76a8106f50 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8111f40 con 0x7f76a8100d00 2024-09-19T07:54:19.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8112240 con 0x7f76a8100350 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 0x7f76a819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 0x7f76a819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41464/0 (socket says 172.21.15.76:41464) 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 -- 172.21.15.76:0/1994011207 learned_addr learned my addr 172.21.15.76:0/1994011207 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76a7fff640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8100350 0x7f76a8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76a77fe640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76a8100d00 0x7f76a8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 -- 172.21.15.76:0/1994011207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8100350 msgr2=0x7f76a8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8100350 0x7f76a8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 -- 172.21.15.76:0/1994011207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76a8100d00 msgr2=0x7f76a8198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76a8100d00 0x7f76a8198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 -- 172.21.15.76:0/1994011207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a819d530 con 0x7f76a8106f50 2024-09-19T07:54:19.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ac977640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 0x7f76a819ce50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76a000eb10 tx=0x7f76a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:19.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76a57fa640 1 -- 172.21.15.76:0/1994011207 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0004b20 con 0x7f76a8106f50 2024-09-19T07:54:19.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a819d820 con 0x7f76a8106f50 2024-09-19T07:54:19.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76a57fa640 1 -- 172.21.15.76:0/1994011207 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76a0004cc0 con 0x7f76a8106f50 2024-09-19T07:54:19.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76a57fa640 1 -- 172.21.15.76:0/1994011207 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a00107f0 con 0x7f76a8106f50 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.431+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a81a5100 con 0x7f76a8106f50 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.434+0000 7f76a57fa640 1 -- 172.21.15.76:0/1994011207 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f76a0005020 con 0x7f76a8106f50 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.434+0000 7f76b07b3740 1 Processor -- start 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 -- start start 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd0b4a0 0x558d2dd0b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd16140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd16680 0x558d2dd18a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558d2dc712e0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d2dc18ce0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76b07b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558d2dc6d2a0 con 0x558d2dd16680 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd16140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd16140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41474/0 (socket says 172.21.15.76:41474) 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 -- 172.21.15.76:0/480012766 learned_addr learned my addr 172.21.15.76:0/480012766 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a57fa640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76900a33b0 0x7f76900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a77fe640 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd16680 0x558d2dd18a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76ac977640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76900a33b0 0x7f76900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 -- 172.21.15.76:0/480012766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd16680 msgr2=0x558d2dd18a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd16680 0x558d2dd18a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 -- 172.21.15.76:0/480012766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd0b4a0 msgr2=0x558d2dd0b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd0b4a0 0x558d2dd0b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 -- 172.21.15.76:0/480012766 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d2dbfd440 con 0x558d2dd0bdc0 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a57fa640 1 -- 172.21.15.76:0/1994011207 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f76a00d0250 con 0x7f76a8106f50 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.435+0000 7f76a7fff640 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd16140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f769800bd10 tx=0x7f76980107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78505287e19f03b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f768e7fc640 1 -- 172.21.15.76:0/480012766 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698004030 con 0x558d2dd0bdc0 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76ac977640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76900a33b0 0x7f76900a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76a00cd9f0 tx=0x7f76a0005990 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f768e7fc640 1 -- 172.21.15.76:0/480012766 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76980041d0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f768e7fc640 1 -- 172.21.15.76:0/480012766 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76980118c0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 -- 172.21.15.76:0/480012766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 msgr2=0x558d2dd16140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd16140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f769800bd10 tx=0x7f76980107a0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 -- 172.21.15.76:0/480012766 shutdown_connections 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd16680 0x558d2dd18a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd16140 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 --2- 172.21.15.76:0/480012766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd0b4a0 0x558d2dd0b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 -- 172.21.15.76:0/480012766 >> 172.21.15.76:0/480012766 conn(0x558d2dd07a30 msgr2=0x558d2dd07e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 -- 172.21.15.76:0/480012766 shutdown_connections 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.436+0000 7f76b07b3740 1 -- 172.21.15.76:0/480012766 wait complete. 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 -- start start 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 Processor -- start 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 0x558d2dd15f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0bdc0 0x558d2dd13240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd16680 0x558d2dd13780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558d2dd19250 con 0x558d2dd0b4a0 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d2dc2c050 con 0x558d2dd16680 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558d2dd193d0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76b07b3740 10 client.0 _ll_register_callbacks cb 0x558d2dc6c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 0x558d2dd15f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 0x558d2dd15f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41488/0 (socket says 172.21.15.76:41488) 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76a77fe640 1 -- 172.21.15.76:0/284937976 learned_addr learned my addr 172.21.15.76:0/284937976 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:19.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.437+0000 7f76a7fff640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0bdc0 0x558d2dd13240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd16680 0x558d2dd13780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 -- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0bdc0 msgr2=0x558d2dd13240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0bdc0 0x558d2dd13240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 -- 172.21.15.76:0/284937976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd16680 msgr2=0x558d2dd13780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd16680 0x558d2dd13780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 -- 172.21.15.76:0/284937976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d2d9e23c0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76a77fe640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 0x558d2dd15f90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f769c009930 tx=0x7f769c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110556c6a6f2fbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76877fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76877fe640 1 -- 172.21.15.76:0/284937976 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c035070 con 0x558d2dd0b4a0 2024-09-19T07:54:19.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76877fe640 1 -- 172.21.15.76:0/284937976 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f769c004240 con 0x558d2dd0b4a0 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76980041d0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76877fe640 1 -- 172.21.15.76:0/284937976 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f769c004440 con 0x558d2dd0b4a0 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76b07b3740 10 client.16014 fetch_fsmap learned FSMap version 27 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d2dd28fe0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.438+0000 7f76877fe640 1 -- 172.21.15.76:0/284937976 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76980041d0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76877fe640 1 -- 172.21.15.76:0/284937976 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f769c03d6b0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76b07b3740 10 client.16014 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76b07b3740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76b07b3740 20 client.16014 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:19.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76b07b3740 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd2a3f0 0x558d2dd2c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76b07b3740 4 client.16014 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d2dc7e850 con 0x558d2dd2a3f0 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76a7fff640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd2a3f0 0x558d2dd2c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76877fe640 10 client.16014 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.439+0000 7f76a7fff640 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd2a3f0 0x558d2dd2c840 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480d0173fb821809 server_cookie=a3fdfa79de994906 in_seq=0 out_seq=0 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76877fe640 1 -- 172.21.15.76:0/284937976 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d2dc7e850 con 0x558d2dd2a3f0 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76877fe640 10 client.16014 handle_command_reply: tid=0 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 client.16014 shutdown 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 msgr2=0x558d2dd15f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 0x558d2dd15f90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f769c009930 tx=0x7f769c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 shutdown_connections 2024-09-19T07:54:19.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd16680 0x558d2dd13780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0bdc0 0x558d2dd13240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd2a3f0 0x558d2dd2c840 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 --2- 172.21.15.76:0/284937976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0b4a0 0x558d2dd15f90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 >> 172.21.15.76:0/284937976 conn(0x558d2dd07a30 msgr2=0x558d2dd06b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76877fe640 0 client.16014 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 shutdown_connections 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 1 -- 172.21.15.76:0/284937976 wait complete. 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.440+0000 7f76b07b3740 20 client.16014 trim_cache size 0 max 16384 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 Processor -- start 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 -- start start 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd32110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd32650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81ae350 con 0x558d2dd0bdc0 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.457+0000 7f76b07b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81abc20 con 0x558d2dd07a30 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76b07b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81a9a70 con 0x558d2dd0b4a0 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd104a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41492/0 (socket says 172.21.15.76:41492) 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 -- 172.21.15.76:0/3446770156 learned_addr learned my addr 172.21.15.76:0/3446770156 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd32110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a7fff640 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd32650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 -- 172.21.15.76:0/3446770156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 msgr2=0x558d2dd32650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd32650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 -- 172.21.15.76:0/3446770156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 msgr2=0x558d2dd32110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd32110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 -- 172.21.15.76:0/3446770156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d2dd0bbf0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f76a77fe640 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd104a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f769c004720 tx=0x7f769c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9952ba90a76489bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f768dffb640 1 -- 172.21.15.76:0/3446770156 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c035070 con 0x558d2dd0bdc0 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f768dffb640 1 -- 172.21.15.76:0/3446770156 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f769c004240 con 0x558d2dd0bdc0 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.458+0000 7f768dffb640 1 -- 172.21.15.76:0/3446770156 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c0049d0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 -- 172.21.15.76:0/3446770156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 msgr2=0x558d2dd104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd104a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f769c004720 tx=0x7f769c005fd0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 -- 172.21.15.76:0/3446770156 shutdown_connections 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd104a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd32650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 --2- 172.21.15.76:0/3446770156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd32110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 -- 172.21.15.76:0/3446770156 >> 172.21.15.76:0/3446770156 conn(0x558d2dd138e0 msgr2=0x558d2dd11b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 -- 172.21.15.76:0/3446770156 shutdown_connections 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 -- 172.21.15.76:0/3446770156 wait complete. 2024-09-19T07:54:19.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 -- start start 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.459+0000 7f76b07b3740 1 Processor -- start 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd1e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd1ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd1f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81aa0e0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81ab550 con 0x558d2dd07a30 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81aa7b0 con 0x558d2dd0b4a0 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76b07b3740 10 client.0 _ll_register_callbacks cb 0x7f769c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd1f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd1f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41502/0 (socket says 172.21.15.76:41502) 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 -- 172.21.15.76:0/406606871 learned_addr learned my addr 172.21.15.76:0/406606871 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd1e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a7fff640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd1ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 -- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 msgr2=0x558d2dd1ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd1ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 -- 172.21.15.76:0/406606871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 msgr2=0x558d2dd1e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd1e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 -- 172.21.15.76:0/406606871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d2dd94110 con 0x558d2dd0bdc0 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76a77fe640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd1f2a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f769c033000 tx=0x7f769c031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f6b098a9adb176 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76877fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76877fe640 1 -- 172.21.15.76:0/406606871 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c035030 con 0x558d2dd0bdc0 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.460+0000 7f76877fe640 1 -- 172.21.15.76:0/406606871 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f769c004770 con 0x558d2dd0bdc0 2024-09-19T07:54:19.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f769c004240 con 0x558d2dd0bdc0 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76877fe640 1 -- 172.21.15.76:0/406606871 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f769c004970 con 0x558d2dd0bdc0 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 10 client.16020 fetch_fsmap learned FSMap version 27 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d2dd953e0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76877fe640 1 -- 172.21.15.76:0/406606871 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f769c004240 con 0x558d2dd0bdc0 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76877fe640 1 -- 172.21.15.76:0/406606871 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f769c003cc0 con 0x558d2dd0bdc0 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 10 client.16020 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 20 client.16020 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd16680 0x558d2dd979b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 4 client.16020 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d2dc78d60 con 0x558d2dd16680 2024-09-19T07:54:19.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.461+0000 7f76a7fff640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd16680 0x558d2dd979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76877fe640 10 client.16020 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76a7fff640 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd16680 0x558d2dd979b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf2543da92b8813 server_cookie=b46d099e7373a994 in_seq=0 out_seq=0 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76877fe640 1 -- 172.21.15.76:0/406606871 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558d2dc78d60 con 0x558d2dd16680 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76877fe640 10 client.16020 handle_command_reply: tid=0 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 client.16020 shutdown 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 msgr2=0x558d2dd1f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd1f2a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f769c033000 tx=0x7f769c031570 comp rx=0 tx=0).stop 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 shutdown_connections 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d2dd16680 0x558d2dd979b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76877fe640 0 client.16020 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:19.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d2dd0bdc0 0x558d2dd1f2a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.365 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:54:19.365 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:54:19.365 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:54:19.365 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d2dd0b4a0 0x558d2dd1ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 --2- 172.21.15.76:0/406606871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d2dd07a30 0x558d2dd1e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 >> 172.21.15.76:0/406606871 conn(0x558d2dd138e0 msgr2=0x558d2dd0d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 shutdown_connections 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 1 -- 172.21.15.76:0/406606871 wait complete. 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.462+0000 7f76b07b3740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76900a33b0 msgr2=0x7f76900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76900a33b0 0x7f76900a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76a00cd9f0 tx=0x7f76a0005990 comp rx=0 tx=0).stop 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 msgr2=0x7f76a819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 0x7f76a819ce50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76a000eb10 tx=0x7f76a000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 shutdown_connections 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76900a33b0 0x7f76900a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f76a8106f50 0x7f76a819ce50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76a8100d00 0x7f76a8198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 --2- 172.21.15.76:0/1994011207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8100350 0x7f76a8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 >> 172.21.15.76:0/1994011207 conn(0x7f76a8077210 msgr2=0x7f76a8105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 shutdown_connections 2024-09-19T07:54:19.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:17.463+0000 7f76ae3da640 1 -- 172.21.15.76:0/1994011207 wait complete. 2024-09-19T07:54:19.731 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar c linux-4.0.5 2024-09-19T07:54:20.413 INFO:tasks.workunit.client.0.smithi076.stderr:+ rm -rf linux-4.0.5 2024-09-19T07:54:20.475 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:54:20.476 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:54:20.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:20 smithi076 ceph-mon[30930]: pgmap v98: 97 pgs: 97 active+clean; 214 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 10 MiB/s wr, 930 op/s 2024-09-19T07:54:20.775 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:20.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:20 smithi152 ceph-mon[35117]: pgmap v98: 97 pgs: 97 active+clean; 214 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 10 MiB/s wr, 930 op/s 2024-09-19T07:54:20.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:20 smithi137 ceph-mon[35309]: pgmap v98: 97 pgs: 97 active+clean; 214 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 10 MiB/s wr, 930 op/s 2024-09-19T07:54:21.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 -- 172.21.15.76:0/1795633634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4101de0 msgr2=0x7f24f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/1795633634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4101de0 0x7f24f41021c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009900 tx=0x7f24e402a410 comp rx=0 tx=0).stop 2024-09-19T07:54:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 -- 172.21.15.76:0/1795633634 shutdown_connections 2024-09-19T07:54:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/1795633634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4106f10 0x7f24f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/1795633634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102790 0x7f24f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/1795633634 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4101de0 0x7f24f41021c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 -- 172.21.15.76:0/1795633634 >> 172.21.15.76:0/1795633634 conn(0x7f24f40fd8c0 msgr2=0x7f24f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 -- 172.21.15.76:0/1795633634 shutdown_connections 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 -- 172.21.15.76:0/1795633634 wait complete. 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.238+0000 7f24f9dd8640 1 Processor -- start 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 -- start start 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4101de0 0x7f24f4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102790 0x7f24f4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 0x7f24f419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4112090 con 0x7f24f4106f10 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4111f10 con 0x7f24f4102790 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f9dd8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4112210 con 0x7f24f4101de0 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 0x7f24f419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4101de0 0x7f24f4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 0x7f24f419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41526/0 (socket says 172.21.15.76:41526) 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 -- 172.21.15.76:0/2161990228 learned_addr learned my addr 172.21.15.76:0/2161990228 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f2ffd640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102790 0x7f24f4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 -- 172.21.15.76:0/2161990228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4101de0 msgr2=0x7f24f4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4101de0 0x7f24f4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 -- 172.21.15.76:0/2161990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102790 msgr2=0x7f24f4198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102790 0x7f24f4198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 -- 172.21.15.76:0/2161990228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f419d3f0 con 0x7f24f4106f10 2024-09-19T07:54:21.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.239+0000 7f24f3fff640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 0x7f24f419cd10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00eb10 tx=0x7f24ec00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:21.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.240+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00ce20 con 0x7f24f4106f10 2024-09-19T07:54:21.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.240+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24ec004b20 con 0x7f24f4106f10 2024-09-19T07:54:21.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.240+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f419d6e0 con 0x7f24f4106f10 2024-09-19T07:54:21.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.240+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec010760 con 0x7f24f4106f10 2024-09-19T07:54:21.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.240+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f41a4fc0 con 0x7f24f4106f10 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.241+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f41021c0 con 0x7f24f4106f10 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.242+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f24ec005020 con 0x7f24f4106f10 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.243+0000 7f24f0ff9640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24dc0a33b0 0x7f24dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.243+0000 7f24f37fe640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24dc0a33b0 0x7f24dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.243+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f24ec0d03d0 con 0x7f24f4106f10 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.243+0000 7f24f37fe640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24dc0a33b0 0x7f24dc0a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009230 tx=0x7f24e40058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:21.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.247+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f24ec09cd50 con 0x7f24f4106f10 2024-09-19T07:54:21.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.458+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24f4109b60 con 0x7f24f4106f10 2024-09-19T07:54:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.458+0000 7f24f0ff9640 1 -- 172.21.15.76:0/2161990228 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11918 (secure 0 0 0) 0x7f24ec09c650 con 0x7f24f4106f10 2024-09-19T07:54:21.461 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:54:21.461 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":27,"btime":"2024-09-19T07:54:09:540363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:08.977147+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:54:21.462 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 27 2024-09-19T07:54:21.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24dc0a33b0 msgr2=0x7f24dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:21.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24dc0a33b0 0x7f24dc0a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009230 tx=0x7f24e40058d0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 msgr2=0x7f24f419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 0x7f24f419cd10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00eb10 tx=0x7f24ec00ef10 comp rx=0 tx=0).stop 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 shutdown_connections 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24dc0a33b0 0x7f24dc0a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f24f4106f10 0x7f24f419cd10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24f4102790 0x7f24f4198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 --2- 172.21.15.76:0/2161990228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f4101de0 0x7f24f4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.460+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 >> 172.21.15.76:0/2161990228 conn(0x7f24f40fd8c0 msgr2=0x7f24f40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.461+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 shutdown_connections 2024-09-19T07:54:21.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:21.461+0000 7f24f9dd8640 1 -- 172.21.15.76:0/2161990228 wait complete. 2024-09-19T07:54:21.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2161990228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:21.827 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2161990228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:21.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2161990228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:22.139 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:54:22.389 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:22.815 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:22 smithi076 ceph-mon[30930]: pgmap v99: 97 pgs: 97 active+clean; 219 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:54:22.815 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:22 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:54:22.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:22 smithi137 ceph-mon[35309]: pgmap v99: 97 pgs: 97 active+clean; 219 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:54:22.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:22 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:54:22.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 -- 172.21.15.76:0/2343315900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101df0 msgr2=0x7f6dd4105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/2343315900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101df0 0x7f6dd4105920 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009900 tx=0x7f6dc802a410 comp rx=0 tx=0).stop 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 -- 172.21.15.76:0/2343315900 shutdown_connections 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/2343315900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd4106050 0x7f6dd410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/2343315900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101df0 0x7f6dd4105920 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/2343315900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4101440 0x7f6dd4101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 -- 172.21.15.76:0/2343315900 >> 172.21.15.76:0/2343315900 conn(0x7f6dd4077210 msgr2=0x7f6dd40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 -- 172.21.15.76:0/2343315900 shutdown_connections 2024-09-19T07:54:22.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.918+0000 7f6dd8b20640 1 -- 172.21.15.76:0/2343315900 wait complete. 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 Processor -- start 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 -- start start 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 0x7f6dd4198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd4101df0 0x7f6dd4198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4106050 0x7f6dd419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41111d0 con 0x7f6dd4101440 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4111050 con 0x7f6dd4101df0 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.919+0000 7f6dd8b20640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4111350 con 0x7f6dd4106050 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 0x7f6dd4198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 0x7f6dd4198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41540/0 (socket says 172.21.15.76:41540) 2024-09-19T07:54:22.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 -- 172.21.15.76:0/719422071 learned_addr learned my addr 172.21.15.76:0/719422071 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:22.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4106050 0x7f6dd419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd4101df0 0x7f6dd4198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 -- 172.21.15.76:0/719422071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4106050 msgr2=0x7f6dd419cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4106050 0x7f6dd419cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 -- 172.21.15.76:0/719422071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd4101df0 msgr2=0x7f6dd4198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd4101df0 0x7f6dd4198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 -- 172.21.15.76:0/719422071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd419d6c0 con 0x7f6dd4101440 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4106050 0x7f6dd419cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd259c640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 0x7f6dd4198710 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400e9f0 tx=0x7f6dc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dc37fe640 1 -- 172.21.15.76:0/719422071 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400cd80 con 0x7f6dd4101440 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dc37fe640 1 -- 172.21.15.76:0/719422071 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6dc4005520 con 0x7f6dd4101440 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd419d9b0 con 0x7f6dd4101440 2024-09-19T07:54:22.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dc37fe640 1 -- 172.21.15.76:0/719422071 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4010690 con 0x7f6dd4101440 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.920+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd41a5290 con 0x7f6dd4101440 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.922+0000 7f6dc37fe640 1 -- 172.21.15.76:0/719422071 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6dc40046c0 con 0x7f6dd4101440 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 Processor -- start 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 -- start start 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6dc37fe640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6dbc0a33b0 0x7f6dbc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 0x5562ddcbe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddccb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5562ddc242f0 con 0x5562ddcbe5d0 2024-09-19T07:54:22.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562ddbcbcf0 con 0x5562ddcbfb40 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.923+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5562ddc202b0 con 0x5562ddcc9370 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dc37fe640 1 -- 172.21.15.76:0/719422071 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6dc40d0190 con 0x7f6dd4101440 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6dbc0a33b0 0x7f6dbc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddccb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 0x5562ddcbe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 0x5562ddcbe090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:33800/0 (socket says 172.21.15.76:33800) 2024-09-19T07:54:22.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 -- 172.21.15.76:0/2628390628 learned_addr learned my addr 172.21.15.76:0/2628390628 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:22.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 -- 172.21.15.76:0/2628390628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 msgr2=0x5562ddccb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddccb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 -- 172.21.15.76:0/2628390628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 msgr2=0x5562ddcbea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 -- 172.21.15.76:0/2628390628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ddbb03a0 con 0x5562ddcbfb40 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6dbc0a33b0 0x7f6dbc0a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0099e0 tx=0x7f6dcc009ef0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dd259c640 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 0x5562ddcbe090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4098870 tx=0x7f6dc4004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b29e5940a98df5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dc0ff9640 1 -- 172.21.15.76:0/2628390628 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc409bd70 con 0x5562ddcbfb40 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dc0ff9640 1 -- 172.21.15.76:0/2628390628 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6dc409cb10 con 0x5562ddcbfb40 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.924+0000 7f6dc0ff9640 1 -- 172.21.15.76:0/2628390628 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4074210 con 0x5562ddcbfb40 2024-09-19T07:54:22.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2628390628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 msgr2=0x5562ddcbe090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 0x5562ddcbe090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4098870 tx=0x7f6dc4004a60 comp rx=0 tx=0).stop 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2628390628 shutdown_connections 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddccb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2628390628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbfb40 0x5562ddcbe090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2628390628 >> 172.21.15.76:0/2628390628 conn(0x5562ddc87310 msgr2=0x5562ddcbac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2628390628 shutdown_connections 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.925+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2628390628 wait complete. 2024-09-19T07:54:22.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 -- start start 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 Processor -- start 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcc8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcbfb40 0x5562ddcc6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcc9370 0x5562ddcc6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5562ddcd0480 con 0x5562ddcbe5d0 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562ddbdf060 con 0x5562ddcc9370 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5562ddcd0600 con 0x5562ddcbfb40 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6ddaef9740 10 client.0 _ll_register_callbacks cb 0x5562dd9328c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcc8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcc8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41564/0 (socket says 172.21.15.76:41564) 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6dd259c640 1 -- 172.21.15.76:0/260478691 learned_addr learned my addr 172.21.15.76:0/260478691 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:22.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcbfb40 0x5562ddcc6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.926+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcc9370 0x5562ddcc6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/260478691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcc9370 msgr2=0x5562ddcc6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcc9370 0x5562ddcc6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/260478691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 msgr2=0x5562ddcc8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcc8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/260478691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562dd9953c0 con 0x5562ddcbfb40 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcbfb40 0x5562ddcc6080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005940 tx=0x7f6dc8031870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46cc2f14731e68a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6db9ffb640 1 -- 172.21.15.76:0/260478691 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8035040 con 0x5562ddcbfb40 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc409cb10 con 0x5562ddcbfb40 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6db9ffb640 1 -- 172.21.15.76:0/260478691 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6dc8004240 con 0x5562ddcbfb40 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6db9ffb640 1 -- 172.21.15.76:0/260478691 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6dc8031a60 con 0x5562ddcbfb40 2024-09-19T07:54:22.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6ddaef9740 10 client.25432 fetch_fsmap learned FSMap version 27 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.927+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5562ddcdbff0 con 0x5562ddcbfb40 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6db9ffb640 1 -- 172.21.15.76:0/260478691 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6dc409cb10 con 0x5562ddcbfb40 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6db9ffb640 1 -- 172.21.15.76:0/260478691 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6dc8004b40 con 0x5562ddcbfb40 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6ddaef9740 10 client.25432 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6ddaef9740 10 client.25432 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6ddaef9740 20 client.25432 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddcdd400 0x5562ddcdf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6ddaef9740 4 client.25432 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562ddc31860 con 0x5562ddcdd400 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6dd259c640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddcdd400 0x5562ddcdf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6dd259c640 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddcdd400 0x5562ddcdf7f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8bc4940ffecde98 server_cookie=fcfbee538bcb7445 in_seq=0 out_seq=0 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.928+0000 7f6db9ffb640 10 client.25432 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:54:22.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6db9ffb640 1 -- 172.21.15.76:0/260478691 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562ddc31860 con 0x5562ddcdd400 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6db9ffb640 10 client.25432 handle_command_reply: tid=0 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 client.25432 shutdown 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcbfb40 msgr2=0x5562ddcc6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcbfb40 0x5562ddcc6080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005940 tx=0x7f6dc8031870 comp rx=0 tx=0).stop 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 shutdown_connections 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddcdd400 0x5562ddcdf7f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcc9370 0x5562ddcc6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6db9ffb640 0 client.25432 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcbfb40 0x5562ddcc6080 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/260478691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbe5d0 0x5562ddcc8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 >> 172.21.15.76:0/260478691 conn(0x5562ddc87310 msgr2=0x5562ddcc09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 shutdown_connections 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 1 -- 172.21.15.76:0/260478691 wait complete. 2024-09-19T07:54:22.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.930+0000 7f6ddaef9740 20 client.25432 trim_cache size 0 max 16384 2024-09-19T07:54:22.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 Processor -- start 2024-09-19T07:54:22.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 -- start start 2024-09-19T07:54:22.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 0x5562ddcc1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcc1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41ae1a0 con 0x5562ddcbfb40 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41aba70 con 0x5562ddcbe5d0 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41a98c0 con 0x5562ddcc9370 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6dd1d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 0x5562ddcc1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6dd1d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 0x5562ddcc1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41572/0 (socket says 172.21.15.76:41572) 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.944+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/987775673 learned_addr learned my addr 172.21.15.76:0/987775673 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcc1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd259c640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/987775673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 msgr2=0x5562ddcc1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcc1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/987775673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 msgr2=0x5562ddcbe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd1d9b640 1 -- 172.21.15.76:0/987775673 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ddcbb960 con 0x5562ddcbfb40 2024-09-19T07:54:22.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcc1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:22.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd259c640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:22.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 0x5562ddcc1120 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80096c0 tx=0x7f6dc8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec3c6f25369710f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:22.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dbbfff640 1 -- 172.21.15.76:0/987775673 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8035070 con 0x5562ddcbfb40 2024-09-19T07:54:22.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dbbfff640 1 -- 172.21.15.76:0/987775673 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6dc8004fc0 con 0x5562ddcbfb40 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.945+0000 7f6dbbfff640 1 -- 172.21.15.76:0/987775673 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8052070 con 0x5562ddcbfb40 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 -- 172.21.15.76:0/987775673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 msgr2=0x5562ddcc1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 0x5562ddcc1120 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80096c0 tx=0x7f6dc8000bc0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 -- 172.21.15.76:0/987775673 shutdown_connections 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcc1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcbfb40 0x5562ddcc1120 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/987775673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcbe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 -- 172.21.15.76:0/987775673 >> 172.21.15.76:0/987775673 conn(0x5562ddc87310 msgr2=0x5562ddcb5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:22.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 -- 172.21.15.76:0/987775673 shutdown_connections 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.946+0000 7f6ddaef9740 1 -- 172.21.15.76:0/987775673 wait complete. 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 -- start start 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 Processor -- start 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcd15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcd1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 0x5562ddcd2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41a9f30 con 0x5562ddcdd400 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41ab3a0 con 0x5562ddcbe5d0 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41aa600 con 0x5562ddcc9370 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6ddaef9740 10 client.0 _ll_register_callbacks cb 0x7f6dc8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 0x5562ddcd2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 0x5562ddcd2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41588/0 (socket says 172.21.15.76:41588) 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 -- 172.21.15.76:0/2895240709 learned_addr learned my addr 172.21.15.76:0/2895240709 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd259c640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcd15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd1d9b640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcd1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 -- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 msgr2=0x5562ddcd1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcd1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 -- 172.21.15.76:0/2895240709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 msgr2=0x5562ddcd15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.947+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcd15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6dd2d9d640 1 -- 172.21.15.76:0/2895240709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ddcba510 con 0x5562ddcdd400 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6dd2d9d640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 0x5562ddcd2060 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc003bd0 tx=0x7f6dcc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc9cb67136c3baf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6db9ffb640 1 -- 172.21.15.76:0/2895240709 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc030060 con 0x5562ddcdd400 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6db9ffb640 1 -- 172.21.15.76:0/2895240709 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6dcc0047e0 con 0x5562ddcdd400 2024-09-19T07:54:22.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc8004fc0 con 0x5562ddcdd400 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6db9ffb640 1 -- 172.21.15.76:0/2895240709 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6dcc02b480 con 0x5562ddcdd400 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6ddaef9740 10 client.16044 fetch_fsmap learned FSMap version 27 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5562ddd481b0 con 0x5562ddcdd400 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.948+0000 7f6db9ffb640 1 -- 172.21.15.76:0/2895240709 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6dc8004fc0 con 0x5562ddcdd400 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6db9ffb640 1 -- 172.21.15.76:0/2895240709 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6dcc020050 con 0x5562ddcdd400 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6ddaef9740 10 client.16044 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6ddaef9740 10 client.16044 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6ddaef9740 20 client.16044 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddd48930 0x5562ddd4ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6ddaef9740 4 client.16044 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5562ddc2bd70 con 0x5562ddd48930 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6dd259c640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddd48930 0x5562ddd4ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6dd259c640 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddd48930 0x5562ddd4ad50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc247c702e3caa43 server_cookie=f677cdfc0d0d4dcb in_seq=0 out_seq=0 2024-09-19T07:54:22.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.949+0000 7f6db9ffb640 10 client.16044 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6db9ffb640 1 -- 172.21.15.76:0/2895240709 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5562ddc2bd70 con 0x5562ddd48930 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6db9ffb640 10 client.16044 handle_command_reply: tid=0 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 client.16044 shutdown 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 msgr2=0x5562ddcd2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 0x5562ddcd2060 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc003bd0 tx=0x7f6dcc01d000 comp rx=0 tx=0).stop 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 shutdown_connections 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5562ddd48930 0x5562ddd4ad50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5562ddcdd400 0x5562ddcd2060 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5562ddcc9370 0x5562ddcd1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 --2- 172.21.15.76:0/2895240709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562ddcbe5d0 0x5562ddcd15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 >> 172.21.15.76:0/2895240709 conn(0x5562ddc87310 msgr2=0x5562ddcb94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6db9ffb640 0 client.16044 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 shutdown_connections 2024-09-19T07:54:22.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.950+0000 7f6ddaef9740 1 -- 172.21.15.76:0/2895240709 wait complete. 2024-09-19T07:54:22.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6ddaef9740 20 client.16044 trim_cache size 0 max 16384 2024-09-19T07:54:22.959 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6dbc0a33b0 msgr2=0x7f6dbc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6dbc0a33b0 0x7f6dbc0a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0099e0 tx=0x7f6dcc009ef0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 msgr2=0x7f6dd4198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 0x7f6dd4198710 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400e9f0 tx=0x7f6dc400edf0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 shutdown_connections 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6dbc0a33b0 0x7f6dbc0a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6dd4106050 0x7f6dd419cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd4101df0 0x7f6dd4198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 --2- 172.21.15.76:0/719422071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6dd4101440 0x7f6dd4198710 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 >> 172.21.15.76:0/719422071 conn(0x7f6dd4077210 msgr2=0x7f6dd4100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:22.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 shutdown_connections 2024-09-19T07:54:22.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:22.951+0000 7f6dd8b20640 1 -- 172.21.15.76:0/719422071 wait complete. 2024-09-19T07:54:23.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:22 smithi152 ceph-mon[35117]: pgmap v99: 97 pgs: 97 active+clean; 219 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:54:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:22 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:54:23.744 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:54:24.069 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:24.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 -- 172.21.15.76:0/1949251164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 msgr2=0x7f1f8c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 --2- 172.21.15.76:0/1949251164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c1021d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009900 tx=0x7f1f7c02a3f0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 -- 172.21.15.76:0/1949251164 shutdown_connections 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 --2- 172.21.15.76:0/1949251164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8c106f20 0x7f1f8c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 --2- 172.21.15.76:0/1949251164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c1027a0 0x7f1f8c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 --2- 172.21.15.76:0/1949251164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c1021d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 -- 172.21.15.76:0/1949251164 >> 172.21.15.76:0/1949251164 conn(0x7f1f8c0fd8f0 msgr2=0x7f1f8c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 -- 172.21.15.76:0/1949251164 shutdown_connections 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 -- 172.21.15.76:0/1949251164 wait complete. 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.695+0000 7f1f92fec640 1 Processor -- start 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 -- start start 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c1027a0 0x7f1f8c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8c106f20 0x7f1f8c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1120f0 con 0x7f1f8c101df0 2024-09-19T07:54:24.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c111f70 con 0x7f1f8c1027a0 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f92fec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c112270 con 0x7f1f8c106f20 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51556/0 (socket says 172.21.15.76:51556) 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 -- 172.21.15.76:0/600504341 learned_addr learned my addr 172.21.15.76:0/600504341 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c1027a0 0x7f1f8c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f91589640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8c106f20 0x7f1f8c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 -- 172.21.15.76:0/600504341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8c106f20 msgr2=0x7f1f8c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8c106f20 0x7f1f8c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 -- 172.21.15.76:0/600504341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c1027a0 msgr2=0x7f1f8c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c1027a0 0x7f1f8c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.696+0000 7f1f90d88640 1 -- 172.21.15.76:0/600504341 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c1a6a10 con 0x7f1f8c101df0 2024-09-19T07:54:24.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.697+0000 7f1f90d88640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c0744f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c004770 tx=0x7f1f7c032970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:24.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.697+0000 7f1f89ffb640 1 -- 172.21.15.76:0/600504341 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c03f030 con 0x7f1f8c101df0 2024-09-19T07:54:24.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.697+0000 7f1f89ffb640 1 -- 172.21.15.76:0/600504341 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f7c032d70 con 0x7f1f8c101df0 2024-09-19T07:54:24.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.697+0000 7f1f89ffb640 1 -- 172.21.15.76:0/600504341 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c035070 con 0x7f1f8c101df0 2024-09-19T07:54:24.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.697+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c1a6ca0 con 0x7f1f8c101df0 2024-09-19T07:54:24.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.697+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c1a7180 con 0x7f1f8c101df0 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 Processor -- start 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 -- start start 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f89ffb640 1 -- 172.21.15.76:0/600504341 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1f7c042030 con 0x7f1f8c101df0 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c2383b40 0x5583c2382090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c2382a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c238f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5583c22e82f0 con 0x5583c2383b40 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583c228fcf0 con 0x5583c238d370 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.700+0000 7f1f953c5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583c22e42b0 con 0x5583c23825d0 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c238f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c2382a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c238f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:57934/0 (socket says 172.21.15.76:57934) 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f91589640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c2383b40 0x5583c2382090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2925483591 learned_addr learned my addr 172.21.15.76:0/2925483591 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2925483591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 msgr2=0x5583c2382a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c2382a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2925483591 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c2383b40 msgr2=0x5583c2382090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c2383b40 0x5583c2382090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2925483591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c22743a0 con 0x5583c238d370 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f89ffb640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f780a3430 0x7f1f780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c238f760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f74011470 tx=0x7f1f74011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ee56ff1f69be55b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f91589640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f780a3430 0x7f1f780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f89ffb640 1 -- 172.21.15.76:0/600504341 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f1f7c0ef970 con 0x7f1f8c101df0 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.701+0000 7f1f82ffd640 1 -- 172.21.15.76:0/2925483591 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7401e070 con 0x5583c238d370 2024-09-19T07:54:24.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f82ffd640 1 -- 172.21.15.76:0/2925483591 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f74003c30 con 0x5583c238d370 2024-09-19T07:54:24.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f82ffd640 1 -- 172.21.15.76:0/2925483591 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400fb70 con 0x5583c238d370 2024-09-19T07:54:24.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 -- 172.21.15.76:0/2925483591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 msgr2=0x5583c238f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f91589640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f780a3430 0x7f1f780a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d20 tx=0x7f1f84005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:24.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c238f760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f74011470 tx=0x7f1f74011930 comp rx=0 tx=0).stop 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 -- 172.21.15.76:0/2925483591 shutdown_connections 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c238f760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c2382a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2925483591 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c2383b40 0x5583c2382090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 -- 172.21.15.76:0/2925483591 >> 172.21.15.76:0/2925483591 conn(0x5583c234b310 msgr2=0x5583c237ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 -- 172.21.15.76:0/2925483591 shutdown_connections 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.702+0000 7f1f953c5740 1 -- 172.21.15.76:0/2925483591 wait complete. 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 -- start start 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 Processor -- start 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c238cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c238a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c238a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5583c2390070 con 0x5583c238d370 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583c22a3060 con 0x5583c2383b40 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583c23901f0 con 0x5583c23825d0 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f953c5740 10 client.0 _ll_register_callbacks cb 0x5583c1ff68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c238a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f91589640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c238a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c238a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:57936/0 (socket says 172.21.15.76:57936) 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2762896508 learned_addr learned my addr 172.21.15.76:0/2762896508 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.703+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c238cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2762896508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 msgr2=0x5583c238cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c238cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2762896508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 msgr2=0x5583c238a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c238a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f8bfff640 1 -- 172.21.15.76:0/2762896508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c20593c0 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c238a020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f74011e30 tx=0x7f1f74009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828b173a6919b636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f6bfff640 1 -- 172.21.15.76:0/2762896508 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7401e040 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f74003c30 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f6bfff640 1 -- 172.21.15.76:0/2762896508 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f1f7400f8b0 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f6bfff640 1 -- 172.21.15.76:0/2762896508 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f74032050 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f953c5740 10 client.25367 fetch_fsmap learned FSMap version 28 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.704+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583c23a4380 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f6bfff640 1 -- 172.21.15.76:0/2762896508 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f74003c30 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f6bfff640 1 -- 172.21.15.76:0/2762896508 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f1f74021030 con 0x5583c2383b40 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f953c5740 10 client.25367 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f953c5740 10 client.25367 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:54:24.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f953c5740 20 client.25367 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c23a56d0 0x5583c23a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f953c5740 4 client.25367 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583c22f5860 con 0x5583c23a56d0 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.705+0000 7f1f90d88640 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c23a56d0 0x5583c23a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f6bfff640 10 client.25367 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f90d88640 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c23a56d0 0x5583c23a7ac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c5eeb93a5feeeaa server_cookie=95f0c17f8a9e92b3 in_seq=0 out_seq=0 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f6bfff640 1 -- 172.21.15.76:0/2762896508 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583c22f5860 con 0x5583c23a56d0 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f6bfff640 10 client.25367 handle_command_reply: tid=0 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 client.25367 shutdown 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 msgr2=0x5583c238a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c238a020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1f74011e30 tx=0x7f1f74009280 comp rx=0 tx=0).stop 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 shutdown_connections 2024-09-19T07:54:24.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c23a56d0 0x5583c23a7ac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c238a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c238a020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2762896508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c238cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 >> 172.21.15.76:0/2762896508 conn(0x5583c234b310 msgr2=0x5583c2384930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.706+0000 7f1f6bfff640 0 client.25367 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.707+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 shutdown_connections 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.707+0000 7f1f953c5740 1 -- 172.21.15.76:0/2762896508 wait complete. 2024-09-19T07:54:24.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.707+0000 7f1f953c5740 20 client.25367 trim_cache size 0 max 16384 2024-09-19T07:54:24.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 Processor -- start 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 -- start start 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 0x5583c23a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c2383b40 0x5583c2385120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c2385660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1ae250 con 0x5583c23825d0 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1abaf0 con 0x5583c238d370 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f953c5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1a9960 con 0x5583c2383b40 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 0x5583c23a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 0x5583c23a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51592/0 (socket says 172.21.15.76:51592) 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 -- 172.21.15.76:0/2306461061 learned_addr learned my addr 172.21.15.76:0/2306461061 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c2383b40 0x5583c2385120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f91589640 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c2385660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 -- 172.21.15.76:0/2306461061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c2383b40 msgr2=0x5583c2385120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c2383b40 0x5583c2385120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 -- 172.21.15.76:0/2306461061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 msgr2=0x5583c2385660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c2385660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.720+0000 7f1f90d88640 1 -- 172.21.15.76:0/2306461061 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c238fbc0 con 0x5583c23825d0 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f90d88640 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 0x5583c23a1c00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c003fa0 tx=0x7f1f7c0f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70cebdbe6707a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f827fc640 1 -- 172.21.15.76:0/2306461061 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c049040 con 0x5583c23825d0 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f827fc640 1 -- 172.21.15.76:0/2306461061 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f7c0bbc40 con 0x5583c23825d0 2024-09-19T07:54:24.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f827fc640 1 -- 172.21.15.76:0/2306461061 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0b82b0 con 0x5583c23825d0 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 -- 172.21.15.76:0/2306461061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 msgr2=0x5583c23a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 0x5583c23a1c00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c003fa0 tx=0x7f1f7c0f1040 comp rx=0 tx=0).stop 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 -- 172.21.15.76:0/2306461061 shutdown_connections 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c238d370 0x5583c2385660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c2383b40 0x5583c2385120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 --2- 172.21.15.76:0/2306461061 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c23825d0 0x5583c23a1c00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 -- 172.21.15.76:0/2306461061 >> 172.21.15.76:0/2306461061 conn(0x5583c234b310 msgr2=0x5583c2379a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 -- 172.21.15.76:0/2306461061 shutdown_connections 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.721+0000 7f1f953c5740 1 -- 172.21.15.76:0/2306461061 wait complete. 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 -- start start 2024-09-19T07:54:24.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 Processor -- start 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c239dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c239e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c23862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1a9fb0 con 0x5583c238d370 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1ab420 con 0x5583c2383b40 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c1aa680 con 0x5583c23825d0 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f953c5740 10 client.0 _ll_register_callbacks cb 0x7f1f7401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c239dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f90d88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c239dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:57372/0 (socket says 172.21.15.76:57372) 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f90d88640 1 -- 172.21.15.76:0/1178385867 learned_addr learned my addr 172.21.15.76:0/1178385867 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.722+0000 7f1f91589640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c23862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c239e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f90d88640 1 -- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 msgr2=0x5583c239e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f90d88640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c239e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f90d88640 1 -- 172.21.15.76:0/1178385867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 msgr2=0x5583c23862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f90d88640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c23862b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f90d88640 1 -- 172.21.15.76:0/1178385867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c2387ec0 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f90d88640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c239dd70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0b80a0 tx=0x7f1f7c0f5480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e480e2ce01d116 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f6bfff640 1 -- 172.21.15.76:0/1178385867 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c049070 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f6bfff640 1 -- 172.21.15.76:0/1178385867 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f1f7c0b82b0 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f7c0bbc40 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f6bfff640 1 -- 172.21.15.76:0/1178385867 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f7c0bb5a0 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f953c5740 10 client.25456 fetch_fsmap learned FSMap version 28 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.723+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583c240f5e0 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f6bfff640 1 -- 172.21.15.76:0/1178385867 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f7c0bbc40 con 0x5583c23825d0 2024-09-19T07:54:24.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f6bfff640 1 -- 172.21.15.76:0/1178385867 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f1f7c0c4370 con 0x5583c23825d0 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f953c5740 10 client.25456 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f953c5740 10 client.25456 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f953c5740 20 client.25456 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f953c5740 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c240fc50 0x5583c2412070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f953c5740 4 client.25456 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583c22efd70 con 0x5583c240fc50 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c240fc50 0x5583c2412070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f8bfff640 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c240fc50 0x5583c2412070 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4084a3d886306edc server_cookie=e48c0d6dbb5ea6b8 in_seq=0 out_seq=0 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.724+0000 7f1f6bfff640 10 client.25456 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f6bfff640 1 -- 172.21.15.76:0/1178385867 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583c22efd70 con 0x5583c240fc50 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f6bfff640 10 client.25456 handle_command_reply: tid=0 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 client.25456 shutdown 2024-09-19T07:54:24.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 msgr2=0x5583c239dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c239dd70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0b80a0 tx=0x7f1f7c0f5480 comp rx=0 tx=0).stop 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 shutdown_connections 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583c240fc50 0x5583c2412070 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583c238d370 0x5583c23862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583c2383b40 0x5583c239e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 --2- 172.21.15.76:0/1178385867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583c23825d0 0x5583c239dd70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 >> 172.21.15.76:0/1178385867 conn(0x5583c234b310 msgr2=0x5583c2388910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f6bfff640 0 client.25456 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 shutdown_connections 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 1 -- 172.21.15.76:0/1178385867 wait complete. 2024-09-19T07:54:24.730 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.725+0000 7f1f953c5740 20 client.25456 trim_cache size 0 max 16384 2024-09-19T07:54:24.731 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:54:24.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f780a3430 msgr2=0x7f1f780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f780a3430 0x7f1f780a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d20 tx=0x7f1f84005f90 comp rx=0 tx=0).stop 2024-09-19T07:54:24.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 msgr2=0x7f1f8c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:24.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c0744f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c004770 tx=0x7f1f7c032970 comp rx=0 tx=0).stop 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 shutdown_connections 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f780a3430 0x7f1f780a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8c106f20 0x7f1f8c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f8c1027a0 0x7f1f8c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 --2- 172.21.15.76:0/600504341 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f8c101df0 0x7f1f8c0744f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 >> 172.21.15.76:0/600504341 conn(0x7f1f8c0fd8f0 msgr2=0x7f1f8c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 shutdown_connections 2024-09-19T07:54:24.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:24.726+0000 7f1f92fec640 1 -- 172.21.15.76:0/600504341 wait complete. 2024-09-19T07:54:24.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:24 smithi137 ceph-mon[35309]: pgmap v100: 97 pgs: 97 active+clean; 219 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:54:24.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:54:24.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:54:24.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:54:24.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:24 smithi076 ceph-mon[30930]: pgmap v100: 97 pgs: 97 active+clean; 219 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:54:24.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:54:24.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:54:24.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:54:25.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:24 smithi152 ceph-mon[35117]: pgmap v100: 97 pgs: 97 active+clean; 219 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:54:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:54:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:54:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:54:25.537 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:54:25.798 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:25.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:25 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:25.924 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:25 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:26.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:25 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 -- 172.21.15.76:0/4137099608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c108300 msgr2=0x7f343c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 --2- 172.21.15.76:0/4137099608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c108300 0x7f343c10ec70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3434009930 tx=0x7f343402a420 comp rx=0 tx=0).stop 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 -- 172.21.15.76:0/4137099608 shutdown_connections 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 --2- 172.21.15.76:0/4137099608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c108300 0x7f343c10ec70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 --2- 172.21.15.76:0/4137099608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f343c103780 0x7f343c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 --2- 172.21.15.76:0/4137099608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c102dd0 0x7f343c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 -- 172.21.15.76:0/4137099608 >> 172.21.15.76:0/4137099608 conn(0x7f343c0fc7d0 msgr2=0x7f343c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 -- 172.21.15.76:0/4137099608 shutdown_connections 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 -- 172.21.15.76:0/4137099608 wait complete. 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.281+0000 7f34414dc640 1 Processor -- start 2024-09-19T07:54:26.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 -- start start 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 0x7f343c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c103780 0x7f343c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f343c108300 0x7f343c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1121f0 con 0x7f343c102dd0 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f343c112070 con 0x7f343c108300 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f34414dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f343c112370 con 0x7f343c103780 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 0x7f343c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 0x7f343c198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51616/0 (socket says 172.21.15.76:51616) 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 -- 172.21.15.76:0/2552331139 learned_addr learned my addr 172.21.15.76:0/2552331139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343a7fc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c103780 0x7f343c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343b7fe640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f343c108300 0x7f343c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 -- 172.21.15.76:0/2552331139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c103780 msgr2=0x7f343c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c103780 0x7f343c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 -- 172.21.15.76:0/2552331139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f343c108300 msgr2=0x7f343c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f343c108300 0x7f343c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 -- 172.21.15.76:0/2552331139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c19d5f0 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343a7fc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c103780 0x7f343c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.282+0000 7f343affd640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 0x7f343c198640 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f342c00eb90 tx=0x7f342c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.283+0000 7f3423fff640 1 -- 172.21.15.76:0/2552331139 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c004d20 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.283+0000 7f3423fff640 1 -- 172.21.15.76:0/2552331139 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f342c00ee90 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.283+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c19d8e0 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.283+0000 7f3423fff640 1 -- 172.21.15.76:0/2552331139 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0108b0 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.283+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c1a51c0 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.285+0000 7f3423fff640 1 -- 172.21.15.76:0/2552331139 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f342c005020 con 0x7f343c102dd0 2024-09-19T07:54:26.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.285+0000 7f3423fff640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34240a33b0 0x7f34240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.285+0000 7f34438b5740 1 Processor -- start 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.285+0000 7f34438b5740 1 -- start start 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343a7fc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34240a33b0 0x7f34240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f3423fff640 1 -- 172.21.15.76:0/2552331139 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f342c0d03e0 con 0x7f343c102dd0 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34438b5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74472090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34438b5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74472a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34438b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d7447d370 0x555d7447f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34438b5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555d743d82f0 con 0x555d744725d0 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34438b5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555d7437fcf0 con 0x555d74473b40 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34438b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555d743d42b0 con 0x555d7447d370 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74472090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343a7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74472a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74472090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:57978/0 (socket says 172.21.15.76:57978) 2024-09-19T07:54:26.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 -- 172.21.15.76:0/1637431367 learned_addr learned my addr 172.21.15.76:0/1637431367 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343b7fe640 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d7447d370 0x555d7447f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 -- 172.21.15.76:0/1637431367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d7447d370 msgr2=0x555d7447f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d7447d370 0x555d7447f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 -- 172.21.15.76:0/1637431367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 msgr2=0x555d74472a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74472a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 -- 172.21.15.76:0/1637431367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d743643a0 con 0x555d74473b40 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343a7fc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34240a33b0 0x7f34240a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f343c0fed60 tx=0x7f3430013ba0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f343affd640 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74472090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f342c099030 tx=0x7f342c09c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce2295a3489b35a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.286+0000 7f34217fa640 1 -- 172.21.15.76:0/1637431367 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0b4020 con 0x555d74473b40 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34217fa640 1 -- 172.21.15.76:0/1637431367 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f342c09c660 con 0x555d74473b40 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34217fa640 1 -- 172.21.15.76:0/1637431367 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0cdd50 con 0x555d74473b40 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 -- 172.21.15.76:0/1637431367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 msgr2=0x555d74472090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74472090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f342c099030 tx=0x7f342c09c260 comp rx=0 tx=0).stop 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 -- 172.21.15.76:0/1637431367 shutdown_connections 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d7447d370 0x555d7447f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74472a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 --2- 172.21.15.76:0/1637431367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74472090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 -- 172.21.15.76:0/1637431367 >> 172.21.15.76:0/1637431367 conn(0x555d7443b310 msgr2=0x555d7446ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 -- 172.21.15.76:0/1637431367 shutdown_connections 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.287+0000 7f34438b5740 1 -- 172.21.15.76:0/1637431367 wait complete. 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 -- start start 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 Processor -- start 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d7447cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d7447a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d7447a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555d74480070 con 0x555d744725d0 2024-09-19T07:54:26.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555d74393060 con 0x555d7447d370 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555d744801f0 con 0x555d74473b40 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f34438b5740 10 client.0 _ll_register_callbacks cb 0x555d740e68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d7447cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d7447cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51626/0 (socket says 172.21.15.76:51626) 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 -- 172.21.15.76:0/1681667208 learned_addr learned my addr 172.21.15.76:0/1681667208 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343b7fe640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d7447a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343a7fc640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d7447a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 -- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 msgr2=0x555d7447a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d7447a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 -- 172.21.15.76:0/1681667208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 msgr2=0x555d7447a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d7447a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.288+0000 7f343affd640 1 -- 172.21.15.76:0/1681667208 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d741493c0 con 0x555d744725d0 2024-09-19T07:54:26.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f343affd640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d7447cd90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f342c09c360 tx=0x7f342c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dddad7011d7217f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f341eff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f341eff5640 1 -- 172.21.15.76:0/1681667208 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0b9070 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f341eff5640 1 -- 172.21.15.76:0/1681667208 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f342c098cd0 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342c09c660 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f341eff5640 1 -- 172.21.15.76:0/1681667208 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f342c0b4040 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555d7448bb40 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f341eff5640 1 -- 172.21.15.76:0/1681667208 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f342c09c660 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f341eff5640 1 -- 172.21.15.76:0/1681667208 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f342c0b0b80 con 0x555d744725d0 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 20 client.16074 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d7448ce90 0x555d7448f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 4 client.16074 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.289+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d743e5860 con 0x555d7448ce90 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.290+0000 7f343a7fc640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d7448ce90 0x555d7448f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.291+0000 7f341eff5640 10 client.16074 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.291+0000 7f343a7fc640 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d7448ce90 0x555d7448f280 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28db8644a52a8a82 server_cookie=8e64877d1a667ebc in_seq=0 out_seq=0 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f341eff5640 1 -- 172.21.15.76:0/1681667208 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d743e5860 con 0x555d7448ce90 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f341eff5640 10 client.16074 handle_command_reply: tid=0 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 client.16074 shutdown 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 msgr2=0x555d7447cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d7447cd90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f342c09c360 tx=0x7f342c00cf90 comp rx=0 tx=0).stop 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 shutdown_connections 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d7447a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d7447a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d7448ce90 0x555d7448f280 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 --2- 172.21.15.76:0/1681667208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d7447cd90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 >> 172.21.15.76:0/1681667208 conn(0x555d7443b310 msgr2=0x555d744749c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:26.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.292+0000 7f341eff5640 0 client.16074 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:26.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.293+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 shutdown_connections 2024-09-19T07:54:26.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.293+0000 7f34438b5740 1 -- 172.21.15.76:0/1681667208 wait complete. 2024-09-19T07:54:26.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.293+0000 7f34438b5740 20 client.16074 trim_cache size 0 max 16384 2024-09-19T07:54:26.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 Processor -- start 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 -- start start 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d744725d0 0x555d74489490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74474820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 0x555d744772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1b26d0 con 0x555d7447d370 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1aff70 con 0x555d74473b40 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f34438b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1addc0 con 0x555d744725d0 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 0x555d744772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 0x555d744772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51632/0 (socket says 172.21.15.76:51632) 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74474820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 -- 172.21.15.76:0/2130368259 learned_addr learned my addr 172.21.15.76:0/2130368259 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:26.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343affd640 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d744725d0 0x555d74489490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 -- 172.21.15.76:0/2130368259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d744725d0 msgr2=0x555d74489490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d744725d0 0x555d74489490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 -- 172.21.15.76:0/2130368259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 msgr2=0x555d74474820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74474820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343b7fe640 1 -- 172.21.15.76:0/2130368259 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d7447afe0 con 0x555d7447d370 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.306+0000 7f343a7fc640 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74474820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f343b7fe640 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 0x555d744772a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3434009930 tx=0x7f3434031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbaa50db06d00e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f3420ff9640 1 -- 172.21.15.76:0/2130368259 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434035040 con 0x555d7447d370 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f3420ff9640 1 -- 172.21.15.76:0/2130368259 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34340318b0 con 0x555d7447d370 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f3420ff9640 1 -- 172.21.15.76:0/2130368259 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434004a00 con 0x555d7447d370 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f34438b5740 1 -- 172.21.15.76:0/2130368259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 msgr2=0x555d744772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f34438b5740 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 0x555d744772a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3434009930 tx=0x7f3434031780 comp rx=0 tx=0).stop 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f34438b5740 1 -- 172.21.15.76:0/2130368259 shutdown_connections 2024-09-19T07:54:26.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f34438b5740 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d7447d370 0x555d744772a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f34438b5740 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d74473b40 0x555d74474820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.307+0000 7f34438b5740 1 --2- 172.21.15.76:0/2130368259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d744725d0 0x555d74489490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- 172.21.15.76:0/2130368259 >> 172.21.15.76:0/2130368259 conn(0x555d7443b310 msgr2=0x555d74474110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- 172.21.15.76:0/2130368259 shutdown_connections 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- 172.21.15.76:0/2130368259 wait complete. 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- start start 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 Processor -- start 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74490050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d74490590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d74490ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1ae430 con 0x555d744725d0 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1af8a0 con 0x555d7447d370 2024-09-19T07:54:26.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1aeb00 con 0x555d74473b40 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f343affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74490050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f34438b5740 10 client.0 _ll_register_callbacks cb 0x7f3430009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f343affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74490050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51646/0 (socket says 172.21.15.76:51646) 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f343affd640 1 -- 172.21.15.76:0/482231100 learned_addr learned my addr 172.21.15.76:0/482231100 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f343a7fc640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d74490590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.308+0000 7f343b7fe640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d74490ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343b7fe640 1 -- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 msgr2=0x555d74490590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343b7fe640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d74490590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343b7fe640 1 -- 172.21.15.76:0/482231100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 msgr2=0x555d74490050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343b7fe640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74490050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343b7fe640 1 -- 172.21.15.76:0/482231100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d744f6800 con 0x555d7447d370 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343affd640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74490050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:26.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f343b7fe640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d74490ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3434009850 tx=0x7f3434005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a5823a9f7d5347 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f341eff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f341eff5640 1 -- 172.21.15.76:0/482231100 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434035040 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34340318b0 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f341eff5640 1 -- 172.21.15.76:0/482231100 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f3434004980 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f341eff5640 1 -- 172.21.15.76:0/482231100 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3434031a60 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f34438b5740 10 client.25391 fetch_fsmap learned FSMap version 28 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.309+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555d744f7ac0 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f341eff5640 1 -- 172.21.15.76:0/482231100 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34340318b0 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f341eff5640 1 -- 172.21.15.76:0/482231100 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3434056a70 con 0x555d7447d370 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 10 client.25391 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 10 client.25391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 20 client.25391 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:26.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d744f8240 0x555d744fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 4 client.25391 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d743dfd70 con 0x555d744f8240 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f343affd640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d744f8240 0x555d744fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f341eff5640 10 client.25391 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f343affd640 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d744f8240 0x555d744fa660 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731e978fee683df4 server_cookie=63e3a0965afadc10 in_seq=0 out_seq=0 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f341eff5640 1 -- 172.21.15.76:0/482231100 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d743dfd70 con 0x555d744f8240 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f341eff5640 10 client.25391 handle_command_reply: tid=0 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.310+0000 7f34438b5740 1 client.25391 shutdown 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 msgr2=0x555d74490ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d74490ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3434009850 tx=0x7f3434005250 comp rx=0 tx=0).stop 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 shutdown_connections 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d7447d370 0x555d74490ad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555d74473b40 0x555d74490590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555d744f8240 0x555d744fa660 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 --2- 172.21.15.76:0/482231100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555d744725d0 0x555d74490050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f341eff5640 0 client.25391 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 >> 172.21.15.76:0/482231100 conn(0x555d7443b310 msgr2=0x555d74474930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 shutdown_connections 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 1 -- 172.21.15.76:0/482231100 wait complete. 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34438b5740 20 client.25391 trim_cache size 0 max 16384 2024-09-19T07:54:26.318 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34240a33b0 msgr2=0x7f34240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34240a33b0 0x7f34240a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f343c0fed60 tx=0x7f3430013ba0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 msgr2=0x7f343c198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 0x7f343c198640 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f342c00eb90 tx=0x7f342c00c6a0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 shutdown_connections 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34240a33b0 0x7f34240a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f343c108300 0x7f343c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.311+0000 7f34414dc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f343c103780 0x7f343c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.312+0000 7f34414dc640 1 --2- 172.21.15.76:0/2552331139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f343c102dd0 0x7f343c198640 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:26.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.312+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 >> 172.21.15.76:0/2552331139 conn(0x7f343c0fc7d0 msgr2=0x7f343c106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:26.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.312+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 shutdown_connections 2024-09-19T07:54:26.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:26.312+0000 7f34414dc640 1 -- 172.21.15.76:0/2552331139 wait complete. 2024-09-19T07:54:26.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:26 smithi137 ceph-mon[35309]: pgmap v101: 97 pgs: 97 active+clean; 226 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2024-09-19T07:54:26.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:26 smithi076 ceph-mon[30930]: pgmap v101: 97 pgs: 97 active+clean; 226 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2024-09-19T07:54:27.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:26 smithi152 ceph-mon[35117]: pgmap v101: 97 pgs: 97 active+clean; 226 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2024-09-19T07:54:28.166 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:54:28.166 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:54:28.414 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:28.809 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:28 smithi076 ceph-mon[30930]: pgmap v102: 97 pgs: 97 active+clean; 226 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.3 MiB/s wr, 605 op/s 2024-09-19T07:54:28.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:28 smithi137 ceph-mon[35309]: pgmap v102: 97 pgs: 97 active+clean; 226 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.3 MiB/s wr, 605 op/s 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 -- 172.21.15.76:0/531376278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 msgr2=0x7f621c10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 --2- 172.21.15.76:0/531376278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c10ea20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6214009ca0 tx=0x7f621402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 -- 172.21.15.76:0/531376278 shutdown_connections 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 --2- 172.21.15.76:0/531376278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c10ea20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 --2- 172.21.15.76:0/531376278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f621c100100 0x7f621c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 --2- 172.21.15.76:0/531376278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c106b80 0x7f621c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 -- 172.21.15.76:0/531376278 >> 172.21.15.76:0/531376278 conn(0x7f621c077230 msgr2=0x7f621c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:28.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 -- 172.21.15.76:0/531376278 shutdown_connections 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.914+0000 7f62227ce640 1 -- 172.21.15.76:0/531376278 wait complete. 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 Processor -- start 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 -- start start 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f621c100100 0x7f621c1012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c106b80 0x7f621c101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f621c112170 con 0x7f621c100aa0 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f621c111ff0 con 0x7f621c100100 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f62227ce640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1122f0 con 0x7f621c106b80 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f621b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f621b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51660/0 (socket says 172.21.15.76:51660) 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f621b7fe640 1 -- 172.21.15.76:0/3134934027 learned_addr learned my addr 172.21.15.76:0/3134934027 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.915+0000 7f621bfff640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f621c100100 0x7f621c1012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f6220d6b640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c106b80 0x7f621c101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f621b7fe640 1 -- 172.21.15.76:0/3134934027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c106b80 msgr2=0x7f621c101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f621b7fe640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c106b80 0x7f621c101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f621b7fe640 1 -- 172.21.15.76:0/3134934027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f621c100100 msgr2=0x7f621c1012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f621b7fe640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f621c100100 0x7f621c1012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f621b7fe640 1 -- 172.21.15.76:0/3134934027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c1a6a30 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f621b7fe640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c101820 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f621000e9f0 tx=0x7f621000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f62197fa640 1 -- 172.21.15.76:0/3134934027 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621000cd80 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c1a6d20 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f62197fa640 1 -- 172.21.15.76:0/3134934027 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6210010930 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f62197fa640 1 -- 172.21.15.76:0/3134934027 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210018b00 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.916+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1a7200 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.918+0000 7f62197fa640 1 -- 172.21.15.76:0/3134934027 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6210018ca0 con 0x7f621c100aa0 2024-09-19T07:54:28.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 Processor -- start 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 -- start start 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 0x55c2bb94cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb957800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb957d40 0x55c2bb95a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c2bb8b2280 con 0x55c2bb94cb60 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c2bb859b10 con 0x55c2bb957d40 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6224ba7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c2bb8ae240 con 0x55c2bb94d480 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 0x55c2bb94cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 0x55c2bb94cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51676/0 (socket says 172.21.15.76:51676) 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 -- 172.21.15.76:0/1342314633 learned_addr learned my addr 172.21.15.76:0/1342314633 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f621bfff640 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb957800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f621b7fe640 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb957d40 0x55c2bb95a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f62197fa640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f62040a33b0 0x7f62040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 -- 172.21.15.76:0/1342314633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 msgr2=0x55c2bb957800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb957800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 -- 172.21.15.76:0/1342314633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb957d40 msgr2=0x55c2bb95a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb957d40 0x55c2bb95a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 -- 172.21.15.76:0/1342314633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bb8661f0 con 0x55c2bb94cb60 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f621bfff640 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb957800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f62197fa640 1 -- 172.21.15.76:0/3134934027 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f62100d01b0 con 0x7f621c100aa0 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.919+0000 7f6220d6b640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f62040a33b0 0x7f62040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.920+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 0x55c2bb94cf40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6214005e30 tx=0x7f6214005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d81a8a180c61529 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.920+0000 7f62027fc640 1 -- 172.21.15.76:0/1342314633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214041040 con 0x55c2bb94cb60 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.920+0000 7f62027fc640 1 -- 172.21.15.76:0/1342314633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6214036070 con 0x55c2bb94cb60 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.920+0000 7f62027fc640 1 -- 172.21.15.76:0/1342314633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621402f900 con 0x55c2bb94cb60 2024-09-19T07:54:28.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 -- 172.21.15.76:0/1342314633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 msgr2=0x55c2bb94cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6220d6b640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f62040a33b0 0x7f62040a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6214009430 tx=0x7f621404d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 0x55c2bb94cf40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6214005e30 tx=0x7f6214005f70 comp rx=0 tx=0).stop 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 -- 172.21.15.76:0/1342314633 shutdown_connections 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb957d40 0x55c2bb95a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb957800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1342314633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb94cb60 0x55c2bb94cf40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 -- 172.21.15.76:0/1342314633 >> 172.21.15.76:0/1342314633 conn(0x55c2bb9490f0 msgr2=0x55c2bb9494d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 -- 172.21.15.76:0/1342314633 shutdown_connections 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 -- 172.21.15.76:0/1342314633 wait complete. 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 -- start start 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 Processor -- start 2024-09-19T07:54:28.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.921+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb954bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb9550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb955630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c2bb95a910 con 0x55c2bb957d40 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c2bb86cf10 con 0x55c2bb94d480 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c2bb95aa90 con 0x55c2bb94cb60 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 10 client.0 _ll_register_callbacks cb 0x55c2bb835a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb955630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f621b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb9550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb955630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51690/0 (socket says 172.21.15.76:51690) 2024-09-19T07:54:28.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 -- 172.21.15.76:0/3051559133 learned_addr learned my addr 172.21.15.76:0/3051559133 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f621b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb9550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:58054/0 (socket says 172.21.15.76:58054) 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f621bfff640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb954bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 -- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 msgr2=0x55c2bb954bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb954bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 -- 172.21.15.76:0/3051559133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 msgr2=0x55c2bb9550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb9550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 -- 172.21.15.76:0/3051559133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bb6236a0 con 0x55c2bb957d40 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f621bfff640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb954bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f621b7fe640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb9550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6220d6b640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb955630 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f621402ade0 tx=0x7f6214004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aabecafefd240f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f61fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f61fb7fe640 1 -- 172.21.15.76:0/3051559133 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214041040 con 0x55c2bb957d40 2024-09-19T07:54:28.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f61fb7fe640 1 -- 172.21.15.76:0/3051559133 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f621402fc20 con 0x55c2bb957d40 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.922+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6214036070 con 0x55c2bb957d40 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f61fb7fe640 1 -- 172.21.15.76:0/3051559133 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6214062050 con 0x55c2bb957d40 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 10 client.16092 fetch_fsmap learned FSMap version 29 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2bb95a910 con 0x55c2bb957d40 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f61fb7fe640 1 -- 172.21.15.76:0/3051559133 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6214036070 con 0x55c2bb957d40 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f61fb7fe640 1 -- 172.21.15.76:0/3051559133 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f62140306e0 con 0x55c2bb957d40 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 10 client.16092 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 20 client.16092 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:28.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb967620 0x55c2bb969a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 4 client.16092 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2bb8bf7f0 con 0x55c2bb967620 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.923+0000 7f621bfff640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb967620 0x55c2bb969a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f61fb7fe640 10 client.16092 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f621bfff640 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb967620 0x55c2bb969a10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb2546732bd74ba3 server_cookie=e457260319a84239 in_seq=0 out_seq=0 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f61fb7fe640 1 -- 172.21.15.76:0/3051559133 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2bb8bf7f0 con 0x55c2bb967620 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f61fb7fe640 10 client.16092 handle_command_reply: tid=0 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 client.16092 shutdown 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 msgr2=0x55c2bb955630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb955630 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f621402ade0 tx=0x7f6214004810 comp rx=0 tx=0).stop 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 shutdown_connections 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb967620 0x55c2bb969a10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb955630 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb9550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f61fb7fe640 0 client.16092 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 --2- 172.21.15.76:0/3051559133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb954bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.924+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 >> 172.21.15.76:0/3051559133 conn(0x55c2bb9490f0 msgr2=0x55c2bb948270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.925+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 shutdown_connections 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.925+0000 7f6224ba7740 1 -- 172.21.15.76:0/3051559133 wait complete. 2024-09-19T07:54:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.925+0000 7f6224ba7740 20 client.16092 trim_cache size 0 max 16384 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 Processor -- start 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 -- start start 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb94f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb96f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb96f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1b26b0 con 0x55c2bb957d40 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1aff20 con 0x55c2bb94d480 2024-09-19T07:54:28.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6224ba7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1add70 con 0x55c2bb94cb60 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb96f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f621b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb96f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb96f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51702/0 (socket says 172.21.15.76:51702) 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.942+0000 7f6220d6b640 1 -- 172.21.15.76:0/1188807049 learned_addr learned my addr 172.21.15.76:0/1188807049 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f621bfff640 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb94f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6220d6b640 1 -- 172.21.15.76:0/1188807049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 msgr2=0x55c2bb94f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb94f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6220d6b640 1 -- 172.21.15.76:0/1188807049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 msgr2=0x55c2bb96f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb96f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6220d6b640 1 -- 172.21.15.76:0/1188807049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2bb948f20 con 0x55c2bb957d40 2024-09-19T07:54:28.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb96f670 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f621402f650 tx=0x7f6214005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaec19efb988d0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:28.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6201ffb640 1 -- 172.21.15.76:0/1188807049 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214041070 con 0x55c2bb957d40 2024-09-19T07:54:28.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6201ffb640 1 -- 172.21.15.76:0/1188807049 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6214036040 con 0x55c2bb957d40 2024-09-19T07:54:28.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.943+0000 7f6201ffb640 1 -- 172.21.15.76:0/1188807049 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621402fc20 con 0x55c2bb957d40 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- 172.21.15.76:0/1188807049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 msgr2=0x55c2bb96f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb96f670 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f621402f650 tx=0x7f6214005d80 comp rx=0 tx=0).stop 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- 172.21.15.76:0/1188807049 shutdown_connections 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb96f670 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94d480 0x55c2bb96f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1188807049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94cb60 0x55c2bb94f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- 172.21.15.76:0/1188807049 >> 172.21.15.76:0/1188807049 conn(0x55c2bb9490f0 msgr2=0x55c2bb956b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:28.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- 172.21.15.76:0/1188807049 shutdown_connections 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- 172.21.15.76:0/1188807049 wait complete. 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- start start 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 Processor -- start 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94cb60 0x55c2bb95bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb95bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb95c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1ae3e0 con 0x55c2bb957d40 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1af850 con 0x55c2bb94cb60 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.944+0000 7f6224ba7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1aeab0 con 0x55c2bb94d480 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6224ba7740 10 client.0 _ll_register_callbacks cb 0x7f62100986d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb95c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f621bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94cb60 0x55c2bb95bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f621bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94cb60 0x55c2bb95bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:58082/0 (socket says 172.21.15.76:58082) 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f621b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb95bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb95c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51708/0 (socket says 172.21.15.76:51708) 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f621bfff640 1 -- 172.21.15.76:0/1093810150 learned_addr learned my addr 172.21.15.76:0/1093810150 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 -- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 msgr2=0x55c2bb95bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb95bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 -- 172.21.15.76:0/1093810150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94cb60 msgr2=0x55c2bb95bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94cb60 0x55c2bb95bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 -- 172.21.15.76:0/1093810150 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bb9d1180 con 0x55c2bb957d40 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6220d6b640 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb95c530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55c2bb948b20 tx=0x7f6214005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bd23ab29ef93ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f61fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f61fb7fe640 1 -- 172.21.15.76:0/1093810150 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214041070 con 0x55c2bb957d40 2024-09-19T07:54:28.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f61fb7fe640 1 -- 172.21.15.76:0/1093810150 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f621402fc20 con 0x55c2bb957d40 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6214036040 con 0x55c2bb957d40 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f61fb7fe640 1 -- 172.21.15.76:0/1093810150 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f621402f310 con 0x55c2bb957d40 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6224ba7740 10 client.16098 fetch_fsmap learned FSMap version 29 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.945+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2bb9d24a0 con 0x55c2bb957d40 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f61fb7fe640 1 -- 172.21.15.76:0/1093810150 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6214036040 con 0x55c2bb957d40 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f61fb7fe640 1 -- 172.21.15.76:0/1093810150 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6214050440 con 0x55c2bb957d40 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f6224ba7740 10 client.16098 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f6224ba7740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f6224ba7740 20 client.16098 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb9d2ab0 0x55c2bb9d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f6224ba7740 4 client.16098 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:54:28.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2bb8b9d00 con 0x55c2bb9d2ab0 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.946+0000 7f621bfff640 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb9d2ab0 0x55c2bb9d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.947+0000 7f61fb7fe640 10 client.16098 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.947+0000 7f621bfff640 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb9d2ab0 0x55c2bb9d4ed0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59319cb0ab874041 server_cookie=a80978a76b7d5079 in_seq=0 out_seq=0 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.947+0000 7f61fb7fe640 1 -- 172.21.15.76:0/1093810150 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2bb8b9d00 con 0x55c2bb9d2ab0 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.947+0000 7f61fb7fe640 10 client.16098 handle_command_reply: tid=0 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.947+0000 7f6224ba7740 1 client.16098 shutdown 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 msgr2=0x55c2bb95c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb95c530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55c2bb948b20 tx=0x7f6214005c50 comp rx=0 tx=0).stop 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 shutdown_connections 2024-09-19T07:54:28.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c2bb9d2ab0 0x55c2bb9d4ed0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c2bb957d40 0x55c2bb95c530 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f61fb7fe640 0 client.16098 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c2bb94d480 0x55c2bb95bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 --2- 172.21.15.76:0/1093810150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c2bb94cb60 0x55c2bb95bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 >> 172.21.15.76:0/1093810150 conn(0x55c2bb9490f0 msgr2=0x55c2bb947a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 shutdown_connections 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 1 -- 172.21.15.76:0/1093810150 wait complete. 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f6224ba7740 20 client.16098 trim_cache size 0 max 16384 2024-09-19T07:54:28.954 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:54:28.955 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:54:28.955 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "8968eeee-4180-44e2-aa66-43b42561a5b4", 2024-09-19T07:54:28.955 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:54:28.955 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:54:28.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f62040a33b0 msgr2=0x7f62040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f62227ce640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f62040a33b0 0x7f62040a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6214009430 tx=0x7f621404d000 comp rx=0 tx=0).stop 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 msgr2=0x7f621c101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.948+0000 7f62227ce640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c101820 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f621000e9f0 tx=0x7f621000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 shutdown_connections 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f62040a33b0 0x7f62040a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c106b80 0x7f621c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f621c100aa0 0x7f621c101820 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 --2- 172.21.15.76:0/3134934027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f621c100100 0x7f621c1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 >> 172.21.15.76:0/3134934027 conn(0x7f621c077230 msgr2=0x7f621c104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 shutdown_connections 2024-09-19T07:54:28.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:28.949+0000 7f62227ce640 1 -- 172.21.15.76:0/3134934027 wait complete. 2024-09-19T07:54:29.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:28 smithi152 ceph-mon[35117]: pgmap v102: 97 pgs: 97 active+clean; 226 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.3 MiB/s wr, 605 op/s 2024-09-19T07:54:29.718 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:54:29.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:29 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:29 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:54:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:29 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:29.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:29 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:54:29.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:29 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:29.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:29 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:54:29.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:29 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:29.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:29 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:54:30.006 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:29 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:29 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:54:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:29 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:29 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:54:30.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 -- 172.21.15.76:0/1924461991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b01027a0 msgr2=0x7f20b01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 --2- 172.21.15.76:0/1924461991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b01027a0 0x7f20b01067f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2098009900 tx=0x7f209802a410 comp rx=0 tx=0).stop 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 -- 172.21.15.76:0/1924461991 shutdown_connections 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 --2- 172.21.15.76:0/1924461991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b0106f20 0x7f20b010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 --2- 172.21.15.76:0/1924461991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b01027a0 0x7f20b01067f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 --2- 172.21.15.76:0/1924461991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20b0101df0 0x7f20b01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 -- 172.21.15.76:0/1924461991 >> 172.21.15.76:0/1924461991 conn(0x7f20b00fd8b0 msgr2=0x7f20b00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 -- 172.21.15.76:0/1924461991 shutdown_connections 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 -- 172.21.15.76:0/1924461991 wait complete. 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 Processor -- start 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.495+0000 7f20b5eca640 1 -- start start 2024-09-19T07:54:30.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20b0101df0 0x7f20b019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b01027a0 0x7f20b019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 0x7f20b019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01120e0 con 0x7f20b0106f20 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0111f60 con 0x7f20b0101df0 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0112260 con 0x7f20b01027a0 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 0x7f20b019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20b0101df0 0x7f20b019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 0x7f20b019f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51720/0 (socket says 172.21.15.76:51720) 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 -- 172.21.15.76:0/441516009 learned_addr learned my addr 172.21.15.76:0/441516009 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20a7fff640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b01027a0 0x7f20b019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 -- 172.21.15.76:0/441516009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b01027a0 msgr2=0x7f20b019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b01027a0 0x7f20b019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 -- 172.21.15.76:0/441516009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20b0101df0 msgr2=0x7f20b019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20b0101df0 0x7f20b019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 -- 172.21.15.76:0/441516009 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b019f700 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20affff640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 0x7f20b019f020 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f20a800b970 tx=0x7f20a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20ad7fa640 1 -- 172.21.15.76:0/441516009 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8019070 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20ad7fa640 1 -- 172.21.15.76:0/441516009 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20a800cb40 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b019f9f0 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20ad7fa640 1 -- 172.21.15.76:0/441516009 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8007700 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.496+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b01a72d0 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20ad7fa640 1 -- 172.21.15.76:0/441516009 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f20a801c070 con 0x7f20b0106f20 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 Processor -- start 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 -- start start 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20ad7fa640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f209c0a33b0 0x7f209c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28ca5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cb0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cb2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558a28c0b2e0 con 0x558a28ca5dc0 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a28bb2ce0 con 0x558a28ca54a0 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20b82a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558a28c072a0 con 0x558a28cb0680 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20ad7fa640 1 -- 172.21.15.76:0/441516009 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f20a80cf1a0 con 0x7f20b0106f20 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20a7fff640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f209c0a33b0 0x7f209c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.499+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28ca5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28ca5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:58120/0 (socket says 172.21.15.76:58120) 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cb0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 -- 172.21.15.76:0/3243857965 learned_addr learned my addr 172.21.15.76:0/3243857965 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:30.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20affff640 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cb2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 -- 172.21.15.76:0/3243857965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 msgr2=0x558a28cb2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cb2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 -- 172.21.15.76:0/3243857965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 msgr2=0x558a28cb0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cb0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 -- 172.21.15.76:0/3243857965 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a28b97440 con 0x558a28ca54a0 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20affff640 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cb2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20a7fff640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f209c0a33b0 0x7f209c0a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20b0076480 tx=0x7f2098031510 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20af7fe640 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28ca5880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009cf0 tx=0x7f20a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4422948f6431031 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20a5ffb640 1 -- 172.21.15.76:0/3243857965 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004230 con 0x558a28ca54a0 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20a5ffb640 1 -- 172.21.15.76:0/3243857965 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20a00043d0 con 0x558a28ca54a0 2024-09-19T07:54:30.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.500+0000 7f20a5ffb640 1 -- 172.21.15.76:0/3243857965 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0019900 con 0x558a28ca54a0 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 -- 172.21.15.76:0/3243857965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 msgr2=0x558a28ca5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28ca5880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009cf0 tx=0x7f20a0011810 comp rx=0 tx=0).stop 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 -- 172.21.15.76:0/3243857965 shutdown_connections 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cb2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cb0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 --2- 172.21.15.76:0/3243857965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28ca5880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 -- 172.21.15.76:0/3243857965 >> 172.21.15.76:0/3243857965 conn(0x558a28ca1a30 msgr2=0x558a28ca1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 -- 172.21.15.76:0/3243857965 shutdown_connections 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 -- 172.21.15.76:0/3243857965 wait complete. 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 -- start start 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.501+0000 7f20b82a3740 1 Processor -- start 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28caff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558a28cb3250 con 0x558a28ca5dc0 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a28bc6050 con 0x558a28ca54a0 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558a28cb33d0 con 0x558a28cb0680 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20b82a3740 10 client.0 _ll_register_callbacks cb 0x558a28c06160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28caff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51744/0 (socket says 172.21.15.76:51744) 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28caff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:58124/0 (socket says 172.21.15.76:58124) 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 -- 172.21.15.76:0/1046020553 learned_addr learned my addr 172.21.15.76:0/1046020553 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20affff640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 -- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 msgr2=0x558a28cad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 -- 172.21.15.76:0/1046020553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 msgr2=0x558a28caff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28caff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 -- 172.21.15.76:0/1046020553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a2897c3c0 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20af7fe640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28caff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f20a7fff640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cad1e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2098009900 tx=0x7f2098045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62e44e036a14066 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.502+0000 7f208effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f208effd640 1 -- 172.21.15.76:0/1046020553 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209804e070 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a00043d0 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f208effd640 1 -- 172.21.15.76:0/1046020553 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2098005460 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f208effd640 1 -- 172.21.15.76:0/1046020553 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f209805a050 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 10 client.16110 fetch_fsmap learned FSMap version 30 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558a28cbeae0 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f208effd640 1 -- 172.21.15.76:0/1046020553 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20a00043d0 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f208effd640 1 -- 172.21.15.76:0/1046020553 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f209803a040 con 0x558a28ca5dc0 2024-09-19T07:54:30.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 10 client.16110 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 20 client.16110 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cbffb0 0x558a28cc2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 4 client.16110 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a28c18850 con 0x558a28cbffb0 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.503+0000 7f20af7fe640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cbffb0 0x558a28cc2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.504+0000 7f208effd640 10 client.16110 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.504+0000 7f20af7fe640 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cbffb0 0x558a28cc2450 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7621f66206e71fbf server_cookie=1eab3e547e65a309 in_seq=0 out_seq=0 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f208effd640 1 -- 172.21.15.76:0/1046020553 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a28c18850 con 0x558a28cbffb0 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f208effd640 10 client.16110 handle_command_reply: tid=0 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 client.16110 shutdown 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 msgr2=0x558a28cad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cad1e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2098009900 tx=0x7f2098045000 comp rx=0 tx=0).stop 2024-09-19T07:54:30.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 shutdown_connections 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28cb0680 0x558a28cad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cbffb0 0x558a28cc2450 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28cad1e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f208effd640 0 client.16110 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 --2- 172.21.15.76:0/1046020553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28caff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 >> 172.21.15.76:0/1046020553 conn(0x558a28ca1a30 msgr2=0x558a28ca7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 shutdown_connections 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 1 -- 172.21.15.76:0/1046020553 wait complete. 2024-09-19T07:54:30.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.505+0000 7f20b82a3740 20 client.16110 trim_cache size 0 max 16384 2024-09-19T07:54:30.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 Processor -- start 2024-09-19T07:54:30.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 -- start start 2024-09-19T07:54:30.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cbc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28cad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28ca87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01b2740 con 0x558a28ca5dc0 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.523+0000 7f20b82a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01aff80 con 0x558a28ca54a0 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20b82a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01addd0 con 0x558a28ca1a30 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28ca87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28ca87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51746/0 (socket says 172.21.15.76:51746) 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 -- 172.21.15.76:0/368817287 learned_addr learned my addr 172.21.15.76:0/368817287 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28cad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20af7fe640 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cbc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 -- 172.21.15.76:0/368817287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 msgr2=0x558a28cbc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cbc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 -- 172.21.15.76:0/368817287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 msgr2=0x558a28cad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28cad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 -- 172.21.15.76:0/368817287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a28ca1860 con 0x558a28ca5dc0 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20af7fe640 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cbc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20affff640 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28ca87a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f20a809b320 tx=0x7f20a809af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f7ef148306066b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20a57fa640 1 -- 172.21.15.76:0/368817287 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a80a41e0 con 0x558a28ca5dc0 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20a57fa640 1 -- 172.21.15.76:0/368817287 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20a8099920 con 0x558a28ca5dc0 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.524+0000 7f20a57fa640 1 -- 172.21.15.76:0/368817287 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a80a3fb0 con 0x558a28ca5dc0 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 -- 172.21.15.76:0/368817287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 msgr2=0x558a28ca87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28ca87a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f20a809b320 tx=0x7f20a809af80 comp rx=0 tx=0).stop 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 -- 172.21.15.76:0/368817287 shutdown_connections 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca5dc0 0x558a28ca87a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca54a0 0x558a28cad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 --2- 172.21.15.76:0/368817287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cbc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 -- 172.21.15.76:0/368817287 >> 172.21.15.76:0/368817287 conn(0x558a28cad880 msgr2=0x558a28ca8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:30.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 -- 172.21.15.76:0/368817287 shutdown_connections 2024-09-19T07:54:30.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 -- 172.21.15.76:0/368817287 wait complete. 2024-09-19T07:54:30.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.525+0000 7f20b82a3740 1 -- start start 2024-09-19T07:54:30.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 Processor -- start 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cb8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 0x558a28cb40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca5dc0 0x558a28cb45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01ae440 con 0x558a28ca54a0 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01af8b0 con 0x558a28ca5dc0 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01aeb10 con 0x558a28ca1a30 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20b82a3740 10 client.0 _ll_register_callbacks cb 0x7f2098009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 0x558a28cb40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 0x558a28cb40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51760/0 (socket says 172.21.15.76:51760) 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 -- 172.21.15.76:0/422423846 learned_addr learned my addr 172.21.15.76:0/422423846 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:30.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20affff640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca5dc0 0x558a28cb45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20af7fe640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cb8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 -- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 msgr2=0x558a28cb8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cb8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 -- 172.21.15.76:0/422423846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca5dc0 msgr2=0x558a28cb45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca5dc0 0x558a28cb45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 -- 172.21.15.76:0/422423846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a28cb4dc0 con 0x558a28ca54a0 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20af7fe640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cb8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:30.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20affff640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca5dc0 0x558a28cb45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.526+0000 7f20a7fff640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 0x558a28cb40a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2098005020 tx=0x7f2098032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea10b321b481ae69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f208effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f208effd640 1 -- 172.21.15.76:0/422423846 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209804e040 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f208effd640 1 -- 172.21.15.76:0/422423846 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f20980037e0 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a8099920 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f208effd640 1 -- 172.21.15.76:0/422423846 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f209806a050 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 10 client.16116 fetch_fsmap learned FSMap version 30 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558a28d2ac20 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f208effd640 1 -- 172.21.15.76:0/422423846 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20a8099920 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f208effd640 1 -- 172.21.15.76:0/422423846 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f20980047e0 con 0x558a28ca54a0 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 10 client.16116 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:54:30.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 20 client.16116 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cb0680 0x558a28d2d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 4 client.16116 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.527+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a28c12d60 con 0x558a28cb0680 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.528+0000 7f20af7fe640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cb0680 0x558a28d2d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.528+0000 7f20af7fe640 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cb0680 0x558a28d2d440 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de8d63c4aef01ab8 server_cookie=92f86305967ad263 in_seq=0 out_seq=0 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.528+0000 7f208effd640 10 client.16116 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.528+0000 7f208effd640 1 -- 172.21.15.76:0/422423846 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558a28c12d60 con 0x558a28cb0680 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.528+0000 7f208effd640 10 client.16116 handle_command_reply: tid=0 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.528+0000 7f20b82a3740 1 client.16116 shutdown 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 msgr2=0x558a28cb40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 0x558a28cb40a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2098005020 tx=0x7f2098032e10 comp rx=0 tx=0).stop 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 shutdown_connections 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a28ca5dc0 0x558a28cb45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558a28cb0680 0x558a28d2d440 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a28ca54a0 0x558a28cb40a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 --2- 172.21.15.76:0/422423846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558a28ca1a30 0x558a28cb8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 >> 172.21.15.76:0/422423846 conn(0x558a28cad880 msgr2=0x558a28ca7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f208effd640 0 client.16116 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 shutdown_connections 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 1 -- 172.21.15.76:0/422423846 wait complete. 2024-09-19T07:54:30.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b82a3740 20 client.16116 trim_cache size 0 max 16384 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: "8968eeee-4180-44e2-aa66-43b42561a5b4": { 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "8968eeee-4180-44e2-aa66-43b42561a5b4", 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:30.536 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:54:30.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f209c0a33b0 msgr2=0x7f209c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b5eca640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f209c0a33b0 0x7f209c0a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20b0076480 tx=0x7f2098031510 comp rx=0 tx=0).stop 2024-09-19T07:54:30.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 msgr2=0x7f20b019f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.529+0000 7f20b5eca640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 0x7f20b019f020 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f20a800b970 tx=0x7f20a800be30 comp rx=0 tx=0).stop 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 shutdown_connections 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f209c0a33b0 0x7f209c0a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b0106f20 0x7f20b019f020 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b01027a0 0x7f20b019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 --2- 172.21.15.76:0/441516009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20b0101df0 0x7f20b019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 >> 172.21.15.76:0/441516009 conn(0x7f20b00fd8b0 msgr2=0x7f20b00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 shutdown_connections 2024-09-19T07:54:30.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:30.530+0000 7f20b5eca640 1 -- 172.21.15.76:0/441516009 wait complete. 2024-09-19T07:54:30.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:30 smithi076 ceph-mon[30930]: pgmap v103: 97 pgs: 97 active+clean; 229 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.2 MiB/s wr, 773 op/s 2024-09-19T07:54:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:30 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:54:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:30 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:30 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:30.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:30 smithi137 ceph-mon[35309]: pgmap v103: 97 pgs: 97 active+clean; 229 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.2 MiB/s wr, 773 op/s 2024-09-19T07:54:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:30 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:54:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:30 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:30.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:30 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:31.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:30 smithi152 ceph-mon[35117]: pgmap v103: 97 pgs: 97 active+clean; 229 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.2 MiB/s wr, 773 op/s 2024-09-19T07:54:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:30 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:54:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:30 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:30 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:31.345 INFO:tasks.cephfs.filesystem:scrub status for tag:8968eeee-4180-44e2-aa66-43b42561a5b4 - {'path': '/', 'tag': '8968eeee-4180-44e2-aa66-43b42561a5b4', 'options': 'recursive,force'} 2024-09-19T07:54:31.753 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar xf doc.tar 2024-09-19T07:54:31.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:31 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:31.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:31 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:32.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:31 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:54:32.622 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:32 smithi076 ceph-mon[30930]: pgmap v104: 97 pgs: 97 active+clean; 229 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 342 op/s 2024-09-19T07:54:32.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:32 smithi137 ceph-mon[35309]: pgmap v104: 97 pgs: 97 active+clean; 229 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 342 op/s 2024-09-19T07:54:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:32 smithi152 ceph-mon[35117]: pgmap v104: 97 pgs: 97 active+clean; 229 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 342 op/s 2024-09-19T07:54:34.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:34 smithi137 ceph-mon[35309]: pgmap v105: 97 pgs: 97 active+clean; 229 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 298 op/s 2024-09-19T07:54:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:34 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:34.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:34 smithi076 ceph-mon[30930]: pgmap v105: 97 pgs: 97 active+clean; 229 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 298 op/s 2024-09-19T07:54:34.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:34 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:34 smithi152 ceph-mon[35117]: pgmap v105: 97 pgs: 97 active+clean; 229 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 298 op/s 2024-09-19T07:54:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:34 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:54:36.152 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T07:54:36.153 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:54:36.403 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:36.798 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:36 smithi076 ceph-mon[30930]: pgmap v106: 97 pgs: 97 active+clean; 227 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 423 op/s 2024-09-19T07:54:36.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 -- 172.21.15.76:0/2035070651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 msgr2=0x7f95e81063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:36.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 --2- 172.21.15.76:0/2035070651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e81063d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009ca0 tx=0x7f95e002a940 comp rx=0 tx=0).stop 2024-09-19T07:54:36.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 -- 172.21.15.76:0/2035070651 shutdown_connections 2024-09-19T07:54:36.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 --2- 172.21.15.76:0/2035070651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e81063d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:36.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 --2- 172.21.15.76:0/2035070651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e8101450 0x7f95e8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 --2- 172.21.15.76:0/2035070651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95e8100b30 0x7f95e8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 -- 172.21.15.76:0/2035070651 >> 172.21.15.76:0/2035070651 conn(0x7f95e80fc7a0 msgr2=0x7f95e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 -- 172.21.15.76:0/2035070651 shutdown_connections 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 -- 172.21.15.76:0/2035070651 wait complete. 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 Processor -- start 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.886+0000 7f95efe80640 1 -- start start 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e8100b30 0x7f95e81a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95e8101450 0x7f95e81a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81186a0 con 0x7f95e8105f40 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8118520 con 0x7f95e8100b30 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8118820 con 0x7f95e8101450 2024-09-19T07:54:36.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e819e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56610/0 (socket says 172.21.15.76:56610) 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 -- 172.21.15.76:0/773172527 learned_addr learned my addr 172.21.15.76:0/773172527 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95edc1c640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e8100b30 0x7f95e81a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 -- 172.21.15.76:0/773172527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95e8101450 msgr2=0x7f95e81a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ed41b640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95e8101450 0x7f95e81a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95e8101450 0x7f95e81a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 -- 172.21.15.76:0/773172527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e8100b30 msgr2=0x7f95e81a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e8100b30 0x7f95e81a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 -- 172.21.15.76:0/773172527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e819f070 con 0x7f95e8105f40 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95ee41d640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e819e940 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95e0005cc0 tx=0x7f95e0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0034040 con 0x7f95e8105f40 2024-09-19T07:54:36.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.887+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e819f300 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.888+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95e002fd70 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.888+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e003a430 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.888+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e81ab650 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.889+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e8105920 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.890+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f95e0037020 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.891+0000 7f95deffd640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95d40a33b0 0x7f95d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.891+0000 7f95edc1c640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95d40a33b0 0x7f95d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.891+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f95e00f0dc0 con 0x7f95e8105f40 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.892+0000 7f95edc1c640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95d40a33b0 0x7f95d40a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95e819fa80 tx=0x7f95e400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:36.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:36.894+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f95e00bd850 con 0x7f95e8105f40 2024-09-19T07:54:36.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:36 smithi137 ceph-mon[35309]: pgmap v106: 97 pgs: 97 active+clean; 227 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 423 op/s 2024-09-19T07:54:37.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:36 smithi152 ceph-mon[35117]: pgmap v106: 97 pgs: 97 active+clean; 227 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 423 op/s 2024-09-19T07:54:37.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.094+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95e81ab820 con 0x7f95e8105f40 2024-09-19T07:54:37.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.095+0000 7f95deffd640 1 -- 172.21.15.76:0/773172527 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7f95e00bd150 con 0x7f95e8105f40 2024-09-19T07:54:37.095 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:54:37.095 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:54:37.096 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:54:37.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95d40a33b0 msgr2=0x7f95d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:37.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95d40a33b0 0x7f95d40a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95e819fa80 tx=0x7f95e400b390 comp rx=0 tx=0).stop 2024-09-19T07:54:37.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 msgr2=0x7f95e819e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:37.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e819e940 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95e0005cc0 tx=0x7f95e0030ec0 comp rx=0 tx=0).stop 2024-09-19T07:54:37.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 shutdown_connections 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95d40a33b0 0x7f95d40a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f95e8105f40 0x7f95e819e940 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95e8101450 0x7f95e81a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 --2- 172.21.15.76:0/773172527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e8100b30 0x7f95e81a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.097+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 >> 172.21.15.76:0/773172527 conn(0x7f95e80fc7a0 msgr2=0x7f95e81038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.098+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 shutdown_connections 2024-09-19T07:54:37.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:37.098+0000 7f95efe80640 1 -- 172.21.15.76:0/773172527 wait complete. 2024-09-19T07:54:37.862 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:37 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/773172527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:37.889 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T07:54:37.890 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T07:54:37.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:37 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/773172527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:38.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:37 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/773172527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:38.137 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:38.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 -- 172.21.15.76:0/3785829515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102570 msgr2=0x7f06e01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 --2- 172.21.15.76:0/3785829515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102570 0x7f06e01029b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009900 tx=0x7f06c802a480 comp rx=0 tx=0).stop 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 -- 172.21.15.76:0/3785829515 shutdown_connections 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 --2- 172.21.15.76:0/3785829515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e0102ef0 0x7f06e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 --2- 172.21.15.76:0/3785829515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102570 0x7f06e01029b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 --2- 172.21.15.76:0/3785829515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0100e20 0x7f06e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 -- 172.21.15.76:0/3785829515 >> 172.21.15.76:0/3785829515 conn(0x7f06e00fc7d0 msgr2=0x7f06e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 -- 172.21.15.76:0/3785829515 shutdown_connections 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.656+0000 7f06e4a48640 1 -- 172.21.15.76:0/3785829515 wait complete. 2024-09-19T07:54:38.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 Processor -- start 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 -- start start 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e0100e20 0x7f06e019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0102570 0x7f06e019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 0x7f06e019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01110a0 con 0x7f06e0102ef0 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0110f20 con 0x7f06e0102570 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.657+0000 7f06e4a48640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0111220 con 0x7f06e0100e20 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 0x7f06e019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 0x7f06e019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56634/0 (socket says 172.21.15.76:56634) 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 -- 172.21.15.76:0/2459690912 learned_addr learned my addr 172.21.15.76:0/2459690912 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:38.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06d7fff640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0102570 0x7f06e019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06de59c640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e0100e20 0x7f06e019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 -- 172.21.15.76:0/2459690912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e0100e20 msgr2=0x7f06e019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e0100e20 0x7f06e019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 -- 172.21.15.76:0/2459690912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0102570 msgr2=0x7f06e019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0102570 0x7f06e019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 -- 172.21.15.76:0/2459690912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e019f640 con 0x7f06e0102ef0 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06ded9d640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 0x7f06e019ef60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f06d800cce0 tx=0x7f06d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06d77fe640 1 -- 172.21.15.76:0/2459690912 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d800f450 con 0x7f06e0102ef0 2024-09-19T07:54:38.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e019f930 con 0x7f06e0102ef0 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06d77fe640 1 -- 172.21.15.76:0/2459690912 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06d800faf0 con 0x7f06e0102ef0 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06d77fe640 1 -- 172.21.15.76:0/2459690912 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8018cc0 con 0x7f06e0102ef0 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.658+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01a7210 con 0x7f06e0102ef0 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06d77fe640 1 -- 172.21.15.76:0/2459690912 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f06d800f5f0 con 0x7f06e0102ef0 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06e6e21740 1 Processor -- start 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06e6e21740 1 -- start start 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e65b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e70400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e72d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.661+0000 7f06e6e21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559bc3dcb2a0 con 0x559bc3e65760 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06e6e21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559bc3d72b10 con 0x559bc3e66080 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06e6e21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559bc3dc7260 con 0x559bc3e70940 2024-09-19T07:54:38.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e65b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e65b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56646/0 (socket says 172.21.15.76:56646) 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 -- 172.21.15.76:0/1758454774 learned_addr learned my addr 172.21.15.76:0/1758454774 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06de59c640 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e70400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d77fe640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f06cc0a33b0 0x7f06cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 -- 172.21.15.76:0/1758454774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 msgr2=0x559bc3e72d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e72d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06ded9d640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f06cc0a33b0 0x7f06cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 -- 172.21.15.76:0/1758454774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 msgr2=0x559bc3e70400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e70400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 -- 172.21.15.76:0/1758454774 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc3b3cb90 con 0x559bc3e65760 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d77fe640 1 -- 172.21.15.76:0/2459690912 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f06d80d0290 con 0x7f06e0102ef0 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e65b40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f06c802a9a0 tx=0x7f06c8031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47df53790e465c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:38.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d4ff9640 1 -- 172.21.15.76:0/1758454774 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8040070 con 0x559bc3e65760 2024-09-19T07:54:38.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06ded9d640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f06cc0a33b0 0x7f06cc0a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06d80cdf80 tx=0x7f06d80672f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:38.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.662+0000 7f06d4ff9640 1 -- 172.21.15.76:0/1758454774 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06c8031a10 con 0x559bc3e65760 2024-09-19T07:54:38.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06d4ff9640 1 -- 172.21.15.76:0/1758454774 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8035040 con 0x559bc3e65760 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 -- 172.21.15.76:0/1758454774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 msgr2=0x559bc3e65b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e65b40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f06c802a9a0 tx=0x7f06c8031760 comp rx=0 tx=0).stop 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 -- 172.21.15.76:0/1758454774 shutdown_connections 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e72d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e70400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1758454774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e65b40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 -- 172.21.15.76:0/1758454774 >> 172.21.15.76:0/1758454774 conn(0x559bc3e61cf0 msgr2=0x559bc3e620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:38.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 -- 172.21.15.76:0/1758454774 shutdown_connections 2024-09-19T07:54:38.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.663+0000 7f06e6e21740 1 -- 172.21.15.76:0/1758454774 wait complete. 2024-09-19T07:54:38.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 -- start start 2024-09-19T07:54:38.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 Processor -- start 2024-09-19T07:54:38.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e6dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559bc3e73510 con 0x559bc3e65760 2024-09-19T07:54:38.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559bc3d536e0 con 0x559bc3e66080 2024-09-19T07:54:38.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559bc3e73690 con 0x559bc3e70940 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06e6e21740 10 client.0 _ll_register_callbacks cb 0x559bc3d77a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56652/0 (socket says 172.21.15.76:56652) 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 -- 172.21.15.76:0/1111561415 learned_addr learned my addr 172.21.15.76:0/1111561415 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06de59c640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e6dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 -- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 msgr2=0x559bc3e6e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 -- 172.21.15.76:0/1111561415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 msgr2=0x559bc3e6dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e6dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 -- 172.21.15.76:0/1111561415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc3e7ca30 con 0x559bc3e65760 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06de59c640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e6dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:54:38.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.664+0000 7f06d7fff640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6d840 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f06c8004cf0 tx=0x7f06c802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2ea9a4e64fdaa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06c5ffb640 1 -- 172.21.15.76:0/1111561415 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8052060 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06c5ffb640 1 -- 172.21.15.76:0/1111561415 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f06c8005430 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c8031a10 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06c5ffb640 1 -- 172.21.15.76:0/1111561415 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f06c8048070 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 10 client.16134 fetch_fsmap learned FSMap version 31 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559bc3e7f3a0 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06c5ffb640 1 -- 172.21.15.76:0/1111561415 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06c8031a10 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06c5ffb640 1 -- 172.21.15.76:0/1111561415 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f06c8044490 con 0x559bc3e65760 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 10 client.16134 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 10 client.16134 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 20 client.16134 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:38.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3e806f0 0x559bc3e82ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 4 client.16134 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.665+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bc3dd89d0 con 0x559bc3e806f0 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.666+0000 7f06de59c640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3e806f0 0x559bc3e82ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.666+0000 7f06c5ffb640 10 client.16134 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.666+0000 7f06de59c640 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3e806f0 0x559bc3e82ae0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16616880d0a290e6 server_cookie=51922e7a620b792e in_seq=0 out_seq=0 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06c5ffb640 1 -- 172.21.15.76:0/1111561415 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bc3dd89d0 con 0x559bc3e806f0 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06c5ffb640 10 client.16134 handle_command_reply: tid=0 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 client.16134 shutdown 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 msgr2=0x559bc3e6d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6d840 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f06c8004cf0 tx=0x7f06c802a480 comp rx=0 tx=0).stop 2024-09-19T07:54:38.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 shutdown_connections 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e6dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3e806f0 0x559bc3e82ae0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 --2- 172.21.15.76:0/1111561415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6d840 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06c5ffb640 0 client.16134 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 >> 172.21.15.76:0/1111561415 conn(0x559bc3e61cf0 msgr2=0x559bc3e67a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 shutdown_connections 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 1 -- 172.21.15.76:0/1111561415 wait complete. 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.667+0000 7f06e6e21740 20 client.16134 trim_cache size 0 max 16384 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 Processor -- start 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 -- start start 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01b2450 con 0x559bc3e65760 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01afc60 con 0x559bc3e66080 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06e6e21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01adab0 con 0x559bc3e70940 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56668/0 (socket says 172.21.15.76:56668) 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 -- 172.21.15.76:0/2835095338 learned_addr learned my addr 172.21.15.76:0/2835095338 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 -- 172.21.15.76:0/2835095338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 msgr2=0x559bc3e6aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 -- 172.21.15.76:0/2835095338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 msgr2=0x559bc3e681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 -- 172.21.15.76:0/2835095338 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc3e65590 con 0x559bc3e65760 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.684+0000 7f06d7fff640 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6f710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009850 tx=0x7f06c8045f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa07518804f2dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06c7fff640 1 -- 172.21.15.76:0/2835095338 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8035030 con 0x559bc3e65760 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06c7fff640 1 -- 172.21.15.76:0/2835095338 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06c8004d20 con 0x559bc3e65760 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06c7fff640 1 -- 172.21.15.76:0/2835095338 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8052070 con 0x559bc3e65760 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 -- 172.21.15.76:0/2835095338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 msgr2=0x559bc3e6f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6f710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009850 tx=0x7f06c8045f50 comp rx=0 tx=0).stop 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 -- 172.21.15.76:0/2835095338 shutdown_connections 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e70940 0x559bc3e6aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e66080 0x559bc3e681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 --2- 172.21.15.76:0/2835095338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e65760 0x559bc3e6f710 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 -- 172.21.15.76:0/2835095338 >> 172.21.15.76:0/2835095338 conn(0x559bc3e61cf0 msgr2=0x559bc3e7c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 -- 172.21.15.76:0/2835095338 shutdown_connections 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.685+0000 7f06e6e21740 1 -- 172.21.15.76:0/2835095338 wait complete. 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 -- start start 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 Processor -- start 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e65760 0x559bc3e83f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 0x559bc3e844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e70940 0x559bc3eea030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01ae120 con 0x559bc3e66080 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01af590 con 0x559bc3e70940 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01ae7f0 con 0x559bc3e65760 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06e6e21740 10 client.0 _ll_register_callbacks cb 0x7f06c8004980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06de59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 0x559bc3e844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06de59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 0x559bc3e844d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56674/0 (socket says 172.21.15.76:56674) 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e65760 0x559bc3e83f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06de59c640 1 -- 172.21.15.76:0/24627539 learned_addr learned my addr 172.21.15.76:0/24627539 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.686+0000 7f06d7fff640 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e70940 0x559bc3eea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06de59c640 1 -- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e65760 msgr2=0x559bc3e83f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06de59c640 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e65760 0x559bc3e83f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06de59c640 1 -- 172.21.15.76:0/24627539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e70940 msgr2=0x559bc3eea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06de59c640 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e70940 0x559bc3eea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06de59c640 1 -- 172.21.15.76:0/24627539 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc3e5d260 con 0x559bc3e66080 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06de59c640 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 0x559bc3e844d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x559bc3e62b50 tx=0x7f06d000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1076dd3b95c6089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06c5ffb640 1 -- 172.21.15.76:0/24627539 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d001a530 con 0x559bc3e66080 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06c5ffb640 1 -- 172.21.15.76:0/24627539 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f06d001a6d0 con 0x559bc3e66080 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c8004d20 con 0x559bc3e66080 2024-09-19T07:54:38.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06c5ffb640 1 -- 172.21.15.76:0/24627539 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f06d002a050 con 0x559bc3e66080 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 10 client.16140 fetch_fsmap learned FSMap version 31 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559bc3eeb6e0 con 0x559bc3e66080 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06c5ffb640 1 -- 172.21.15.76:0/24627539 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06c8004d20 con 0x559bc3e66080 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06c5ffb640 1 -- 172.21.15.76:0/24627539 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f06d0011bd0 con 0x559bc3e66080 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 10 client.16140 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 10 client.16140 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 20 client.16140 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3eebf10 0x559bc3eee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 4 client.16140 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.687+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x559bc3dd2d20 con 0x559bc3eebf10 2024-09-19T07:54:38.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.688+0000 7f06d7fff640 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3eebf10 0x559bc3eee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:38.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.688+0000 7f06c5ffb640 10 client.16140 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:38.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:38.688+0000 7f06d7fff640 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3eebf10 0x559bc3eee330 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7a86a5b251e0878 server_cookie=44c73d89561631bf in_seq=0 out_seq=0 2024-09-19T07:54:38.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:38 smithi137 ceph-mon[35309]: pgmap v107: 97 pgs: 97 active+clean; 227 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-09-19T07:54:38.946 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:38 smithi076 ceph-mon[30930]: pgmap v107: 97 pgs: 97 active+clean; 227 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-09-19T07:54:39.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:38 smithi152 ceph-mon[35117]: pgmap v107: 97 pgs: 97 active+clean; 227 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-09-19T07:54:39.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:39 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:54:39.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:39 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:54:40.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:39 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:54:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:40 smithi137 ceph-mon[35309]: pgmap v108: 97 pgs: 97 active+clean; 232 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 321 op/s 2024-09-19T07:54:40.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:40 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:54:40.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:40 smithi076 ceph-mon[30930]: pgmap v108: 97 pgs: 97 active+clean; 232 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 321 op/s 2024-09-19T07:54:40.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:40 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:54:41.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:40 smithi152 ceph-mon[35117]: pgmap v108: 97 pgs: 97 active+clean; 232 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 321 op/s 2024-09-19T07:54:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:40 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:54:42.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:42 smithi137 ceph-mon[35309]: pgmap v109: 97 pgs: 97 active+clean; 232 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-09-19T07:54:42.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:42 smithi076 ceph-mon[30930]: pgmap v109: 97 pgs: 97 active+clean; 232 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-09-19T07:54:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:42 smithi152 ceph-mon[35117]: pgmap v109: 97 pgs: 97 active+clean; 232 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-09-19T07:54:44.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:44 smithi137 ceph-mon[35309]: pgmap v110: 97 pgs: 97 active+clean; 232 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 138 op/s 2024-09-19T07:54:44.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:44 smithi076 ceph-mon[30930]: pgmap v110: 97 pgs: 97 active+clean; 232 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 138 op/s 2024-09-19T07:54:45.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:44 smithi152 ceph-mon[35117]: pgmap v110: 97 pgs: 97 active+clean; 232 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 138 op/s 2024-09-19T07:54:45.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06c5ffb640 1 -- 172.21.15.76:0/24627539 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559bc3dd2d20 con 0x559bc3eebf10 2024-09-19T07:54:45.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06c5ffb640 10 client.16140 handle_command_reply: tid=0 2024-09-19T07:54:45.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 client.16140 shutdown 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 msgr2=0x559bc3e844d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 0x559bc3e844d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x559bc3e62b50 tx=0x7f06d000cef0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 shutdown_connections 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bc3e70940 0x559bc3eea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bc3eebf10 0x559bc3eee330 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bc3e66080 0x559bc3e844d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 --2- 172.21.15.76:0/24627539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bc3e65760 0x559bc3e83f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06c5ffb640 0 client.16140 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 >> 172.21.15.76:0/24627539 conn(0x559bc3e61cf0 msgr2=0x559bc3e6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 shutdown_connections 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 1 -- 172.21.15.76:0/24627539 wait complete. 2024-09-19T07:54:45.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.310+0000 7f06e6e21740 20 client.16140 trim_cache size 0 max 16384 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 31, 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 14, 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "6ce28f28": { 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 14, 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:54:45.312 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 136.6, 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "QUIESCED", 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:45.313 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:45.314 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:45.314 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:45.314 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:54:45.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f06cc0a33b0 msgr2=0x7f06cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f06cc0a33b0 0x7f06cc0a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06d80cdf80 tx=0x7f06d80672f0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 msgr2=0x7f06e019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 0x7f06e019ef60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f06d800cce0 tx=0x7f06d800a620 comp rx=0 tx=0).stop 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 shutdown_connections 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f06cc0a33b0 0x7f06cc0a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06e0102ef0 0x7f06e019ef60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e0102570 0x7f06e019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 --2- 172.21.15.76:0/2459690912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e0100e20 0x7f06e019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 >> 172.21.15.76:0/2459690912 conn(0x7f06e00fc7d0 msgr2=0x7f06e006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 shutdown_connections 2024-09-19T07:54:45.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:45.311+0000 7f06e4a48640 1 -- 172.21.15.76:0/2459690912 wait complete. 2024-09-19T07:54:46.346 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6ce28f28', quiesce took 10.2 seconds. Will release after: 6.400000000000002 2024-09-19T07:54:46.886 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:46 smithi076 ceph-mon[30930]: pgmap v111: 97 pgs: 97 active+clean; 244 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 563 op/s 2024-09-19T07:54:46.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:46 smithi137 ceph-mon[35309]: pgmap v111: 97 pgs: 97 active+clean; 244 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 563 op/s 2024-09-19T07:54:47.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:46 smithi152 ceph-mon[35117]: pgmap v111: 97 pgs: 97 active+clean; 244 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 563 op/s 2024-09-19T07:54:48.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:48 smithi137 ceph-mon[35309]: pgmap v112: 97 pgs: 97 active+clean; 244 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 439 op/s 2024-09-19T07:54:48.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:48 smithi076 ceph-mon[30930]: pgmap v112: 97 pgs: 97 active+clean; 244 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 439 op/s 2024-09-19T07:54:49.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:48 smithi152 ceph-mon[35117]: pgmap v112: 97 pgs: 97 active+clean; 244 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 439 op/s 2024-09-19T07:54:50.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:50 smithi137 ceph-mon[35309]: pgmap v113: 97 pgs: 97 active+clean; 251 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 495 op/s 2024-09-19T07:54:50.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:50 smithi076 ceph-mon[30930]: pgmap v113: 97 pgs: 97 active+clean; 251 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 495 op/s 2024-09-19T07:54:51.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:50 smithi152 ceph-mon[35117]: pgmap v113: 97 pgs: 97 active+clean; 251 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 495 op/s 2024-09-19T07:54:52.747 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:54:52.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:52 smithi137 ceph-mon[35309]: pgmap v114: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 483 op/s 2024-09-19T07:54:52.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:52 smithi076 ceph-mon[30930]: pgmap v114: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 483 op/s 2024-09-19T07:54:53.022 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:53.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:52 smithi152 ceph-mon[35117]: pgmap v114: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 483 op/s 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 -- 172.21.15.76:0/3227374437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18100e20 msgr2=0x7faa18101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 --2- 172.21.15.76:0/3227374437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18100e20 0x7faa18101200 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faa14009900 tx=0x7faa1402a480 comp rx=0 tx=0).stop 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 -- 172.21.15.76:0/3227374437 shutdown_connections 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 --2- 172.21.15.76:0/3227374437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 0x7faa1810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 --2- 172.21.15.76:0/3227374437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa18102570 0x7faa181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 --2- 172.21.15.76:0/3227374437 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18100e20 0x7faa18101200 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.538+0000 7faa200ec640 1 -- 172.21.15.76:0/3227374437 >> 172.21.15.76:0/3227374437 conn(0x7faa180fc7d0 msgr2=0x7faa180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 -- 172.21.15.76:0/3227374437 shutdown_connections 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 -- 172.21.15.76:0/3227374437 wait complete. 2024-09-19T07:54:53.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 Processor -- start 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 -- start start 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa18100e20 0x7faa181974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 0x7faa18197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 0x7faa1819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faa181110e0 con 0x7faa18102570 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa18110f60 con 0x7faa18102ef0 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa200ec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faa18111260 con 0x7faa18100e20 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.539+0000 7faa1d687640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 0x7faa18197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 0x7faa18197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54946/0 (socket says 172.21.15.76:54946) 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 -- 172.21.15.76:0/2151221180 learned_addr learned my addr 172.21.15.76:0/2151221180 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1e689640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 0x7faa1819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1de88640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa18100e20 0x7faa181974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:53.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 -- 172.21.15.76:0/2151221180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa18100e20 msgr2=0x7faa181974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa18100e20 0x7faa181974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 -- 172.21.15.76:0/2151221180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 msgr2=0x7faa1819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 0x7faa1819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 -- 172.21.15.76:0/2151221180 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1819c480 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1e689640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 0x7faa1819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa1d687640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 0x7faa18197a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7faa0800b4a0 tx=0x7faa0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08014070 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1819c770 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa08010b10 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08017d60 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.540+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa181a4050 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.541+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa18101200 con 0x7faa18102570 2024-09-19T07:54:53.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.542+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7faa08017070 con 0x7faa18102570 2024-09-19T07:54:53.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.543+0000 7faa0effd640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7faa040a33b0 0x7faa040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:53.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.543+0000 7faa1de88640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7faa040a33b0 0x7faa040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:53.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.543+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7faa080cf130 con 0x7faa18102570 2024-09-19T07:54:53.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.543+0000 7faa1de88640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7faa040a33b0 0x7faa040a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa14005ab0 tx=0x7faa14005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:53.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.547+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa0809bbc0 con 0x7faa18102570 2024-09-19T07:54:53.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.750+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa18109090 con 0x7faa18102570 2024-09-19T07:54:53.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.751+0000 7faa0effd640 1 -- 172.21.15.76:0/2151221180 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7faa0809b4c0 con 0x7faa18102570 2024-09-19T07:54:53.751 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:54:53.751 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:54:53.752 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:54:53.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7faa040a33b0 msgr2=0x7faa040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:53.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7faa040a33b0 0x7faa040a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa14005ab0 tx=0x7faa14005a20 comp rx=0 tx=0).stop 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 msgr2=0x7faa18197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 0x7faa18197a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7faa0800b4a0 tx=0x7faa0800b960 comp rx=0 tx=0).stop 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 shutdown_connections 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7faa040a33b0 0x7faa040a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa18102ef0 0x7faa1819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa18102570 0x7faa18197a10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 --2- 172.21.15.76:0/2151221180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa18100e20 0x7faa181974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.753+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 >> 172.21.15.76:0/2151221180 conn(0x7faa180fc7d0 msgr2=0x7faa18105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.754+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 shutdown_connections 2024-09-19T07:54:53.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:53.754+0000 7faa200ec640 1 -- 172.21.15.76:0/2151221180 wait complete. 2024-09-19T07:54:54.563 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db --set-id 6ce28f28 --release --await' 2024-09-19T07:54:54.563 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db --set-id 6ce28f28 --release --await 2024-09-19T07:54:54.811 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:54:54.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:54 smithi137 ceph-mon[35309]: pgmap v115: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 482 op/s 2024-09-19T07:54:54.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:54 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2151221180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:54.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:54 smithi076 ceph-mon[30930]: pgmap v115: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 482 op/s 2024-09-19T07:54:54.932 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:54 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2151221180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:55.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:54 smithi152 ceph-mon[35117]: pgmap v115: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 482 op/s 2024-09-19T07:54:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:54 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2151221180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:54:55.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 -- 172.21.15.76:0/289908110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10102790 msgr2=0x7f8b101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 --2- 172.21.15.76:0/289908110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10102790 0x7f8b101067e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009900 tx=0x7f8b0002a410 comp rx=0 tx=0).stop 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 -- 172.21.15.76:0/289908110 shutdown_connections 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 --2- 172.21.15.76:0/289908110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 0x7f8b1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 --2- 172.21.15.76:0/289908110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10102790 0x7f8b101067e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 --2- 172.21.15.76:0/289908110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10101de0 0x7f8b101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 -- 172.21.15.76:0/289908110 >> 172.21.15.76:0/289908110 conn(0x7f8b100fd8c0 msgr2=0x7f8b100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 -- 172.21.15.76:0/289908110 shutdown_connections 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.341+0000 7f8b18599640 1 -- 172.21.15.76:0/289908110 wait complete. 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 Processor -- start 2024-09-19T07:54:55.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 -- start start 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 0x7f8b10198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10102790 0x7f8b10198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 0x7f8b1019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10112150 con 0x7f8b10101de0 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10111fd0 con 0x7f8b10102790 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b18599640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101122d0 con 0x7f8b10106f10 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 0x7f8b10198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 0x7f8b10198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54968/0 (socket says 172.21.15.76:54968) 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 -- 172.21.15.76:0/2234744395 learned_addr learned my addr 172.21.15.76:0/2234744395 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b15b34640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10102790 0x7f8b10198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16b36640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 0x7f8b1019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 -- 172.21.15.76:0/2234744395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 msgr2=0x7f8b1019cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 0x7f8b1019cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 -- 172.21.15.76:0/2234744395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10102790 msgr2=0x7f8b10198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10102790 0x7f8b10198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16335640 1 -- 172.21.15.76:0/2234744395 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1019d600 con 0x7f8b10101de0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b16b36640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 0x7f8b1019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.342+0000 7f8b15b34640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10102790 0x7f8b10198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.343+0000 7f8b16335640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 0x7f8b10198650 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00b4a0 tx=0x7f8b0c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.343+0000 7f8b077fe640 1 -- 172.21.15.76:0/2234744395 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c014070 con 0x7f8b10101de0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.343+0000 7f8b077fe640 1 -- 172.21.15.76:0/2234744395 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b0c010b10 con 0x7f8b10101de0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.343+0000 7f8b077fe640 1 -- 172.21.15.76:0/2234744395 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c017d60 con 0x7f8b10101de0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.343+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1019d8f0 con 0x7f8b10101de0 2024-09-19T07:54:55.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.343+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b101a51d0 con 0x7f8b10101de0 2024-09-19T07:54:55.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.345+0000 7f8b077fe640 1 -- 172.21.15.76:0/2234744395 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8b0c017070 con 0x7f8b10101de0 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.345+0000 7f8b1a972740 1 Processor -- start 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 -- start start 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c84440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c8ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c91630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d908be9620 con 0x55d908c84060 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d908b90e50 con 0x55d908c8f240 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b1a972740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d908be55e0 con 0x55d908c84980 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c84440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b077fe640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8afc0a33b0 0x7f8afc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c84440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54970/0 (socket says 172.21.15.76:54970) 2024-09-19T07:54:55.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 -- 172.21.15.76:0/3678767439 learned_addr learned my addr 172.21.15.76:0/3678767439 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8afc0a33b0 0x7f8afc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b077fe640 1 -- 172.21.15.76:0/2234744395 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f8b0c0cf0c0 con 0x7f8b10101de0 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16335640 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c8ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c91630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 -- 172.21.15.76:0/3678767439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 msgr2=0x55d908c8ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c8ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 -- 172.21.15.76:0/3678767439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 msgr2=0x55d908c91630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c91630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.346+0000 7f8b16b36640 1 -- 172.21.15.76:0/3678767439 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d908b81d40 con 0x55d908c84060 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.347+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c91630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.347+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c84440 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f8b08010a30 tx=0x7f8b08010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a012d97beac62ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.347+0000 7f8b04ff9640 1 -- 172.21.15.76:0/3678767439 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08020070 con 0x55d908c84060 2024-09-19T07:54:55.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.347+0000 7f8b16b36640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8afc0a33b0 0x7f8afc0a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b0801d000 tx=0x7f8b08019000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.347+0000 7f8b04ff9640 1 -- 172.21.15.76:0/3678767439 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b0801bbd0 con 0x55d908c84060 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.347+0000 7f8b04ff9640 1 -- 172.21.15.76:0/3678767439 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800e5b0 con 0x55d908c84060 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 -- 172.21.15.76:0/3678767439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 msgr2=0x55d908c84440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c84440 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f8b08010a30 tx=0x7f8b08010ef0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 -- 172.21.15.76:0/3678767439 shutdown_connections 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c91630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c8ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3678767439 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c84440 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 -- 172.21.15.76:0/3678767439 >> 172.21.15.76:0/3678767439 conn(0x55d908c805f0 msgr2=0x55d908c809d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 -- 172.21.15.76:0/3678767439 shutdown_connections 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 -- 172.21.15.76:0/3678767439 wait complete. 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 -- start start 2024-09-19T07:54:55.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.348+0000 7f8b1a972740 1 Processor -- start 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 0x55d908c8c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c8cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d908c91e10 con 0x55d908c84980 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d908b71f10 con 0x55d908c8f240 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d908c91f90 con 0x55d908c84060 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 0x55d908c8c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 10 client.0 _ll_register_callbacks cb 0x55d908b95db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:55.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 0x55d908c8c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54986/0 (socket says 172.21.15.76:54986) 2024-09-19T07:54:55.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 -- 172.21.15.76:0/3730082440 learned_addr learned my addr 172.21.15.76:0/3730082440 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:55.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c8cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b16335640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 -- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 msgr2=0x55d908c8c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 -- 172.21.15.76:0/3730082440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 msgr2=0x55d908c8cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c8cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 -- 172.21.15.76:0/3730082440 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9088f8580 con 0x55d908c84980 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 0x55d908c8c6f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8b0002a930 tx=0x7f8b00004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d60fa37be49884 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8af9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3730082440 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0003f070 con 0x55d908c84980 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b0801bbd0 con 0x55d908c84980 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.349+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3730082440 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f8b000035f0 con 0x55d908c84980 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3730082440 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8b00035070 con 0x55d908c84980 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 10 client.16158 fetch_fsmap learned FSMap version 31 2024-09-19T07:54:55.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d9089c2960 con 0x55d908c84980 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3730082440 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b0801bbd0 con 0x55d908c84980 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3730082440 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f8b00044ab0 con 0x55d908c84980 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 10 client.16158 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 10 client.16158 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 20 client.16158 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908ca1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 4 client.16158 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d908bf6b90 con 0x55d908c9ee40 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.350+0000 7f8b16335640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908ca1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.351+0000 7f8b16335640 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908ca1250 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9cf9d1f7391bf8 server_cookie=7c91aeb20e839f1f in_seq=0 out_seq=0 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.351+0000 7f8af9ffb640 10 client.16158 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.351+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3730082440 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d908bf6b90 con 0x55d908c9ee40 2024-09-19T07:54:55.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.351+0000 7f8af9ffb640 10 client.16158 handle_command_reply: tid=0 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.351+0000 7f8b1a972740 1 client.16158 shutdown 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 msgr2=0x55d908c8c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 0x55d908c8c6f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8b0002a930 tx=0x7f8b00004060 comp rx=0 tx=0).stop 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 shutdown_connections 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908c8cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908ca1250 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8af9ffb640 0 client.16158 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84980 0x55d908c8c6f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3730082440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 >> 172.21.15.76:0/3730082440 conn(0x55d908c805f0 msgr2=0x55d908c862d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 shutdown_connections 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 1 -- 172.21.15.76:0/3730082440 wait complete. 2024-09-19T07:54:55.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.352+0000 7f8b1a972740 20 client.16158 trim_cache size 0 max 16384 2024-09-19T07:54:55.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.368+0000 7f8b1a972740 1 Processor -- start 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.368+0000 7f8b1a972740 1 -- start start 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c84980 0x55d908ca6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 0x55d908ca7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b1a972740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101b06b0 con 0x55d908c8f240 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b1a972740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101adec0 con 0x55d908c84980 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b1a972740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101abd10 con 0x55d908c84060 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 0x55d908ca7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 0x55d908ca7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54994/0 (socket says 172.21.15.76:54994) 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 -- 172.21.15.76:0/3438117982 learned_addr learned my addr 172.21.15.76:0/3438117982 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:55.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 -- 172.21.15.76:0/3438117982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 msgr2=0x55d908c8e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16335640 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 -- 172.21.15.76:0/3438117982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c84980 msgr2=0x55d908ca6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c84980 0x55d908ca6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c84980 0x55d908ca6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 -- 172.21.15.76:0/3438117982 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d908c8a700 con 0x55d908c8f240 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c84980 0x55d908ca6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 0x55d908ca7060 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8b080108d0 tx=0x7f8b08004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7c7c412d94931b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.369+0000 7f8afbfff640 1 -- 172.21.15.76:0/3438117982 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08032070 con 0x55d908c8f240 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8afbfff640 1 -- 172.21.15.76:0/3438117982 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b0801bbd0 con 0x55d908c8f240 2024-09-19T07:54:55.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8afbfff640 1 -- 172.21.15.76:0/3438117982 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08020040 con 0x55d908c8f240 2024-09-19T07:54:55.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 -- 172.21.15.76:0/3438117982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 msgr2=0x55d908ca7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 0x55d908ca7060 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8b080108d0 tx=0x7f8b08004b50 comp rx=0 tx=0).stop 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 -- 172.21.15.76:0/3438117982 shutdown_connections 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c8f240 0x55d908ca7060 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c84980 0x55d908ca6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3438117982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84060 0x55d908c8e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 -- 172.21.15.76:0/3438117982 >> 172.21.15.76:0/3438117982 conn(0x55d908c805f0 msgr2=0x55d908c8da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 -- 172.21.15.76:0/3438117982 shutdown_connections 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 -- 172.21.15.76:0/3438117982 wait complete. 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 -- start start 2024-09-19T07:54:55.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.370+0000 7f8b1a972740 1 Processor -- start 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c937b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c93cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908d02ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101ac380 con 0x55d908c84060 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101ad7f0 con 0x55d908c8f240 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b101aca50 con 0x55d908c84980 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 10 client.0 _ll_register_callbacks cb 0x7f8b00031a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c937b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55002/0 (socket says 172.21.15.76:55002) 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 -- 172.21.15.76:0/3149034775 learned_addr learned my addr 172.21.15.76:0/3149034775 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:54:55.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c93cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908d02ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 -- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 msgr2=0x55d908c93cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c93cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 -- 172.21.15.76:0/3149034775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 msgr2=0x55d908d02ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908d02ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 -- 172.21.15.76:0/3149034775 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d908d03100 con 0x55d908c84060 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16b36640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908d02ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b16335640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c937b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c09b150 tx=0x7f8b0c0177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b756e099f40e83c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8af9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3149034775 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c01e040 con 0x55d908c84060 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b0801bbd0 con 0x55d908c84060 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.371+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3149034775 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f8b0c010cc0 con 0x55d908c84060 2024-09-19T07:54:55.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3149034775 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8b0c0a40c0 con 0x55d908c84060 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 10 client.16164 fetch_fsmap learned FSMap version 31 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d908d0a420 con 0x55d908c84060 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3149034775 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b0801bbd0 con 0x55d908c84060 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3149034775 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f8b0c097ac0 con 0x55d908c84060 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 10 client.16164 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 10 client.16164 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 20 client.16164 populate_metadata read hostname 'smithi076' 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908d0cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 4 client.16164 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6ce28f28", "release": true, "await": true}] 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6ce28f28", "release": true, "await": true}) -- 0x55d908bf10a0 con 0x55d908c9ee40 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.372+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908d0cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:54:55.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.373+0000 7f8b15b34640 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908d0cb90 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0dfb3bef9a8295d server_cookie=da61b6ed20ddd9a6 in_seq=0 out_seq=0 2024-09-19T07:54:55.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.373+0000 7f8af9ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:55.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.601+0000 7f8af9ffb640 1 -- 172.21.15.76:0/3149034775 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d908bf10a0 con 0x55d908c9ee40 2024-09-19T07:54:55.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.601+0000 7f8af9ffb640 10 client.16164 handle_command_reply: tid=0 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.601+0000 7f8b1a972740 1 client.16164 shutdown 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.601+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 msgr2=0x55d908c937b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.601+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c937b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c09b150 tx=0x7f8b0c0177c0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 shutdown_connections 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d908c8f240 0x55d908d02ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d908c84980 0x55d908c93cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d908c9ee40 0x55d908d0cb90 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 --2- 172.21.15.76:0/3149034775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d908c84060 0x55d908c937b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 >> 172.21.15.76:0/3149034775 conn(0x55d908c805f0 msgr2=0x55d908c7f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8af9ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:54:55.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 shutdown_connections 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 1 -- 172.21.15.76:0/3149034775 wait complete. 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b1a972740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 31, 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 16, 2024-09-19T07:54:55.604 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": { 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "6ce28f28": { 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "version": 16, 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "age_ref": 0.0, 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "timeout": 90.0, 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "expiration": 136.6, 2024-09-19T07:54:55.605 INFO:teuthology.orchestra.run.smithi076.stdout: "members": { 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: "file:/": { 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: "excluded": false, 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: "state": { 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RELEASED", 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 0.0 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:55.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:55.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:54:55.607 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:54:55.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8afc0a33b0 msgr2=0x7f8afc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8afc0a33b0 0x7f8afc0a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b0801d000 tx=0x7f8b08019000 comp rx=0 tx=0).stop 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 msgr2=0x7f8b10198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 0x7f8b10198650 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00b4a0 tx=0x7f8b0c00b960 comp rx=0 tx=0).stop 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 shutdown_connections 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8afc0a33b0 0x7f8afc0a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b10106f10 0x7f8b1019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b10102790 0x7f8b10198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.602+0000 7f8b18599640 1 --2- 172.21.15.76:0/2234744395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b10101de0 0x7f8b10198650 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:54:55.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.603+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 >> 172.21.15.76:0/2234744395 conn(0x7f8b100fd8c0 msgr2=0x7f8b100fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:54:55.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.603+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 shutdown_connections 2024-09-19T07:54:55.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:54:55.603+0000 7f8b18599640 1 -- 172.21.15.76:0/2234744395 wait complete. 2024-09-19T07:54:56.169 INFO:tasks.workunit.client.0.smithi076.stderr:+ sync 2024-09-19T07:54:56.665 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6ce28f28', total seconds elapsed: 20.5 2024-09-19T07:54:56.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:56 smithi137 ceph-mon[35309]: pgmap v116: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 486 op/s 2024-09-19T07:54:56.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:56 smithi076 ceph-mon[30930]: pgmap v116: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 486 op/s 2024-09-19T07:54:57.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:56 smithi152 ceph-mon[35117]: pgmap v116: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 486 op/s 2024-09-19T07:54:57.327 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar c linux-4.0.5 2024-09-19T07:54:57.658 INFO:tasks.workunit.client.0.smithi076.stdout:Ok 2024-09-19T07:54:57.659 INFO:tasks.workunit.client.0.smithi076.stderr:+ echo Ok 2024-09-19T07:54:57.659 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T07:54:57.660 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T07:54:58.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:54:58 smithi137 ceph-mon[35309]: pgmap v117: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 575 KiB/s wr, 61 op/s 2024-09-19T07:54:58.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:54:58 smithi076 ceph-mon[30930]: pgmap v117: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 575 KiB/s wr, 61 op/s 2024-09-19T07:54:59.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:54:58 smithi152 ceph-mon[35117]: pgmap v117: 97 pgs: 97 active+clean; 251 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 575 KiB/s wr, 61 op/s 2024-09-19T07:55:00.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:00 smithi137 ceph-mon[35309]: pgmap v118: 97 pgs: 97 active+clean; 269 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 2.1 MiB/s wr, 199 op/s 2024-09-19T07:55:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:00 smithi076 ceph-mon[30930]: pgmap v118: 97 pgs: 97 active+clean; 269 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 2.1 MiB/s wr, 199 op/s 2024-09-19T07:55:01.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:00 smithi152 ceph-mon[35117]: pgmap v118: 97 pgs: 97 active+clean; 269 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 2.1 MiB/s wr, 199 op/s 2024-09-19T07:55:01.346 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:55:01.602 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:02.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 -- 172.21.15.76:0/695518566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0102ef0 msgr2=0x7f05f010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 --2- 172.21.15.76:0/695518566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0102ef0 0x7f05f010da40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009ca0 tx=0x7f05e802a950 comp rx=0 tx=0).stop 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 -- 172.21.15.76:0/695518566 shutdown_connections 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 --2- 172.21.15.76:0/695518566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0102ef0 0x7f05f010da40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 --2- 172.21.15.76:0/695518566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102570 0x7f05f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 --2- 172.21.15.76:0/695518566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0100e20 0x7f05f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 -- 172.21.15.76:0/695518566 >> 172.21.15.76:0/695518566 conn(0x7f05f00fc7d0 msgr2=0x7f05f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 -- 172.21.15.76:0/695518566 shutdown_connections 2024-09-19T07:55:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.225+0000 7f05f4be0640 1 -- 172.21.15.76:0/695518566 wait complete. 2024-09-19T07:55:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 Processor -- start 2024-09-19T07:55:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 -- start start 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 0x7f05f00fe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0102570 0x7f05f00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102ef0 0x7f05f00fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05f0111100 con 0x7f05f0100e20 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f0110f80 con 0x7f05f0102570 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05f4be0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05f0111280 con 0x7f05f0102ef0 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05ee59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 0x7f05f00fe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05ee59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 0x7f05f00fe8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55032/0 (socket says 172.21.15.76:55032) 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05ee59c640 1 -- 172.21.15.76:0/1811185438 learned_addr learned my addr 172.21.15.76:0/1811185438 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.226+0000 7f05eed9d640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102ef0 0x7f05f00fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05edd9b640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0102570 0x7f05f00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05ee59c640 1 -- 172.21.15.76:0/1811185438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102ef0 msgr2=0x7f05f00fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05ee59c640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102ef0 0x7f05f00fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05ee59c640 1 -- 172.21.15.76:0/1811185438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0102570 msgr2=0x7f05f00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05ee59c640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0102570 0x7f05f00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05ee59c640 1 -- 172.21.15.76:0/1811185438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f01aafc0 con 0x7f05f0100e20 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05eed9d640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102ef0 0x7f05f00fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05edd9b640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0102570 0x7f05f00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05ee59c640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 0x7f05f00fe8c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b4a0 tx=0x7f05e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05df7fe640 1 -- 172.21.15.76:0/1811185438 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0014070 con 0x7f05f0100e20 2024-09-19T07:55:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f01ab1f0 con 0x7f05f0100e20 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05df7fe640 1 -- 172.21.15.76:0/1811185438 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05e0010b10 con 0x7f05f0100e20 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05df7fe640 1 -- 172.21.15.76:0/1811185438 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0017d60 con 0x7f05f0100e20 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.227+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f01ab780 con 0x7f05f0100e20 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 Processor -- start 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 -- start start 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 0x5623d5168880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5173140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5173680 0x5623d5175a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5623d50ce2e0 con 0x5623d5168dc0 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5623d5075ce0 con 0x5623d5173680 2024-09-19T07:55:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5623d50ca2a0 con 0x5623d51684a0 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.230+0000 7f05df7fe640 1 -- 172.21.15.76:0/1811185438 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f05e0017070 con 0x7f05f0100e20 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 0x5623d5168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 0x5623d5168880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:52380/0 (socket says 172.21.15.76:52380) 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 -- 172.21.15.76:0/2563512704 learned_addr learned my addr 172.21.15.76:0/2563512704 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05edd9b640 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5173680 0x5623d5175a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 -- 172.21.15.76:0/2563512704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5173680 msgr2=0x5623d5175a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5173680 0x5623d5175a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 -- 172.21.15.76:0/2563512704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 msgr2=0x5623d5173140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5173140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 -- 172.21.15.76:0/2563512704 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d505a440 con 0x5623d51684a0 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.231+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 0x5623d5168880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05e8005fe0 tx=0x7f05e8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f4141a08d87d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.232+0000 7f05dcff9640 1 -- 172.21.15.76:0/2563512704 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8048070 con 0x5623d51684a0 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.232+0000 7f05dcff9640 1 -- 172.21.15.76:0/2563512704 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05e8003970 con 0x5623d51684a0 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.232+0000 7f05dcff9640 1 -- 172.21.15.76:0/2563512704 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8034040 con 0x5623d51684a0 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.232+0000 7f05df7fe640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05d80a33b0 0x7f05d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.232+0000 7f05ee59c640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05d80a33b0 0x7f05d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.232+0000 7f05df7fe640 1 -- 172.21.15.76:0/1811185438 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f05e00cf040 con 0x7f05f0100e20 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2563512704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 msgr2=0x5623d5168880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 0x5623d5168880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05e8005fe0 tx=0x7f05e8009920 comp rx=0 tx=0).stop 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2563512704 shutdown_connections 2024-09-19T07:55:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5173680 0x5623d5175a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5173140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2563512704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d51684a0 0x5623d5168880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2563512704 >> 172.21.15.76:0/2563512704 conn(0x5623d5164a30 msgr2=0x5623d5164e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05ee59c640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05d80a33b0 0x7f05d80a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5623d5165890 tx=0x7f05e0090860 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2563512704 shutdown_connections 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2563512704 wait complete. 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 -- start start 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.233+0000 7f05f6fb9740 1 Processor -- start 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 0x5623d5172fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5168dc0 0x5623d5170250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5170790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5623d5176250 con 0x5623d51684a0 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5623d5089050 con 0x5623d5168dc0 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5623d51763d0 con 0x5623d5173680 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 0x5623d5172fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05f6fb9740 10 client.0 _ll_register_callbacks cb 0x5623d50c9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 0x5623d5172fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55046/0 (socket says 172.21.15.76:55046) 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 -- 172.21.15.76:0/789723353 learned_addr learned my addr 172.21.15.76:0/789723353 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05edd9b640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5168dc0 0x5623d5170250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5170790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 -- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 msgr2=0x5623d5170790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5170790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 -- 172.21.15.76:0/789723353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5168dc0 msgr2=0x5623d5170250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5168dc0 0x5623d5170250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 -- 172.21.15.76:0/789723353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d4e3f3c0 con 0x5623d51684a0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05eed9d640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 0x5623d5172fa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ae70 tx=0x7f05e80043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3819a51957104f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.234+0000 7f05d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05d5ffb640 1 -- 172.21.15.76:0/789723353 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8053060 con 0x5623d51684a0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05d5ffb640 1 -- 172.21.15.76:0/789723353 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f05e8004770 con 0x5623d51684a0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e8003970 con 0x5623d51684a0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05d5ffb640 1 -- 172.21.15.76:0/789723353 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f05e8048040 con 0x5623d51684a0 2024-09-19T07:55:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 10 client.16173 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5623d5181bd0 con 0x5623d51684a0 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05d5ffb640 1 -- 172.21.15.76:0/789723353 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05e8003970 con 0x5623d51684a0 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05d5ffb640 1 -- 172.21.15.76:0/789723353 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f05e803a430 con 0x5623d51684a0 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 10 client.16173 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 20 client.16173 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d5182f20 0x5623d5185310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 4 client.16173 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623d50db850 con 0x5623d5182f20 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.235+0000 7f05edd9b640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d5182f20 0x5623d5185310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.236+0000 7f05d5ffb640 10 client.16173 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.236+0000 7f05edd9b640 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d5182f20 0x5623d5185310 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51fd1c5a38addc5c server_cookie=e01b2957ae0571ce in_seq=0 out_seq=0 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.237+0000 7f05d5ffb640 1 -- 172.21.15.76:0/789723353 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623d50db850 con 0x5623d5182f20 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.237+0000 7f05d5ffb640 10 client.16173 handle_command_reply: tid=0 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.237+0000 7f05f6fb9740 1 client.16173 shutdown 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 msgr2=0x5623d5172fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 0x5623d5172fa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ae70 tx=0x7f05e80043e0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 shutdown_connections 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5170790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d5168dc0 0x5623d5170250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d5182f20 0x5623d5185310 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/789723353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d51684a0 0x5623d5172fa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 >> 172.21.15.76:0/789723353 conn(0x5623d5164a30 msgr2=0x5623d516a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:02.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05d5ffb640 0 client.16173 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:02.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 shutdown_connections 2024-09-19T07:55:02.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 1 -- 172.21.15.76:0/789723353 wait complete. 2024-09-19T07:55:02.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.238+0000 7f05f6fb9740 20 client.16173 trim_cache size 0 max 16384 2024-09-19T07:55:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 Processor -- start 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 -- start start 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d516eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5188880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05f01b6b80 con 0x5623d5168dc0 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f01b4390 con 0x5623d51684a0 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05f01b21e0 con 0x5623d5173680 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05edd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05edd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55052/0 (socket says 172.21.15.76:55052) 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05edd9b640 1 -- 172.21.15.76:0/2656964933 learned_addr learned my addr 172.21.15.76:0/2656964933 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5188880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d516eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 -- 172.21.15.76:0/2656964933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 msgr2=0x5623d516eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d516eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 -- 172.21.15.76:0/2656964933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 msgr2=0x5623d5188340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.257+0000 7f05eed9d640 1 -- 172.21.15.76:0/2656964933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d516f200 con 0x5623d5173680 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.258+0000 7f05edd9b640 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:02.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.258+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5188880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05e803a9a0 tx=0x7f05e8045040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e823e1047688190e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.258+0000 7f05d7fff640 1 -- 172.21.15.76:0/2656964933 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8053070 con 0x5623d5173680 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.258+0000 7f05d7fff640 1 -- 172.21.15.76:0/2656964933 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05e80098c0 con 0x5623d5173680 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.258+0000 7f05d7fff640 1 -- 172.21.15.76:0/2656964933 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8034040 con 0x5623d5173680 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2656964933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 msgr2=0x5623d5188880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5188880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05e803a9a0 tx=0x7f05e8045040 comp rx=0 tx=0).stop 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2656964933 shutdown_connections 2024-09-19T07:55:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d5188880 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2656964933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d516eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2656964933 >> 172.21.15.76:0/2656964933 conn(0x5623d5164a30 msgr2=0x5623d5163b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2656964933 shutdown_connections 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2656964933 wait complete. 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 -- start start 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 Processor -- start 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.259+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d5188030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05f6fb9740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d51e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f05f01b2850 con 0x5623d5168dc0 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f01b3cc0 con 0x5623d51684a0 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05f6fb9740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05f01b2f20 con 0x5623d5173680 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05f6fb9740 10 client.0 _ll_register_callbacks cb 0x7f05e8046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55066/0 (socket says 172.21.15.76:55066) 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 -- 172.21.15.76:0/2085491419 learned_addr learned my addr 172.21.15.76:0/2085491419 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d51e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d5188030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 -- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 msgr2=0x5623d51e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d51e4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 -- 172.21.15.76:0/2085491419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 msgr2=0x5623d5188030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d5188030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 -- 172.21.15.76:0/2085491419 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d51e5390 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d51e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05edd9b640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188570 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f05e40095e0 tx=0x7f05e4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b042102ac17da4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.260+0000 7f05d5ffb640 1 -- 172.21.15.76:0/2085491419 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e401e380 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05d5ffb640 1 -- 172.21.15.76:0/2085491419 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f05e401e520 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e80098c0 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05d5ffb640 1 -- 172.21.15.76:0/2085491419 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f05e402d050 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 10 client.16179 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5623d51ed930 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05d5ffb640 1 -- 172.21.15.76:0/2085491419 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05e401ec20 con 0x5623d5168dc0 2024-09-19T07:55:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05d5ffb640 1 -- 172.21.15.76:0/2085491419 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f05e400f040 con 0x5623d5168dc0 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 10 client.16179 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 20 client.16179 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d51ee100 0x5623d51f0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 4 client.16179 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f05e80098c0 con 0x5623d51ee100 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.261+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d51ee100 0x5623d51f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.262+0000 7f05eed9d640 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d51ee100 0x5623d51f0520 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cce44fda0eead18 server_cookie=91a1804cbd58de2f in_seq=0 out_seq=0 2024-09-19T07:55:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.262+0000 7f05d5ffb640 10 client.16179 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.263+0000 7f05d5ffb640 1 -- 172.21.15.76:0/2085491419 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f05e80098c0 con 0x5623d51ee100 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.263+0000 7f05d5ffb640 10 client.16179 handle_command_reply: tid=0 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.263+0000 7f05f6fb9740 1 client.16179 shutdown 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 msgr2=0x5623d5188570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188570 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f05e40095e0 tx=0x7f05e4004410 comp rx=0 tx=0).stop 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 shutdown_connections 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623d5173680 0x5623d51e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5623d51ee100 0x5623d51f0520 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05d5ffb640 0 client.16179 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5623d5168dc0 0x5623d5188570 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 --2- 172.21.15.76:0/2085491419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5623d51684a0 0x5623d5188030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 >> 172.21.15.76:0/2085491419 conn(0x5623d5164a30 msgr2=0x5623d5163b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 shutdown_connections 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 1 -- 172.21.15.76:0/2085491419 wait complete. 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f6fb9740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:55:02.270 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:02.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05d80a33b0 msgr2=0x7f05d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f4be0640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05d80a33b0 0x7f05d80a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5623d5165890 tx=0x7f05e0090860 comp rx=0 tx=0).stop 2024-09-19T07:55:02.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 msgr2=0x7f05f00fe8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:02.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.264+0000 7f05f4be0640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 0x7f05f00fe8c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b4a0 tx=0x7f05e000b960 comp rx=0 tx=0).stop 2024-09-19T07:55:02.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 shutdown_connections 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f05d80a33b0 0x7f05d80a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05f0102ef0 0x7f05f00fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f0102570 0x7f05f00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 --2- 172.21.15.76:0/1811185438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f05f0100e20 0x7f05f00fe8c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 >> 172.21.15.76:0/1811185438 conn(0x7f05f00fc7d0 msgr2=0x7f05f006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 shutdown_connections 2024-09-19T07:55:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:02.265+0000 7f05f4be0640 1 -- 172.21.15.76:0/1811185438 wait complete. 2024-09-19T07:55:02.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:02 smithi137 ceph-mon[35309]: pgmap v119: 97 pgs: 97 active+clean; 270 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-09-19T07:55:02.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:02 smithi076 ceph-mon[30930]: pgmap v119: 97 pgs: 97 active+clean; 270 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-09-19T07:55:03.058 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:55:03.058 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:55:03.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:02 smithi152 ceph-mon[35117]: pgmap v119: 97 pgs: 97 active+clean; 270 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-09-19T07:55:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:03.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/1730895420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f281082a0 msgr2=0x7f8f2810ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:03.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/1730895420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f281082a0 0x7f8f2810ec10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009cd0 tx=0x7f8f2002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:55:03.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/1730895420 shutdown_connections 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/1730895420 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f281082a0 0x7f8f2810ec10 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/1730895420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f28103720 0x7f8f28107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/1730895420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f28102d70 0x7f8f28103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/1730895420 >> 172.21.15.76:0/1730895420 conn(0x7f8f280fc7d0 msgr2=0x7f8f280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/1730895420 shutdown_connections 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/1730895420 wait complete. 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 Processor -- start 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 -- start start 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f28102d70 0x7f8f281009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 0x7f8f28100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.819+0000 7f8f2f0e4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f281082a0 0x7f8f28101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:03.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f2f0e4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8f281121e0 con 0x7f8f28103720 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f2f0e4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28112060 con 0x7f8f281082a0 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f2f0e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28112360 con 0x7f8f28102d70 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 0x7f8f28100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 0x7f8f28100f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34056/0 (socket says 172.21.15.76:34056) 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 -- 172.21.15.76:0/2224025403 learned_addr learned my addr 172.21.15.76:0/2224025403 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f2ce80640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f28102d70 0x7f8f281009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f2d681640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f281082a0 0x7f8f28101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 -- 172.21.15.76:0/2224025403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f28102d70 msgr2=0x7f8f281009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f28102d70 0x7f8f281009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 -- 172.21.15.76:0/2224025403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f281082a0 msgr2=0x7f8f28101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f281082a0 0x7f8f28101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:03.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 -- 172.21.15.76:0/2224025403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f281a6a40 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1ffff640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 0x7f8f28100f10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800d750 tx=0x7f8f1800db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18017070 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f281a6d30 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f18009820 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.820+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18020060 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.821+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f281a7210 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.822+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f28103150 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.823+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8f180099d0 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.823+0000 7f8f1dffb640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f100a33b0 0x7f8f100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.823+0000 7f8f2ce80640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f100a33b0 0x7f8f100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.823+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f8f180cf620 con 0x7f8f28103720 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.824+0000 7f8f2ce80640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f100a33b0 0x7f8f100a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400abe0 tx=0x7f8f2400a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:03.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:03.828+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f1809bfa0 con 0x7f8f28103720 2024-09-19T07:55:04.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.046+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f281a7440 con 0x7f8f28103720 2024-09-19T07:55:04.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.047+0000 7f8f1dffb640 1 -- 172.21.15.76:0/2224025403 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7f8f1809b8a0 con 0x7f8f28103720 2024-09-19T07:55:04.047 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:55:04.048 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:55:04.048 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:55:04.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f100a33b0 msgr2=0x7f8f100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:04.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f100a33b0 0x7f8f100a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400abe0 tx=0x7f8f2400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:55:04.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 msgr2=0x7f8f28100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 0x7f8f28100f10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800d750 tx=0x7f8f1800db50 comp rx=0 tx=0).stop 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 shutdown_connections 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f100a33b0 0x7f8f100a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f281082a0 0x7f8f28101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f28103720 0x7f8f28100f10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 --2- 172.21.15.76:0/2224025403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f28102d70 0x7f8f281009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 >> 172.21.15.76:0/2224025403 conn(0x7f8f280fc7d0 msgr2=0x7f8f280fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 shutdown_connections 2024-09-19T07:55:04.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:04.049+0000 7f8f2f0e4640 1 -- 172.21.15.76:0/2224025403 wait complete. 2024-09-19T07:55:04.794 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:55:04.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:04 smithi137 ceph-mon[35309]: pgmap v120: 97 pgs: 97 active+clean; 270 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.7 MiB/s wr, 158 op/s 2024-09-19T07:55:04.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:04 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2224025403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:04.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:04 smithi076 ceph-mon[30930]: pgmap v120: 97 pgs: 97 active+clean; 270 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.7 MiB/s wr, 158 op/s 2024-09-19T07:55:04.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:04 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2224025403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:05.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:04 smithi152 ceph-mon[35117]: pgmap v120: 97 pgs: 97 active+clean; 270 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.7 MiB/s wr, 158 op/s 2024-09-19T07:55:05.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:04 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2224025403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:05.065 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:05.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 -- 172.21.15.76:0/3140928248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 msgr2=0x7f80ac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/3140928248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac1067e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f809c009900 tx=0x7f809c02a410 comp rx=0 tx=0).stop 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 -- 172.21.15.76:0/3140928248 shutdown_connections 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/3140928248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac106f10 0x7f80ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/3140928248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac1067e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/3140928248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 0x7f80ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 -- 172.21.15.76:0/3140928248 >> 172.21.15.76:0/3140928248 conn(0x7f80ac0fd8c0 msgr2=0x7f80ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 -- 172.21.15.76:0/3140928248 shutdown_connections 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 -- 172.21.15.76:0/3140928248 wait complete. 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 Processor -- start 2024-09-19T07:55:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 -- start start 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.561+0000 7f80b3a1e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 0x7f80ac1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac106f10 0x7f80ac19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac112090 con 0x7f80ac102790 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac111f10 con 0x7f80ac101de0 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac112210 con 0x7f80ac106f10 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34072/0 (socket says 172.21.15.76:34072) 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 -- 172.21.15.76:0/2669422510 learned_addr learned my addr 172.21.15.76:0/2669422510 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b17ba640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 0x7f80ac1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac106f10 0x7f80ac19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 -- 172.21.15.76:0/2669422510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac106f10 msgr2=0x7f80ac19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac106f10 0x7f80ac19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 -- 172.21.15.76:0/2669422510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 msgr2=0x7f80ac1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 0x7f80ac1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 -- 172.21.15.76:0/2669422510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac19d470 con 0x7f80ac102790 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b17ba640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 0x7f80ac1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac198a00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f809c006010 tx=0x7f809c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:05.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80a27fc640 1 -- 172.21.15.76:0/2669422510 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c03f030 con 0x7f80ac102790 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80a27fc640 1 -- 172.21.15.76:0/2669422510 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f809c0044c0 con 0x7f80ac102790 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ac19d700 con 0x7f80ac102790 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80a27fc640 1 -- 172.21.15.76:0/2669422510 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c035070 con 0x7f80ac102790 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.562+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ac074420 con 0x7f80ac102790 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80a27fc640 1 -- 172.21.15.76:0/2669422510 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f809c042030 con 0x7f80ac102790 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 Processor -- start 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 -- start start 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 0x55f8565fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fb5d0 0x55f8565fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856608760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f8565612f0 con 0x55f856606370 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f856508cf0 con 0x55f8565fb5d0 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.565+0000 7f80b5df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f85655d2b0 con 0x55f8565fcb40 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b0fb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856608760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 0x55f8565fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 0x55f8565fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:35472/0 (socket says 172.21.15.76:35472) 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 -- 172.21.15.76:0/1240520664 learned_addr learned my addr 172.21.15.76:0/1240520664 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b17ba640 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fb5d0 0x55f8565fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80a27fc640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80980a77c0 0x7f80980a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 -- 172.21.15.76:0/1240520664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fb5d0 msgr2=0x55f8565fba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fb5d0 0x55f8565fba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 -- 172.21.15.76:0/1240520664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 msgr2=0x55f856608760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856608760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 -- 172.21.15.76:0/1240520664 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8564ed3a0 con 0x55f8565fcb40 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856608760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80980a77c0 0x7f80980a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80a27fc640 1 -- 172.21.15.76:0/2669422510 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f809c0efff0 con 0x7f80ac102790 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 0x55f8565fb090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80a4011590 tx=0x7f80a4011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52f1c653b299101 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80980a77c0 0x7f80980a9c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80a4022000 tx=0x7f80a4023000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.566+0000 7f80977fe640 1 -- 172.21.15.76:0/1240520664 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4017050 con 0x55f8565fcb40 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80977fe640 1 -- 172.21.15.76:0/1240520664 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80a401bb90 con 0x55f8565fcb40 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80977fe640 1 -- 172.21.15.76:0/1240520664 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a400e610 con 0x55f8565fcb40 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 -- 172.21.15.76:0/1240520664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 msgr2=0x55f8565fb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 0x55f8565fb090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80a4011590 tx=0x7f80a4011a50 comp rx=0 tx=0).stop 2024-09-19T07:55:05.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 -- 172.21.15.76:0/1240520664 shutdown_connections 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856608760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fb5d0 0x55f8565fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 --2- 172.21.15.76:0/1240520664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fcb40 0x55f8565fb090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 -- 172.21.15.76:0/1240520664 >> 172.21.15.76:0/1240520664 conn(0x55f8565c4310 msgr2=0x55f8565f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 -- 172.21.15.76:0/1240520664 shutdown_connections 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.567+0000 7f80b5df7740 1 -- 172.21.15.76:0/1240520664 wait complete. 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 -- start start 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 Processor -- start 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f856605d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f856603040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856603650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f856609070 con 0x55f856606370 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f85651c060 con 0x55f8565fcb40 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f8566091f0 con 0x55f8565fb5d0 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b5df7740 10 client.0 _ll_register_callbacks cb 0x55f85626f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b1fbb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856603650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b1fbb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856603650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34096/0 (socket says 172.21.15.76:34096) 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b17ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f856605d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b1fbb640 1 -- 172.21.15.76:0/3077004877 learned_addr learned my addr 172.21.15.76:0/3077004877 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f856603040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.568+0000 7f80b1fbb640 1 -- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 msgr2=0x55f856605d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f856605d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b1fbb640 1 -- 172.21.15.76:0/3077004877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 msgr2=0x55f856603040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f856603040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b1fbb640 1 -- 172.21.15.76:0/3077004877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8562d23c0 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856603650 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f80a40258a0 tx=0x7f80a40258d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2d9cfd088793e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f8094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f8094ff9640 1 -- 172.21.15.76:0/3077004877 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4009c50 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a401bb90 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f8094ff9640 1 -- 172.21.15.76:0/3077004877 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f80a4025e00 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f8094ff9640 1 -- 172.21.15.76:0/3077004877 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80a4017030 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b5df7740 10 client.16197 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f856614b40 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f8094ff9640 1 -- 172.21.15.76:0/3077004877 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80a401bb90 con 0x55f856606370 2024-09-19T07:55:05.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f8094ff9640 1 -- 172.21.15.76:0/3077004877 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f80a4005740 con 0x55f856606370 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b5df7740 10 client.16197 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.569+0000 7f80b5df7740 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f80b5df7740 20 client.16197 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f80b5df7740 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856618280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f80b5df7740 4 client.16197 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f85656e860 con 0x55f856615e90 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f80b17ba640 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856618280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f8094ff9640 10 client.16197 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.570+0000 7f80b17ba640 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856618280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e79097ff6d976e05 server_cookie=7744a7e01bc1e955 in_seq=0 out_seq=0 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f8094ff9640 1 -- 172.21.15.76:0/3077004877 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f85656e860 con 0x55f856615e90 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f8094ff9640 10 client.16197 handle_command_reply: tid=0 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 client.16197 shutdown 2024-09-19T07:55:05.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 msgr2=0x55f856603650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856603650 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f80a40258a0 tx=0x7f80a40258d0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 shutdown_connections 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856618280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f856606370 0x55f856603650 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f856603040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f8094ff9640 0 client.16197 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 --2- 172.21.15.76:0/3077004877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f856605d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 >> 172.21.15.76:0/3077004877 conn(0x55f8565c4310 msgr2=0x55f8565fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 shutdown_connections 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.571+0000 7f80b5df7740 1 -- 172.21.15.76:0/3077004877 wait complete. 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.572+0000 7f80b5df7740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.584+0000 7f80b5df7740 1 Processor -- start 2024-09-19T07:55:05.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.584+0000 7f80b5df7740 1 -- start start 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f8565f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 0x55f8565fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f856606370 0x55f8565fe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b5df7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1ae2a0 con 0x55f8565fcb40 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b5df7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1abab0 con 0x55f856606370 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b5df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1a9900 con 0x55f8565fb5d0 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 0x55f8565fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 0x55f8565fe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34104/0 (socket says 172.21.15.76:34104) 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 -- 172.21.15.76:0/316096190 learned_addr learned my addr 172.21.15.76:0/316096190 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b17ba640 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f8565f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 -- 172.21.15.76:0/316096190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 msgr2=0x55f8565f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f856606370 0x55f8565fe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f8565f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 -- 172.21.15.76:0/316096190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f856606370 msgr2=0x55f8565fe660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f856606370 0x55f8565fe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 -- 172.21.15.76:0/316096190 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f856601590 con 0x55f8565fcb40 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b17ba640 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f8565f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 0x55f8565fe120 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f809c0bc020 tx=0x7f809c0b86f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d25a4f7304ec2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f8096ffd640 1 -- 172.21.15.76:0/316096190 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c049070 con 0x55f8565fcb40 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f8096ffd640 1 -- 172.21.15.76:0/316096190 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f809c003e10 con 0x55f8565fcb40 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.585+0000 7f8096ffd640 1 -- 172.21.15.76:0/316096190 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c0b8990 con 0x55f8565fcb40 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 -- 172.21.15.76:0/316096190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 msgr2=0x55f8565fe120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 0x55f8565fe120 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f809c0bc020 tx=0x7f809c0b86f0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 -- 172.21.15.76:0/316096190 shutdown_connections 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f856606370 0x55f8565fe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fcb40 0x55f8565fe120 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 --2- 172.21.15.76:0/316096190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8565fb5d0 0x55f8565f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 -- 172.21.15.76:0/316096190 >> 172.21.15.76:0/316096190 conn(0x55f8565c4310 msgr2=0x55f8566050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 -- 172.21.15.76:0/316096190 shutdown_connections 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 -- 172.21.15.76:0/316096190 wait complete. 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 -- start start 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.586+0000 7f80b5df7740 1 Processor -- start 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 0x55f85660a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f85660a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f856606370 0x55f85660acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1a9f70 con 0x55f8565fb5d0 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1ab3e0 con 0x55f8565fcb40 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1aa640 con 0x55f856606370 2024-09-19T07:55:05.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b5df7740 10 client.0 _ll_register_callbacks cb 0x7f80a4011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:05.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 0x55f85660a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 0x55f85660a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34110/0 (socket says 172.21.15.76:34110) 2024-09-19T07:55:05.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 -- 172.21.15.76:0/4104051566 learned_addr learned my addr 172.21.15.76:0/4104051566 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:05.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b1fbb640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f856606370 0x55f85660acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f85660a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 -- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f856606370 msgr2=0x55f85660acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f856606370 0x55f85660acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 -- 172.21.15.76:0/4104051566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 msgr2=0x55f85660a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f85660a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.587+0000 7f80b17ba640 1 -- 172.21.15.76:0/4104051566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85667fa60 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b17ba640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 0x55f85660a230 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f80a8012a50 tx=0x7f80a8012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993d0db809ad87ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f8094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f8094ff9640 1 -- 172.21.15.76:0/4104051566 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a801daa0 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f8094ff9640 1 -- 172.21.15.76:0/4104051566 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f80a801dc40 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f856568d70 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f8094ff9640 1 -- 172.21.15.76:0/4104051566 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80a801de40 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 10 client.16203 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f856680d40 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f8094ff9640 1 -- 172.21.15.76:0/4104051566 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55f856568d70 con 0x55f8565fb5d0 2024-09-19T07:55:05.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f8094ff9640 1 -- 172.21.15.76:0/4104051566 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f80a80106d0 con 0x55f8565fb5d0 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 10 client.16203 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 20 client.16203 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856683530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 4 client.16203 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.588+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8564e5170 con 0x55f856615e90 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856683530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f8094ff9640 10 client.16203 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b0fb9640 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856683530 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85ec388297357223 server_cookie=8706a01aebda6eda in_seq=0 out_seq=0 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f8094ff9640 1 -- 172.21.15.76:0/4104051566 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f8564e5170 con 0x55f856615e90 2024-09-19T07:55:05.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f8094ff9640 10 client.16203 handle_command_reply: tid=0 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 client.16203 shutdown 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 msgr2=0x55f85660a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 0x55f85660a230 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f80a8012a50 tx=0x7f80a8012e50 comp rx=0 tx=0).stop 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 shutdown_connections 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55f856615e90 0x55f856683530 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f856606370 0x55f85660acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f8565fcb40 0x55f85660a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f8094ff9640 0 client.16203 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 --2- 172.21.15.76:0/4104051566 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f8565fb5d0 0x55f85660a230 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 >> 172.21.15.76:0/4104051566 conn(0x55f8565c4310 msgr2=0x55f8566028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 shutdown_connections 2024-09-19T07:55:05.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.589+0000 7f80b5df7740 1 -- 172.21.15.76:0/4104051566 wait complete. 2024-09-19T07:55:05.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b5df7740 20 client.16203 trim_cache size 0 max 16384 2024-09-19T07:55:05.612 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80980a77c0 msgr2=0x7f80980a9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80980a77c0 0x7f80980a9c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80a4022000 tx=0x7f80a4023000 comp rx=0 tx=0).stop 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 msgr2=0x7f80ac198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac198a00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f809c006010 tx=0x7f809c0040c0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 shutdown_connections 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80980a77c0 0x7f80980a9c80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac106f10 0x7f80ac19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ac102790 0x7f80ac198a00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 --2- 172.21.15.76:0/2669422510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80ac101de0 0x7f80ac1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:05.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 >> 172.21.15.76:0/2669422510 conn(0x7f80ac0fd8c0 msgr2=0x7f80ac0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:05.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 shutdown_connections 2024-09-19T07:55:05.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:05.590+0000 7f80b3a1e640 1 -- 172.21.15.76:0/2669422510 wait complete. 2024-09-19T07:55:06.363 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:55:06.618 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:06.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:06 smithi137 ceph-mon[35309]: pgmap v121: 97 pgs: 97 active+clean; 274 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 2.2 MiB/s wr, 268 op/s 2024-09-19T07:55:06.914 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:06 smithi076 ceph-mon[30930]: pgmap v121: 97 pgs: 97 active+clean; 274 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 2.2 MiB/s wr, 268 op/s 2024-09-19T07:55:07.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:06 smithi152 ceph-mon[35117]: pgmap v121: 97 pgs: 97 active+clean; 274 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 2.2 MiB/s wr, 268 op/s 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 -- 172.21.15.76:0/862077401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc109b10 msgr2=0x7f85bc114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 --2- 172.21.15.76:0/862077401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc109b10 0x7f85bc114570 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009900 tx=0x7f85b002a490 comp rx=0 tx=0).stop 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 -- 172.21.15.76:0/862077401 shutdown_connections 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 --2- 172.21.15.76:0/862077401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc114ab0 0x7f85bc116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 --2- 172.21.15.76:0/862077401 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc109b10 0x7f85bc114570 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 --2- 172.21.15.76:0/862077401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc1091f0 0x7f85bc1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 -- 172.21.15.76:0/862077401 >> 172.21.15.76:0/862077401 conn(0x7f85bc06e140 msgr2=0x7f85bc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 -- 172.21.15.76:0/862077401 shutdown_connections 2024-09-19T07:55:07.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.125+0000 7f85c2032640 1 -- 172.21.15.76:0/862077401 wait complete. 2024-09-19T07:55:07.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.126+0000 7f85c2032640 1 Processor -- start 2024-09-19T07:55:07.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 -- start start 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc1091f0 0x7f85bc1a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc109b10 0x7f85bc1a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 0x7f85bc1a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc11cb40 con 0x7f85bc114ab0 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc11c9c0 con 0x7f85bc109b10 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 0x7f85bc1a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 0x7f85bc1a78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34138/0 (socket says 172.21.15.76:34138) 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85bbfff640 1 -- 172.21.15.76:0/364276340 learned_addr learned my addr 172.21.15.76:0/364276340 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:07.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.127+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc11ccc0 con 0x7f85bc1091f0 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.128+0000 7f85baffd640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc109b10 0x7f85bc1a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.128+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc1091f0 0x7f85bc1a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.128+0000 7f85bbfff640 1 -- 172.21.15.76:0/364276340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc1091f0 msgr2=0x7f85bc1a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.128+0000 7f85bbfff640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc1091f0 0x7f85bc1a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.128+0000 7f85bbfff640 1 -- 172.21.15.76:0/364276340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc109b10 msgr2=0x7f85bc1a3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.129+0000 7f85bbfff640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc109b10 0x7f85bc1a3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.129+0000 7f85bbfff640 1 -- 172.21.15.76:0/364276340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc1a7fd0 con 0x7f85bc114ab0 2024-09-19T07:55:07.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.129+0000 7f85baffd640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc109b10 0x7f85bc1a3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:07.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.129+0000 7f85bbfff640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 0x7f85bc1a78f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009fd0 tx=0x7f85b400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:07.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.130+0000 7f85b8ff9640 1 -- 172.21.15.76:0/364276340 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4004d20 con 0x7f85bc114ab0 2024-09-19T07:55:07.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.130+0000 7f85b8ff9640 1 -- 172.21.15.76:0/364276340 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85b400cb20 con 0x7f85bc114ab0 2024-09-19T07:55:07.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.130+0000 7f85b8ff9640 1 -- 172.21.15.76:0/364276340 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4004d20 con 0x7f85bc114ab0 2024-09-19T07:55:07.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.130+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc1a82c0 con 0x7f85bc114ab0 2024-09-19T07:55:07.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.130+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc1afba0 con 0x7f85bc114ab0 2024-09-19T07:55:07.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.133+0000 7f85b8ff9640 1 -- 172.21.15.76:0/364276340 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f85b400ccd0 con 0x7f85bc114ab0 2024-09-19T07:55:07.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.135+0000 7f85c440b740 1 Processor -- start 2024-09-19T07:55:07.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.136+0000 7f85b8ff9640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f85a40a35f0 0x7f85a40a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.136+0000 7f85c440b740 1 -- start start 2024-09-19T07:55:07.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.136+0000 7f85b8ff9640 1 -- 172.21.15.76:0/364276340 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f85b40cffc0 con 0x7f85bc114ab0 2024-09-19T07:55:07.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.136+0000 7f85baffd640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f85a40a35f0 0x7f85a40a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85c440b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85c440b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc1b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85c440b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 0x560f3fc27f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85c440b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560f3fb782f0 con 0x560f3fc25b80 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85c440b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560f3fb1fcf0 con 0x560f3fc1c350 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85c440b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f3fb742b0 con 0x560f3fc1ade0 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 0x560f3fc27f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 0x560f3fc27f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34152/0 (socket says 172.21.15.76:34152) 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.137+0000 7f85bbfff640 1 -- 172.21.15.76:0/2293782619 learned_addr learned my addr 172.21.15.76:0/2293782619 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85baffd640 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc1b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85baffd640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f85a40a35f0 0x7f85a40a5ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000c00 tx=0x7f85b0004040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2293782619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 msgr2=0x560f3fc1b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc1b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2293782619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 msgr2=0x560f3fc27f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 0x560f3fc27f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2293782619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3fb043a0 con 0x560f3fc1c350 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bbfff640 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 0x560f3fc27f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.138+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1a8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00bbe0 tx=0x7f85ac00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb3c32fe6d9c71c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.139+0000 7f85a1ffb640 1 -- 172.21.15.76:0/2293782619 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac015070 con 0x560f3fc1c350 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.139+0000 7f85a1ffb640 1 -- 172.21.15.76:0/2293782619 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85ac0035f0 con 0x560f3fc1c350 2024-09-19T07:55:07.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.139+0000 7f85a1ffb640 1 -- 172.21.15.76:0/2293782619 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac011640 con 0x560f3fc1c350 2024-09-19T07:55:07.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.141+0000 7f85c440b740 1 -- 172.21.15.76:0/2293782619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 msgr2=0x560f3fc1a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.141+0000 7f85c440b740 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1a8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00bbe0 tx=0x7f85ac00f730 comp rx=0 tx=0).stop 2024-09-19T07:55:07.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.142+0000 7f85c440b740 1 -- 172.21.15.76:0/2293782619 shutdown_connections 2024-09-19T07:55:07.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.142+0000 7f85c440b740 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc25b80 0x560f3fc27f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.142+0000 7f85c440b740 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc1b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.142+0000 7f85c440b740 1 --2- 172.21.15.76:0/2293782619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1a8a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.143+0000 7f85c440b740 1 -- 172.21.15.76:0/2293782619 >> 172.21.15.76:0/2293782619 conn(0x560f3fbdb310 msgr2=0x560f3fc17470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:07.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.143+0000 7f85c440b740 1 -- 172.21.15.76:0/2293782619 shutdown_connections 2024-09-19T07:55:07.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.144+0000 7f85c440b740 1 -- 172.21.15.76:0/2293782619 wait complete. 2024-09-19T07:55:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.144+0000 7f85c440b740 1 -- start start 2024-09-19T07:55:07.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.145+0000 7f85c440b740 1 Processor -- start 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.145+0000 7f85c440b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc25580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.145+0000 7f85c440b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1c350 0x560f3fc22880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.145+0000 7f85c440b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 0x560f3fc22ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.145+0000 7f85c440b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560f3fc28880 con 0x560f3fc1c350 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.145+0000 7f85c440b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560f3fb33060 con 0x560f3fc25b80 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85c440b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f3fc28a00 con 0x560f3fc1ade0 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 0x560f3fc22ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85c440b740 10 client.0 _ll_register_callbacks cb 0x560f3f8868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 0x560f3fc22ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:54362/0 (socket says 172.21.15.76:54362) 2024-09-19T07:55:07.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85baffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1c350 0x560f3fc22880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 -- 172.21.15.76:0/2485007392 learned_addr learned my addr 172.21.15.76:0/2485007392 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:07.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc25580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 -- 172.21.15.76:0/2485007392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 msgr2=0x560f3fc25580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc25580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 -- 172.21.15.76:0/2485007392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1c350 msgr2=0x560f3fc22880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1c350 0x560f3fc22880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.146+0000 7f85bbfff640 1 -- 172.21.15.76:0/2485007392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f3f8e93c0 con 0x560f3fc25b80 2024-09-19T07:55:07.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f85bbfff640 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 0x560f3fc22ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85b409bee0 tx=0x7f85b409c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab13fb0b2d3feeda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f859affd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f859affd640 1 -- 172.21.15.76:0/2485007392 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b40b4020 con 0x560f3fc25b80 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f859affd640 1 -- 172.21.15.76:0/2485007392 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f85b40a0170 con 0x560f3fc25b80 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85ac0035f0 con 0x560f3fc25b80 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f859affd640 1 -- 172.21.15.76:0/2485007392 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f85b401f040 con 0x560f3fc25b80 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f85c440b740 10 client.25493 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.147+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560f3fc34410 con 0x560f3fc25b80 2024-09-19T07:55:07.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f859affd640 1 -- 172.21.15.76:0/2485007392 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85b40bc2c0 con 0x560f3fc25b80 2024-09-19T07:55:07.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f859affd640 1 -- 172.21.15.76:0/2485007392 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f85b400f040 con 0x560f3fc25b80 2024-09-19T07:55:07.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f85c440b740 10 client.25493 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f85c440b740 10 client.25493 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f85c440b740 20 client.25493 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f85c440b740 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fc358d0 0x560f3fc37cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f85c440b740 4 client.25493 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.148+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f85ac0035f0 con 0x560f3fc358d0 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.149+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fc358d0 0x560f3fc37cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.149+0000 7f859affd640 10 client.25493 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.149+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fc358d0 0x560f3fc37cc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8dcea9d5bea7b537 server_cookie=fda6a9659adfffce in_seq=0 out_seq=0 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.150+0000 7f859affd640 1 -- 172.21.15.76:0/2485007392 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f85ac0035f0 con 0x560f3fc358d0 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.150+0000 7f859affd640 10 client.25493 handle_command_reply: tid=0 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.150+0000 7f85c440b740 1 client.25493 shutdown 2024-09-19T07:55:07.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 msgr2=0x560f3fc22ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 0x560f3fc22ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85b409bee0 tx=0x7f85b409c2a0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 shutdown_connections 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fc358d0 0x560f3fc37cc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f859affd640 0 client.25493 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc25b80 0x560f3fc22ee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1c350 0x560f3fc22880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 --2- 172.21.15.76:0/2485007392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc1ade0 0x560f3fc25580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 >> 172.21.15.76:0/2485007392 conn(0x560f3fbdb310 msgr2=0x560f3fc1d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 shutdown_connections 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 1 -- 172.21.15.76:0/2485007392 wait complete. 2024-09-19T07:55:07.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.151+0000 7f85c440b740 20 client.25493 trim_cache size 0 max 16384 2024-09-19T07:55:07.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 Processor -- start 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 -- start start 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc17580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b6bb0 con 0x560f3fc1ade0 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b43c0 con 0x560f3fc1c350 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85c440b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b2250 con 0x560f3fc25b80 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc17580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85baffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85baffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc247f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:54370/0 (socket says 172.21.15.76:54370) 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc17580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34166/0 (socket says 172.21.15.76:34166) 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85baffd640 1 -- 172.21.15.76:0/2194589508 learned_addr learned my addr 172.21.15.76:0/2194589508 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:07.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.172+0000 7f85bbfff640 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2194589508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 msgr2=0x560f3fc1d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2194589508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 msgr2=0x560f3fc247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc247f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2194589508 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3fc25180 con 0x560f3fc1ade0 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85baffd640 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc17580 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x560f3fc38490 tx=0x7f85ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3a48ba7c13e7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85a17fa640 1 -- 172.21.15.76:0/2194589508 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac02a070 con 0x560f3fc1ade0 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85a17fa640 1 -- 172.21.15.76:0/2194589508 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85ac00be70 con 0x560f3fc1ade0 2024-09-19T07:55:07.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.173+0000 7f85a17fa640 1 -- 172.21.15.76:0/2194589508 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac015040 con 0x560f3fc1ade0 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 -- 172.21.15.76:0/2194589508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 msgr2=0x560f3fc17580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc17580 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x560f3fc38490 tx=0x7f85ac000bc0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 -- 172.21.15.76:0/2194589508 shutdown_connections 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 --2- 172.21.15.76:0/2194589508 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc17580 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 -- 172.21.15.76:0/2194589508 >> 172.21.15.76:0/2194589508 conn(0x560f3fbdb310 msgr2=0x560f3fc240e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 -- 172.21.15.76:0/2194589508 shutdown_connections 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 -- 172.21.15.76:0/2194589508 wait complete. 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.174+0000 7f85c440b740 1 -- start start 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 Processor -- start 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc2e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc2e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc2e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34170/0 (socket says 172.21.15.76:34170) 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2027438503 learned_addr learned my addr 172.21.15.76:0/2027438503 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b28a0 con 0x560f3fc1ade0 2024-09-19T07:55:07.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85baffd640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b3cf0 con 0x560f3fc1c350 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.175+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b2f50 con 0x560f3fc25b80 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85c440b740 10 client.0 _ll_register_callbacks cb 0x7f85b40cd5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bbfff640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2027438503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 msgr2=0x560f3fc1f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 msgr2=0x560f3fc1f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bb7fe640 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f3fc200e0 con 0x560f3fc1ade0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85bb7fe640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc2e2d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b5d0 tx=0x7f85ac0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c31a3d76d31f78c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f859affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f859affd640 1 -- 172.21.15.76:0/2027438503 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac033060 con 0x560f3fc1ade0 2024-09-19T07:55:07.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f859affd640 1 -- 172.21.15.76:0/2027438503 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f85ac003f10 con 0x560f3fc1ade0 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85ac00be70 con 0x560f3fc1ade0 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.176+0000 7f859affd640 1 -- 172.21.15.76:0/2027438503 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f85ac015070 con 0x560f3fc1ade0 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 10 client.16221 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560f3fca03d0 con 0x560f3fc1ade0 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f859affd640 1 -- 172.21.15.76:0/2027438503 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85ac00be70 con 0x560f3fc1ade0 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f859affd640 1 -- 172.21.15.76:0/2027438503 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f85ac02d070 con 0x560f3fc1ade0 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 10 client.16221 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 20 client.16221 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fca0880 0x560f3fca2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 4 client.16221 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f3fb85860 con 0x560f3fca0880 2024-09-19T07:55:07.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.177+0000 7f85baffd640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fca0880 0x560f3fca2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f859affd640 10 client.16221 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85baffd640 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fca0880 0x560f3fca2ca0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab56d98ff8725091 server_cookie=279b4ffc6cd4006a in_seq=0 out_seq=0 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f859affd640 1 -- 172.21.15.76:0/2027438503 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f3fb85860 con 0x560f3fca0880 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f859affd640 10 client.16221 handle_command_reply: tid=0 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 client.16221 shutdown 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 msgr2=0x560f3fc2e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc2e2d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b5d0 tx=0x7f85ac0038a0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 shutdown_connections 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x560f3fca0880 0x560f3fca2ca0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f3fc25b80 0x560f3fc1f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560f3fc1c350 0x560f3fc1f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f859affd640 0 client.16221 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 --2- 172.21.15.76:0/2027438503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560f3fc1ade0 0x560f3fc2e2d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 >> 172.21.15.76:0/2027438503 conn(0x560f3fbdb310 msgr2=0x560f3fc24900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 shutdown_connections 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 1 -- 172.21.15.76:0/2027438503 wait complete. 2024-09-19T07:55:07.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.178+0000 7f85c440b740 20 client.16221 trim_cache size 0 max 16384 2024-09-19T07:55:07.186 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:55:07.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f85a40a35f0 msgr2=0x7f85a40a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f85a40a35f0 0x7f85a40a5ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000c00 tx=0x7f85b0004040 comp rx=0 tx=0).stop 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 msgr2=0x7f85bc1a78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 0x7f85bc1a78f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009fd0 tx=0x7f85b400ee60 comp rx=0 tx=0).stop 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 shutdown_connections 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f85a40a35f0 0x7f85a40a5ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f85bc114ab0 0x7f85bc1a78f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85bc109b10 0x7f85bc1a3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 --2- 172.21.15.76:0/364276340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc1091f0 0x7f85bc1a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 >> 172.21.15.76:0/364276340 conn(0x7f85bc06e140 msgr2=0x7f85bc070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 shutdown_connections 2024-09-19T07:55:07.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:07.179+0000 7f85c2032640 1 -- 172.21.15.76:0/364276340 wait complete. 2024-09-19T07:55:07.973 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:55:08.267 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:08.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 -- 172.21.15.76:0/734538721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c108290 msgr2=0x7f916c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 --2- 172.21.15.76:0/734538721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c108290 0x7f916c10ec30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9164009cd0 tx=0x7f916402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 -- 172.21.15.76:0/734538721 shutdown_connections 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 --2- 172.21.15.76:0/734538721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c108290 0x7f916c10ec30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 --2- 172.21.15.76:0/734538721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 0x7f916c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 --2- 172.21.15.76:0/734538721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916c102d90 0x7f916c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 -- 172.21.15.76:0/734538721 >> 172.21.15.76:0/734538721 conn(0x7f916c0fc7d0 msgr2=0x7f916c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 -- 172.21.15.76:0/734538721 shutdown_connections 2024-09-19T07:55:08.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.798+0000 7f9172178640 1 -- 172.21.15.76:0/734538721 wait complete. 2024-09-19T07:55:08.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 Processor -- start 2024-09-19T07:55:08.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 -- start start 2024-09-19T07:55:08.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 0x7f916c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 0x7f916c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916c108290 0x7f916c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f916c112230 con 0x7f916c102d90 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1120b0 con 0x7f916c108290 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f9172178640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1123b0 con 0x7f916c103740 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.799+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 0x7f916c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 0x7f916c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34180/0 (socket says 172.21.15.76:34180) 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916b7fe640 1 -- 172.21.15.76:0/2459909706 learned_addr learned my addr 172.21.15.76:0/2459909706 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 0x7f916c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916bfff640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916c108290 0x7f916c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 -- 172.21.15.76:0/2459909706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916c108290 msgr2=0x7f916c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916c108290 0x7f916c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 -- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 msgr2=0x7f916c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 0x7f916c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 -- 172.21.15.76:0/2459909706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c19d620 con 0x7f916c103740 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916b7fe640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 0x7f916c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f916affd640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 0x7f916c198bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f916000e9c0 tx=0x7f916000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f9168ff9640 1 -- 172.21.15.76:0/2459909706 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916000ccc0 con 0x7f916c103740 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c19d910 con 0x7f916c103740 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f9168ff9640 1 -- 172.21.15.76:0/2459909706 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9160005020 con 0x7f916c103740 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f9168ff9640 1 -- 172.21.15.76:0/2459909706 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160004a60 con 0x7f916c103740 2024-09-19T07:55:08.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.800+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c1a51f0 con 0x7f916c103740 2024-09-19T07:55:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9168ff9640 1 -- 172.21.15.76:0/2459909706 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9160004d00 con 0x7f916c103740 2024-09-19T07:55:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 Processor -- start 2024-09-19T07:55:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 -- start start 2024-09-19T07:55:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531dc5d0 0x5616531dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531eb780 0x5616531edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5616531422f0 con 0x5616531dc5d0 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616530e9cf0 con 0x5616531ddb40 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9174551740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56165313e2b0 con 0x5616531eb780 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f9168ff9640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f91540a3430 0x7f91540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531dc5d0 0x5616531dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f916affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531eb780 0x5616531edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.803+0000 7f916bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531dc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:54414/0 (socket says 172.21.15.76:54414) 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916bfff640 1 -- 172.21.15.76:0/4058769105 learned_addr learned my addr 172.21.15.76:0/4058769105 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916bfff640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f91540a3430 0x7f91540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f9168ff9640 1 -- 172.21.15.76:0/2459909706 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f91600cfd30 con 0x7f916c103740 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916b7fe640 1 -- 172.21.15.76:0/4058769105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531eb780 msgr2=0x5616531edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531eb780 0x5616531edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916b7fe640 1 -- 172.21.15.76:0/4058769105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 msgr2=0x5616531dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916b7fe640 1 -- 172.21.15.76:0/4058769105 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616530ce3a0 con 0x5616531dc5d0 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531dc5d0 0x5616531dca10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f915c009e20 tx=0x7f915c00e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15293e9ab8f5c12a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f916bfff640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f91540a3430 0x7f91540a58f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f916402ae00 tx=0x7f9164009360 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f9151ffb640 1 -- 172.21.15.76:0/4058769105 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c017070 con 0x5616531dc5d0 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f9151ffb640 1 -- 172.21.15.76:0/4058769105 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f915c013970 con 0x5616531dc5d0 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.804+0000 7f9151ffb640 1 -- 172.21.15.76:0/4058769105 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c012a30 con 0x5616531dc5d0 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 -- 172.21.15.76:0/4058769105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531dc5d0 msgr2=0x5616531dca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531dc5d0 0x5616531dca10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f915c009e20 tx=0x7f915c00e5a0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 -- 172.21.15.76:0/4058769105 shutdown_connections 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531eb780 0x5616531edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531dc5d0 0x5616531dca10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 --2- 172.21.15.76:0/4058769105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 -- 172.21.15.76:0/4058769105 >> 172.21.15.76:0/4058769105 conn(0x5616531a5310 msgr2=0x5616531d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 -- 172.21.15.76:0/4058769105 shutdown_connections 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 -- 172.21.15.76:0/4058769105 wait complete. 2024-09-19T07:55:08.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.805+0000 7f9174551740 1 -- start start 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 Processor -- start 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531dc5d0 0x5616531eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531ddb40 0x5616531e8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5616531ee480 con 0x5616531eb780 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616530fd060 con 0x5616531dc5d0 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5616531ee600 con 0x5616531ddb40 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f9174551740 10 client.0 _ll_register_callbacks cb 0x561652e508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:08.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34202/0 (socket says 172.21.15.76:34202) 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 -- 172.21.15.76:0/4267292896 learned_addr learned my addr 172.21.15.76:0/4267292896 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531dc5d0 0x5616531eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916affd640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531ddb40 0x5616531e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 -- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531ddb40 msgr2=0x5616531e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531ddb40 0x5616531e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 -- 172.21.15.76:0/4267292896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531dc5d0 msgr2=0x5616531eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531dc5d0 0x5616531eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916bfff640 1 -- 172.21.15.76:0/4267292896 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561652eb33c0 con 0x5616531eb780 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.806+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531dc5d0 0x5616531eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f916bfff640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e88f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9164031830 tx=0x7f916402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bec1ea665f653e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f914affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:08.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f914affd640 1 -- 172.21.15.76:0/4267292896 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640305a0 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f914affd640 1 -- 172.21.15.76:0/4267292896 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9164030740 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f915c013970 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f914affd640 1 -- 172.21.15.76:0/4267292896 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9164030940 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f9174551740 10 client.16233 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5616531f9e90 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f914affd640 1 -- 172.21.15.76:0/4267292896 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f915c013970 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f914affd640 1 -- 172.21.15.76:0/4267292896 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f9164030070 con 0x5616531eb780 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.807+0000 7f9174551740 10 client.16233 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f9174551740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f9174551740 20 client.16233 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f9174551740 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x5616531fd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f9174551740 4 client.16233 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56165314f860 con 0x5616531fb350 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x5616531fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f916b7fe640 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x5616531fd810 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=472c584cc401fb37 server_cookie=4bb17404afab2b0a in_seq=0 out_seq=0 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.808+0000 7f914affd640 10 client.16233 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f914affd640 1 -- 172.21.15.76:0/4267292896 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56165314f860 con 0x5616531fb350 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f914affd640 10 client.16233 handle_command_reply: tid=0 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f9174551740 1 client.16233 shutdown 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 msgr2=0x5616531e88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f9174551740 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e88f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9164031830 tx=0x7f916402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 shutdown_connections 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f9174551740 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x5616531fd810 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f914affd640 0 client.16233 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:08.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.809+0000 7f9174551740 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e88f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f9174551740 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531ddb40 0x5616531e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f9174551740 1 --2- 172.21.15.76:0/4267292896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531dc5d0 0x5616531eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 >> 172.21.15.76:0/4267292896 conn(0x5616531a5310 msgr2=0x5616531de960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:08.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 shutdown_connections 2024-09-19T07:55:08.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f9174551740 1 -- 172.21.15.76:0/4267292896 wait complete. 2024-09-19T07:55:08.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.810+0000 7f9174551740 20 client.16233 trim_cache size 0 max 16384 2024-09-19T07:55:08.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.824+0000 7f9174551740 1 Processor -- start 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.824+0000 7f9174551740 1 -- start start 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.824+0000 7f9174551740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.824+0000 7f9174551740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531f7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f9174551740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f9174551740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ae290 con 0x5616531eb780 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f9174551740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1abaa0 con 0x5616531ddb40 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f9174551740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1a98f0 con 0x5616531dc5d0 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:54432/0 (socket says 172.21.15.76:54432) 2024-09-19T07:55:08.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531d8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:35600/0 (socket says 172.21.15.76:35600) 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 -- 172.21.15.76:0/678262215 learned_addr learned my addr 172.21.15.76:0/678262215 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 -- 172.21.15.76:0/678262215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 msgr2=0x5616531d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531d8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 -- 172.21.15.76:0/678262215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 msgr2=0x5616531e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 -- 172.21.15.76:0/678262215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616531e68e0 con 0x5616531ddb40 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916bfff640 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f916affd640 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531f7720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f916009bf40 tx=0x7f9160009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e31266730dc2314c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f91517fa640 1 -- 172.21.15.76:0/678262215 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916001c040 con 0x5616531ddb40 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.825+0000 7f91517fa640 1 -- 172.21.15.76:0/678262215 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91600a0360 con 0x5616531ddb40 2024-09-19T07:55:08.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f91517fa640 1 -- 172.21.15.76:0/678262215 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916009c470 con 0x5616531ddb40 2024-09-19T07:55:08.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 -- 172.21.15.76:0/678262215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 msgr2=0x5616531f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531f7720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f916009bf40 tx=0x7f9160009f90 comp rx=0 tx=0).stop 2024-09-19T07:55:08.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 -- 172.21.15.76:0/678262215 shutdown_connections 2024-09-19T07:55:08.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531eb780 0x5616531e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531ddb40 0x5616531f7720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 --2- 172.21.15.76:0/678262215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 -- 172.21.15.76:0/678262215 >> 172.21.15.76:0/678262215 conn(0x5616531a5310 msgr2=0x5616531d8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 -- 172.21.15.76:0/678262215 shutdown_connections 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.826+0000 7f9174551740 1 -- 172.21.15.76:0/678262215 wait complete. 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 -- start start 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 Processor -- start 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 0x5616531f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531eb780 0x5616532650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1a9f60 con 0x5616531ddb40 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ab3d0 con 0x5616531eb780 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1aa630 con 0x5616531dc5d0 2024-09-19T07:55:08.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f9174551740 10 client.0 _ll_register_callbacks cb 0x7f9164009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f916affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 0x5616531f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f916affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 0x5616531f0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34234/0 (socket says 172.21.15.76:34234) 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f916affd640 1 -- 172.21.15.76:0/1449385489 learned_addr learned my addr 172.21.15.76:0/1449385489 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.827+0000 7f916b7fe640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916bfff640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531eb780 0x5616532650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916affd640 1 -- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 msgr2=0x5616531efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916affd640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916affd640 1 -- 172.21.15.76:0/1449385489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531eb780 msgr2=0x5616532650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916affd640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531eb780 0x5616532650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916affd640 1 -- 172.21.15.76:0/1449385489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616532655f0 con 0x5616531ddb40 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f916affd640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 0x5616531f0230 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f916009bcb0 tx=0x7f91600cd3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cd15870d501729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:08.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f914affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f914affd640 1 -- 172.21.15.76:0/1449385489 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916001c070 con 0x5616531ddb40 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f914affd640 1 -- 172.21.15.76:0/1449385489 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f916009c210 con 0x5616531ddb40 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91600a0360 con 0x5616531ddb40 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f914affd640 1 -- 172.21.15.76:0/1449385489 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9160098620 con 0x5616531ddb40 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f9174551740 10 client.16239 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5616532668c0 con 0x5616531ddb40 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.828+0000 7f914affd640 1 -- 172.21.15.76:0/1449385489 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91600a0360 con 0x5616531ddb40 2024-09-19T07:55:08.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f914affd640 1 -- 172.21.15.76:0/1449385489 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f916007ab90 con 0x5616531ddb40 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f9174551740 10 client.16239 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f9174551740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f9174551740 20 client.16239 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f9174551740 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x561653269020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f9174551740 4 client.16239 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561653149d70 con 0x5616531fb350 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f916b7fe640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x561653269020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f914affd640 10 client.16239 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.829+0000 7f916b7fe640 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x561653269020 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db1ec990980ee82b server_cookie=bd36ec6cccdeedc9 in_seq=0 out_seq=0 2024-09-19T07:55:08.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f914affd640 1 -- 172.21.15.76:0/1449385489 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561653149d70 con 0x5616531fb350 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f914affd640 10 client.16239 handle_command_reply: tid=0 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 client.16239 shutdown 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 msgr2=0x5616531f0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 0x5616531f0230 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f916009bcb0 tx=0x7f91600cd3c0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 shutdown_connections 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616531eb780 0x5616532650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5616531fb350 0x561653269020 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5616531ddb40 0x5616531f0230 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 --2- 172.21.15.76:0/1449385489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5616531dc5d0 0x5616531efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f914affd640 0 client.16239 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 >> 172.21.15.76:0/1449385489 conn(0x5616531a5310 msgr2=0x5616531d86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:08.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 shutdown_connections 2024-09-19T07:55:08.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 1 -- 172.21.15.76:0/1449385489 wait complete. 2024-09-19T07:55:08.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9174551740 20 client.16239 trim_cache size 0 max 16384 2024-09-19T07:55:08.837 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f91540a3430 msgr2=0x7f91540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9172178640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f91540a3430 0x7f91540a58f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f916402ae00 tx=0x7f9164009360 comp rx=0 tx=0).stop 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 msgr2=0x7f916c198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.830+0000 7f9172178640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 0x7f916c198bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f916000e9c0 tx=0x7f916000ee80 comp rx=0 tx=0).stop 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 shutdown_connections 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f91540a3430 0x7f91540a58f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916c108290 0x7f916c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c103740 0x7f916c198bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 --2- 172.21.15.76:0/2459909706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f916c102d90 0x7f916c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 >> 172.21.15.76:0/2459909706 conn(0x7f916c0fc7d0 msgr2=0x7f916c105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 shutdown_connections 2024-09-19T07:55:08.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:08.831+0000 7f9172178640 1 -- 172.21.15.76:0/2459909706 wait complete. 2024-09-19T07:55:08.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:08 smithi137 ceph-mon[35309]: pgmap v122: 97 pgs: 97 active+clean; 274 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.2 MiB/s wr, 263 op/s 2024-09-19T07:55:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:08 smithi076 ceph-mon[30930]: pgmap v122: 97 pgs: 97 active+clean; 274 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.2 MiB/s wr, 263 op/s 2024-09-19T07:55:09.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:08 smithi152 ceph-mon[35117]: pgmap v122: 97 pgs: 97 active+clean; 274 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.2 MiB/s wr, 263 op/s 2024-09-19T07:55:10.626 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:55:10.627 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:55:10.882 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:10.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:10 smithi076 ceph-mon[30930]: pgmap v123: 97 pgs: 97 active+clean; 284 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 402 op/s 2024-09-19T07:55:11.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:10 smithi152 ceph-mon[35117]: pgmap v123: 97 pgs: 97 active+clean; 284 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 402 op/s 2024-09-19T07:55:11.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:10 smithi137 ceph-mon[35309]: pgmap v123: 97 pgs: 97 active+clean; 284 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 402 op/s 2024-09-19T07:55:11.388 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-19T07:55:11.388 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 -- 172.21.15.76:0/3664312098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278102570 msgr2=0x7f52781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 --2- 172.21.15.76:0/3664312098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278102570 0x7f52781029b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5264009900 tx=0x7f526402a480 comp rx=0 tx=0).stop 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 -- 172.21.15.76:0/3664312098 shutdown_connections 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 --2- 172.21.15.76:0/3664312098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102ef0 0x7f527810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 --2- 172.21.15.76:0/3664312098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278102570 0x7f52781029b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 --2- 172.21.15.76:0/3664312098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278100e20 0x7f5278101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 -- 172.21.15.76:0/3664312098 >> 172.21.15.76:0/3664312098 conn(0x7f52780fc7d0 msgr2=0x7f52780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 -- 172.21.15.76:0/3664312098 shutdown_connections 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.388+0000 7f527ef61640 1 -- 172.21.15.76:0/3664312098 wait complete. 2024-09-19T07:55:11.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 Processor -- start 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 -- start start 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 0x7f5278199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102570 0x7f5278199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278102ef0 0x7f52781a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5278111070 con 0x7f5278100e20 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5278110ef0 con 0x7f5278102ef0 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ef61640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f52781111f0 con 0x7f5278102570 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ccfd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 0x7f5278199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ccfd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 0x7f5278199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34254/0 (socket says 172.21.15.76:34254) 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f527ccfd640 1 -- 172.21.15.76:0/4077676832 learned_addr learned my addr 172.21.15.76:0/4077676832 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.389+0000 7f5277fff640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102570 0x7f5278199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527d4fe640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278102ef0 0x7f52781a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ccfd640 1 -- 172.21.15.76:0/4077676832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102570 msgr2=0x7f5278199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ccfd640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102570 0x7f5278199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ccfd640 1 -- 172.21.15.76:0/4077676832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278102ef0 msgr2=0x7f52781a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ccfd640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278102ef0 0x7f52781a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ccfd640 1 -- 172.21.15.76:0/4077676832 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52781a49e0 con 0x7f5278100e20 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527d4fe640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278102ef0 0x7f52781a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f5277fff640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102570 0x7f5278199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ccfd640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 0x7f5278199420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e9f0 tx=0x7f526c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f5275ffb640 1 -- 172.21.15.76:0/4077676832 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c00cd80 con 0x7f5278100e20 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52781a4bb0 con 0x7f5278100e20 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f5275ffb640 1 -- 172.21.15.76:0/4077676832 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f526c010930 con 0x7f5278100e20 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f5275ffb640 1 -- 172.21.15.76:0/4077676832 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c018b00 con 0x7f5278100e20 2024-09-19T07:55:11.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.390+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52781a5070 con 0x7f5278100e20 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f5275ffb640 1 -- 172.21.15.76:0/4077676832 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f526c018ca0 con 0x7f5278100e20 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f528133a740 1 Processor -- start 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f528133a740 1 -- start start 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f5275ffb640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f52680a33b0 0x7f52680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f528133a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 0x55a66285be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f528133a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a66286ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f528133a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.393+0000 7f5275ffb640 1 -- 172.21.15.76:0/4077676832 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f526c0d01b0 con 0x7f5278100e20 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f528133a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a6627c1280 con 0x55a66285c3a0 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f528133a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a662768b10 con 0x55a66285ba80 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f528133a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a6627bd240 con 0x55a66286b150 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527d4fe640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f52680a33b0 0x7f52680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 0x55a66285be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f5277fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a66286ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 0x55a66285be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:54478/0 (socket says 172.21.15.76:54478) 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 -- 172.21.15.76:0/786388540 learned_addr learned my addr 172.21.15.76:0/786388540 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527d4fe640 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 -- 172.21.15.76:0/786388540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 msgr2=0x55a66286d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 -- 172.21.15.76:0/786388540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 msgr2=0x55a66286ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a66286ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 -- 172.21.15.76:0/786388540 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6627751f0 con 0x55a66285ba80 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f5277fff640 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a66286ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527d4fe640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f52680a33b0 0x7f52680a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52700094d0 tx=0x7f5270013b20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:11.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f527ccfd640 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 0x55a66285be60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f526c0a4b70 tx=0x7f526c09c030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9249fe6fa698fc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f5262ffd640 1 -- 172.21.15.76:0/786388540 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c017ad0 con 0x55a66285ba80 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f5262ffd640 1 -- 172.21.15.76:0/786388540 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f526c09cb30 con 0x55a66285ba80 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.394+0000 7f5262ffd640 1 -- 172.21.15.76:0/786388540 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c013190 con 0x55a66285ba80 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 -- 172.21.15.76:0/786388540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 msgr2=0x55a66285be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 0x55a66285be60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f526c0a4b70 tx=0x7f526c09c030 comp rx=0 tx=0).stop 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 -- 172.21.15.76:0/786388540 shutdown_connections 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a66286ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 --2- 172.21.15.76:0/786388540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285ba80 0x55a66285be60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 -- 172.21.15.76:0/786388540 >> 172.21.15.76:0/786388540 conn(0x55a6628580f0 msgr2=0x55a6628584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 -- 172.21.15.76:0/786388540 shutdown_connections 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.395+0000 7f528133a740 1 -- 172.21.15.76:0/786388540 wait complete. 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 -- start start 2024-09-19T07:55:11.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 Processor -- start 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a662868100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662868640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662868b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a66286dcc0 con 0x55a66285c3a0 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a66277bf10 con 0x55a66286b150 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a66286de40 con 0x55a66285ba80 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f528133a740 10 client.0 _ll_register_callbacks cb 0x55a662744a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f5277fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662868640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f5277fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662868640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34264/0 (socket says 172.21.15.76:34264) 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f5277fff640 1 -- 172.21.15.76:0/1772797652 learned_addr learned my addr 172.21.15.76:0/1772797652 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f527ccfd640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a662868100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.396+0000 7f527d4fe640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662868b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5277fff640 1 -- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 msgr2=0x55a662868100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5277fff640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a662868100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5277fff640 1 -- 172.21.15.76:0/1772797652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 msgr2=0x55a662868b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5277fff640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662868b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5277fff640 1 -- 172.21.15.76:0/1772797652 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6625326a0 con 0x55a66285c3a0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5277fff640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662868640 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5264009900 tx=0x7f5264031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc024dcb867c6d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5257fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5257fff640 1 -- 172.21.15.76:0/1772797652 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264035040 con 0x55a66285c3a0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5257fff640 1 -- 172.21.15.76:0/1772797652 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5264004240 con 0x55a66285c3a0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f526c09cb30 con 0x55a66285c3a0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5257fff640 1 -- 172.21.15.76:0/1772797652 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5264004440 con 0x55a66285c3a0 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f528133a740 10 client.16251 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:11.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a662879a30 con 0x55a66285c3a0 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.397+0000 7f5257fff640 1 -- 172.21.15.76:0/1772797652 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f526c09cb30 con 0x55a66285c3a0 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f5257fff640 1 -- 172.21.15.76:0/1772797652 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f526403d910 con 0x55a66285c3a0 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f528133a740 10 client.16251 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f528133a740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f528133a740 20 client.16251 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f528133a740 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a66287af30 0x55a66287d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f528133a740 4 client.16251 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6627ce7f0 con 0x55a66287af30 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f527ccfd640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a66287af30 0x55a66287d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f5257fff640 10 client.16251 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.398+0000 7f527ccfd640 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a66287af30 0x55a66287d320 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e18afbd5d10ec5b3 server_cookie=be2a0d21fce30214 in_seq=0 out_seq=0 2024-09-19T07:55:11.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f5257fff640 1 -- 172.21.15.76:0/1772797652 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6627ce7f0 con 0x55a66287af30 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f5257fff640 10 client.16251 handle_command_reply: tid=0 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 client.16251 shutdown 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 msgr2=0x55a662868640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662868640 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5264009900 tx=0x7f5264031540 comp rx=0 tx=0).stop 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 shutdown_connections 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662868b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a66287af30 0x55a66287d320 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f5257fff640 0 client.16251 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662868640 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 --2- 172.21.15.76:0/1772797652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a662868100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 >> 172.21.15.76:0/1772797652 conn(0x55a6628580f0 msgr2=0x55a66285dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:11.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 shutdown_connections 2024-09-19T07:55:11.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.399+0000 7f528133a740 1 -- 172.21.15.76:0/1772797652 wait complete. 2024-09-19T07:55:11.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.400+0000 7f528133a740 20 client.16251 trim_cache size 0 max 16384 2024-09-19T07:55:11.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 Processor -- start 2024-09-19T07:55:11.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 -- start start 2024-09-19T07:55:11.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a6628689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662857160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662882be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f52781ae250 con 0x55a66285c3a0 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52781aba60 con 0x55a66286b150 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f528133a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f52781a98b0 con 0x55a66285ba80 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.417+0000 7f5277fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662857160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662857160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34280/0 (socket says 172.21.15.76:34280) 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 -- 172.21.15.76:0/3108662722 learned_addr learned my addr 172.21.15.76:0/3108662722 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f527ccfd640 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a6628689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f527d4fe640 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662882be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 -- 172.21.15.76:0/3108662722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 msgr2=0x55a6628689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a6628689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 -- 172.21.15.76:0/3108662722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 msgr2=0x55a662882be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662882be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 -- 172.21.15.76:0/3108662722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662866650 con 0x55a66285c3a0 2024-09-19T07:55:11.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f527d4fe640 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662882be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f5277fff640 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662857160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5264001eb0 tx=0x7f5264005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6170f968fa4cce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f52627fc640 1 -- 172.21.15.76:0/3108662722 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264035070 con 0x55a66285c3a0 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f52627fc640 1 -- 172.21.15.76:0/3108662722 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5264055070 con 0x55a66285c3a0 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.418+0000 7f52627fc640 1 -- 172.21.15.76:0/3108662722 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264000e60 con 0x55a66285c3a0 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 -- 172.21.15.76:0/3108662722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 msgr2=0x55a662857160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662857160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5264001eb0 tx=0x7f5264005fd0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 -- 172.21.15.76:0/3108662722 shutdown_connections 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66286b150 0x55a662882be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285c3a0 0x55a662857160 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 --2- 172.21.15.76:0/3108662722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66285ba80 0x55a6628689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 -- 172.21.15.76:0/3108662722 >> 172.21.15.76:0/3108662722 conn(0x55a6628580f0 msgr2=0x55a662856a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:11.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 -- 172.21.15.76:0/3108662722 shutdown_connections 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.419+0000 7f528133a740 1 -- 172.21.15.76:0/3108662722 wait complete. 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 -- start start 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 Processor -- start 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 0x55a6628730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285c3a0 0x55a662873620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f52781a9f20 con 0x55a66285ba80 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52781ab390 con 0x55a66285c3a0 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f52781aa5f0 con 0x55a66286b150 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f528133a740 10 client.0 _ll_register_callbacks cb 0x7f5264009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f527ccfd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 0x55a6628730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f527ccfd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 0x55a6628730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34290/0 (socket says 172.21.15.76:34290) 2024-09-19T07:55:11.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f527ccfd640 1 -- 172.21.15.76:0/2879432982 learned_addr learned my addr 172.21.15.76:0/2879432982 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f527d4fe640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.420+0000 7f5277fff640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285c3a0 0x55a662873620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f527ccfd640 1 -- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 msgr2=0x55a66286f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f527ccfd640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f527ccfd640 1 -- 172.21.15.76:0/2879432982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285c3a0 msgr2=0x55a662873620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f527ccfd640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285c3a0 0x55a662873620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f527ccfd640 1 -- 172.21.15.76:0/2879432982 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66286fd90 con 0x55a66285ba80 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f527ccfd640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 0x55a6628730e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f526c0cd950 tx=0x7f526c0132b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b139fbd5e8c9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f5257fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f5257fff640 1 -- 172.21.15.76:0/2879432982 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a07e0 con 0x55a66285ba80 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f5257fff640 1 -- 172.21.15.76:0/2879432982 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f526c0cdb20 con 0x55a66285ba80 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5264055070 con 0x55a66285ba80 2024-09-19T07:55:11.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f5257fff640 1 -- 172.21.15.76:0/2879432982 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f526c09cb30 con 0x55a66285ba80 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f528133a740 10 client.16257 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6628e6640 con 0x55a66285ba80 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.421+0000 7f5257fff640 1 -- 172.21.15.76:0/2879432982 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5264055070 con 0x55a66285ba80 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f5257fff640 1 -- 172.21.15.76:0/2879432982 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f526c0a6030 con 0x55a66285ba80 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f528133a740 10 client.16257 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f528133a740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f528133a740 20 client.16257 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f528133a740 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a6628e69a0 0x55a6628e8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f528133a740 4 client.16257 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a6627c8d00 con 0x55a6628e69a0 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f5277fff640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a6628e69a0 0x55a6628e8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f5277fff640 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a6628e69a0 0x55a6628e8dc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c82a22d7ec05f83f server_cookie=285517fc33df8f83 in_seq=0 out_seq=0 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.422+0000 7f5257fff640 10 client.16257 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:11.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f5257fff640 1 -- 172.21.15.76:0/2879432982 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a6627c8d00 con 0x55a6628e69a0 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f5257fff640 10 client.16257 handle_command_reply: tid=0 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 client.16257 shutdown 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 msgr2=0x55a6628730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 0x55a6628730e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f526c0cd950 tx=0x7f526c0132b0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 shutdown_connections 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a66286b150 0x55a66286f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a66285c3a0 0x55a662873620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a6628e69a0 0x55a6628e8dc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 --2- 172.21.15.76:0/2879432982 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a66285ba80 0x55a6628730e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 >> 172.21.15.76:0/2879432982 conn(0x55a6628580f0 msgr2=0x55a662857270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f5257fff640 0 client.16257 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.423+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 shutdown_connections 2024-09-19T07:55:11.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f528133a740 1 -- 172.21.15.76:0/2879432982 wait complete. 2024-09-19T07:55:11.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f528133a740 20 client.16257 trim_cache size 0 max 16384 2024-09-19T07:55:11.433 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:55:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "26752f9e-e18d-46dd-a1d8-67cb9e7f3979", 2024-09-19T07:55:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:55:11.433 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f52680a33b0 msgr2=0x7f52680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f52680a33b0 0x7f52680a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52700094d0 tx=0x7f5270013b20 comp rx=0 tx=0).stop 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 msgr2=0x7f5278199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 0x7f5278199420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e9f0 tx=0x7f526c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 shutdown_connections 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f52680a33b0 0x7f52680a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5278102ef0 0x7f52781a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5278102570 0x7f5278199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 --2- 172.21.15.76:0/4077676832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5278100e20 0x7f5278199420 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:11.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 >> 172.21.15.76:0/4077676832 conn(0x7f52780fc7d0 msgr2=0x7f5278106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:11.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 shutdown_connections 2024-09-19T07:55:11.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:11.424+0000 7f527ef61640 1 -- 172.21.15.76:0/4077676832 wait complete. 2024-09-19T07:55:11.715 DEBUG:teuthology.parallel:result is None 2024-09-19T07:55:11.715 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T07:55:11.790 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T07:55:11.790 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T07:55:11.802 INFO:tasks.quiescer:joining Quiescers 2024-09-19T07:55:11.802 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T07:55:11.802 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:55:12.339 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:55:12.433 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:12.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:12 smithi076 ceph-mon[30930]: pgmap v124: 97 pgs: 97 active+clean; 285 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 282 op/s 2024-09-19T07:55:12.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:12 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:55:12.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:12 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:12.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:12 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:55:12.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:12 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 -- 172.21.15.76:0/1099025901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c8010bfd0 msgr2=0x7f6c8010e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 --2- 172.21.15.76:0/1099025901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c8010bfd0 0x7f6c8010e450 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009ca0 tx=0x7f6c7802a950 comp rx=0 tx=0).stop 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 -- 172.21.15.76:0/1099025901 shutdown_connections 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 --2- 172.21.15.76:0/1099025901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c8010bfd0 0x7f6c8010e450 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 --2- 172.21.15.76:0/1099025901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c80103510 0x7f6c8010ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 --2- 172.21.15.76:0/1099025901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 0x7f6c80102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 -- 172.21.15.76:0/1099025901 >> 172.21.15.76:0/1099025901 conn(0x7f6c800fc610 msgr2=0x7f6c800fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:12.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.896+0000 7f6c8539e640 1 -- 172.21.15.76:0/1099025901 shutdown_connections 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.897+0000 7f6c8539e640 1 -- 172.21.15.76:0/1099025901 wait complete. 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.897+0000 7f6c8539e640 1 Processor -- start 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 -- start start 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 0x7f6c80198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 0x7f6c80198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c8010bfd0 0x7f6c8019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80111eb0 con 0x7f6c80103510 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80111d30 con 0x7f6c8010bfd0 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c8539e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80112030 con 0x7f6c80102bf0 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 0x7f6c80198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 0x7f6c80198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34318/0 (socket says 172.21.15.76:34318) 2024-09-19T07:55:12.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 -- 172.21.15.76:0/483922106 learned_addr learned my addr 172.21.15.76:0/483922106 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c84b9d640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c8010bfd0 0x7f6c8019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c7ffff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 0x7f6c80198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 -- 172.21.15.76:0/483922106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 msgr2=0x7f6c80198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 0x7f6c80198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 -- 172.21.15.76:0/483922106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c8010bfd0 msgr2=0x7f6c8019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c8010bfd0 0x7f6c8019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c77fff640 1 -- 172.21.15.76:0/483922106 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8019d200 con 0x7f6c80103510 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.898+0000 7f6c7ffff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 0x7f6c80198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.899+0000 7f6c77fff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 0x7f6c80198790 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c890 tx=0x7f6c6800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.899+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004220 con 0x7f6c80103510 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.899+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c680043c0 con 0x7f6c80103510 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.899+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8019d4f0 con 0x7f6c80103510 2024-09-19T07:55:12.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.899+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004b10 con 0x7f6c80103510 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.899+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c801a4dd0 con 0x7f6c80103510 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.900+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c80102fd0 con 0x7f6c80103510 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.901+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6c680051b0 con 0x7f6c80103510 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.902+0000 7f6c7dffb640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c6c0a33b0 0x7f6c6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.902+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6c680cfe50 con 0x7f6c80103510 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.902+0000 7f6c7ffff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c6c0a33b0 0x7f6c6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.902+0000 7f6c7ffff640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c6c0a33b0 0x7f6c6c0a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000baa0 tx=0x7f6c70005d90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:12.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:12.906+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c68014030 con 0x7f6c80103510 2024-09-19T07:55:12.952 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:13.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:12 smithi152 ceph-mon[35117]: pgmap v124: 97 pgs: 97 active+clean; 285 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 282 op/s 2024-09-19T07:55:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:12 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:55:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:12 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:12 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:55:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:12 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:13.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.133+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c801a5100 con 0x7f6c80103510 2024-09-19T07:55:13.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.134+0000 7f6c7dffb640 1 -- 172.21.15.76:0/483922106 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7f6c6809c7d0 con 0x7f6c80103510 2024-09-19T07:55:13.138 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:55:13.138 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c6c0a33b0 msgr2=0x7f6c6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c6c0a33b0 0x7f6c6c0a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000baa0 tx=0x7f6c70005d90 comp rx=0 tx=0).stop 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 msgr2=0x7f6c80198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 0x7f6c80198790 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c890 tx=0x7f6c6800cd50 comp rx=0 tx=0).stop 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 shutdown_connections 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c6c0a33b0 0x7f6c6c0a5870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c8010bfd0 0x7f6c8019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c80103510 0x7f6c80198790 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:13.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 --2- 172.21.15.76:0/483922106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c80102bf0 0x7f6c80198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:13.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.136+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 >> 172.21.15.76:0/483922106 conn(0x7f6c800fc610 msgr2=0x7f6c800fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:13.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.137+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 shutdown_connections 2024-09-19T07:55:13.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:13.137+0000 7f6c8539e640 1 -- 172.21.15.76:0/483922106 wait complete. 2024-09-19T07:55:13.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:12 smithi137 ceph-mon[35309]: pgmap v124: 97 pgs: 97 active+clean; 285 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 282 op/s 2024-09-19T07:55:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:12 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:55:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:12 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:12 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:55:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:12 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:13.926 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:13 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/483922106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:13.955 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24478 quiesce db --cancel --all' 2024-09-19T07:55:13.956 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24478 quiesce db --cancel --all 2024-09-19T07:55:14.055 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:13 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/483922106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:14.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:13 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/483922106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/2628959129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4101420 msgr2=0x7f5dc410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/2628959129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4101420 0x7f5dc410d950 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009cd0 tx=0x7f5dbc02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/2628959129 shutdown_connections 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/2628959129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4101420 0x7f5dc410d950 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/2628959129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4100a80 0x7f5dc4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/2628959129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dc4106a80 0x7f5dc4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.193+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/2628959129 >> 172.21.15.76:0/2628959129 conn(0x7f5dc40fc7a0 msgr2=0x7f5dc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/2628959129 shutdown_connections 2024-09-19T07:55:14.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/2628959129 wait complete. 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 Processor -- start 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 -- start start 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dc4100a80 0x7f5dc4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4101420 0x7f5dc4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 0x7f5dc419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.194+0000 7f5dcbcf6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc4111060 con 0x7f5dc4106a80 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dcbcf6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc4110ee0 con 0x7f5dc4100a80 2024-09-19T07:55:14.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dcbcf6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41111e0 con 0x7f5dc4101420 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 0x7f5dc419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 0x7f5dc419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38246/0 (socket says 172.21.15.76:38246) 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 -- 172.21.15.76:0/3363803360 learned_addr learned my addr 172.21.15.76:0/3363803360 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dc4100a80 0x7f5dc4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dc9291640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4101420 0x7f5dc4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 -- 172.21.15.76:0/3363803360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4101420 msgr2=0x7f5dc4198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4101420 0x7f5dc4198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 -- 172.21.15.76:0/3363803360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dc4100a80 msgr2=0x7f5dc4198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dc4100a80 0x7f5dc4198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 -- 172.21.15.76:0/3363803360 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc419d5c0 con 0x7f5dc4106a80 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dc9291640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4101420 0x7f5dc4198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dca293640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 0x7f5dc419cee0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009df0 tx=0x7f5dbc032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dbaffd640 1 -- 172.21.15.76:0/3363803360 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc004240 con 0x7f5dc4106a80 2024-09-19T07:55:14.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dbaffd640 1 -- 172.21.15.76:0/3363803360 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dbc0305a0 con 0x7f5dc4106a80 2024-09-19T07:55:14.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc419d850 con 0x7f5dc4106a80 2024-09-19T07:55:14.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dbaffd640 1 -- 172.21.15.76:0/3363803360 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0466c0 con 0x7f5dc4106a80 2024-09-19T07:55:14.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.195+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc41a5190 con 0x7f5dc4106a80 2024-09-19T07:55:14.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.198+0000 7f5dbaffd640 1 -- 172.21.15.76:0/3363803360 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5dbc030750 con 0x7f5dc4106a80 2024-09-19T07:55:14.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.198+0000 7f5dce0cf740 1 Processor -- start 2024-09-19T07:55:14.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.198+0000 7f5dce0cf740 1 -- start start 2024-09-19T07:55:14.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dbaffd640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5db00a33b0 0x7f5db00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 0x55e17d622880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d62d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d62fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e17d5882e0 con 0x55e17d62d680 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e17d52fce0 con 0x55e17d6224a0 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e17d5842a0 con 0x55e17d622dc0 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9291640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5db00a33b0 0x7f5db00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dbaffd640 1 -- 172.21.15.76:0/3363803360 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5dbc02e030 con 0x7f5dc4106a80 2024-09-19T07:55:14.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 0x55e17d622880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 0x55e17d622880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:57184/0 (socket says 172.21.15.76:57184) 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2957295347 learned_addr learned my addr 172.21.15.76:0/2957295347 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dca293640 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d62fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9291640 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d62d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9291640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5db00a33b0 0x7f5db00a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4013650 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2957295347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 msgr2=0x55e17d62d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d62d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2957295347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 msgr2=0x55e17d62fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d62fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.199+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2957295347 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17d514440 con 0x55e17d6224a0 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.200+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 0x55e17d622880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000b7a0 tx=0x7f5dc000bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=331c8bcae1ca0168 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.200+0000 7f5daffff640 1 -- 172.21.15.76:0/2957295347 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000d950 con 0x55e17d6224a0 2024-09-19T07:55:14.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.200+0000 7f5daffff640 1 -- 172.21.15.76:0/2957295347 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dc0019070 con 0x55e17d6224a0 2024-09-19T07:55:14.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.200+0000 7f5daffff640 1 -- 172.21.15.76:0/2957295347 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00123e0 con 0x55e17d6224a0 2024-09-19T07:55:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2957295347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 msgr2=0x55e17d622880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 0x55e17d622880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000b7a0 tx=0x7f5dc000bc60 comp rx=0 tx=0).stop 2024-09-19T07:55:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2957295347 shutdown_connections 2024-09-19T07:55:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d62fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d62d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2957295347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d6224a0 0x55e17d622880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2957295347 >> 172.21.15.76:0/2957295347 conn(0x55e17d61ea30 msgr2=0x55e17d61ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2957295347 shutdown_connections 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2957295347 wait complete. 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 -- start start 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.201+0000 7f5dce0cf740 1 Processor -- start 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d62cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 0x55e17d62a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d62a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e17d634660 con 0x55e17d622dc0 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e17d543050 con 0x55e17d62d680 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e17d6347e0 con 0x55e17d6224a0 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dce0cf740 10 client.0 _ll_register_callbacks cb 0x55e17d583160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:14.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 0x55e17d62a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dca293640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d62a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 0x55e17d62a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38262/0 (socket says 172.21.15.76:38262) 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 -- 172.21.15.76:0/4213740141 learned_addr learned my addr 172.21.15.76:0/4213740141 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d62cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 -- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 msgr2=0x55e17d62cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d62cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 -- 172.21.15.76:0/4213740141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 msgr2=0x55e17d62a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d62a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dc9291640 1 -- 172.21.15.76:0/4213740141 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e17d2f93c0 con 0x55e17d622dc0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.202+0000 7f5dca293640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d62a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dc9291640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 0x55e17d62a170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5db4008080 tx=0x7f5db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6bccfe8d1142e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dad7fa640 1 -- 172.21.15.76:0/4213740141 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4025020 con 0x55e17d622dc0 2024-09-19T07:55:14.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dad7fa640 1 -- 172.21.15.76:0/4213740141 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5db4015c40 con 0x55e17d622dc0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc0019070 con 0x55e17d622dc0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dad7fa640 1 -- 172.21.15.76:0/4213740141 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5db4030050 con 0x55e17d622dc0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dce0cf740 10 client.16275 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e17d63ff70 con 0x55e17d622dc0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.203+0000 7f5dad7fa640 1 -- 172.21.15.76:0/4213740141 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dc0019070 con 0x55e17d622dc0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dad7fa640 1 -- 172.21.15.76:0/4213740141 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5db4015040 con 0x55e17d622dc0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dce0cf740 10 client.16275 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dce0cf740 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dce0cf740 20 client.16275 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6418f0 0x55e17d643d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dce0cf740 4 client.16275 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e17d595850 con 0x55e17d6418f0 2024-09-19T07:55:14.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6418f0 0x55e17d643d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6418f0 0x55e17d643d30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d29a8e8977a0f8c3 server_cookie=8094038de89cbed5 in_seq=0 out_seq=0 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.204+0000 7f5dad7fa640 10 client.16275 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dad7fa640 1 -- 172.21.15.76:0/4213740141 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e17d595850 con 0x55e17d6418f0 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dad7fa640 10 client.16275 handle_command_reply: tid=0 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 client.16275 shutdown 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 msgr2=0x55e17d62a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 0x55e17d62a170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5db4008080 tx=0x7f5db40046c0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 shutdown_connections 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d62a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6418f0 0x55e17d643d30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d622dc0 0x55e17d62a170 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dad7fa640 0 client.16275 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/4213740141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d62cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.205+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 >> 172.21.15.76:0/4213740141 conn(0x55e17d61ea30 msgr2=0x55e17d624710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.206+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 shutdown_connections 2024-09-19T07:55:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.206+0000 7f5dce0cf740 1 -- 172.21.15.76:0/4213740141 wait complete. 2024-09-19T07:55:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.206+0000 7f5dce0cf740 20 client.16275 trim_cache size 0 max 16384 2024-09-19T07:55:14.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 Processor -- start 2024-09-19T07:55:14.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 -- start start 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d629a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d622dc0 0x55e17d6257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d649640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41ae290 con 0x55e17d62d680 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41abaa0 con 0x55e17d622dc0 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41a98f0 con 0x55e17d6224a0 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dca293640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d649640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dca293640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d649640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38274/0 (socket says 172.21.15.76:38274) 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dca293640 1 -- 172.21.15.76:0/3429987699 learned_addr learned my addr 172.21.15.76:0/3429987699 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dc9291640 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d622dc0 0x55e17d6257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d629a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.223+0000 7f5dca293640 1 -- 172.21.15.76:0/3429987699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 msgr2=0x55e17d629a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5dca293640 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d629a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5dca293640 1 -- 172.21.15.76:0/3429987699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d622dc0 msgr2=0x55e17d6257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5dca293640 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d622dc0 0x55e17d6257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5dca293640 1 -- 172.21.15.76:0/3429987699 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17d629120 con 0x55e17d62d680 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5dca293640 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d649640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc030fd0 tx=0x7f5dbc005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f21d42baf5bf56f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5daf7fe640 1 -- 172.21.15.76:0/3429987699 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0c1ac0 con 0x55e17d62d680 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5daf7fe640 1 -- 172.21.15.76:0/3429987699 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dbc036020 con 0x55e17d62d680 2024-09-19T07:55:14.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.224+0000 7f5daf7fe640 1 -- 172.21.15.76:0/3429987699 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc030ae0 con 0x55e17d62d680 2024-09-19T07:55:14.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 -- 172.21.15.76:0/3429987699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 msgr2=0x55e17d649640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d649640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc030fd0 tx=0x7f5dbc005f30 comp rx=0 tx=0).stop 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 -- 172.21.15.76:0/3429987699 shutdown_connections 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d62d680 0x55e17d649640 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d622dc0 0x55e17d6257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/3429987699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d6224a0 0x55e17d629a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 -- 172.21.15.76:0/3429987699 >> 172.21.15.76:0/3429987699 conn(0x55e17d61ea30 msgr2=0x55e17d6250e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 -- 172.21.15.76:0/3429987699 shutdown_connections 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 -- 172.21.15.76:0/3429987699 wait complete. 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 -- start start 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.225+0000 7f5dce0cf740 1 Processor -- start 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 0x55e17d639cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d63a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d6245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41a9f60 con 0x55e17d6224a0 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41ab3d0 con 0x55e17d62d680 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc41aa630 con 0x55e17d622dc0 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dce0cf740 10 client.0 _ll_register_callbacks cb 0x7f5db4007120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 0x55e17d639cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 0x55e17d639cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38290/0 (socket says 172.21.15.76:38290) 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2200273865 learned_addr learned my addr 172.21.15.76:0/2200273865 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dca293640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d6245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9291640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d63a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 msgr2=0x55e17d63a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d63a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2200273865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 msgr2=0x55e17d6245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d6245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 -- 172.21.15.76:0/2200273865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e17d622bf0 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9291640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d63a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dc9a92640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 0x55e17d639cd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0014570 tx=0x7f5dc0014a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cda49d1caf4d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.226+0000 7f5dad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dad7fa640 1 -- 172.21.15.76:0/2200273865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000db50 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dad7fa640 1 -- 172.21.15.76:0/2200273865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5dc000dcf0 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dbc036020 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dad7fa640 1 -- 172.21.15.76:0/2200273865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5dc00272d0 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 10 client.16281 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e17d639460 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dad7fa640 1 -- 172.21.15.76:0/2200273865 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dbc036020 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dad7fa640 1 -- 172.21.15.76:0/2200273865 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5dc0013070 con 0x55e17d6224a0 2024-09-19T07:55:14.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 10 client.16281 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 20 client.16281 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6ac610 0x55e17d6aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 4 client.16281 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.227+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e17d58fd60 con 0x55e17d6ac610 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.228+0000 7f5dc9291640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6ac610 0x55e17d6aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.228+0000 7f5dc9291640 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6ac610 0x55e17d6aea00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb54f70220f9822a server_cookie=fdaaf5cccf36ca98 in_seq=0 out_seq=0 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.228+0000 7f5dad7fa640 10 client.16281 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dad7fa640 1 -- 172.21.15.76:0/2200273865 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e17d58fd60 con 0x55e17d6ac610 2024-09-19T07:55:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dad7fa640 10 client.16281 handle_command_reply: tid=0 2024-09-19T07:55:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 client.16281 shutdown 2024-09-19T07:55:14.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 msgr2=0x55e17d639cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 0x55e17d639cd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0014570 tx=0x7f5dc0014a40 comp rx=0 tx=0).stop 2024-09-19T07:55:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 shutdown_connections 2024-09-19T07:55:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e17d62d680 0x55e17d6245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e17d622dc0 0x55e17d63a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e17d6ac610 0x55e17d6aea00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 --2- 172.21.15.76:0/2200273865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e17d6224a0 0x55e17d639cd0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dad7fa640 0 client.16281 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 >> 172.21.15.76:0/2200273865 conn(0x55e17d61ea30 msgr2=0x55e17d61db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 shutdown_connections 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 1 -- 172.21.15.76:0/2200273865 wait complete. 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.229+0000 7f5dce0cf740 20 client.16281 trim_cache size 0 max 16384 2024-09-19T07:55:14.235 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:14.236 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:55:14.236 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:55:14.236 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:14.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5db00a33b0 msgr2=0x7f5db00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5db00a33b0 0x7f5db00a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4013650 comp rx=0 tx=0).stop 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 msgr2=0x7f5dc419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 0x7f5dc419cee0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009df0 tx=0x7f5dbc032c00 comp rx=0 tx=0).stop 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 shutdown_connections 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5db00a33b0 0x7f5db00a5870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5dc4106a80 0x7f5dc419cee0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4101420 0x7f5dc4198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 --2- 172.21.15.76:0/3363803360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dc4100a80 0x7f5dc4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 >> 172.21.15.76:0/3363803360 conn(0x7f5dc40fc7a0 msgr2=0x7f5dc4104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 shutdown_connections 2024-09-19T07:55:14.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.230+0000 7f5dcbcf6640 1 -- 172.21.15.76:0/3363803360 wait complete. 2024-09-19T07:55:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:14.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:14 smithi076 ceph-mon[30930]: pgmap v125: 97 pgs: 97 active+clean; 285 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-19T07:55:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:14 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:55:14.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 -- 172.21.15.76:0/4078562015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc101400 msgr2=0x7f7fcc10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/4078562015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc101400 0x7f7fcc10d930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009930 tx=0x7f7fbc02a420 comp rx=0 tx=0).stop 2024-09-19T07:55:14.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 -- 172.21.15.76:0/4078562015 shutdown_connections 2024-09-19T07:55:14.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/4078562015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc101400 0x7f7fcc10d930 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/4078562015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc100a60 0x7f7fcc100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/4078562015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fcc106a60 0x7f7fcc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 -- 172.21.15.76:0/4078562015 >> 172.21.15.76:0/4078562015 conn(0x7f7fcc0fc780 msgr2=0x7f7fcc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 -- 172.21.15.76:0/4078562015 shutdown_connections 2024-09-19T07:55:14.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 -- 172.21.15.76:0/4078562015 wait complete. 2024-09-19T07:55:14.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.951+0000 7f7fd12c3640 1 Processor -- start 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 -- start start 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fcc100a60 0x7f7fcc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc101400 0x7f7fcc199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 0x7f7fcc1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc110fc0 con 0x7f7fcc106a60 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc110e40 con 0x7f7fcc100a60 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fd12c3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc111140 con 0x7f7fcc101400 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 0x7f7fcc1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 0x7f7fcc1a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38314/0 (socket says 172.21.15.76:38314) 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 -- 172.21.15.76:0/2415576374 learned_addr learned my addr 172.21.15.76:0/2415576374 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fcc100a60 0x7f7fcc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc101400 0x7f7fcc199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 -- 172.21.15.76:0/2415576374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc101400 msgr2=0x7f7fcc199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc101400 0x7f7fcc199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 -- 172.21.15.76:0/2415576374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fcc100a60 msgr2=0x7f7fcc199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fcc100a60 0x7f7fcc199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.952+0000 7f7fcb7fe640 1 -- 172.21.15.76:0/2415576374 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc1a48d0 con 0x7f7fcc106a60 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc101400 0x7f7fcc199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fcb7fe640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 0x7f7fcc1a4390 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005ab0 tx=0x7f7fbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fc3fff640 1 -- 172.21.15.76:0/2415576374 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc03f030 con 0x7f7fcc106a60 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fc3fff640 1 -- 172.21.15.76:0/2415576374 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fbc003d00 con 0x7f7fcc106a60 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc1a4aa0 con 0x7f7fcc106a60 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fc3fff640 1 -- 172.21.15.76:0/2415576374 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc035070 con 0x7f7fcc106a60 2024-09-19T07:55:14.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.953+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc1a4ef0 con 0x7f7fcc106a60 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.955+0000 7f7fc3fff640 1 -- 172.21.15.76:0/2415576374 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7fbc042030 con 0x7f7fcc106a60 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 Processor -- start 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 -- start start 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e03de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e10fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f1a2d68200 con 0x55f1a2e0ebe0 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1a2d0edc0 con 0x55f1a2e03a00 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fd369c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f1a2d641c0 con 0x55f1a2e04320 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e10fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fc3fff640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7fb80a33b0 0x7f7fb80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e10fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38318/0 (socket says 172.21.15.76:38318) 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fca7fc640 1 -- 172.21.15.76:0/3823675883 learned_addr learned my addr 172.21.15.76:0/3823675883 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fcb7fe640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7fb80a33b0 0x7f7fb80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e03de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fca7fc640 1 -- 172.21.15.76:0/3823675883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 msgr2=0x55f1a2e0e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.956+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fca7fc640 1 -- 172.21.15.76:0/3823675883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 msgr2=0x55f1a2e03de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e03de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fca7fc640 1 -- 172.21.15.76:0/3823675883 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a2ad9620 con 0x55f1a2e0ebe0 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fc3fff640 1 -- 172.21.15.76:0/2415576374 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7fbc0f0530 con 0x7f7fcc106a60 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e10fd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40125f0 tx=0x7f7fb400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfde0972b507fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fcb7fe640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7fb80a33b0 0x7f7fb80a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0edcd0 tx=0x7f7fbc08e6b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fc17fa640 1 -- 172.21.15.76:0/3823675883 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4018030 con 0x55f1a2e0ebe0 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fc17fa640 1 -- 172.21.15.76:0/3823675883 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fb4005520 con 0x55f1a2e0ebe0 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.957+0000 7f7fc17fa640 1 -- 172.21.15.76:0/3823675883 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4010920 con 0x55f1a2e0ebe0 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- 172.21.15.76:0/3823675883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 msgr2=0x55f1a2e10fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e10fd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40125f0 tx=0x7f7fb400b6e0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- 172.21.15.76:0/3823675883 shutdown_connections 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e10fd0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- 172.21.15.76:0/3823675883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e03de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- 172.21.15.76:0/3823675883 >> 172.21.15.76:0/3823675883 conn(0x55f1a2dfff90 msgr2=0x55f1a2e00370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- 172.21.15.76:0/3823675883 shutdown_connections 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- 172.21.15.76:0/3823675883 wait complete. 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- start start 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 Processor -- start 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e0e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e0bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.958+0000 7f7fd369c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f1a2e117b0 con 0x55f1a2e03a00 2024-09-19T07:55:14.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fd369c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1a2d02c50 con 0x55f1a2e0ebe0 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fd369c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f1a2e11930 con 0x55f1a2e04320 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fd369c740 10 client.0 _ll_register_callbacks cb 0x55f1a2d14ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e0e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e0e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38330/0 (socket says 172.21.15.76:38330) 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 -- 172.21.15.76:0/2693708828 learned_addr learned my addr 172.21.15.76:0/2693708828 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e0bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 -- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 msgr2=0x55f1a2e0b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 -- 172.21.15.76:0/2693708828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e0ebe0 msgr2=0x55f1a2e0bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e0bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 -- 172.21.15.76:0/2693708828 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a2e0c540 con 0x55f1a2e03a00 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:14.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e0e520 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4015040 tx=0x7f7fb4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b991981024e931cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fb27fc640 1 -- 172.21.15.76:0/2693708828 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4018040 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fb27fc640 1 -- 172.21.15.76:0/2693708828 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7fb4010720 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb4005520 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fb27fc640 1 -- 172.21.15.76:0/2693708828 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7fb4032050 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fd369c740 10 client.16293 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.959+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f1a2e1d360 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fb27fc640 1 -- 172.21.15.76:0/2693708828 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fb4005520 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fb27fc640 1 -- 172.21.15.76:0/2693708828 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f7fb401d940 con 0x55f1a2e03a00 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fd369c740 10 client.16293 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fd369c740 10 client.16293 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fd369c740 20 client.16293 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fd369c740 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e1e710 0x55f1a2e20b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fd369c740 4 client.16293 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1a2d75770 con 0x55f1a2e1e710 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.960+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e1e710 0x55f1a2e20b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fb27fc640 10 client.16293 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e1e710 0x55f1a2e20b00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b224f55fe841d1ac server_cookie=4c3986c27897d082 in_seq=0 out_seq=0 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fb27fc640 1 -- 172.21.15.76:0/2693708828 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1a2d75770 con 0x55f1a2e1e710 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fb27fc640 10 client.16293 handle_command_reply: tid=0 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fd369c740 1 client.16293 shutdown 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 msgr2=0x55f1a2e0e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.961+0000 7f7fd369c740 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e0e520 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4015040 tx=0x7f7fb4005f90 comp rx=0 tx=0).stop 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 shutdown_connections 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e0ebe0 0x55f1a2e0bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2e04320 0x55f1a2e0b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e1e710 0x55f1a2e20b00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 --2- 172.21.15.76:0/2693708828 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e0e520 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 >> 172.21.15.76:0/2693708828 conn(0x55f1a2dfff90 msgr2=0x55f1a2dff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fb27fc640 0 client.16293 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 shutdown_connections 2024-09-19T07:55:14.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 1 -- 172.21.15.76:0/2693708828 wait complete. 2024-09-19T07:55:14.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.962+0000 7f7fd369c740 20 client.16293 trim_cache size 0 max 16384 2024-09-19T07:55:14.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.978+0000 7f7fd369c740 1 Processor -- start 2024-09-19T07:55:14.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.978+0000 7f7fd369c740 1 -- start start 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2dfb520 0x55f1a2e06c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e0a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fd369c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b03f0 con 0x55f1a2e03a00 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fd369c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1adc00 con 0x55f1a2dfb520 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fd369c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1aba50 con 0x55f1a2dfff90 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e1aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38340/0 (socket says 172.21.15.76:38340) 2024-09-19T07:55:14.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 -- 172.21.15.76:0/4202542710 learned_addr learned my addr 172.21.15.76:0/4202542710 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e0a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 -- 172.21.15.76:0/4202542710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 msgr2=0x55f1a2e0a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e0a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 -- 172.21.15.76:0/4202542710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2dfb520 msgr2=0x55f1a2e06c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2dfb520 0x55f1a2e06c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 -- 172.21.15.76:0/4202542710 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a2e09d20 con 0x55f1a2e03a00 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.979+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e1aa40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4005b90 tx=0x7f7fb400b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5d0e487135eb43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fc0ff9640 1 -- 172.21.15.76:0/4202542710 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4018070 con 0x55f1a2e03a00 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fc0ff9640 1 -- 172.21.15.76:0/4202542710 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fb400bd50 con 0x55f1a2e03a00 2024-09-19T07:55:14.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fc0ff9640 1 -- 172.21.15.76:0/4202542710 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb401d6c0 con 0x55f1a2e03a00 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 -- 172.21.15.76:0/4202542710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 msgr2=0x55f1a2e1aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e1aa40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4005b90 tx=0x7f7fb400b500 comp rx=0 tx=0).stop 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 -- 172.21.15.76:0/4202542710 shutdown_connections 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2e03a00 0x55f1a2e1aa40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e0a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 --2- 172.21.15.76:0/4202542710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2dfb520 0x55f1a2e06c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 -- 172.21.15.76:0/4202542710 >> 172.21.15.76:0/4202542710 conn(0x55f1a2e0be70 msgr2=0x55f1a2e0d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.980+0000 7f7fd369c740 1 -- 172.21.15.76:0/4202542710 shutdown_connections 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 -- 172.21.15.76:0/4202542710 wait complete. 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 -- start start 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 Processor -- start 2024-09-19T07:55:14.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 0x55f1a2e814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e81a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e86340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1ac0c0 con 0x55f1a2dfb520 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1ad530 con 0x55f1a2e03a00 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1ac790 con 0x55f1a2dfff90 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fd369c740 10 client.0 _ll_register_callbacks cb 0x7f7fb400b450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 0x55f1a2e814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fca7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 0x55f1a2e814d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38356/0 (socket says 172.21.15.76:38356) 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fca7fc640 1 -- 172.21.15.76:0/1550144893 learned_addr learned my addr 172.21.15.76:0/1550144893 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e81a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.981+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e86340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fca7fc640 1 -- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 msgr2=0x55f1a2e81a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e81a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fca7fc640 1 -- 172.21.15.76:0/1550144893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 msgr2=0x55f1a2e86340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e86340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fca7fc640 1 -- 172.21.15.76:0/1550144893 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a2e86980 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fca7fc640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 0x55f1a2e814d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400b8b0 tx=0x7f7fb4021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904d7bb7dcb74ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fb27fc640 1 -- 172.21.15.76:0/1550144893 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb403c020 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fb27fc640 1 -- 172.21.15.76:0/1550144893 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7fb4004040 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb400bd50 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fb27fc640 1 -- 172.21.15.76:0/1550144893 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7fb4047050 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fd369c740 10 client.16299 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f1a2e8dd10 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fb27fc640 1 -- 172.21.15.76:0/1550144893 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fb400bd50 con 0x55f1a2dfb520 2024-09-19T07:55:14.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fb27fc640 1 -- 172.21.15.76:0/1550144893 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f7fb4010720 con 0x55f1a2dfb520 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fd369c740 10 client.16299 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fd369c740 10 client.16299 resolve_mds: validated gid 24478 aka daemon mds.i 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.982+0000 7f7fd369c740 20 client.16299 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.983+0000 7f7fd369c740 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e04320 0x55f1a2e90380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.983+0000 7f7fd369c740 4 client.16299 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.983+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55f1a2d6fc80 con 0x55f1a2e04320 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.983+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e04320 0x55f1a2e90380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.983+0000 7f7fb27fc640 10 client.16299 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.983+0000 7f7fcaffd640 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e04320 0x55f1a2e90380 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d307e0580820027 server_cookie=35f48d13bce4486 in_seq=0 out_seq=0 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fb27fc640 1 -- 172.21.15.76:0/1550144893 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55f1a2d6fc80 con 0x55f1a2e04320 2024-09-19T07:55:14.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fb27fc640 10 client.16299 handle_command_reply: tid=0 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 client.16299 shutdown 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 msgr2=0x55f1a2e814d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 0x55f1a2e814d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400b8b0 tx=0x7f7fb4021040 comp rx=0 tx=0).stop 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 shutdown_connections 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1a2e03a00 0x55f1a2e86340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1a2dfff90 0x55f1a2e81a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55f1a2e04320 0x55f1a2e90380 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 --2- 172.21.15.76:0/1550144893 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f1a2dfb520 0x55f1a2e814d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fb27fc640 0 client.16299 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 >> 172.21.15.76:0/1550144893 conn(0x55f1a2e0be70 msgr2=0x55f1a2e05450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 shutdown_connections 2024-09-19T07:55:14.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 1 -- 172.21.15.76:0/1550144893 wait complete. 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.984+0000 7f7fd369c740 20 client.16299 trim_cache size 0 max 16384 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 31, 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stdout: "leader": 24478, 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stdout: "set_version": 16, 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stdout: "sets": {} 2024-09-19T07:55:14.990 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:14.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7fb80a33b0 msgr2=0x7f7fb80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7fb80a33b0 0x7f7fb80a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0edcd0 tx=0x7f7fbc08e6b0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 msgr2=0x7f7fcc1a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 0x7f7fcc1a4390 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005ab0 tx=0x7f7fbc0042f0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 shutdown_connections 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7fb80a33b0 0x7f7fb80a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fcc106a60 0x7f7fcc1a4390 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fcc101400 0x7f7fcc199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 --2- 172.21.15.76:0/2415576374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fcc100a60 0x7f7fcc199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 >> 172.21.15.76:0/2415576374 conn(0x7f7fcc0fc780 msgr2=0x7f7fcc0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 shutdown_connections 2024-09-19T07:55:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:14.985+0000 7f7fd12c3640 1 -- 172.21.15.76:0/2415576374 wait complete. 2024-09-19T07:55:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:14 smithi152 ceph-mon[35117]: pgmap v125: 97 pgs: 97 active+clean; 285 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-19T07:55:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:14 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:55:15.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:14 smithi137 ceph-mon[35309]: pgmap v125: 97 pgs: 97 active+clean; 285 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-19T07:55:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:14 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:55:15.792 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T07:55:15.792 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T07:55:15.803 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T07:55:15.803 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:55:15.804 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T07:55:15.804 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T07:55:15.831 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T07:55:16.263 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:55:16.263 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:55:16.508 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:16.897 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:16 smithi076 ceph-mon[30930]: pgmap v126: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 385 op/s 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 -- 172.21.15.76:0/1613339894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c100a80 msgr2=0x7f441c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 --2- 172.21.15.76:0/1613339894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c100a80 0x7f441c100ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4408009930 tx=0x7f440802a420 comp rx=0 tx=0).stop 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 -- 172.21.15.76:0/1613339894 shutdown_connections 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 --2- 172.21.15.76:0/1613339894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f441c101420 0x7f441c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 --2- 172.21.15.76:0/1613339894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c100a80 0x7f441c100ee0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 --2- 172.21.15.76:0/1613339894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c106a80 0x7f441c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:16.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 -- 172.21.15.76:0/1613339894 >> 172.21.15.76:0/1613339894 conn(0x7f441c0fc7a0 msgr2=0x7f441c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 -- 172.21.15.76:0/1613339894 shutdown_connections 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.976+0000 7f4422cae640 1 -- 172.21.15.76:0/1613339894 wait complete. 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 Processor -- start 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 -- start start 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c100a80 0x7f441c0fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f441c101420 0x7f441c0fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 0x7f441c0fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f441c110fa0 con 0x7f441c106a80 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f441c110e20 con 0x7f441c100a80 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4422cae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f441c111120 con 0x7f441c101420 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 0x7f441c0fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:16.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 0x7f441c0fd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38380/0 (socket says 172.21.15.76:38380) 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 -- 172.21.15.76:0/1798509490 learned_addr learned my addr 172.21.15.76:0/1798509490 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4420a4a640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c100a80 0x7f441c0fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f441bfff640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f441c101420 0x7f441c0fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 -- 172.21.15.76:0/1798509490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f441c101420 msgr2=0x7f441c0fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f441c101420 0x7f441c0fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 -- 172.21.15.76:0/1798509490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c100a80 msgr2=0x7f441c0fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c100a80 0x7f441c0fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f442124b640 1 -- 172.21.15.76:0/1798509490 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c1a6a40 con 0x7f441c106a80 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.977+0000 7f4420a4a640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c100a80 0x7f441c0fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.978+0000 7f442124b640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 0x7f441c0fd810 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f441400eaa0 tx=0x7f441400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.978+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441400cdb0 con 0x7f441c106a80 2024-09-19T07:55:16.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.978+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4414004b20 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.978+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441c1a6d30 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.978+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414011760 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.978+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f441c1a71f0 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.979+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441c100ee0 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.980+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4414004cd0 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.981+0000 7f4419ffb640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f440c0a33b0 0x7f440c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.981+0000 7f4420a4a640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f440c0a33b0 0x7f440c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.981+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f44140d00e0 con 0x7f441c106a80 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.981+0000 7f4420a4a640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f440c0a33b0 0x7f440c0a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4410005fd0 tx=0x7f4410005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:16.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:16.985+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4414016030 con 0x7f441c106a80 2024-09-19T07:55:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:16 smithi152 ceph-mon[35117]: pgmap v126: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 385 op/s 2024-09-19T07:55:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:16 smithi137 ceph-mon[35309]: pgmap v126: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 385 op/s 2024-09-19T07:55:17.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.186+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f441c10a000 con 0x7f441c106a80 2024-09-19T07:55:17.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.186+0000 7f4419ffb640 1 -- 172.21.15.76:0/1798509490 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7f441409ca60 con 0x7f441c106a80 2024-09-19T07:55:17.186 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:55:17.187 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:55:17.187 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.188+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f440c0a33b0 msgr2=0x7f440c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.188+0000 7f4422cae640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f440c0a33b0 0x7f440c0a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4410005fd0 tx=0x7f4410005850 comp rx=0 tx=0).stop 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.188+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 msgr2=0x7f441c0fd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.188+0000 7f4422cae640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 0x7f441c0fd810 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f441400eaa0 tx=0x7f441400ef60 comp rx=0 tx=0).stop 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 shutdown_connections 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f440c0a33b0 0x7f440c0a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:17.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f441c106a80 0x7f441c0fd810 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:17.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f441c101420 0x7f441c0fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:17.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 --2- 172.21.15.76:0/1798509490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f441c100a80 0x7f441c0fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:17.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 >> 172.21.15.76:0/1798509490 conn(0x7f441c0fc7a0 msgr2=0x7f441c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:17.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 shutdown_connections 2024-09-19T07:55:17.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:17.189+0000 7f4422cae640 1 -- 172.21.15.76:0/1798509490 wait complete. 2024-09-19T07:55:17.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:17 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1798509490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:18.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:17 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1798509490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:18.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:17 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1798509490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:55:18.390 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:55:18.644 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:18.933 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:18 smithi076 ceph-mon[30930]: pgmap v127: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 276 op/s 2024-09-19T07:55:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:18 smithi152 ceph-mon[35117]: pgmap v127: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 276 op/s 2024-09-19T07:55:19.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 -- 172.21.15.76:0/3683310650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608100a80 msgr2=0x7f9608100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 --2- 172.21.15.76:0/3683310650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608100a80 0x7f9608100ee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009930 tx=0x7f95f802a420 comp rx=0 tx=0).stop 2024-09-19T07:55:19.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 -- 172.21.15.76:0/3683310650 shutdown_connections 2024-09-19T07:55:19.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 --2- 172.21.15.76:0/3683310650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9608101420 0x7f960810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 --2- 172.21.15.76:0/3683310650 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608100a80 0x7f9608100ee0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 --2- 172.21.15.76:0/3683310650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9608106a80 0x7f9608106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.138+0000 7f9610432640 1 -- 172.21.15.76:0/3683310650 >> 172.21.15.76:0/3683310650 conn(0x7f96080fc7a0 msgr2=0x7f96080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 -- 172.21.15.76:0/3683310650 shutdown_connections 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 -- 172.21.15.76:0/3683310650 wait complete. 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 Processor -- start 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 -- start start 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9608100a80 0x7f96081971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9608101420 0x7f96081976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 0x7f9608197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9608110fa0 con 0x7f9608106a80 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9608110e20 con 0x7f9608101420 2024-09-19T07:55:19.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f9610432640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9608111120 con 0x7f9608100a80 2024-09-19T07:55:19.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.139+0000 7f960e9cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 0x7f9608197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 0x7f9608197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38410/0 (socket says 172.21.15.76:38410) 2024-09-19T07:55:19.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 -- 172.21.15.76:0/2466191713 learned_addr learned my addr 172.21.15.76:0/2466191713 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:19.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e1ce640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9608100a80 0x7f96081971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9608101420 0x7f96081976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 -- 172.21.15.76:0/2466191713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9608100a80 msgr2=0x7f96081971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9608100a80 0x7f96081971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 -- 172.21.15.76:0/2466191713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9608101420 msgr2=0x7f96081976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9608101420 0x7f96081976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 -- 172.21.15.76:0/2466191713 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96081a6a10 con 0x7f9608106a80 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f960e9cf640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 0x7f9608197c20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f960000eaa0 tx=0x7f960000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f95ff7fe640 1 -- 172.21.15.76:0/2466191713 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960000cdb0 con 0x7f9608106a80 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f95ff7fe640 1 -- 172.21.15.76:0/2466191713 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9600004b20 con 0x7f9608106a80 2024-09-19T07:55:19.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96081a6d00 con 0x7f9608106a80 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f95ff7fe640 1 -- 172.21.15.76:0/2466191713 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600011760 con 0x7f9608106a80 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.140+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96081a71c0 con 0x7f9608106a80 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.142+0000 7f95ff7fe640 1 -- 172.21.15.76:0/2466191713 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9600004cd0 con 0x7f9608106a80 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 Processor -- start 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 -- start start 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e38090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b03d9e2f0 con 0x561b03e43370 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b03d45cf0 con 0x561b03e39b40 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f961280b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561b03d9a2b0 con 0x561b03e385d0 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e45760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38422/0 (socket says 172.21.15.76:38422) 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f960d9cd640 1 -- 172.21.15.76:0/2562950996 learned_addr learned my addr 172.21.15.76:0/2562950996 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f960e1ce640 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f95ff7fe640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95f40a33b0 0x7f95f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e38090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.143+0000 7f960e9cf640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95f40a33b0 0x7f95f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f95ff7fe640 1 -- 172.21.15.76:0/2466191713 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f96000d0030 con 0x7f9608106a80 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960d9cd640 1 -- 172.21.15.76:0/2562950996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 msgr2=0x561b03e38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e38a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960d9cd640 1 -- 172.21.15.76:0/2562950996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 msgr2=0x561b03e38090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e38090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960d9cd640 1 -- 172.21.15.76:0/2562950996 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b03d2a3a0 con 0x561b03e43370 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e45760 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f95f802a940 tx=0x7f95f8005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3523a0381749b1fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f960e9cf640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95f40a33b0 0x7f95f40a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9600009270 tx=0x7f960006e030 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:19.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f95fcdea640 1 -- 172.21.15.76:0/2562950996 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8035040 con 0x561b03e43370 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f95fcdea640 1 -- 172.21.15.76:0/2562950996 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f8004030 con 0x561b03e43370 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.144+0000 7f95fcdea640 1 -- 172.21.15.76:0/2562950996 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8003b30 con 0x561b03e43370 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- 172.21.15.76:0/2562950996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 msgr2=0x561b03e45760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e45760 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f95f802a940 tx=0x7f95f8005b50 comp rx=0 tx=0).stop 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- 172.21.15.76:0/2562950996 shutdown_connections 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e45760 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- 172.21.15.76:0/2562950996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e38090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- 172.21.15.76:0/2562950996 >> 172.21.15.76:0/2562950996 conn(0x561b03e01310 msgr2=0x561b03e34c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- 172.21.15.76:0/2562950996 shutdown_connections 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- 172.21.15.76:0/2562950996 wait complete. 2024-09-19T07:55:19.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- start start 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 Processor -- start 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e42d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e3ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561b03e46010 con 0x561b03e385d0 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b03d59060 con 0x561b03e43370 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.145+0000 7f961280b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561b03e46190 con 0x561b03e39b40 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f961280b740 10 client.0 _ll_register_callbacks cb 0x561b03aac8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e42d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e42d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38438/0 (socket says 172.21.15.76:38438) 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 -- 172.21.15.76:0/1221981303 learned_addr learned my addr 172.21.15.76:0/1221981303 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e3ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 -- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 msgr2=0x561b03e3ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e3ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 -- 172.21.15.76:0/1221981303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 msgr2=0x561b03e405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 -- 172.21.15.76:0/1221981303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b03b0f3c0 con 0x561b03e385d0 2024-09-19T07:55:19.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e3ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e42d30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f95f80057c0 tx=0x7f95f80037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33e5a0e981e2854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f95f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1221981303 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8035070 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1221981303 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f95f80038b0 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f8004030 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1221981303 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f95f8031a80 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f961280b740 10 client.16317 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.146+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561b03e51aa0 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1221981303 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f8004030 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1221981303 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f95f803a040 con 0x561b03e385d0 2024-09-19T07:55:19.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f961280b740 10 client.16317 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f961280b740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f961280b740 20 client.16317 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f961280b740 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03e52df0 0x561b03e551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f961280b740 4 client.16317 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b03dab860 con 0x561b03e52df0 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.147+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03e52df0 0x561b03e551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f95f1ffb640 10 client.16317 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03e52df0 0x561b03e551e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d98a7292bacfbb2 server_cookie=f40671b956129891 in_seq=0 out_seq=0 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1221981303 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b03dab860 con 0x561b03e52df0 2024-09-19T07:55:19.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f95f1ffb640 10 client.16317 handle_command_reply: tid=0 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 client.16317 shutdown 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 msgr2=0x561b03e42d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e42d30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f95f80057c0 tx=0x7f95f80037d0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 shutdown_connections 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03e52df0 0x561b03e551e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e3ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f95f1ffb640 0 client.16317 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 --2- 172.21.15.76:0/1221981303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e42d30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 >> 172.21.15.76:0/1221981303 conn(0x561b03e01310 msgr2=0x561b03e3a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 shutdown_connections 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.148+0000 7f961280b740 1 -- 172.21.15.76:0/1221981303 wait complete. 2024-09-19T07:55:19.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.149+0000 7f961280b740 20 client.16317 trim_cache size 0 max 16384 2024-09-19T07:55:19.163 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:18 smithi137 ceph-mon[35309]: pgmap v127: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 276 op/s 2024-09-19T07:55:19.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.161+0000 7f961280b740 1 Processor -- start 2024-09-19T07:55:19.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.161+0000 7f961280b740 1 -- start start 2024-09-19T07:55:19.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f961280b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e34d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f961280b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e4f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f961280b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e39300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f961280b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f96081b2650 con 0x561b03e43370 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f961280b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96081afe60 con 0x561b03e39b40 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f961280b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f96081adcb0 con 0x561b03e385d0 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e39300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e39300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38444/0 (socket says 172.21.15.76:38444) 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 -- 172.21.15.76:0/2940277977 learned_addr learned my addr 172.21.15.76:0/2940277977 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960e1ce640 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e4f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e34d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 -- 172.21.15.76:0/2940277977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 msgr2=0x561b03e34d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e34d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 -- 172.21.15.76:0/2940277977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 msgr2=0x561b03e4f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e4f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 -- 172.21.15.76:0/2940277977 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b03e42950 con 0x561b03e43370 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f960d9cd640 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e39300 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f95f8005e00 tx=0x7f95f803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216683aa9d02f458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f95f3fff640 1 -- 172.21.15.76:0/2940277977 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f805e020 con 0x561b03e43370 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f95f3fff640 1 -- 172.21.15.76:0/2940277977 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f8031400 con 0x561b03e43370 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.162+0000 7f95f3fff640 1 -- 172.21.15.76:0/2940277977 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8035040 con 0x561b03e43370 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 -- 172.21.15.76:0/2940277977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 msgr2=0x561b03e39300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e39300 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f95f8005e00 tx=0x7f95f803f040 comp rx=0 tx=0).stop 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 -- 172.21.15.76:0/2940277977 shutdown_connections 2024-09-19T07:55:19.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e43370 0x561b03e39300 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e39b40 0x561b03e4f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 --2- 172.21.15.76:0/2940277977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e385d0 0x561b03e34d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 -- 172.21.15.76:0/2940277977 >> 172.21.15.76:0/2940277977 conn(0x561b03e01310 msgr2=0x561b03e34680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 -- 172.21.15.76:0/2940277977 shutdown_connections 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 -- 172.21.15.76:0/2940277977 wait complete. 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 -- start start 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.163+0000 7f961280b740 1 Processor -- start 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e4bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e3c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f96081ae320 con 0x561b03e385d0 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96081af790 con 0x561b03e43370 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f96081ae9f0 con 0x561b03e39b40 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f961280b740 10 client.0 _ll_register_callbacks cb 0x7f9604004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e4b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38448/0 (socket says 172.21.15.76:38448) 2024-09-19T07:55:19.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 -- 172.21.15.76:0/1809012207 learned_addr learned my addr 172.21.15.76:0/1809012207 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 -- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 msgr2=0x561b03e4bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e4bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e4bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 -- 172.21.15.76:0/1809012207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 msgr2=0x561b03e3c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e3c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 -- 172.21.15.76:0/1809012207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b03e3cfa0 con 0x561b03e385d0 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e4bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f960d9cd640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e4b600 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f95f802a460 tx=0x7f95f803ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6dd01e15404f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f95f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:19.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.164+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1809012207 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f805e070 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1809012207 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f95f8005250 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f8031400 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1809012207 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f95f8035070 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 10 client.16323 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561b03ebd1d0 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1809012207 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f8031400 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1809012207 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f95f8063070 con 0x561b03e385d0 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 10 client.16323 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 10 client.16323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 20 client.16323 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:19.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03ebd880 0x561b03ebfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 4 client.16323 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b03da5d70 con 0x561b03ebd880 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.165+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03ebd880 0x561b03ebfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f960e1ce640 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03ebd880 0x561b03ebfc70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d72ec239a0eafe55 server_cookie=55cebef2197a6691 in_seq=0 out_seq=0 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f95f1ffb640 10 client.16323 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f95f1ffb640 1 -- 172.21.15.76:0/1809012207 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b03da5d70 con 0x561b03ebd880 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f95f1ffb640 10 client.16323 handle_command_reply: tid=0 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 client.16323 shutdown 2024-09-19T07:55:19.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 msgr2=0x561b03e4b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e4b600 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f95f802a460 tx=0x7f95f803ddf0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 shutdown_connections 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x561b03ebd880 0x561b03ebfc70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b03e43370 0x561b03e3c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561b03e39b40 0x561b03e4bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f95f1ffb640 0 client.16323 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 --2- 172.21.15.76:0/1809012207 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b03e385d0 0x561b03e4b600 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 >> 172.21.15.76:0/1809012207 conn(0x561b03e01310 msgr2=0x561b03e34680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:19.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 shutdown_connections 2024-09-19T07:55:19.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 1 -- 172.21.15.76:0/1809012207 wait complete. 2024-09-19T07:55:19.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.166+0000 7f961280b740 20 client.16323 trim_cache size 0 max 16384 2024-09-19T07:55:19.178 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:55:19.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95f40a33b0 msgr2=0x7f95f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95f40a33b0 0x7f95f40a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9600009270 tx=0x7f960006e030 comp rx=0 tx=0).stop 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 msgr2=0x7f9608197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 0x7f9608197c20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f960000eaa0 tx=0x7f960000ef60 comp rx=0 tx=0).stop 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 shutdown_connections 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f95f40a33b0 0x7f95f40a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9608106a80 0x7f9608197c20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9608101420 0x7f96081976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 --2- 172.21.15.76:0/2466191713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9608100a80 0x7f96081971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 >> 172.21.15.76:0/2466191713 conn(0x7f96080fc7a0 msgr2=0x7f96080fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 shutdown_connections 2024-09-19T07:55:19.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:19.167+0000 7f9610432640 1 -- 172.21.15.76:0/2466191713 wait complete. 2024-09-19T07:55:19.952 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:55:20.200 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:20.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 -- 172.21.15.76:0/797755598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 msgr2=0x7f12a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 --2- 172.21.15.76:0/797755598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a81021c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1298009900 tx=0x7f129802a410 comp rx=0 tx=0).stop 2024-09-19T07:55:20.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 -- 172.21.15.76:0/797755598 shutdown_connections 2024-09-19T07:55:20.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 --2- 172.21.15.76:0/797755598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a8106f10 0x7f12a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 --2- 172.21.15.76:0/797755598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a8102790 0x7f12a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 --2- 172.21.15.76:0/797755598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a81021c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 -- 172.21.15.76:0/797755598 >> 172.21.15.76:0/797755598 conn(0x7f12a80fd8c0 msgr2=0x7f12a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 -- 172.21.15.76:0/797755598 shutdown_connections 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.677+0000 7f12acdd7640 1 -- 172.21.15.76:0/797755598 wait complete. 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 Processor -- start 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 -- start start 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a8102790 0x7f12a8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a8106f10 0x7f12a819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f12a8112090 con 0x7f12a8101de0 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12a8111f10 con 0x7f12a8102790 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12acdd7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12a8112210 con 0x7f12a8106f10 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12a659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12a659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38466/0 (socket says 172.21.15.76:38466) 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12a659c640 1 -- 172.21.15.76:0/3992673555 learned_addr learned my addr 172.21.15.76:0/3992673555 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a8102790 0x7f12a8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.678+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a8106f10 0x7f12a819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.679+0000 7f12a659c640 1 -- 172.21.15.76:0/3992673555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a8106f10 msgr2=0x7f12a819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.679+0000 7f12a659c640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a8106f10 0x7f12a819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.679+0000 7f12a659c640 1 -- 172.21.15.76:0/3992673555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a8102790 msgr2=0x7f12a8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.679+0000 7f12a659c640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a8102790 0x7f12a8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.679+0000 7f12a659c640 1 -- 172.21.15.76:0/3992673555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a819d4c0 con 0x7f12a8101de0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.679+0000 7f12a659c640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a8198510 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1298006010 tx=0x7f12980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.680+0000 7f12977fe640 1 -- 172.21.15.76:0/3992673555 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129803f030 con 0x7f12a8101de0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.680+0000 7f12977fe640 1 -- 172.21.15.76:0/3992673555 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1298003d00 con 0x7f12a8101de0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.680+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a819d750 con 0x7f12a8101de0 2024-09-19T07:55:20.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.680+0000 7f12977fe640 1 -- 172.21.15.76:0/3992673555 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298035070 con 0x7f12a8101de0 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.680+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a81a5090 con 0x7f12a8101de0 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.682+0000 7f12977fe640 1 -- 172.21.15.76:0/3992673555 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1298042030 con 0x7f12a8101de0 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 Processor -- start 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 -- start start 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6db40 0x55db74e6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6c5d0 0x55db74e6ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 0x55db74e79760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55db74dd22f0 con 0x55db74e77370 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55db74d79cf0 con 0x55db74e6db40 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12af1b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55db74dce2b0 con 0x55db74e6c5d0 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12977fe640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f12900a33b0 0x7f12900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12a5d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 0x55db74e79760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12a5d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 0x55db74e79760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38482/0 (socket says 172.21.15.76:38482) 2024-09-19T07:55:20.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12a5d9b640 1 -- 172.21.15.76:0/389762214 learned_addr learned my addr 172.21.15.76:0/389762214 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12a659c640 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6c5d0 0x55db74e6ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6db40 0x55db74e6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f12900a33b0 0x7f12900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.683+0000 7f12977fe640 1 -- 172.21.15.76:0/3992673555 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f12980f02e0 con 0x7f12a8101de0 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a5d9b640 1 -- 172.21.15.76:0/389762214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6c5d0 msgr2=0x55db74e6ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6c5d0 0x55db74e6ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a5d9b640 1 -- 172.21.15.76:0/389762214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6db40 msgr2=0x55db74e6c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6db40 0x55db74e6c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a5d9b640 1 -- 172.21.15.76:0/389762214 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db74d5e3a0 con 0x55db74e77370 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a659c640 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6c5d0 0x55db74e6ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 0x55db74e79760 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f129c00b740 tx=0x7f129c00bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a63bd350aa82339 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f12900a33b0 0x7f12900a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12a000a780 tx=0x7f12a000a4d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:20.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f1294ff9640 1 -- 172.21.15.76:0/389762214 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c003dd0 con 0x55db74e77370 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f1294ff9640 1 -- 172.21.15.76:0/389762214 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f129c015070 con 0x55db74e77370 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.684+0000 7f1294ff9640 1 -- 172.21.15.76:0/389762214 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c011440 con 0x55db74e77370 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- 172.21.15.76:0/389762214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 msgr2=0x55db74e79760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 0x55db74e79760 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f129c00b740 tx=0x7f129c00bc00 comp rx=0 tx=0).stop 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- 172.21.15.76:0/389762214 shutdown_connections 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e77370 0x55db74e79760 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6c5d0 0x55db74e6ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- 172.21.15.76:0/389762214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6db40 0x55db74e6c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- 172.21.15.76:0/389762214 >> 172.21.15.76:0/389762214 conn(0x55db74e35310 msgr2=0x55db74e68c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- 172.21.15.76:0/389762214 shutdown_connections 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- 172.21.15.76:0/389762214 wait complete. 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- start start 2024-09-19T07:55:20.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 Processor -- start 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6c5d0 0x55db74e76d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 0x55db74e74030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e77370 0x55db74e74640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55db74e7a070 con 0x55db74e6db40 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55db74d8d060 con 0x55db74e6c5d0 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.685+0000 7f12af1b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55db74e7a1f0 con 0x55db74e77370 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12af1b0740 10 client.0 _ll_register_callbacks cb 0x55db74ae08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 0x55db74e74030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 0x55db74e74030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38496/0 (socket says 172.21.15.76:38496) 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 -- 172.21.15.76:0/3200332003 learned_addr learned my addr 172.21.15.76:0/3200332003 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a659c640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6c5d0 0x55db74e76d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e77370 0x55db74e74640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 -- 172.21.15.76:0/3200332003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e77370 msgr2=0x55db74e74640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e77370 0x55db74e74640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 -- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6c5d0 msgr2=0x55db74e76d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6c5d0 0x55db74e76d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 -- 172.21.15.76:0/3200332003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db74b433c0 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 0x55db74e74030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f129c004b30 tx=0x7f129c004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a0762c6adc47aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f128dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f128dffb640 1 -- 172.21.15.76:0/3200332003 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c028060 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f128dffb640 1 -- 172.21.15.76:0/3200332003 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f129c003dd0 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f129c015070 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f128dffb640 1 -- 172.21.15.76:0/3200332003 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f129c005000 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12af1b0740 10 client.16335 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.686+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55db74e85b40 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f128dffb640 1 -- 172.21.15.76:0/3200332003 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f129c015070 con 0x55db74e6db40 2024-09-19T07:55:20.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f128dffb640 1 -- 172.21.15.76:0/3200332003 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f129c022070 con 0x55db74e6db40 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12af1b0740 10 client.16335 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12af1b0740 10 client.16335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12af1b0740 20 client.16335 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12af1b0740 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74e86e90 0x55db74e89280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12af1b0740 4 client.16335 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db74ddf860 con 0x55db74e86e90 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.687+0000 7f12a659c640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74e86e90 0x55db74e89280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f128dffb640 10 client.16335 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f12a659c640 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74e86e90 0x55db74e89280 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f29e4ccd2312e542 server_cookie=5dac39f3b5720337 in_seq=0 out_seq=0 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f128dffb640 1 -- 172.21.15.76:0/3200332003 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db74ddf860 con 0x55db74e86e90 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f128dffb640 10 client.16335 handle_command_reply: tid=0 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f12af1b0740 1 client.16335 shutdown 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 msgr2=0x55db74e74030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.688+0000 7f12af1b0740 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 0x55db74e74030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f129c004b30 tx=0x7f129c004f60 comp rx=0 tx=0).stop 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 shutdown_connections 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74e86e90 0x55db74e89280 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e77370 0x55db74e74640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6db40 0x55db74e74030 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f128dffb640 0 client.16335 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 --2- 172.21.15.76:0/3200332003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e6c5d0 0x55db74e76d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 >> 172.21.15.76:0/3200332003 conn(0x55db74e35310 msgr2=0x55db74e6e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 shutdown_connections 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 1 -- 172.21.15.76:0/3200332003 wait complete. 2024-09-19T07:55:20.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.689+0000 7f12af1b0740 20 client.16335 trim_cache size 0 max 16384 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 Processor -- start 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 -- start start 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e75fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e6f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e6f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81b04b0 con 0x55db74e6c5d0 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81adcc0 con 0x55db74e77370 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12af1b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81abb10 con 0x55db74e6db40 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e75fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38504/0 (socket says 172.21.15.76:38504) 2024-09-19T07:55:20.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 -- 172.21.15.76:0/2436112804 learned_addr learned my addr 172.21.15.76:0/2436112804 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e6f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e6f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 -- 172.21.15.76:0/2436112804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 msgr2=0x55db74e6f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e6f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 -- 172.21.15.76:0/2436112804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 msgr2=0x55db74e6f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e6f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 -- 172.21.15.76:0/2436112804 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db74e6c2d0 con 0x55db74e6c5d0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e6f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e6f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.702+0000 7f12a659c640 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e75fa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f12980b90a0 tx=0x7f129808f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f073b402b83ed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f128ffff640 1 -- 172.21.15.76:0/2436112804 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298049040 con 0x55db74e6c5d0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f128ffff640 1 -- 172.21.15.76:0/2436112804 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12980bc6d0 con 0x55db74e6c5d0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f128ffff640 1 -- 172.21.15.76:0/2436112804 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12980b8d40 con 0x55db74e6c5d0 2024-09-19T07:55:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 -- 172.21.15.76:0/2436112804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 msgr2=0x55db74e75fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e75fa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f12980b90a0 tx=0x7f129808f5c0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 -- 172.21.15.76:0/2436112804 shutdown_connections 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e6f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e6f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 --2- 172.21.15.76:0/2436112804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e75fa0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 -- 172.21.15.76:0/2436112804 >> 172.21.15.76:0/2436112804 conn(0x55db74e35310 msgr2=0x55db74e75890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 -- 172.21.15.76:0/2436112804 shutdown_connections 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.703+0000 7f12af1b0740 1 -- 172.21.15.76:0/2436112804 wait complete. 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 -- start start 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 Processor -- start 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e71620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e71b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81ac180 con 0x55db74e6c5d0 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81ad5f0 con 0x55db74e77370 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f12a81ac850 con 0x55db74e6db40 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12af1b0740 10 client.0 _ll_register_callbacks cb 0x7f12a000adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38508/0 (socket says 172.21.15.76:38508) 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 -- 172.21.15.76:0/1331407012 learned_addr learned my addr 172.21.15.76:0/1331407012 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a6d9d640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e71b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e71620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 -- 172.21.15.76:0/1331407012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 msgr2=0x55db74e71620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e71620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 -- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 msgr2=0x55db74e71b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e71b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.704+0000 7f12a659c640 1 -- 172.21.15.76:0/1331407012 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db74ef4d10 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12a659c640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e710e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1298005ab0 tx=0x7f12980b8330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef18af6f3eec4a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f128dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f128dffb640 1 -- 172.21.15.76:0/1331407012 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298085020 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f128dffb640 1 -- 172.21.15.76:0/1331407012 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f12980b8d40 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12980bc6d0 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f128dffb640 1 -- 172.21.15.76:0/1331407012 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1298049050 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 10 client.16341 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55db74ef5f40 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f128dffb640 1 -- 172.21.15.76:0/1331407012 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12980bc6d0 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f128dffb640 1 -- 172.21.15.76:0/1331407012 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f129808f230 con 0x55db74e6c5d0 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 10 client.16341 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 10 client.16341 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 20 client.16341 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:20.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74ef65b0 0x55db74ef89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 4 client.16341 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.705+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db74dd9d70 con 0x55db74ef65b0 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74ef65b0 0x55db74ef89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f128dffb640 10 client.16341 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12a5d9b640 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74ef65b0 0x55db74ef89d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72a5080196ced2c6 server_cookie=538fffb5577b2747 in_seq=0 out_seq=0 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f128dffb640 1 -- 172.21.15.76:0/1331407012 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db74dd9d70 con 0x55db74ef65b0 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f128dffb640 10 client.16341 handle_command_reply: tid=0 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 client.16341 shutdown 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 msgr2=0x55db74e710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e710e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1298005ab0 tx=0x7f12980b8330 comp rx=0 tx=0).stop 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 shutdown_connections 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55db74ef65b0 0x55db74ef89d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55db74e77370 0x55db74e71b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55db74e6db40 0x55db74e71620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 --2- 172.21.15.76:0/1331407012 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55db74e6c5d0 0x55db74e710e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 >> 172.21.15.76:0/1331407012 conn(0x55db74e35310 msgr2=0x55db74e760b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f128dffb640 0 client.16341 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 shutdown_connections 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.706+0000 7f12af1b0740 1 -- 172.21.15.76:0/1331407012 wait complete. 2024-09-19T07:55:20.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12af1b0740 20 client.16341 trim_cache size 0 max 16384 2024-09-19T07:55:20.716 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:55:20.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f12900a33b0 msgr2=0x7f12900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f12900a33b0 0x7f12900a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12a000a780 tx=0x7f12a000a4d0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 msgr2=0x7f12a8198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a8198510 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1298006010 tx=0x7f12980042f0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 shutdown_connections 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f12900a33b0 0x7f12900a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12a8106f10 0x7f12a819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a8102790 0x7f12a8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 --2- 172.21.15.76:0/3992673555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f12a8101de0 0x7f12a8198510 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 >> 172.21.15.76:0/3992673555 conn(0x7f12a80fd8c0 msgr2=0x7f12a80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 shutdown_connections 2024-09-19T07:55:20.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:20.707+0000 7f12acdd7640 1 -- 172.21.15.76:0/3992673555 wait complete. 2024-09-19T07:55:20.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:20 smithi076 ceph-mon[30930]: pgmap v128: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 281 op/s 2024-09-19T07:55:21.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:20 smithi152 ceph-mon[35117]: pgmap v128: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 281 op/s 2024-09-19T07:55:21.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:20 smithi137 ceph-mon[35309]: pgmap v128: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 281 op/s 2024-09-19T07:55:21.494 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:55:21.744 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:22.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:22 smithi076 ceph-mon[30930]: pgmap v129: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 649 KiB/s wr, 142 op/s 2024-09-19T07:55:23.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:22 smithi152 ceph-mon[35117]: pgmap v129: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 649 KiB/s wr, 142 op/s 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 -- 172.21.15.76:0/2003639656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9894102d30 msgr2=0x7f9894103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 --2- 172.21.15.76:0/2003639656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9894102d30 0x7f9894103110 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9884009cd0 tx=0x7f988402a910 comp rx=0 tx=0).stop 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 -- 172.21.15.76:0/2003639656 shutdown_connections 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 --2- 172.21.15.76:0/2003639656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98941082a0 0x7f989410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 --2- 172.21.15.76:0/2003639656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98941036e0 0x7f9894107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 --2- 172.21.15.76:0/2003639656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9894102d30 0x7f9894103110 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 -- 172.21.15.76:0/2003639656 >> 172.21.15.76:0/2003639656 conn(0x7f98940fc7d0 msgr2=0x7f98940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 -- 172.21.15.76:0/2003639656 shutdown_connections 2024-09-19T07:55:23.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 -- 172.21.15.76:0/2003639656 wait complete. 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 Processor -- start 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.220+0000 7f9899383640 1 -- start start 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9894102d30 0x7f9894100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 0x7f9894100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98941082a0 0x7f9894101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9894112220 con 0x7f98941036e0 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98941120a0 con 0x7f9894102d30 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98941123a0 con 0x7f98941082a0 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 0x7f9894100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 0x7f9894100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38516/0 (socket says 172.21.15.76:38516) 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 -- 172.21.15.76:0/694528202 learned_addr learned my addr 172.21.15.76:0/694528202 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:23.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9892ffd640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9894102d30 0x7f9894100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 -- 172.21.15.76:0/694528202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98941082a0 msgr2=0x7f9894101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98941082a0 0x7f9894101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 -- 172.21.15.76:0/694528202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9894102d30 msgr2=0x7f9894100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9894102d30 0x7f9894100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 -- 172.21.15.76:0/694528202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98941a6ba0 con 0x7f98941036e0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f98927fc640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 0x7f9894100ed0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f987c006fd0 tx=0x7f987c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f988bfff640 1 -- 172.21.15.76:0/694528202 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c011830 con 0x7f98941036e0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f988bfff640 1 -- 172.21.15.76:0/694528202 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f987c016070 con 0x7f98941036e0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98941a6e90 con 0x7f98941036e0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f988bfff640 1 -- 172.21.15.76:0/694528202 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c00f2e0 con 0x7f98941036e0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.221+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98941a72f0 con 0x7f98941036e0 2024-09-19T07:55:23.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f988bfff640 1 -- 172.21.15.76:0/694528202 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f987c0119d0 con 0x7f98941036e0 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 Processor -- start 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 -- start start 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c670b40 0x55d41c66f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c66f5d0 0x55d41c66fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c67c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d41c5d52f0 con 0x55d41c67a370 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d41c57ccf0 con 0x55d41c66f5d0 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f989b75c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d41c5d12b0 con 0x55d41c670b40 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f988bfff640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f98800a33b0 0x7f98800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f98927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c67c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.224+0000 7f98927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c67c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38532/0 (socket says 172.21.15.76:38532) 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 -- 172.21.15.76:0/1087251170 learned_addr learned my addr 172.21.15.76:0/1087251170 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98937fe640 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c670b40 0x55d41c66f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98937fe640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f98800a33b0 0x7f98800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f9892ffd640 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c66f5d0 0x55d41c66fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f988bfff640 1 -- 172.21.15.76:0/694528202 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f987c0cf350 con 0x7f98941036e0 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 -- 172.21.15.76:0/1087251170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c670b40 msgr2=0x55d41c66f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c670b40 0x55d41c66f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 -- 172.21.15.76:0/1087251170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c66f5d0 msgr2=0x55d41c66fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c66f5d0 0x55d41c66fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 -- 172.21.15.76:0/1087251170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41c5613a0 con 0x55d41c67a370 2024-09-19T07:55:23.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98927fc640 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c67c760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f987c0a3e20 tx=0x7f987c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a72155085e4c4bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98937fe640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f98800a33b0 0x7f98800a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f988c005d00 tx=0x7f988c00c2f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98897fa640 1 -- 172.21.15.76:0/1087251170 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c09b040 con 0x55d41c67a370 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98897fa640 1 -- 172.21.15.76:0/1087251170 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f987c09bde0 con 0x55d41c67a370 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.225+0000 7f98897fa640 1 -- 172.21.15.76:0/1087251170 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c0cccc0 con 0x55d41c67a370 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 -- 172.21.15.76:0/1087251170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 msgr2=0x55d41c67c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c67c760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f987c0a3e20 tx=0x7f987c00bf90 comp rx=0 tx=0).stop 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 -- 172.21.15.76:0/1087251170 shutdown_connections 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c67c760 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c66f5d0 0x55d41c66fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 --2- 172.21.15.76:0/1087251170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c670b40 0x55d41c66f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 -- 172.21.15.76:0/1087251170 >> 172.21.15.76:0/1087251170 conn(0x55d41c638310 msgr2=0x55d41c66bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 -- 172.21.15.76:0/1087251170 shutdown_connections 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 -- 172.21.15.76:0/1087251170 wait complete. 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 -- start start 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.226+0000 7f989b75c740 1 Processor -- start 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c679d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c676fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c6775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d41c67d010 con 0x55d41c67a370 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d41c590060 con 0x55d41c670b40 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d41c67d190 con 0x55d41c66f5d0 2024-09-19T07:55:23.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f989b75c740 10 client.0 _ll_register_callbacks cb 0x55d41c2e38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c679d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98927fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c676fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c679d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:59578/0 (socket says 172.21.15.76:59578) 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98937fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c6775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f9892ffd640 1 -- 172.21.15.76:0/650941606 learned_addr learned my addr 172.21.15.76:0/650941606 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98937fe640 1 -- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 msgr2=0x55d41c679d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98937fe640 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c679d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98937fe640 1 -- 172.21.15.76:0/650941606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 msgr2=0x55d41c676fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98937fe640 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c676fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98937fe640 1 -- 172.21.15.76:0/650941606 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41c3463c0 con 0x55d41c67a370 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.227+0000 7f98927fc640 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c676fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:55:23.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f98937fe640 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c6775d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f988c012d60 tx=0x7f988c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea8123e3dee6463 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f987a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f987a7fc640 1 -- 172.21.15.76:0/650941606 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0108d0 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f987c09bde0 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f987a7fc640 1 -- 172.21.15.76:0/650941606 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f988c010a70 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f987a7fc640 1 -- 172.21.15.76:0/650941606 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f988c010c70 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 10 client.16353 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d41c688b20 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f987a7fc640 1 -- 172.21.15.76:0/650941606 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f987c09bde0 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f987a7fc640 1 -- 172.21.15.76:0/650941606 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f988c028410 con 0x55d41c67a370 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 10 client.16353 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 20 client.16353 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:23.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c689f30 0x55d41c68c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 4 client.16353 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.228+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d41c5e2860 con 0x55d41c689f30 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.229+0000 7f9892ffd640 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c689f30 0x55d41c68c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.229+0000 7f9892ffd640 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c689f30 0x55d41c68c360 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313248cd73cae9aa server_cookie=8809c2a5d16f4b6c in_seq=0 out_seq=0 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.229+0000 7f987a7fc640 10 client.16353 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f987a7fc640 1 -- 172.21.15.76:0/650941606 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d41c5e2860 con 0x55d41c689f30 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f987a7fc640 10 client.16353 handle_command_reply: tid=0 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 client.16353 shutdown 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 msgr2=0x55d41c6775d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c6775d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f988c012d60 tx=0x7f988c017000 comp rx=0 tx=0).stop 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 shutdown_connections 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c689f30 0x55d41c68c360 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c67a370 0x55d41c6775d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c676fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 --2- 172.21.15.76:0/650941606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c679d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 >> 172.21.15.76:0/650941606 conn(0x55d41c638310 msgr2=0x55d41c671990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f987a7fc640 0 client.16353 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 shutdown_connections 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 1 -- 172.21.15.76:0/650941606 wait complete. 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.230+0000 7f989b75c740 20 client.16353 trim_cache size 0 max 16384 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 Processor -- start 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 -- start start 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c6862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 0x55d41c66b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c67a370 0x55d41c66bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f98941b2720 con 0x55d41c670b40 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98941aff30 con 0x55d41c67a370 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f989b75c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98941add80 con 0x55d41c66f5d0 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f98927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 0x55d41c66b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f98927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 0x55d41c66b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38538/0 (socket says 172.21.15.76:38538) 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f98927fc640 1 -- 172.21.15.76:0/233889287 learned_addr learned my addr 172.21.15.76:0/233889287 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f98937fe640 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c67a370 0x55d41c66bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.243+0000 7f9892ffd640 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c6862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f98927fc640 1 -- 172.21.15.76:0/233889287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 msgr2=0x55d41c6862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f98927fc640 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c6862b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f98927fc640 1 -- 172.21.15.76:0/233889287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c67a370 msgr2=0x55d41c66bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f98927fc640 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c67a370 0x55d41c66bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f98927fc640 1 -- 172.21.15.76:0/233889287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41c688930 con 0x55d41c670b40 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f9892ffd640 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c6862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f98927fc640 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 0x55d41c66b700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f987c0ccc00 tx=0x7f987c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d979c4502d1757 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f9888ff9640 1 -- 172.21.15.76:0/233889287 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c09bde0 con 0x55d41c670b40 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f9888ff9640 1 -- 172.21.15.76:0/233889287 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f987c09b6e0 con 0x55d41c670b40 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.244+0000 7f9888ff9640 1 -- 172.21.15.76:0/233889287 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c0ccc30 con 0x55d41c670b40 2024-09-19T07:55:23.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- 172.21.15.76:0/233889287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 msgr2=0x55d41c66b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 0x55d41c66b700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f987c0ccc00 tx=0x7f987c0047d0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- 172.21.15.76:0/233889287 shutdown_connections 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c67a370 0x55d41c66bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c670b40 0x55d41c66b700 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- 172.21.15.76:0/233889287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c66f5d0 0x55d41c6862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- 172.21.15.76:0/233889287 >> 172.21.15.76:0/233889287 conn(0x55d41c638310 msgr2=0x55d41c676fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- 172.21.15.76:0/233889287 shutdown_connections 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- 172.21.15.76:0/233889287 wait complete. 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- start start 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 Processor -- start 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 0x55d41c682910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c67dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c67a370 0x55d41c67e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f98941ae3f0 con 0x55d41c66f5d0 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98941af860 con 0x55d41c670b40 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f98941aeac0 con 0x55d41c67a370 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f989b75c740 10 client.0 _ll_register_callbacks cb 0x7f988c00c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 0x55d41c682910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.245+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 0x55d41c682910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:38542/0 (socket says 172.21.15.76:38542) 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 -- 172.21.15.76:0/1181955571 learned_addr learned my addr 172.21.15.76:0/1181955571 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f98937fe640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c67a370 0x55d41c67e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f98927fc640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c67dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 -- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c67a370 msgr2=0x55d41c67e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c67a370 0x55d41c67e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 -- 172.21.15.76:0/1181955571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 msgr2=0x55d41c67dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c67dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 -- 172.21.15.76:0/1181955571 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41c67e740 con 0x55d41c66f5d0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f9892ffd640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 0x55d41c682910 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9884005e30 tx=0x7f98840039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f591d01419a42fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f987a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f987a7fc640 1 -- 172.21.15.76:0/1181955571 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884055060 con 0x55d41c66f5d0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f987a7fc640 1 -- 172.21.15.76:0/1181955571 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9884031660 con 0x55d41c66f5d0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f987c09b6e0 con 0x55d41c66f5d0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f987a7fc640 1 -- 172.21.15.76:0/1181955571 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9884031860 con 0x55d41c66f5d0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f989b75c740 10 client.16359 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d41c6f4960 con 0x55d41c66f5d0 2024-09-19T07:55:23.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.246+0000 7f987a7fc640 1 -- 172.21.15.76:0/1181955571 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f987c09b6e0 con 0x55d41c66f5d0 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f987a7fc640 1 -- 172.21.15.76:0/1181955571 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f988404f030 con 0x55d41c66f5d0 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 10 client.16359 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 20 client.16359 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c6f5070 0x55d41c6f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 4 client.16359 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d41c5dcd70 con 0x55d41c6f5070 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f98927fc640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c6f5070 0x55d41c6f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f987a7fc640 10 client.16359 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f98927fc640 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c6f5070 0x55d41c6f7490 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66fd8e0484f90cb0 server_cookie=8ca914e42e9311bb in_seq=0 out_seq=0 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f987a7fc640 1 -- 172.21.15.76:0/1181955571 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d41c5dcd70 con 0x55d41c6f5070 2024-09-19T07:55:23.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f987a7fc640 10 client.16359 handle_command_reply: tid=0 2024-09-19T07:55:23.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.247+0000 7f989b75c740 1 client.16359 shutdown 2024-09-19T07:55:23.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 msgr2=0x55d41c682910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 0x55d41c682910 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9884005e30 tx=0x7f98840039c0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.099 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:55:23.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 shutdown_connections 2024-09-19T07:55:23.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d41c67a370 0x55d41c67e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41c670b40 0x55d41c67dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d41c6f5070 0x55d41c6f7490 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 --2- 172.21.15.76:0/1181955571 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d41c66f5d0 0x55d41c682910 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 >> 172.21.15.76:0/1181955571 conn(0x55d41c638310 msgr2=0x55d41c66b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f987a7fc640 0 client.16359 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 shutdown_connections 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 1 -- 172.21.15.76:0/1181955571 wait complete. 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.248+0000 7f989b75c740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T07:55:23.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f98800a33b0 msgr2=0x7f98800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f98800a33b0 0x7f98800a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f988c005d00 tx=0x7f988c00c2f0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 msgr2=0x7f9894100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 0x7f9894100ed0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f987c006fd0 tx=0x7f987c00b8e0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 shutdown_connections 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f98800a33b0 0x7f98800a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98941082a0 0x7f9894101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f98941036e0 0x7f9894100ed0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 --2- 172.21.15.76:0/694528202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9894102d30 0x7f9894100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 >> 172.21.15.76:0/694528202 conn(0x7f98940fc7d0 msgr2=0x7f9894105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 shutdown_connections 2024-09-19T07:55:23.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:22.249+0000 7f9899383640 1 -- 172.21.15.76:0/694528202 wait complete. 2024-09-19T07:55:23.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:22 smithi137 ceph-mon[35309]: pgmap v129: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 649 KiB/s wr, 142 op/s 2024-09-19T07:55:24.888 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:55:24.888 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:55:24.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:24 smithi076 ceph-mon[30930]: pgmap v130: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 533 KiB/s wr, 125 op/s 2024-09-19T07:55:24.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:55:24.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:55:24.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:55:24.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:55:25.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:24 smithi152 ceph-mon[35117]: pgmap v130: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 533 KiB/s wr, 125 op/s 2024-09-19T07:55:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:55:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:55:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:55:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:55:25.134 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:25.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:24 smithi137 ceph-mon[35309]: pgmap v130: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 533 KiB/s wr, 125 op/s 2024-09-19T07:55:25.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:55:25.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:55:25.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:55:25.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 -- 172.21.15.76:0/3867140933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84100ca0 msgr2=0x7f1b84106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 --2- 172.21.15.76:0/3867140933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84100ca0 0x7f1b84106840 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009930 tx=0x7f1b7402a420 comp rx=0 tx=0).stop 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 -- 172.21.15.76:0/3867140933 shutdown_connections 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 --2- 172.21.15.76:0/3867140933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b84106f50 0x7f1b8410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 --2- 172.21.15.76:0/3867140933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84100ca0 0x7f1b84106840 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 --2- 172.21.15.76:0/3867140933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b841002f0 0x7f1b841006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 -- 172.21.15.76:0/3867140933 >> 172.21.15.76:0/3867140933 conn(0x7f1b84077210 msgr2=0x7f1b840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 -- 172.21.15.76:0/3867140933 shutdown_connections 2024-09-19T07:55:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 -- 172.21.15.76:0/3867140933 wait complete. 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.591+0000 7f1b8c080640 1 Processor -- start 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 -- start start 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b841002f0 0x7f1b84101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b84100ca0 0x7f1b841017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 0x7f1b84101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841120c0 con 0x7f1b84106f50 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84111f40 con 0x7f1b841002f0 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8c080640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84112240 con 0x7f1b84100ca0 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 0x7f1b84101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 0x7f1b84101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39312/0 (socket says 172.21.15.76:39312) 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 -- 172.21.15.76:0/685018452 learned_addr learned my addr 172.21.15.76:0/685018452 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:25.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8961b640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b84100ca0 0x7f1b841017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b841002f0 0x7f1b84101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 -- 172.21.15.76:0/685018452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b84100ca0 msgr2=0x7f1b841017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b84100ca0 0x7f1b841017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 -- 172.21.15.76:0/685018452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b841002f0 msgr2=0x7f1b84101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b841002f0 0x7f1b84101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 -- 172.21.15.76:0/685018452 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841a6a50 con 0x7f1b84106f50 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.592+0000 7f1b8a61d640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 0x7f1b84101cf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00eb10 tx=0x7f1b7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.593+0000 7f1b7affd640 1 -- 172.21.15.76:0/685018452 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c004b20 con 0x7f1b84106f50 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.593+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b841a6d40 con 0x7f1b84106f50 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.593+0000 7f1b7affd640 1 -- 172.21.15.76:0/685018452 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b7c004cc0 con 0x7f1b84106f50 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.593+0000 7f1b7affd640 1 -- 172.21.15.76:0/685018452 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0107f0 con 0x7f1b84106f50 2024-09-19T07:55:25.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.593+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841a7200 con 0x7f1b84106f50 2024-09-19T07:55:25.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.595+0000 7f1b7affd640 1 -- 172.21.15.76:0/685018452 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1b7c005020 con 0x7f1b84106f50 2024-09-19T07:55:25.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.595+0000 7f1b8e459740 1 Processor -- start 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.595+0000 7f1b8e459740 1 -- start start 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.595+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b50ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.595+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b51a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b51d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8e459740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562c9b475280 con 0x562c9b50fb60 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8e459740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562c9b41cb10 con 0x562c9b510480 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8e459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562c9b471240 con 0x562c9b51ad40 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b50ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b7affd640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1b700a33b0 0x7f1b700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b50ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39320/0 (socket says 172.21.15.76:39320) 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 -- 172.21.15.76:0/2374596517 learned_addr learned my addr 172.21.15.76:0/2374596517 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:25.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b51a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8a61d640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1b700a33b0 0x7f1b700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b51d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b7affd640 1 -- 172.21.15.76:0/685018452 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f1b7c0d0410 con 0x7f1b84106f50 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 -- 172.21.15.76:0/2374596517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 msgr2=0x562c9b51d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b51d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 -- 172.21.15.76:0/2374596517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 msgr2=0x562c9b51a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b51a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 -- 172.21.15.76:0/2374596517 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9b4291f0 con 0x562c9b50fb60 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8961b640 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b50ff40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005ab0 tx=0x7f1b74005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3538d138f57d5f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.596+0000 7f1b8a61d640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1b700a33b0 0x7f1b700a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c099060 tx=0x7f1b7c06e410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b6ffff640 1 -- 172.21.15.76:0/2374596517 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74035070 con 0x562c9b50fb60 2024-09-19T07:55:25.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b6ffff640 1 -- 172.21.15.76:0/2374596517 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b74044070 con 0x562c9b50fb60 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b6ffff640 1 -- 172.21.15.76:0/2374596517 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740046c0 con 0x562c9b50fb60 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 -- 172.21.15.76:0/2374596517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 msgr2=0x562c9b50ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b50ff40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005ab0 tx=0x7f1b74005e50 comp rx=0 tx=0).stop 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 -- 172.21.15.76:0/2374596517 shutdown_connections 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b51d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b51a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 --2- 172.21.15.76:0/2374596517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b50ff40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 -- 172.21.15.76:0/2374596517 >> 172.21.15.76:0/2374596517 conn(0x562c9b50c0f0 msgr2=0x562c9b50c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 -- 172.21.15.76:0/2374596517 shutdown_connections 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.597+0000 7f1b8e459740 1 -- 172.21.15.76:0/2374596517 wait complete. 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 -- start start 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 Processor -- start 2024-09-19T07:55:25.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b517c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b5181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b518710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562c9b51d910 con 0x562c9b50fb60 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562c9b42ff10 con 0x562c9b510480 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562c9b51da90 con 0x562c9b51ad40 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8e459740 10 client.0 _ll_register_callbacks cb 0x562c9b3f8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8961b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b517c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8961b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b517c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39334/0 (socket says 172.21.15.76:39334) 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b8961b640 1 -- 172.21.15.76:0/1669360938 learned_addr learned my addr 172.21.15.76:0/1669360938 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.598+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b5181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b518710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 -- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 msgr2=0x562c9b518710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b518710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 -- 172.21.15.76:0/1669360938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 msgr2=0x562c9b5181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b5181d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 -- 172.21.15.76:0/1669360938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9b1e66a0 con 0x562c9b50fb60 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8961b640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b517c90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1b74031bd0 tx=0x7f1b74005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96be09e852033ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/1669360938 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74052060 con 0x562c9b50fb60 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/1669360938 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f1b74004230 con 0x562c9b50fb60 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b74044070 con 0x562c9b50fb60 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/1669360938 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1b74035070 con 0x562c9b50fb60 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8e459740 10 client.16371 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:25.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562c9b529590 con 0x562c9b50fb60 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.599+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/1669360938 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b74044070 con 0x562c9b50fb60 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/1669360938 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f1b74003a20 con 0x562c9b50fb60 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b8e459740 10 client.16371 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b8e459740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b8e459740 20 client.16371 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b8e459740 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b52a8e0 0x562c9b52ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b8e459740 4 client.16371 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c9b4827f0 con 0x562c9b52a8e0 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b52a8e0 0x562c9b52ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b6d7fa640 10 client.16371 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:25.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.600+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b52a8e0 0x562c9b52ccd0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c93bd63bc9ffe68 server_cookie=546594dfe08d05eb in_seq=0 out_seq=0 2024-09-19T07:55:25.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/1669360938 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c9b4827f0 con 0x562c9b52a8e0 2024-09-19T07:55:25.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b6d7fa640 10 client.16371 handle_command_reply: tid=0 2024-09-19T07:55:25.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 client.16371 shutdown 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 msgr2=0x562c9b517c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b517c90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1b74031bd0 tx=0x7f1b74005450 comp rx=0 tx=0).stop 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 shutdown_connections 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b518710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b510480 0x562c9b5181d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b52a8e0 0x562c9b52ccd0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 --2- 172.21.15.76:0/1669360938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b50fb60 0x562c9b517c90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b6d7fa640 0 client.16371 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 >> 172.21.15.76:0/1669360938 conn(0x562c9b50c0f0 msgr2=0x562c9b511e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 shutdown_connections 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 1 -- 172.21.15.76:0/1669360938 wait complete. 2024-09-19T07:55:25.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.601+0000 7f1b8e459740 20 client.16371 trim_cache size 0 max 16384 2024-09-19T07:55:25.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.618+0000 7f1b8e459740 1 Processor -- start 2024-09-19T07:55:25.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.618+0000 7f1b8e459740 1 -- start start 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.618+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b50fb60 0x562c9b519af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b5322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b51ad40 0x562c9b532810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8e459740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841b2600 con 0x562c9b510480 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8e459740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841afe10 con 0x562c9b51ad40 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8e459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841adc60 con 0x562c9b50fb60 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b5322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b5322d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39344/0 (socket says 172.21.15.76:39344) 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 -- 172.21.15.76:0/4093280449 learned_addr learned my addr 172.21.15.76:0/4093280449 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8961b640 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b50fb60 0x562c9b519af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8961b640 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b51ad40 0x562c9b532810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 -- 172.21.15.76:0/4093280449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b50fb60 msgr2=0x562c9b519af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b50fb60 0x562c9b519af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 -- 172.21.15.76:0/4093280449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b51ad40 msgr2=0x562c9b532810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b51ad40 0x562c9b532810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 -- 172.21.15.76:0/4093280449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9b52d040 con 0x562c9b510480 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b8961b640 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b51ad40 0x562c9b532810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b5322d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x562c9b517520 tx=0x7f1b80010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd9d184d7306f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b6f7fe640 1 -- 172.21.15.76:0/4093280449 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80004220 con 0x562c9b510480 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b6f7fe640 1 -- 172.21.15.76:0/4093280449 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b800043c0 con 0x562c9b510480 2024-09-19T07:55:25.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.619+0000 7f1b6f7fe640 1 -- 172.21.15.76:0/4093280449 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800035f0 con 0x562c9b510480 2024-09-19T07:55:25.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 -- 172.21.15.76:0/4093280449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 msgr2=0x562c9b5322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b5322d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x562c9b517520 tx=0x7f1b80010800 comp rx=0 tx=0).stop 2024-09-19T07:55:25.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 -- 172.21.15.76:0/4093280449 shutdown_connections 2024-09-19T07:55:25.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b51ad40 0x562c9b532810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b5322d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 --2- 172.21.15.76:0/4093280449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b50fb60 0x562c9b519af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 -- 172.21.15.76:0/4093280449 >> 172.21.15.76:0/4093280449 conn(0x562c9b50c0f0 msgr2=0x562c9b5193e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 -- 172.21.15.76:0/4093280449 shutdown_connections 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 -- 172.21.15.76:0/4093280449 wait complete. 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 -- start start 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.620+0000 7f1b8e459740 1 Processor -- start 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b50fb60 0x562c9b51f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b51f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b5942a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841ae2d0 con 0x562c9b510480 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841af740 con 0x562c9b50fb60 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841ae9a0 con 0x562c9b51ad40 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8e459740 10 client.0 _ll_register_callbacks cb 0x7f1b8000c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b51f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b51f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39352/0 (socket says 172.21.15.76:39352) 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 -- 172.21.15.76:0/503497534 learned_addr learned my addr 172.21.15.76:0/503497534 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8961b640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b50fb60 0x562c9b51f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8961b640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b5942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 -- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 msgr2=0x562c9b5942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b5942a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 -- 172.21.15.76:0/503497534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b50fb60 msgr2=0x562c9b51f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b50fb60 0x562c9b51f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 -- 172.21.15.76:0/503497534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9b594810 con 0x562c9b510480 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b8961b640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b5942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b89e1c640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b51f6d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1b80004ad0 tx=0x7f1b80004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d622d92bbb3c549 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.621+0000 7f1b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/503497534 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80005180 con 0x562c9b510480 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/503497534 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f1b80005320 con 0x562c9b510480 2024-09-19T07:55:25.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b800043c0 con 0x562c9b510480 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/503497534 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1b80005520 con 0x562c9b510480 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 10 client.16377 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562c9b595b30 con 0x562c9b510480 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/503497534 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b800043c0 con 0x562c9b510480 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/503497534 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f1b8002e800 con 0x562c9b510480 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 10 client.16377 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 20 client.16377 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b596200 0x562c9b598620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 4 client.16377 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c9b47cd00 con 0x562c9b596200 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.622+0000 7f1b8961b640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b596200 0x562c9b598620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:25.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.623+0000 7f1b6d7fa640 10 client.16377 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.623+0000 7f1b8961b640 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b596200 0x562c9b598620 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f8ffdb92e90413 server_cookie=7776566b166f7eb6 in_seq=0 out_seq=0 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b6d7fa640 1 -- 172.21.15.76:0/503497534 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c9b47cd00 con 0x562c9b596200 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b6d7fa640 10 client.16377 handle_command_reply: tid=0 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 client.16377 shutdown 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 msgr2=0x562c9b51f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b51f6d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1b80004ad0 tx=0x7f1b80004930 comp rx=0 tx=0).stop 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 shutdown_connections 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562c9b51ad40 0x562c9b5942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562c9b596200 0x562c9b598620 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562c9b510480 0x562c9b51f6d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 --2- 172.21.15.76:0/503497534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562c9b50fb60 0x562c9b51f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b6d7fa640 0 client.16377 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 >> 172.21.15.76:0/503497534 conn(0x562c9b50c0f0 msgr2=0x562c9b518470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:25.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 shutdown_connections 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 1 -- 172.21.15.76:0/503497534 wait complete. 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.624+0000 7f1b8e459740 20 client.16377 trim_cache size 0 max 16384 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "82062bb9-2424-4134-91a4-0848aa720d9b", 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:55:25.630 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1b700a33b0 msgr2=0x7f1b700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1b700a33b0 0x7f1b700a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c099060 tx=0x7f1b7c06e410 comp rx=0 tx=0).stop 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 msgr2=0x7f1b84101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 0x7f1b84101cf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00eb10 tx=0x7f1b7c00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 shutdown_connections 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1b700a33b0 0x7f1b700a5870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1b84106f50 0x7f1b84101cf0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b84100ca0 0x7f1b841017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 --2- 172.21.15.76:0/685018452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b841002f0 0x7f1b84101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:25.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 >> 172.21.15.76:0/685018452 conn(0x7f1b84077210 msgr2=0x7f1b840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:25.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 shutdown_connections 2024-09-19T07:55:25.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:25.625+0000 7f1b8c080640 1 -- 172.21.15.76:0/685018452 wait complete. 2024-09-19T07:55:26.412 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:55:26.658 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:26.939 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:26 smithi076 ceph-mon[30930]: pgmap v131: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 537 KiB/s wr, 128 op/s 2024-09-19T07:55:26.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:26 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:55:26.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:26 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:26.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:26 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:55:26.940 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:26 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:27.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:26 smithi152 ceph-mon[35117]: pgmap v131: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 537 KiB/s wr, 128 op/s 2024-09-19T07:55:27.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:26 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:55:27.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:26 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:27.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:26 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:55:27.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:26 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:27.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:26 smithi137 ceph-mon[35309]: pgmap v131: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 537 KiB/s wr, 128 op/s 2024-09-19T07:55:27.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:26 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:55:27.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:26 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:27.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:26 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:55:27.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:26 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/4033280966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 msgr2=0x7f2ab0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/4033280966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab0106e60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009930 tx=0x7f2aa802a420 comp rx=0 tx=0).stop 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/4033280966 shutdown_connections 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/4033280966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ab0101420 0x7f2ab010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/4033280966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab0100a80 0x7f2ab0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/4033280966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab0106e60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/4033280966 >> 172.21.15.76:0/4033280966 conn(0x7f2ab00fc7a0 msgr2=0x7f2ab00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/4033280966 shutdown_connections 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.142+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/4033280966 wait complete. 2024-09-19T07:55:27.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 Processor -- start 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 -- start start 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ab0100a80 0x7f2ab0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab0101420 0x7f2ab0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01120e0 con 0x7f2ab0106a80 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0111f60 con 0x7f2ab0101420 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab6d4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0112260 con 0x7f2ab0100a80 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39362/0 (socket says 172.21.15.76:39362) 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 -- 172.21.15.76:0/3281972631 learned_addr learned my addr 172.21.15.76:0/3281972631 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab0101420 0x7f2ab0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ab0100a80 0x7f2ab0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 -- 172.21.15.76:0/3281972631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ab0100a80 msgr2=0x7f2ab0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ab0100a80 0x7f2ab0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 -- 172.21.15.76:0/3281972631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab0101420 msgr2=0x7f2ab0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab0101420 0x7f2ab0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.143+0000 7f2ab52ec640 1 -- 172.21.15.76:0/3281972631 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab019d530 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.144+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab019ce50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009fd0 tx=0x7f2a9800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.144+0000 7f2aadffb640 1 -- 172.21.15.76:0/3281972631 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98011830 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.144+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab019d820 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.144+0000 7f2aadffb640 1 -- 172.21.15.76:0/3281972631 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a98016070 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.144+0000 7f2aadffb640 1 -- 172.21.15.76:0/3281972631 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800f2e0 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.144+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab01a5100 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.146+0000 7f2aadffb640 1 -- 172.21.15.76:0/3281972631 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2a9801b460 con 0x7f2ab0106a80 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.146+0000 7f2ab9128740 1 Processor -- start 2024-09-19T07:55:27.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 -- start start 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aadffb640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a9c0a33b0 0x7f2a9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cbca0 0x562dec4da550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4daa90 0x562dec4dce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562dec4312e0 con 0x562dec4cb380 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562dec3d8ce0 con 0x562dec4daa90 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab9128740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562dec42d2a0 con 0x562dec4cbca0 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a9c0a33b0 0x7f2a9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39366/0 (socket says 172.21.15.76:39366) 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 -- 172.21.15.76:0/1702686497 learned_addr learned my addr 172.21.15.76:0/1702686497 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aadffb640 1 -- 172.21.15.76:0/3281972631 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2a980cf170 con 0x7f2ab0106a80 2024-09-19T07:55:27.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4daa90 0x562dec4dce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cbca0 0x562dec4da550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 -- 172.21.15.76:0/1702686497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cbca0 msgr2=0x562dec4da550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cbca0 0x562dec4da550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 -- 172.21.15.76:0/1702686497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4daa90 msgr2=0x562dec4dce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4daa90 0x562dec4dce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2aaffff640 1 -- 172.21.15.76:0/1702686497 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dec3bd440 con 0x562dec4cb380 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.147+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a9c0a33b0 0x7f2a9c0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009900 tx=0x7f2aa80058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2aaffff640 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4cb760 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009fd0 tx=0x7f2aa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5487b00bde5064c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2aa6ffd640 1 -- 172.21.15.76:0/1702686497 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa001a030 con 0x562dec4cb380 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2aa6ffd640 1 -- 172.21.15.76:0/1702686497 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2aa0004b20 con 0x562dec4cb380 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2aa6ffd640 1 -- 172.21.15.76:0/1702686497 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0010660 con 0x562dec4cb380 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 -- 172.21.15.76:0/1702686497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 msgr2=0x562dec4cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4cb760 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009fd0 tx=0x7f2aa0009bb0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 -- 172.21.15.76:0/1702686497 shutdown_connections 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4daa90 0x562dec4dce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cbca0 0x562dec4da550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1702686497 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4cb760 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 -- 172.21.15.76:0/1702686497 >> 172.21.15.76:0/1702686497 conn(0x562dec4c7a30 msgr2=0x562dec4c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 -- 172.21.15.76:0/1702686497 shutdown_connections 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.148+0000 7f2ab9128740 1 -- 172.21.15.76:0/1702686497 wait complete. 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 -- start start 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 Processor -- start 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4da3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4d7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562dec4dd660 con 0x562dec4cb380 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562dec3ec050 con 0x562dec4cbca0 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562dec4dd7e0 con 0x562dec4daa90 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab9128740 10 client.0 _ll_register_callbacks cb 0x562dec42c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab4aeb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4da3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab4aeb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4da3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39368/0 (socket says 172.21.15.76:39368) 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.149+0000 7f2ab4aeb640 1 -- 172.21.15.76:0/3402350617 learned_addr learned my addr 172.21.15.76:0/3402350617 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4d7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab4aeb640 1 -- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 msgr2=0x562dec4d7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab4aeb640 1 -- 172.21.15.76:0/3402350617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 msgr2=0x562dec4d7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4d7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab4aeb640 1 -- 172.21.15.76:0/3402350617 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dec1a23c0 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4d7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4da3a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009930 tx=0x7f2aa8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afa8c1dc2209a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2a8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3402350617 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa804d020 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3402350617 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2aa80037f0 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2aa0004b20 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3402350617 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2aa8058050 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab9128740 10 client.16389 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562dec4e9020 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.150+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3402350617 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2aa0004b20 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3402350617 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2aa803c440 con 0x562dec4cb380 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2ab9128740 10 client.16389 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:27.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2ab9128740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2ab9128740 20 client.16389 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec4ea520 0x562dec4ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2ab9128740 4 client.16389 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dec43e850 con 0x562dec4ea520 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec4ea520 0x562dec4ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec4ea520 0x562dec4ec9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb2eb404e1a25bd2 server_cookie=f7eb821dadacc71d in_seq=0 out_seq=0 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.151+0000 7f2a8ffff640 10 client.16389 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3402350617 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562dec43e850 con 0x562dec4ea520 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2a8ffff640 10 client.16389 handle_command_reply: tid=0 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 client.16389 shutdown 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 msgr2=0x562dec4da3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4da3a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009930 tx=0x7f2aa8009260 comp rx=0 tx=0).stop 2024-09-19T07:55:27.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 shutdown_connections 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4d7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.152+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec4ea520 0x562dec4ec9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.153+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3402350617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cb380 0x562dec4da3a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.153+0000 7f2a8ffff640 0 client.16389 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.153+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 >> 172.21.15.76:0/3402350617 conn(0x562dec4c7a30 msgr2=0x562dec4cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.153+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 shutdown_connections 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.153+0000 7f2ab9128740 1 -- 172.21.15.76:0/3402350617 wait complete. 2024-09-19T07:55:27.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.153+0000 7f2ab9128740 20 client.16389 trim_cache size 0 max 16384 2024-09-19T07:55:27.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 Processor -- start 2024-09-19T07:55:27.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 -- start start 2024-09-19T07:55:27.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cb380 0x562dec4e6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4f2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 0x562dec4f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01ae390 con 0x562dec4daa90 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01abba0 con 0x562dec4cbca0 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.170+0000 7f2ab9128740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01a99f0 con 0x562dec4cb380 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 0x562dec4f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 0x562dec4f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39372/0 (socket says 172.21.15.76:39372) 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 -- 172.21.15.76:0/1910225020 learned_addr learned my addr 172.21.15.76:0/1910225020 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cb380 0x562dec4e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2aaffff640 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 -- 172.21.15.76:0/1910225020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cb380 msgr2=0x562dec4e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cb380 0x562dec4e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 -- 172.21.15.76:0/1910225020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 msgr2=0x562dec4f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 -- 172.21.15.76:0/1910225020 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dec4cc840 con 0x562dec4daa90 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 0x562dec4f27b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2a98097f70 tx=0x7f2a980047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79ea5f4c2cc27f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2aa67fc640 1 -- 172.21.15.76:0/1910225020 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9809f950 con 0x562dec4daa90 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2aa67fc640 1 -- 172.21.15.76:0/1910225020 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a980a4210 con 0x562dec4daa90 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.171+0000 7f2aa67fc640 1 -- 172.21.15.76:0/1910225020 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a980ccb80 con 0x562dec4daa90 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 -- 172.21.15.76:0/1910225020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 msgr2=0x562dec4f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 0x562dec4f27b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2a98097f70 tx=0x7f2a980047d0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 -- 172.21.15.76:0/1910225020 shutdown_connections 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4daa90 0x562dec4f27b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cbca0 0x562dec4f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 --2- 172.21.15.76:0/1910225020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4cb380 0x562dec4e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 -- 172.21.15.76:0/1910225020 >> 172.21.15.76:0/1910225020 conn(0x562dec4c7a30 msgr2=0x562dec4d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 -- 172.21.15.76:0/1910225020 shutdown_connections 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 -- 172.21.15.76:0/1910225020 wait complete. 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 -- start start 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.172+0000 7f2ab9128740 1 Processor -- start 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cb380 0x562dec4e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 0x562dec4d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01aa060 con 0x562dec4cbca0 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01ab4d0 con 0x562dec4cb380 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01aa730 con 0x562dec4daa90 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab9128740 10 client.0 _ll_register_callbacks cb 0x7f2aa8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:27.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 0x562dec4d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 0x562dec4d43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39388/0 (socket says 172.21.15.76:39388) 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 -- 172.21.15.76:0/3579729376 learned_addr learned my addr 172.21.15.76:0/3579729376 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cb380 0x562dec4e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 -- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 msgr2=0x562dec4d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 -- 172.21.15.76:0/3579729376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cb380 msgr2=0x562dec4e31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cb380 0x562dec4e31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2aaffff640 1 -- 172.21.15.76:0/3579729376 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dec4d5140 con 0x562dec4cbca0 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cb380 0x562dec4e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.173+0000 7f2ab52ec640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2aaffff640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 0x562dec4d43d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0015010 tx=0x7f2aa0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538b68bf7ce7a226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:27.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2a8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3579729376 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa002c030 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3579729376 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2aa00134c0 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a980a4210 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3579729376 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2aa0004b00 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 10 client.16395 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562dec5552b0 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3579729376 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a980a4210 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3579729376 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2aa000f040 con 0x562dec4cbca0 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 10 client.16395 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 20 client.16395 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:27.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec555800 0x562dec557c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 4 client.16395 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.174+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562dec438d60 con 0x562dec555800 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec555800 0x562dec557c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab4aeb640 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec555800 0x562dec557c20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8922968257507d server_cookie=b4c60d2b19ff960c in_seq=0 out_seq=0 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2a8ffff640 10 client.16395 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2a8ffff640 1 -- 172.21.15.76:0/3579729376 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562dec438d60 con 0x562dec555800 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2a8ffff640 10 client.16395 handle_command_reply: tid=0 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 client.16395 shutdown 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 msgr2=0x562dec4d43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 0x562dec4d43d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0015010 tx=0x7f2aa0003f10 comp rx=0 tx=0).stop 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 shutdown_connections 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562dec4daa90 0x562dec4d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562dec555800 0x562dec557c20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562dec4cbca0 0x562dec4d43d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2a8ffff640 0 client.16395 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 --2- 172.21.15.76:0/3579729376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562dec4cb380 0x562dec4e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.175+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 >> 172.21.15.76:0/3579729376 conn(0x562dec4c7a30 msgr2=0x562dec4c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 shutdown_connections 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab9128740 1 -- 172.21.15.76:0/3579729376 wait complete. 2024-09-19T07:55:27.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab9128740 20 client.16395 trim_cache size 0 max 16384 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: "82062bb9-2424-4134-91a4-0848aa720d9b": { 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "82062bb9-2424-4134-91a4-0848aa720d9b", 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:55:27.185 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a9c0a33b0 msgr2=0x7f2a9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a9c0a33b0 0x7f2a9c0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009900 tx=0x7f2aa80058d0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 msgr2=0x7f2ab019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab019ce50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009fd0 tx=0x7f2a9800b8e0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 shutdown_connections 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a9c0a33b0 0x7f2a9c0a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2ab0106a80 0x7f2ab019ce50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab0101420 0x7f2ab0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 --2- 172.21.15.76:0/3281972631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ab0100a80 0x7f2ab0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:27.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.176+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 >> 172.21.15.76:0/3281972631 conn(0x7f2ab00fc7a0 msgr2=0x7f2ab00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:27.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.177+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 shutdown_connections 2024-09-19T07:55:27.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:27.177+0000 7f2ab6d4f640 1 -- 172.21.15.76:0/3281972631 wait complete. 2024-09-19T07:55:28.128 INFO:tasks.cephfs.filesystem:scrub status for tag:82062bb9-2424-4134-91a4-0848aa720d9b - {'path': '/', 'tag': '82062bb9-2424-4134-91a4-0848aa720d9b', 'options': 'recursive,force'} 2024-09-19T07:55:28.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:28 smithi076 ceph-mon[30930]: pgmap v132: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-09-19T07:55:29.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:28 smithi152 ceph-mon[35117]: pgmap v132: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-09-19T07:55:29.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:28 smithi137 ceph-mon[35309]: pgmap v132: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-09-19T07:55:29.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:29 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:55:30.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:29 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:55:30.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:29 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:55:31.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:30 smithi152 ceph-mon[35117]: pgmap v133: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-19T07:55:31.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:30 smithi137 ceph-mon[35309]: pgmap v133: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-19T07:55:31.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:30 smithi076 ceph-mon[30930]: pgmap v133: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-19T07:55:32.996 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:32 smithi076 ceph-mon[30930]: pgmap v134: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-19T07:55:33.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:32 smithi152 ceph-mon[35117]: pgmap v134: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-19T07:55:33.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:32 smithi137 ceph-mon[35309]: pgmap v134: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2024-09-19T07:55:35.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:34 smithi152 ceph-mon[35117]: pgmap v135: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-09-19T07:55:35.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:34 smithi137 ceph-mon[35309]: pgmap v135: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-09-19T07:55:35.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:34 smithi076 ceph-mon[30930]: pgmap v135: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-09-19T07:55:37.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:36 smithi152 ceph-mon[35117]: pgmap v136: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T07:55:37.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:36 smithi137 ceph-mon[35309]: pgmap v136: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T07:55:37.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:36 smithi076 ceph-mon[30930]: pgmap v136: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T07:55:39.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:38 smithi152 ceph-mon[35117]: pgmap v137: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:39.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:38 smithi137 ceph-mon[35309]: pgmap v137: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:39.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:38 smithi076 ceph-mon[30930]: pgmap v137: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:41.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:40 smithi152 ceph-mon[35117]: pgmap v138: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:55:41.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:40 smithi137 ceph-mon[35309]: pgmap v138: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:55:41.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:40 smithi076 ceph-mon[30930]: pgmap v138: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:55:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:42 smithi152 ceph-mon[35117]: pgmap v139: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:43.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:42 smithi137 ceph-mon[35309]: pgmap v139: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:43.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:42 smithi076 ceph-mon[30930]: pgmap v139: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:45.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:44 smithi152 ceph-mon[35117]: pgmap v140: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:45.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:44 smithi137 ceph-mon[35309]: pgmap v140: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:45.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:44 smithi076 ceph-mon[30930]: pgmap v140: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:55:47.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:46 smithi152 ceph-mon[35117]: pgmap v141: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:55:47.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:46 smithi137 ceph-mon[35309]: pgmap v141: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:55:47.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:46 smithi076 ceph-mon[30930]: pgmap v141: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:55:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:48 smithi152 ceph-mon[35117]: pgmap v142: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:49.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:48 smithi137 ceph-mon[35309]: pgmap v142: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:49.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:48 smithi076 ceph-mon[30930]: pgmap v142: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:51.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:50 smithi152 ceph-mon[35117]: pgmap v143: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:55:51.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:50 smithi137 ceph-mon[35309]: pgmap v143: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:55:51.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:50 smithi076 ceph-mon[30930]: pgmap v143: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:55:53.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:52 smithi152 ceph-mon[35117]: pgmap v144: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:55:53.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:52 smithi137 ceph-mon[35309]: pgmap v144: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:55:53.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:52 smithi076 ceph-mon[30930]: pgmap v144: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:55:55.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:54 smithi152 ceph-mon[35117]: pgmap v145: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:55.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:54 smithi137 ceph-mon[35309]: pgmap v145: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:55.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:54 smithi076 ceph-mon[30930]: pgmap v145: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:57.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:56 smithi152 ceph-mon[35117]: pgmap v146: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:55:57.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:56 smithi137 ceph-mon[35309]: pgmap v146: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:55:57.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:56 smithi076 ceph-mon[30930]: pgmap v146: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:55:58.129 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:55:58.399 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:55:58.771 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:55:58 smithi076 ceph-mon[30930]: pgmap v147: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:58.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 -- 172.21.15.76:0/3751723455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac01027a0 msgr2=0x7f5ac01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/3751723455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac01027a0 0x7f5ac01067f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009900 tx=0x7f5ab402a410 comp rx=0 tx=0).stop 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 -- 172.21.15.76:0/3751723455 shutdown_connections 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/3751723455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0106f20 0x7f5ac010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/3751723455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac01027a0 0x7f5ac01067f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/3751723455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac0101df0 0x7f5ac01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 -- 172.21.15.76:0/3751723455 >> 172.21.15.76:0/3751723455 conn(0x7f5ac00fd8b0 msgr2=0x7f5ac00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 -- 172.21.15.76:0/3751723455 shutdown_connections 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.995+0000 7f5ac64d8640 1 -- 172.21.15.76:0/3751723455 wait complete. 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 Processor -- start 2024-09-19T07:55:58.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 -- start start 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0101df0 0x7f5ac00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac01027a0 0x7f5ac0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 0x7f5ac0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0112060 con 0x7f5ac0106f20 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0111ee0 con 0x7f5ac01027a0 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac64d8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01121e0 con 0x7f5ac0101df0 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac4a75640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 0x7f5ac0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac4a75640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 0x7f5ac0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52988/0 (socket says 172.21.15.76:52988) 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5ac4a75640 1 -- 172.21.15.76:0/1482364368 learned_addr learned my addr 172.21.15.76:0/1482364368 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.996+0000 7f5abffff640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0101df0 0x7f5ac00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:58.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac01027a0 0x7f5ac0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac4a75640 1 -- 172.21.15.76:0/1482364368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0101df0 msgr2=0x7f5ac00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac4a75640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0101df0 0x7f5ac00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac4a75640 1 -- 172.21.15.76:0/1482364368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac01027a0 msgr2=0x7f5ac0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac4a75640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac01027a0 0x7f5ac0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac4a75640 1 -- 172.21.15.76:0/1482364368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01a6970 con 0x7f5ac0106f20 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac4a75640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 0x7f5ac0074f70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800cad0 tx=0x7f5ab800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5abd7fa640 1 -- 172.21.15.76:0/1482364368 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800ad60 con 0x7f5ac0106f20 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a6c60 con 0x7f5ac0106f20 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5abd7fa640 1 -- 172.21.15.76:0/1482364368 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ab8004b20 con 0x7f5ac0106f20 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5abd7fa640 1 -- 172.21.15.76:0/1482364368 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800f6f0 con 0x7f5ac0106f20 2024-09-19T07:55:59.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:58.997+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a7170 con 0x7f5ac0106f20 2024-09-19T07:55:59.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.000+0000 7f5ac88b1740 1 Processor -- start 2024-09-19T07:55:59.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.000+0000 7f5abd7fa640 1 -- 172.21.15.76:0/1482364368 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5ab800f8f0 con 0x7f5ac0106f20 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.000+0000 7f5ac88b1740 1 -- start start 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.000+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b588880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.000+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b593140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b595a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c74b4ee2e0 con 0x55c74b593680 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c74b495ce0 con 0x55c74b5884a0 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c74b4ea2a0 con 0x55c74b588dc0 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b595a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b595a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52990/0 (socket says 172.21.15.76:52990) 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 -- 172.21.15.76:0/1285041563 learned_addr learned my addr 172.21.15.76:0/1285041563 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b588880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abffff640 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b593140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abd7fa640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5aa80a33b0 0x7f5aa80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 -- 172.21.15.76:0/1285041563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 msgr2=0x55c74b593140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b593140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 -- 172.21.15.76:0/1285041563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 msgr2=0x55c74b588880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b588880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 -- 172.21.15.76:0/1285041563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c74b47a440 con 0x55c74b593680 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5ac4a75640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5aa80a33b0 0x7f5aa80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b595a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5ab402a930 tx=0x7f5ab4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30d236afaeec2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.001+0000 7f5abd7fa640 1 -- 172.21.15.76:0/1482364368 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5ab80cfcb0 con 0x7f5ac0106f20 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5aa67fc640 1 -- 172.21.15.76:0/1285041563 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4035070 con 0x55c74b593680 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5aa67fc640 1 -- 172.21.15.76:0/1285041563 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ab4005520 con 0x55c74b593680 2024-09-19T07:55:59.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5aa67fc640 1 -- 172.21.15.76:0/1285041563 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4004ba0 con 0x55c74b593680 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 -- 172.21.15.76:0/1285041563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 msgr2=0x55c74b595a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac4a75640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5aa80a33b0 0x7f5aa80a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ab809bc30 tx=0x7f5ab808f040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b595a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5ab402a930 tx=0x7f5ab4000bc0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 -- 172.21.15.76:0/1285041563 shutdown_connections 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b595a70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b593140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/1285041563 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b588880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 -- 172.21.15.76:0/1285041563 >> 172.21.15.76:0/1285041563 conn(0x55c74b584a30 msgr2=0x55c74b584e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 -- 172.21.15.76:0/1285041563 shutdown_connections 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.002+0000 7f5ac88b1740 1 -- 172.21.15.76:0/1285041563 wait complete. 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 -- start start 2024-09-19T07:55:59.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 Processor -- start 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b593000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 0x55c74b5902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b593680 0x55c74b590830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c74b596250 con 0x55c74b588dc0 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c74b4a9050 con 0x55c74b5884a0 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c74b5963d0 con 0x55c74b593680 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5ac88b1740 10 client.0 _ll_register_callbacks cb 0x55c74b4e9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5abffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 0x55c74b5902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5abffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 0x55c74b5902b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53000/0 (socket says 172.21.15.76:53000) 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.003+0000 7f5abffff640 1 -- 172.21.15.76:0/3758000510 learned_addr learned my addr 172.21.15.76:0/3758000510 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b593000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b593680 0x55c74b590830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abffff640 1 -- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b593680 msgr2=0x55c74b590830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abffff640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b593680 0x55c74b590830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abffff640 1 -- 172.21.15.76:0/3758000510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 msgr2=0x55c74b593000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abffff640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b593000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abffff640 1 -- 172.21.15.76:0/3758000510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c74b25f3c0 con 0x55c74b588dc0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b593680 0x55c74b590830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5abffff640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 0x55c74b5902b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0010a50 tx=0x7f5ab0010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b1d8e7b167d468 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5a9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/3758000510 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab001e060 con 0x55c74b588dc0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/3758000510 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5ab000fbd0 con 0x55c74b588dc0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ab4005520 con 0x55c74b588dc0 2024-09-19T07:55:59.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/3758000510 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5ab000fdd0 con 0x55c74b588dc0 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5ac88b1740 10 client.16407 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.004+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c74b5a1d20 con 0x55c74b588dc0 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/3758000510 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ab4005520 con 0x55c74b588dc0 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/3758000510 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5ab000e6b0 con 0x55c74b588dc0 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5ac88b1740 10 client.16407 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5ac88b1740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5ac88b1740 20 client.16407 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b5a3280 0x55c74b5a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5ac88b1740 4 client.16407 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c74b4fb850 con 0x55c74b5a3280 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b5a3280 0x55c74b5a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5a9f7fe640 10 client.16407 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:59.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.005+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b5a3280 0x55c74b5a56e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32046668b5e362e server_cookie=a1edb1f9f0cad1e8 in_seq=0 out_seq=0 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/3758000510 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c74b4fb850 con 0x55c74b5a3280 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5a9f7fe640 10 client.16407 handle_command_reply: tid=0 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 client.16407 shutdown 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 msgr2=0x55c74b5902b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 0x55c74b5902b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0010a50 tx=0x7f5ab0010f10 comp rx=0 tx=0).stop 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 shutdown_connections 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b593680 0x55c74b590830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b5a3280 0x55c74b5a56e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b588dc0 0x55c74b5902b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/3758000510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b593000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 >> 172.21.15.76:0/3758000510 conn(0x55c74b584a30 msgr2=0x55c74b58a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:59.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.006+0000 7f5a9f7fe640 0 client.16407 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:59.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.007+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 shutdown_connections 2024-09-19T07:55:59.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.007+0000 7f5ac88b1740 1 -- 172.21.15.76:0/3758000510 wait complete. 2024-09-19T07:55:59.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.007+0000 7f5ac88b1740 20 client.16407 trim_cache size 0 max 16384 2024-09-19T07:55:59.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.023+0000 7f5ac88b1740 1 Processor -- start 2024-09-19T07:55:59.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.023+0000 7f5ac88b1740 1 -- start start 2024-09-19T07:55:59.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 0x55c74b59f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b5aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b593680 0x55c74b5ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b2570 con 0x55c74b5884a0 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01afd80 con 0x55c74b593680 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01adbd0 con 0x55c74b588dc0 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 0x55c74b59f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 0x55c74b59f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53004/0 (socket says 172.21.15.76:53004) 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 -- 172.21.15.76:0/167426495 learned_addr learned my addr 172.21.15.76:0/167426495 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abffff640 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b5aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b593680 0x55c74b5ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 -- 172.21.15.76:0/167426495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 msgr2=0x55c74b5aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b5aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 -- 172.21.15.76:0/167426495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b593680 msgr2=0x55c74b5ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b593680 0x55c74b5ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 -- 172.21.15.76:0/167426495 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c74b5882d0 con 0x55c74b5884a0 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.024+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 0x55c74b59f4e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4004590 tx=0x7f5ab4041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edecc3e2eec0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5aa5ffb640 1 -- 172.21.15.76:0/167426495 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4056040 con 0x55c74b5884a0 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5aa5ffb640 1 -- 172.21.15.76:0/167426495 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ab4000e40 con 0x55c74b5884a0 2024-09-19T07:55:59.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5aa5ffb640 1 -- 172.21.15.76:0/167426495 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4035040 con 0x55c74b5884a0 2024-09-19T07:55:59.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 -- 172.21.15.76:0/167426495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 msgr2=0x55c74b59f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 0x55c74b59f4e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4004590 tx=0x7f5ab4041040 comp rx=0 tx=0).stop 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 -- 172.21.15.76:0/167426495 shutdown_connections 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b593680 0x55c74b5ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b5aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/167426495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b5884a0 0x55c74b59f4e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 -- 172.21.15.76:0/167426495 >> 172.21.15.76:0/167426495 conn(0x55c74b584a30 msgr2=0x55c74b58eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 -- 172.21.15.76:0/167426495 shutdown_connections 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.025+0000 7f5ac88b1740 1 -- 172.21.15.76:0/167426495 wait complete. 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 -- start start 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 Processor -- start 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b596bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b597110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b60bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01ae240 con 0x55c74b593680 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01af6b0 con 0x55c74b5884a0 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01ae910 con 0x55c74b588dc0 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5ac88b1740 10 client.0 _ll_register_callbacks cb 0x7f5ab000a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b60bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b60bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53018/0 (socket says 172.21.15.76:53018) 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.026+0000 7f5abf7fe640 1 -- 172.21.15.76:0/2978133711 learned_addr learned my addr 172.21.15.76:0/2978133711 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abffff640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b597110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b596bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 -- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 msgr2=0x55c74b597110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b597110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 -- 172.21.15.76:0/2978133711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 msgr2=0x55c74b596bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b596bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 -- 172.21.15.76:0/2978133711 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c74b60c530 con 0x55c74b593680 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abffff640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b597110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5abf7fe640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b60bf70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4005e40 tx=0x7f5ab4032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2962b182775dc4f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5a9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/2978133711 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4035040 con 0x55c74b593680 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/2978133711 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5ab404b890 con 0x55c74b593680 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c74b4f5d60 con 0x55c74b593680 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/2978133711 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5ab404ba90 con 0x55c74b593680 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5ac88b1740 10 client.16413 fetch_fsmap learned FSMap version 31 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.027+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c74b60d820 con 0x55c74b593680 2024-09-19T07:55:59.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/2978133711 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55c74b4f5d60 con 0x55c74b593680 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/2978133711 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5ab403c440 con 0x55c74b593680 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5ac88b1740 10 client.16413 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5ac88b1740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5ac88b1740 20 client.16413 populate_metadata read hostname 'smithi076' 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b60db00 0x55c74b60fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5ac88b1740 4 client.16413 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c74b472210 con 0x55c74b60db00 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.028+0000 7f5abffff640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b60db00 0x55c74b60fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5a9f7fe640 10 client.16413 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5abffff640 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b60db00 0x55c74b60fef0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ed7c447d3eaa19 server_cookie=3ca353dd1b215807 in_seq=0 out_seq=0 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5a9f7fe640 1 -- 172.21.15.76:0/2978133711 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c74b472210 con 0x55c74b60db00 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5a9f7fe640 10 client.16413 handle_command_reply: tid=0 2024-09-19T07:55:59.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 client.16413 shutdown 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 msgr2=0x55c74b60bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b60bf70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4005e40 tx=0x7f5ab4032c30 comp rx=0 tx=0).stop 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 shutdown_connections 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c74b60db00 0x55c74b60fef0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c74b593680 0x55c74b60bf70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5a9f7fe640 0 client.16413 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c74b588dc0 0x55c74b597110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 --2- 172.21.15.76:0/2978133711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c74b5884a0 0x55c74b596bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 >> 172.21.15.76:0/2978133711 conn(0x55c74b584a30 msgr2=0x55c74b583350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 shutdown_connections 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 1 -- 172.21.15.76:0/2978133711 wait complete. 2024-09-19T07:55:59.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.029+0000 7f5ac88b1740 20 client.16413 trim_cache size 0 max 16384 2024-09-19T07:55:59.035 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:55:59.035 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:55:59.035 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:55:59.035 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5aa80a33b0 msgr2=0x7f5aa80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5aa80a33b0 0x7f5aa80a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ab809bc30 tx=0x7f5ab808f040 comp rx=0 tx=0).stop 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 msgr2=0x7f5ac0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 0x7f5ac0074f70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800cad0 tx=0x7f5ab800ced0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 shutdown_connections 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5aa80a33b0 0x7f5aa80a5870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ac0106f20 0x7f5ac0074f70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac01027a0 0x7f5ac0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 --2- 172.21.15.76:0/1482364368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac0101df0 0x7f5ac00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:55:59.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 >> 172.21.15.76:0/1482364368 conn(0x7f5ac00fd8b0 msgr2=0x7f5ac00fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:55:59.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 shutdown_connections 2024-09-19T07:55:59.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:55:59.030+0000 7f5ac64d8640 1 -- 172.21.15.76:0/1482364368 wait complete. 2024-09-19T07:55:59.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:55:58 smithi152 ceph-mon[35117]: pgmap v147: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:59.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:55:58 smithi137 ceph-mon[35309]: pgmap v147: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:55:59.830 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:55:59.830 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:56:00.078 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:00.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 -- 172.21.15.76:0/1650416739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c102790 msgr2=0x7f046c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:00.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 --2- 172.21.15.76:0/1650416739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c102790 0x7f046c1067e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0454009900 tx=0x7f045402a410 comp rx=0 tx=0).stop 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 -- 172.21.15.76:0/1650416739 shutdown_connections 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 --2- 172.21.15.76:0/1650416739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f046c106f10 0x7f046c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 --2- 172.21.15.76:0/1650416739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c102790 0x7f046c1067e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 --2- 172.21.15.76:0/1650416739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c101de0 0x7f046c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.535+0000 7f0471969640 1 -- 172.21.15.76:0/1650416739 >> 172.21.15.76:0/1650416739 conn(0x7f046c0fd8c0 msgr2=0x7f046c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.536+0000 7f0471969640 1 -- 172.21.15.76:0/1650416739 shutdown_connections 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.536+0000 7f0471969640 1 -- 172.21.15.76:0/1650416739 wait complete. 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.536+0000 7f0471969640 1 Processor -- start 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.536+0000 7f0471969640 1 -- start start 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.536+0000 7f0471969640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c101de0 0x7f046c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.536+0000 7f0471969640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f046c102790 0x7f046c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:00.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0471969640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 0x7f046c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0471969640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f046c112090 con 0x7f046c106f10 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0471969640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f046c111f10 con 0x7f046c101de0 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0471969640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f046c112210 con 0x7f046c102790 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 0x7f046c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 0x7f046c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53040/0 (socket says 172.21.15.76:53040) 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 -- 172.21.15.76:0/1205500886 learned_addr learned my addr 172.21.15.76:0/1205500886 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046affd640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c101de0 0x7f046c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f04627fc640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f046c102790 0x7f046c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 -- 172.21.15.76:0/1205500886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f046c102790 msgr2=0x7f046c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f046c102790 0x7f046c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 -- 172.21.15.76:0/1205500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c101de0 msgr2=0x7f046c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:00.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c101de0 0x7f046c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 -- 172.21.15.76:0/1205500886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c19d410 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f046b7fe640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 0x7f046c19cd30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f046400eaa0 tx=0x7f046400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464004d20 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0464005020 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c19d700 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04640116b0 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.537+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c1a4fe0 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.539+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046c1021c0 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.540+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f04640051d0 con 0x7f046c106f10 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.541+0000 7f0470967640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f04580a3430 0x7f04580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.541+0000 7f046affd640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f04580a3430 0x7f04580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:00.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.541+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f04640cfe40 con 0x7f046c106f10 2024-09-19T07:56:00.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.541+0000 7f046affd640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f04580a3430 0x7f04580a58f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f045c00abe0 tx=0x7f045c00a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:00.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.545+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0464016030 con 0x7f046c106f10 2024-09-19T07:56:00.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.751+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f046c02d7c0 con 0x7f046c106f10 2024-09-19T07:56:00.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.752+0000 7f0470967640 1 -- 172.21.15.76:0/1205500886 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7f046409c7c0 con 0x7f046c106f10 2024-09-19T07:56:00.753 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:56:00.753 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:56:00.753 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f04580a3430 msgr2=0x7f04580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f04580a3430 0x7f04580a58f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f045c00abe0 tx=0x7f045c00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 msgr2=0x7f046c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 0x7f046c19cd30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f046400eaa0 tx=0x7f046400eea0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 shutdown_connections 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f04580a3430 0x7f04580a58f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f046c106f10 0x7f046c19cd30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f046c102790 0x7f046c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 --2- 172.21.15.76:0/1205500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046c101de0 0x7f046c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:00.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 >> 172.21.15.76:0/1205500886 conn(0x7f046c0fd8c0 msgr2=0x7f046c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:00.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 shutdown_connections 2024-09-19T07:56:00.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:00.755+0000 7f0471969640 1 -- 172.21.15.76:0/1205500886 wait complete. 2024-09-19T07:56:01.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:00 smithi152 ceph-mon[35117]: pgmap v148: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:56:01.108 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:00 smithi076 ceph-mon[30930]: pgmap v148: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:56:01.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:00 smithi137 ceph-mon[35309]: pgmap v148: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:56:01.523 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:56:01.772 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:02.013 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:01 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1205500886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:02.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:01 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1205500886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:02.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:01 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1205500886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 -- 172.21.15.76:0/1778006741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04103670 msgr2=0x7fdd0410bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/1778006741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04103670 0x7fdd0410bb60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009900 tx=0x7fdcf802a480 comp rx=0 tx=0).stop 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 -- 172.21.15.76:0/1778006741 shutdown_connections 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/1778006741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd0410c180 0x7fdd0410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/1778006741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04103670 0x7fdd0410bb60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/1778006741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd04102d50 0x7fdd04103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 -- 172.21.15.76:0/1778006741 >> 172.21.15.76:0/1778006741 conn(0x7fdd040fc7d0 msgr2=0x7fdd040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:02.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 -- 172.21.15.76:0/1778006741 shutdown_connections 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.232+0000 7fdd0a91f640 1 -- 172.21.15.76:0/1778006741 wait complete. 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 Processor -- start 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 -- start start 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 0x7fdd04198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04103670 0x7fdd04198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0410c180 0x7fdd0419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdd04112180 con 0x7fdd04102d50 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd04112000 con 0x7fdd04103670 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd0a91f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd04112300 con 0x7fdd0410c180 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 0x7fdd04198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 0x7fdd04198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53048/0 (socket says 172.21.15.76:53048) 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 -- 172.21.15.76:0/764451318 learned_addr learned my addr 172.21.15.76:0/764451318 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:02.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0410c180 0x7fdd0419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd037fe640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04103670 0x7fdd04198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 -- 172.21.15.76:0/764451318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0410c180 msgr2=0x7fdd0419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0410c180 0x7fdd0419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 -- 172.21.15.76:0/764451318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04103670 msgr2=0x7fdd04198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04103670 0x7fdd04198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd03fff640 1 -- 172.21.15.76:0/764451318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0419d630 con 0x7fdd04102d50 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.233+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0410c180 0x7fdd0419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.234+0000 7fdd03fff640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 0x7fdd04198680 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400b4a0 tx=0x7fdcf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.234+0000 7fdd017fa640 1 -- 172.21.15.76:0/764451318 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4014070 con 0x7fdd04102d50 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.234+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0419d920 con 0x7fdd04102d50 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.234+0000 7fdd017fa640 1 -- 172.21.15.76:0/764451318 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcf4010b10 con 0x7fdd04102d50 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.234+0000 7fdd017fa640 1 -- 172.21.15.76:0/764451318 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4017d60 con 0x7fdd04102d50 2024-09-19T07:56:02.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.234+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd041a5200 con 0x7fdd04102d50 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.236+0000 7fdd017fa640 1 -- 172.21.15.76:0/764451318 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fdcf4017070 con 0x7fdd04102d50 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.236+0000 7fdd0ccf8740 1 Processor -- start 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.236+0000 7fdd0ccf8740 1 -- start start 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555822010b40 0x55582200f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582200f5d0 0x55582200fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x55582201c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555821f752f0 con 0x55582201a370 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555821f1ccf0 con 0x555822010b40 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555821f712b0 con 0x55582200f5d0 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd017fa640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdcec0a3430 0x7fdcec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x55582201c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x55582201c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53058/0 (socket says 172.21.15.76:53058) 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 -- 172.21.15.76:0/2262267237 learned_addr learned my addr 172.21.15.76:0/2262267237 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdcec0a3430 0x7fdcec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555822010b40 0x55582200f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd017fa640 1 -- 172.21.15.76:0/764451318 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdcf40cf0e0 con 0x7fdd04102d50 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd03fff640 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582200f5d0 0x55582200fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 -- 172.21.15.76:0/2262267237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582200f5d0 msgr2=0x55582200fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582200f5d0 0x55582200fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 -- 172.21.15.76:0/2262267237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555822010b40 msgr2=0x55582200f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555822010b40 0x55582200f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 -- 172.21.15.76:0/2262267237 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555821f013a0 con 0x55582201a370 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555822010b40 0x55582200f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.237+0000 7fdd037fe640 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x55582201c760 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8006010 tx=0x7fdcf8031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fcbc008544497a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:02.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdcec0a3430 0x7fdcec0a58f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00b4a0 tx=0x7fdcfc009380 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdcea7fc640 1 -- 172.21.15.76:0/2262267237 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8035070 con 0x55582201a370 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdcea7fc640 1 -- 172.21.15.76:0/2262267237 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcf8004030 con 0x55582201a370 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdcea7fc640 1 -- 172.21.15.76:0/2262267237 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf803d760 con 0x55582201a370 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/2262267237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 msgr2=0x55582201c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x55582201c760 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8006010 tx=0x7fdcf8031510 comp rx=0 tx=0).stop 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/2262267237 shutdown_connections 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x55582201c760 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582200f5d0 0x55582200fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/2262267237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555822010b40 0x55582200f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/2262267237 >> 172.21.15.76:0/2262267237 conn(0x555821fd8310 msgr2=0x55582200bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/2262267237 shutdown_connections 2024-09-19T07:56:02.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.238+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/2262267237 wait complete. 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 -- start start 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 Processor -- start 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822019d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x555822017010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x555822017600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55582201d010 con 0x55582201a370 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555821f30060 con 0x55582200f5d0 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55582201d190 con 0x555822010b40 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd0ccf8740 10 client.0 _ll_register_callbacks cb 0x555821c838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.239+0000 7fdd08ebc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x555822017600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x555822017600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53068/0 (socket says 172.21.15.76:53068) 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 -- 172.21.15.76:0/4184585297 learned_addr learned my addr 172.21.15.76:0/4184585297 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:02.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd037fe640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x555822017010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd03fff640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822019d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 -- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 msgr2=0x555822017010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x555822017010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 -- 172.21.15.76:0/4184585297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 msgr2=0x555822019d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822019d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 -- 172.21.15.76:0/4184585297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555821ce63c0 con 0x55582201a370 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x555822017600 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00dbe0 tx=0x7fdcfc004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19ac27ac844900c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdce37fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdce37fe640 1 -- 172.21.15.76:0/4184585297 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc021030 con 0x55582201a370 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdce37fe640 1 -- 172.21.15.76:0/4184585297 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdcfc00cda0 con 0x55582201a370 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf8004030 con 0x55582201a370 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdce37fe640 1 -- 172.21.15.76:0/4184585297 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdcfc014070 con 0x55582201a370 2024-09-19T07:56:02.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd0ccf8740 10 client.16431 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.240+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555822028b10 con 0x55582201a370 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdce37fe640 1 -- 172.21.15.76:0/4184585297 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcf8004030 con 0x55582201a370 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdce37fe640 1 -- 172.21.15.76:0/4184585297 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fdcfc01a050 con 0x55582201a370 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd0ccf8740 10 client.16431 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd0ccf8740 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd0ccf8740 20 client.16431 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55582202a020 0x55582202c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd0ccf8740 4 client.16431 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555821f82860 con 0x55582202a020 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.241+0000 7fdd03fff640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55582202a020 0x55582202c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.242+0000 7fdd03fff640 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55582202a020 0x55582202c470 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45f0ed7481288f84 server_cookie=25cdfd7ed643ac24 in_seq=0 out_seq=0 2024-09-19T07:56:02.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.242+0000 7fdce37fe640 10 client.16431 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.242+0000 7fdce37fe640 1 -- 172.21.15.76:0/4184585297 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555821f82860 con 0x55582202a020 2024-09-19T07:56:02.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.242+0000 7fdce37fe640 10 client.16431 handle_command_reply: tid=0 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.242+0000 7fdd0ccf8740 1 client.16431 shutdown 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 msgr2=0x555822017600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x555822017600 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00dbe0 tx=0x7fdcfc004b50 comp rx=0 tx=0).stop 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 shutdown_connections 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55582202a020 0x55582202c470 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582201a370 0x555822017600 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdce37fe640 0 client.16431 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x555822017010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/4184585297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822019d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 >> 172.21.15.76:0/4184585297 conn(0x555821fd8310 msgr2=0x555822011960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 shutdown_connections 2024-09-19T07:56:02.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/4184585297 wait complete. 2024-09-19T07:56:02.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.243+0000 7fdd0ccf8740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 Processor -- start 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 -- start start 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822018f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 0x555822012120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582201a370 0x555822012660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041ae390 con 0x555822010b40 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041abba0 con 0x55582200f5d0 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041a99f0 con 0x55582201a370 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 0x555822012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 0x555822012120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53084/0 (socket says 172.21.15.76:53084) 2024-09-19T07:56:02.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 -- 172.21.15.76:0/602638178 learned_addr learned my addr 172.21.15.76:0/602638178 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582201a370 0x555822012660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd03fff640 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822018f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 -- 172.21.15.76:0/602638178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582201a370 msgr2=0x555822012660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582201a370 0x555822012660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 -- 172.21.15.76:0/602638178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 msgr2=0x555822018f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822018f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.256+0000 7fdd037fe640 1 -- 172.21.15.76:0/602638178 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555822015560 con 0x555822010b40 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.257+0000 7fdd037fe640 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 0x555822012120 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdcf802a4c0 tx=0x7fdcf802ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e70c196ffa9a21e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.257+0000 7fdce9ffb640 1 -- 172.21.15.76:0/602638178 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8035050 con 0x555822010b40 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.257+0000 7fdce9ffb640 1 -- 172.21.15.76:0/602638178 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcf80055a0 con 0x555822010b40 2024-09-19T07:56:02.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.257+0000 7fdce9ffb640 1 -- 172.21.15.76:0/602638178 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf803db80 con 0x555822010b40 2024-09-19T07:56:02.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.257+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/602638178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 msgr2=0x555822012120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.257+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 0x555822012120 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdcf802a4c0 tx=0x7fdcf802ac30 comp rx=0 tx=0).stop 2024-09-19T07:56:02.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/602638178 shutdown_connections 2024-09-19T07:56:02.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55582201a370 0x555822012660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555822010b40 0x555822012120 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/602638178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582200f5d0 0x555822018f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/602638178 >> 172.21.15.76:0/602638178 conn(0x555821fd8310 msgr2=0x555822018870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/602638178 shutdown_connections 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/602638178 wait complete. 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- start start 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 Processor -- start 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 0x55582201e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x55582201e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582201a370 0x55582201ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041aa060 con 0x55582200f5d0 2024-09-19T07:56:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041ab4d0 con 0x55582201a370 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041aa730 con 0x555822010b40 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.258+0000 7fdd0ccf8740 10 client.0 _ll_register_callbacks cb 0x7fdcfc00d860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 0x55582201e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 0x55582201e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53088/0 (socket says 172.21.15.76:53088) 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 -- 172.21.15.76:0/736714111 learned_addr learned my addr 172.21.15.76:0/736714111 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd037fe640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x55582201e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582201a370 0x55582201ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 -- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 msgr2=0x55582201e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x55582201e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 -- 172.21.15.76:0/736714111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582201a370 msgr2=0x55582201ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582201a370 0x55582201ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 -- 172.21.15.76:0/736714111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555822093d10 con 0x55582200f5d0 2024-09-19T07:56:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd08ebc640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582201a370 0x55582201ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd03fff640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 0x55582201e170 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdcf409b110 tx=0x7fdcf4017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa52843c95923d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdce37fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdce37fe640 1 -- 172.21.15.76:0/736714111 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf401e040 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdce37fe640 1 -- 172.21.15.76:0/736714111 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fdcf4010cc0 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf80055a0 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdce37fe640 1 -- 172.21.15.76:0/736714111 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdcf40a4080 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd0ccf8740 10 client.16437 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.259+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555822094ff0 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdce37fe640 1 -- 172.21.15.76:0/736714111 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcf80055a0 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdce37fe640 1 -- 172.21.15.76:0/736714111 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fdcf40cca80 con 0x55582200f5d0 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd0ccf8740 10 client.16437 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd0ccf8740 10 client.16437 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd0ccf8740 20 client.16437 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555822095720 0x555822097b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd0ccf8740 4 client.16437 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555821f7cd70 con 0x555822095720 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.260+0000 7fdd037fe640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555822095720 0x555822097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd037fe640 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555822095720 0x555822097b40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bea835f5303f0a39 server_cookie=d4a2c8b9c3c89e5e in_seq=0 out_seq=0 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdce37fe640 10 client.16437 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdce37fe640 1 -- 172.21.15.76:0/736714111 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555821f7cd70 con 0x555822095720 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdce37fe640 10 client.16437 handle_command_reply: tid=0 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 client.16437 shutdown 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 msgr2=0x55582201e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 0x55582201e170 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdcf409b110 tx=0x7fdcf4017360 comp rx=0 tx=0).stop 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 shutdown_connections 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555822095720 0x555822097b40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55582201a370 0x55582201ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555822010b40 0x55582201e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 --2- 172.21.15.76:0/736714111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55582200f5d0 0x55582201e170 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 >> 172.21.15.76:0/736714111 conn(0x555821fd8310 msgr2=0x555822019090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdce37fe640 0 client.16437 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 shutdown_connections 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 1 -- 172.21.15.76:0/736714111 wait complete. 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.261+0000 7fdd0ccf8740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T07:56:02.267 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:02.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdcec0a3430 msgr2=0x7fdcec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdcec0a3430 0x7fdcec0a58f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00b4a0 tx=0x7fdcfc009380 comp rx=0 tx=0).stop 2024-09-19T07:56:02.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 msgr2=0x7fdd04198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:02.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 0x7fdd04198680 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400b4a0 tx=0x7fdcf400b960 comp rx=0 tx=0).stop 2024-09-19T07:56:02.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 shutdown_connections 2024-09-19T07:56:02.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdcec0a3430 0x7fdcec0a58f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0410c180 0x7fdd0419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04103670 0x7fdd04198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 --2- 172.21.15.76:0/764451318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdd04102d50 0x7fdd04198680 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 >> 172.21.15.76:0/764451318 conn(0x7fdd040fc7d0 msgr2=0x7fdd040fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 shutdown_connections 2024-09-19T07:56:02.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:02.262+0000 7fdd0a91f640 1 -- 172.21.15.76:0/764451318 wait complete. 2024-09-19T07:56:03.020 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:02 smithi076 ceph-mon[30930]: pgmap v149: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:56:03.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:56:03.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:02 smithi152 ceph-mon[35117]: pgmap v149: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:56:03.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:02 smithi137 ceph-mon[35309]: pgmap v149: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:56:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.774+0000 7ff0f5848640 1 -- 172.21.15.76:0/2328365151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0106f10 msgr2=0x7ff0f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.774+0000 7ff0f5848640 1 --2- 172.21.15.76:0/2328365151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0106f10 0x7ff0f010ea90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009ca0 tx=0x7ff0e802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- 172.21.15.76:0/2328365151 shutdown_connections 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 --2- 172.21.15.76:0/2328365151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0106f10 0x7ff0f010ea90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 --2- 172.21.15.76:0/2328365151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0102790 0x7ff0f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 --2- 172.21.15.76:0/2328365151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0101de0 0x7ff0f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- 172.21.15.76:0/2328365151 >> 172.21.15.76:0/2328365151 conn(0x7ff0f00fd8c0 msgr2=0x7ff0f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- 172.21.15.76:0/2328365151 shutdown_connections 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- 172.21.15.76:0/2328365151 wait complete. 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 Processor -- start 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- start start 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 0x7ff0f01a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0102790 0x7ff0f01a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0106f10 0x7ff0f019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0118690 con 0x7ff0f0101de0 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0118510 con 0x7ff0f0102790 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.775+0000 7ff0f5848640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0118810 con 0x7ff0f0106f10 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 0x7ff0f01a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 0x7ff0f01a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55208/0 (socket says 172.21.15.76:55208) 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 -- 172.21.15.76:0/3859851997 learned_addr learned my addr 172.21.15.76:0/3859851997 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0102790 0x7ff0f01a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0106f10 0x7ff0f019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 -- 172.21.15.76:0/3859851997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0106f10 msgr2=0x7ff0f019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0106f10 0x7ff0f019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 -- 172.21.15.76:0/3859851997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0102790 msgr2=0x7ff0f01a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0102790 0x7ff0f01a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 -- 172.21.15.76:0/3859851997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f019efd0 con 0x7ff0f0101de0 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0106f10 0x7ff0f019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0102790 0x7ff0f01a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 0x7ff0f01a46b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d950 tx=0x7ff0e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0f4846640 1 -- 172.21.15.76:0/3859851997 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0017070 con 0x7ff0f0101de0 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0f4846640 1 -- 172.21.15.76:0/3859851997 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0e0009c30 con 0x7ff0f0101de0 2024-09-19T07:56:03.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0f4846640 1 -- 172.21.15.76:0/3859851997 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000f740 con 0x7ff0f0101de0 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f019f2c0 con 0x7ff0f0101de0 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.776+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f01ab510 con 0x7ff0f0101de0 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.778+0000 7ff0f4846640 1 -- 172.21.15.76:0/3859851997 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff0e0010a80 con 0x7ff0f0101de0 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 Processor -- start 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 -- start start 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e920d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920d5d0 0x5604e920da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e9218370 0x5604e921a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5604e91732f0 con 0x5604e920eb40 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5604e911acf0 con 0x5604e920d5d0 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5604e916f2b0 con 0x5604e9218370 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0ef7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e920d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0ef7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e920d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55210/0 (socket says 172.21.15.76:55210) 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/2743972129 learned_addr learned my addr 172.21.15.76:0/2743972129 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0f4846640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0d80a33b0 0x7ff0d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920d5d0 0x5604e920da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e9218370 0x5604e921a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.779+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0d80a33b0 0x7ff0d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0f4846640 1 -- 172.21.15.76:0/3859851997 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7ff0e00cfa80 con 0x7ff0f0101de0 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/2743972129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e9218370 msgr2=0x5604e921a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e9218370 0x5604e921a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/2743972129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920d5d0 msgr2=0x5604e920da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920d5d0 0x5604e920da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/2743972129 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e90ff3a0 con 0x5604e920eb40 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e920d090 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8003aa0 tx=0x7ff0e8031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa45239c1937daf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0d80a33b0 0x7ff0d80a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8003ad0 tx=0x7ff0e8049000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0d5ffb640 1 -- 172.21.15.76:0/2743972129 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e804f070 con 0x5604e920eb40 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0d5ffb640 1 -- 172.21.15.76:0/2743972129 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0e8036070 con 0x5604e920eb40 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.780+0000 7ff0d5ffb640 1 -- 172.21.15.76:0/2743972129 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e802fab0 con 0x5604e920eb40 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2743972129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 msgr2=0x5604e920d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e920d090 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8003aa0 tx=0x7ff0e8031f40 comp rx=0 tx=0).stop 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2743972129 shutdown_connections 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e9218370 0x5604e921a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920d5d0 0x5604e920da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2743972129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e920d090 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2743972129 >> 172.21.15.76:0/2743972129 conn(0x5604e91d6310 msgr2=0x5604e9209c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:03.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2743972129 shutdown_connections 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2743972129 wait complete. 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.781+0000 7ff0f7c21740 1 -- start start 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 Processor -- start 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9217d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9214ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e92155e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5604e921ae90 con 0x5604e920eb40 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5604e912e060 con 0x5604e9218370 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5604e921b010 con 0x5604e920d5d0 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0f7c21740 10 client.0 _ll_register_callbacks cb 0x5604e8e818c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:03.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9214ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9214ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55212/0 (socket says 172.21.15.76:55212) 2024-09-19T07:56:03.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/629548686 learned_addr learned my addr 172.21.15.76:0/629548686 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:03.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9217d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e92155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/629548686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 msgr2=0x5604e9217d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9217d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 msgr2=0x5604e92155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e92155e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/629548686 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e8ee43c0 con 0x5604e920eb40 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e92155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9217d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9214ff0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4010770 tx=0x7ff0e4010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01ca394effeb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.782+0000 7ff0ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0ceffd640 1 -- 172.21.15.76:0/629548686 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400ece0 con 0x5604e920eb40 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0ceffd640 1 -- 172.21.15.76:0/629548686 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7ff0e4004020 con 0x5604e920eb40 2024-09-19T07:56:03.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0e8036070 con 0x5604e920eb40 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0ceffd640 1 -- 172.21.15.76:0/629548686 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff0e4010e80 con 0x5604e920eb40 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 10 client.16449 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5604e9226960 con 0x5604e920eb40 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0ceffd640 1 -- 172.21.15.76:0/629548686 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0e8036070 con 0x5604e920eb40 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0ceffd640 1 -- 172.21.15.76:0/629548686 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff0e4004a00 con 0x5604e920eb40 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 10 client.16449 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:03.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 20 client.16449 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:03.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9227f10 0x5604e922a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 4 client.16449 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:03.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.783+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604e9180860 con 0x5604e9227f10 2024-09-19T07:56:03.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.784+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9227f10 0x5604e922a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.784+0000 7ff0ceffd640 10 client.16449 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.784+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9227f10 0x5604e922a330 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e32f34aed39e411c server_cookie=702f7509369d2aeb in_seq=0 out_seq=0 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0ceffd640 1 -- 172.21.15.76:0/629548686 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604e9180860 con 0x5604e9227f10 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0ceffd640 10 client.16449 handle_command_reply: tid=0 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 client.16449 shutdown 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 msgr2=0x5604e9214ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9214ff0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4010770 tx=0x7ff0e4010c30 comp rx=0 tx=0).stop 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 shutdown_connections 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9227f10 0x5604e922a330 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e92155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9214ff0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/629548686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9217d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 >> 172.21.15.76:0/629548686 conn(0x5604e91d6310 msgr2=0x5604e920f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0ceffd640 0 client.16449 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 shutdown_connections 2024-09-19T07:56:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 1 -- 172.21.15.76:0/629548686 wait complete. 2024-09-19T07:56:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.785+0000 7ff0f7c21740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T07:56:03.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.804+0000 7ff0f7c21740 1 Processor -- start 2024-09-19T07:56:03.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.804+0000 7ff0f7c21740 1 -- start start 2024-09-19T07:56:03.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.804+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9224130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9213ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e922fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01b6a90 con 0x5604e920eb40 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01b42a0 con 0x5604e9218370 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01b20f0 con 0x5604e920d5d0 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9213ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9213ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55224/0 (socket says 172.21.15.76:55224) 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/2981587715 learned_addr learned my addr 172.21.15.76:0/2981587715 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e922fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9224130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/2981587715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 msgr2=0x5604e9224130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9224130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/2981587715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 msgr2=0x5604e922fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e922fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 -- 172.21.15.76:0/2981587715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e9215950 con 0x5604e920eb40 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9224130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9213ff0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4000c00 tx=0x7ff0e40036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0a41ca26a4c21f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0d57fa640 1 -- 172.21.15.76:0/2981587715 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4033070 con 0x5604e920eb40 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0d57fa640 1 -- 172.21.15.76:0/2981587715 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0e400ece0 con 0x5604e920eb40 2024-09-19T07:56:03.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.805+0000 7ff0d57fa640 1 -- 172.21.15.76:0/2981587715 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e402a040 con 0x5604e920eb40 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2981587715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 msgr2=0x5604e9213ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9213ff0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4000c00 tx=0x7ff0e40036f0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2981587715 shutdown_connections 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e9218370 0x5604e922fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e920eb40 0x5604e9213ff0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/2981587715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9224130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2981587715 >> 172.21.15.76:0/2981587715 conn(0x5604e91d6310 msgr2=0x5604e92138e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2981587715 shutdown_connections 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 -- 172.21.15.76:0/2981587715 wait complete. 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.806+0000 7ff0f7c21740 1 -- start start 2024-09-19T07:56:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 Processor -- start 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9220890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920eb40 0x5604e9211b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 0x5604e92120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01b2760 con 0x5604e9218370 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01b3bd0 con 0x5604e920eb40 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01b2e30 con 0x5604e920d5d0 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0f7c21740 10 client.0 _ll_register_callbacks cb 0x7ff0e400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 0x5604e92120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 0x5604e92120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55228/0 (socket says 172.21.15.76:55228) 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/1623692319 learned_addr learned my addr 172.21.15.76:0/1623692319 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ee7fc640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920eb40 0x5604e9211b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9220890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/1623692319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 msgr2=0x5604e9220890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9220890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920eb40 msgr2=0x5604e9211b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920eb40 0x5604e9211b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.807+0000 7ff0ef7fe640 1 -- 172.21.15.76:0/1623692319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e9212710 con 0x5604e9218370 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ef7fe640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 0x5604e92120d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8003a70 tx=0x7ff0e8031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6162530df6ed9689 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ceffd640 1 -- 172.21.15.76:0/1623692319 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8058070 con 0x5604e9218370 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ceffd640 1 -- 172.21.15.76:0/1623692319 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7ff0e802f610 con 0x5604e9218370 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0e400ece0 con 0x5604e9218370 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ceffd640 1 -- 172.21.15.76:0/1623692319 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff0e8063050 con 0x5604e9218370 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 10 client.16455 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5604e9292950 con 0x5604e9218370 2024-09-19T07:56:03.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ceffd640 1 -- 172.21.15.76:0/1623692319 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0e400ece0 con 0x5604e9218370 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0ceffd640 1 -- 172.21.15.76:0/1623692319 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7ff0e80305c0 con 0x5604e9218370 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 10 client.16455 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 10 client.16455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 20 client.16455 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9292d90 0x5604e92951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 4 client.16455 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.808+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604e917ad70 con 0x5604e9292d90 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9292d90 0x5604e92951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0eeffd640 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9292d90 0x5604e92951b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc22c1272ae6e0af server_cookie=d5bcf17f78357916 in_seq=0 out_seq=0 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0ceffd640 10 client.16455 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0ceffd640 1 -- 172.21.15.76:0/1623692319 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604e917ad70 con 0x5604e9292d90 2024-09-19T07:56:03.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0ceffd640 10 client.16455 handle_command_reply: tid=0 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 client.16455 shutdown 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 msgr2=0x5604e92120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 0x5604e92120d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8003a70 tx=0x7ff0e8031b10 comp rx=0 tx=0).stop 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 shutdown_connections 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5604e9292d90 0x5604e92951b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5604e9218370 0x5604e92120d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5604e920eb40 0x5604e9211b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 --2- 172.21.15.76:0/1623692319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604e920d5d0 0x5604e9220890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0ceffd640 0 client.16455 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.809+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 >> 172.21.15.76:0/1623692319 conn(0x5604e91d6310 msgr2=0x5604e92084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 shutdown_connections 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f7c21740 1 -- 172.21.15.76:0/1623692319 wait complete. 2024-09-19T07:56:03.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f7c21740 20 client.16455 trim_cache size 0 max 16384 2024-09-19T07:56:03.816 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:03.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0d80a33b0 msgr2=0x7ff0d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0d80a33b0 0x7ff0d80a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8003ad0 tx=0x7ff0e8049000 comp rx=0 tx=0).stop 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 msgr2=0x7ff0f01a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 0x7ff0f01a46b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d950 tx=0x7ff0e000de10 comp rx=0 tx=0).stop 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 shutdown_connections 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0d80a33b0 0x7ff0d80a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0106f10 0x7ff0f019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0f0102790 0x7ff0f01a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 --2- 172.21.15.76:0/3859851997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0f0101de0 0x7ff0f01a46b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 >> 172.21.15.76:0/3859851997 conn(0x7ff0f00fd8c0 msgr2=0x7ff0f00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 shutdown_connections 2024-09-19T07:56:03.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:03.810+0000 7ff0f5848640 1 -- 172.21.15.76:0/3859851997 wait complete. 2024-09-19T07:56:04.636 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:56:04.886 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:04.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:04 smithi076 ceph-mon[30930]: pgmap v150: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:05.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:04 smithi152 ceph-mon[35117]: pgmap v150: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:04 smithi137 ceph-mon[35309]: pgmap v150: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 -- 172.21.15.76:0/635680038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c105ba0 msgr2=0x7fb81c105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 --2- 172.21.15.76:0/635680038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c105ba0 0x7fb81c105f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009ca0 tx=0x7fb80c02a950 comp rx=0 tx=0).stop 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 -- 172.21.15.76:0/635680038 shutdown_connections 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 --2- 172.21.15.76:0/635680038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb81c102110 0x7fb81c10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 --2- 172.21.15.76:0/635680038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c101790 0x7fb81c101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 --2- 172.21.15.76:0/635680038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c105ba0 0x7fb81c105f80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 -- 172.21.15.76:0/635680038 >> 172.21.15.76:0/635680038 conn(0x7fb81c077210 msgr2=0x7fb81c077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 -- 172.21.15.76:0/635680038 shutdown_connections 2024-09-19T07:56:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 -- 172.21.15.76:0/635680038 wait complete. 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 Processor -- start 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.416+0000 7fb820852640 1 -- start start 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c101790 0x7fb81c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 0x7fb81c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb81c105ba0 0x7fb81c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c110fc0 con 0x7fb81c102110 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c110e40 con 0x7fb81c105ba0 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c111140 con 0x7fb81c101790 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 0x7fb81c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 0x7fb81c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55252/0 (socket says 172.21.15.76:55252) 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 -- 172.21.15.76:0/2416977968 learned_addr learned my addr 172.21.15.76:0/2416977968 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb81c105ba0 0x7fb81c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb81a59c640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c101790 0x7fb81c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 -- 172.21.15.76:0/2416977968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c101790 msgr2=0x7fb81c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c101790 0x7fb81c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 -- 172.21.15.76:0/2416977968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb81c105ba0 msgr2=0x7fb81c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb81c105ba0 0x7fb81c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 -- 172.21.15.76:0/2416977968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c1a48b0 con 0x7fb81c102110 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb819d9b640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 0x7fb81c199830 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb80400d770 tx=0x7fb80400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb8137fe640 1 -- 172.21.15.76:0/2416977968 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804017070 con 0x7fb81c102110 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c1a4a80 con 0x7fb81c102110 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb8137fe640 1 -- 172.21.15.76:0/2416977968 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb804005520 con 0x7fb81c102110 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.417+0000 7fb8137fe640 1 -- 172.21.15.76:0/2416977968 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804010460 con 0x7fb81c102110 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.418+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1a4f40 con 0x7fb81c102110 2024-09-19T07:56:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.420+0000 7fb8137fe640 1 -- 172.21.15.76:0/2416977968 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb804004ea0 con 0x7fb81c102110 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.420+0000 7fb822c2b740 1 Processor -- start 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.420+0000 7fb822c2b740 1 -- start start 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.420+0000 7fb8137fe640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8080a33b0 0x7fb8080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.420+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc898fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc898faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc89909780 0x55cc8990bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb822c2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cc898602f0 con 0x55cc898fbb40 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb822c2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc89807cf0 con 0x55cc898fa5d0 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb822c2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cc8985c2b0 con 0x55cc89909780 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc898fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8080a33b0 0x7fb8080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc898fa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55258/0 (socket says 172.21.15.76:55258) 2024-09-19T07:56:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 -- 172.21.15.76:0/886633961 learned_addr learned my addr 172.21.15.76:0/886633961 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb8137fe640 1 -- 172.21.15.76:0/2416977968 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb8040cf8b0 con 0x7fb81c102110 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb819d9b640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc898faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 -- 172.21.15.76:0/886633961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc89909780 msgr2=0x55cc8990bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc89909780 0x55cc8990bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc89909780 0x55cc8990bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 -- 172.21.15.76:0/886633961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 msgr2=0x55cc898faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc898faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 -- 172.21.15.76:0/886633961 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc897ec3a0 con 0x55cc898fbb40 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb819d9b640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc898faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc89909780 0x55cc8990bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8080a33b0 0x7fb8080a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b710 tx=0x7fb814004140 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:05.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb81a59c640 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc898fa090 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009880 tx=0x7fb80c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2008f971dcae42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb810ff9640 1 -- 172.21.15.76:0/886633961 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c034050 con 0x55cc898fbb40 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb810ff9640 1 -- 172.21.15.76:0/886633961 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb80c02fc70 con 0x55cc898fbb40 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.421+0000 7fb810ff9640 1 -- 172.21.15.76:0/886633961 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004470 con 0x55cc898fbb40 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 -- 172.21.15.76:0/886633961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 msgr2=0x55cc898fa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc898fa090 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009880 tx=0x7fb80c0098b0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 -- 172.21.15.76:0/886633961 shutdown_connections 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc89909780 0x55cc8990bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc898faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 --2- 172.21.15.76:0/886633961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc898fa090 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 -- 172.21.15.76:0/886633961 >> 172.21.15.76:0/886633961 conn(0x55cc898c3310 msgr2=0x55cc898f6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 -- 172.21.15.76:0/886633961 shutdown_connections 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.422+0000 7fb822c2b740 1 -- 172.21.15.76:0/886633961 wait complete. 2024-09-19T07:56:05.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 -- start start 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 Processor -- start 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc89906360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc89909780 0x55cc899068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cc8990c420 con 0x55cc898fbb40 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc8981b060 con 0x55cc89909780 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55cc8990c5a0 con 0x55cc898fa5d0 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb822c2b740 10 client.0 _ll_register_callbacks cb 0x55cc8956e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc89906360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc89906360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55266/0 (socket says 172.21.15.76:55266) 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 -- 172.21.15.76:0/2559776925 learned_addr learned my addr 172.21.15.76:0/2559776925 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:05.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 -- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 msgr2=0x55cc899090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb81a59c640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899090b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc89909780 0x55cc899068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 -- 172.21.15.76:0/2559776925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc89909780 msgr2=0x55cc899068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc89909780 0x55cc899068a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.423+0000 7fb819d9b640 1 -- 172.21.15.76:0/2559776925 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc895d13c0 con 0x55cc898fbb40 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb819d9b640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc89906360 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb80400d740 tx=0x7fb80409b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771b10c9c76bfacf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb801ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb801ffb640 1 -- 172.21.15.76:0/2559776925 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80409ce60 con 0x55cc898fbb40 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb801ffb640 1 -- 172.21.15.76:0/2559776925 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb8040c04e0 con 0x55cc898fbb40 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb80c02fc70 con 0x55cc898fbb40 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb801ffb640 1 -- 172.21.15.76:0/2559776925 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb804020070 con 0x55cc898fbb40 2024-09-19T07:56:05.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 10 client.16467 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cc89917d80 con 0x55cc898fbb40 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb801ffb640 1 -- 172.21.15.76:0/2559776925 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb80c02fc70 con 0x55cc898fbb40 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb801ffb640 1 -- 172.21.15.76:0/2559776925 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb8040981a0 con 0x55cc898fbb40 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 10 client.16467 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 20 client.16467 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc8991b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 4 client.16467 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc8986d860 con 0x55cc899191e0 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.424+0000 7fb81a59c640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc8991b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.425+0000 7fb801ffb640 10 client.16467 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.425+0000 7fb81a59c640 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc8991b680 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c81cb1fc876868e server_cookie=b4aa97e0850a8ee7 in_seq=0 out_seq=0 2024-09-19T07:56:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb801ffb640 1 -- 172.21.15.76:0/2559776925 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc8986d860 con 0x55cc899191e0 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb801ffb640 10 client.16467 handle_command_reply: tid=0 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 client.16467 shutdown 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 msgr2=0x55cc89906360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc89906360 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb80400d740 tx=0x7fb80409b590 comp rx=0 tx=0).stop 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 shutdown_connections 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc89909780 0x55cc899068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc8991b680 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc898fbb40 0x55cc89906360 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 --2- 172.21.15.76:0/2559776925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb801ffb640 0 client.16467 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 >> 172.21.15.76:0/2559776925 conn(0x55cc898c3310 msgr2=0x55cc898fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:05.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 shutdown_connections 2024-09-19T07:56:05.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 1 -- 172.21.15.76:0/2559776925 wait complete. 2024-09-19T07:56:05.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.426+0000 7fb822c2b740 20 client.16467 trim_cache size 0 max 16384 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 Processor -- start 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 -- start start 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899156c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fbb40 0x55cc89905c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc89920f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1ae1e0 con 0x55cc89909780 2024-09-19T07:56:05.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1ab9f0 con 0x55cc898fbb40 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb822c2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1a9840 con 0x55cc898fa5d0 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb81ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc89920f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb81ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc89920f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55276/0 (socket says 172.21.15.76:55276) 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3448822629 learned_addr learned my addr 172.21.15.76:0/3448822629 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb819d9b640 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fbb40 0x55cc89905c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.439+0000 7fb81a59c640 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3448822629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 msgr2=0x55cc899156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3448822629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fbb40 msgr2=0x55cc89905c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fbb40 0x55cc89905c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3448822629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc898fad50 con 0x55cc89909780 2024-09-19T07:56:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc89920f50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c010 tx=0x7fb814015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63da70cf24e03781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb803fff640 1 -- 172.21.15.76:0/3448822629 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814012b70 con 0x55cc89909780 2024-09-19T07:56:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb803fff640 1 -- 172.21.15.76:0/3448822629 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb814023070 con 0x55cc89909780 2024-09-19T07:56:05.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.440+0000 7fb803fff640 1 -- 172.21.15.76:0/3448822629 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81401f680 con 0x55cc89909780 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- 172.21.15.76:0/3448822629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 msgr2=0x55cc89920f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc89920f50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c010 tx=0x7fb814015000 comp rx=0 tx=0).stop 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- 172.21.15.76:0/3448822629 shutdown_connections 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc89920f50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fbb40 0x55cc89905c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3448822629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fa5d0 0x55cc899156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- 172.21.15.76:0/3448822629 >> 172.21.15.76:0/3448822629 conn(0x55cc898c3310 msgr2=0x55cc89904c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- 172.21.15.76:0/3448822629 shutdown_connections 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- 172.21.15.76:0/3448822629 wait complete. 2024-09-19T07:56:05.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- start start 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 Processor -- start 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc89911830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fbb40 0x55cc89911d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc8990e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1a9eb0 con 0x55cc89909780 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1ab320 con 0x55cc898fa5d0 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1aa580 con 0x55cc898fbb40 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.441+0000 7fb822c2b740 10 client.0 _ll_register_callbacks cb 0x7fb80400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc8990e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc8990e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55278/0 (socket says 172.21.15.76:55278) 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3538052221 learned_addr learned my addr 172.21.15.76:0/3538052221 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81a59c640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc89911830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb819d9b640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fbb40 0x55cc89911d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fbb40 msgr2=0x55cc89911d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fbb40 0x55cc89911d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3538052221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 msgr2=0x55cc89911830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc89911830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 -- 172.21.15.76:0/3538052221 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8990ed40 con 0x55cc89909780 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb819d9b640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fbb40 0x55cc89911d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb81ad9d640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc8990e800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb8140127c0 tx=0x7fb814012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b80ac3feb584104 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb801ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb801ffb640 1 -- 172.21.15.76:0/3538052221 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814028880 con 0x55cc89909780 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb801ffb640 1 -- 172.21.15.76:0/3538052221 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb814031480 con 0x55cc89909780 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb814023070 con 0x55cc89909780 2024-09-19T07:56:05.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb801ffb640 1 -- 172.21.15.76:0/3538052221 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb814004420 con 0x55cc89909780 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb822c2b740 10 client.16473 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.442+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cc899846b0 con 0x55cc89909780 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb801ffb640 1 -- 172.21.15.76:0/3538052221 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb814023070 con 0x55cc89909780 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb801ffb640 1 -- 172.21.15.76:0/3538052221 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb81401f5e0 con 0x55cc89909780 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb822c2b740 10 client.16473 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb822c2b740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb822c2b740 20 client.16473 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc89986df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb822c2b740 4 client.16473 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc89867d70 con 0x55cc899191e0 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.443+0000 7fb81a59c640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc89986df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:05.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb81a59c640 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc89986df0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c087268acfe94d3 server_cookie=4f82f87701020f8e in_seq=0 out_seq=0 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb801ffb640 10 client.16473 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb801ffb640 1 -- 172.21.15.76:0/3538052221 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc89867d70 con 0x55cc899191e0 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb801ffb640 10 client.16473 handle_command_reply: tid=0 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 client.16473 shutdown 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 msgr2=0x55cc8990e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc8990e800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb8140127c0 tx=0x7fb814012c20 comp rx=0 tx=0).stop 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 shutdown_connections 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55cc899191e0 0x55cc89986df0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cc89909780 0x55cc8990e800 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cc898fbb40 0x55cc89911d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 --2- 172.21.15.76:0/3538052221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc898fa5d0 0x55cc89911830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 >> 172.21.15.76:0/3538052221 conn(0x55cc898c3310 msgr2=0x55cc898fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:05.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb801ffb640 0 client.16473 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:05.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 shutdown_connections 2024-09-19T07:56:05.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 1 -- 172.21.15.76:0/3538052221 wait complete. 2024-09-19T07:56:05.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.444+0000 7fb822c2b740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T07:56:05.451 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8080a33b0 msgr2=0x7fb8080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8080a33b0 0x7fb8080a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b710 tx=0x7fb814004140 comp rx=0 tx=0).stop 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 msgr2=0x7fb81c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 0x7fb81c199830 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb80400d770 tx=0x7fb80400dc30 comp rx=0 tx=0).stop 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 shutdown_connections 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8080a33b0 0x7fb8080a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb81c105ba0 0x7fb81c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb81c102110 0x7fb81c199830 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 --2- 172.21.15.76:0/2416977968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c101790 0x7fb81c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:05.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 >> 172.21.15.76:0/2416977968 conn(0x7fb81c077210 msgr2=0x7fb81c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:05.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 shutdown_connections 2024-09-19T07:56:05.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:05.445+0000 7fb820852640 1 -- 172.21.15.76:0/2416977968 wait complete. 2024-09-19T07:56:07.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:06 smithi152 ceph-mon[35117]: pgmap v151: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:07.152 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:56:07.153 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:56:07.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:06 smithi137 ceph-mon[35309]: pgmap v151: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:07.180 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:06 smithi076 ceph-mon[30930]: pgmap v151: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:07.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2592369037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac101de0 msgr2=0x7fd6ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2592369037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac101de0 0x7fd6ac1021c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009900 tx=0x7fd6a802a410 comp rx=0 tx=0).stop 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2592369037 shutdown_connections 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2592369037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac106f10 0x7fd6ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2592369037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6ac102790 0x7fd6ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2592369037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac101de0 0x7fd6ac1021c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2592369037 >> 172.21.15.76:0/2592369037 conn(0x7fd6ac0fd880 msgr2=0x7fd6ac0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2592369037 shutdown_connections 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2592369037 wait complete. 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.910+0000 7fd6b3fba640 1 Processor -- start 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 -- start start 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6ac101de0 0x7fd6ac198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac102790 0x7fd6ac198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 0x7fd6ac19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1120d0 con 0x7fd6ac106f10 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac111f50 con 0x7fd6ac102790 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b3fba640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac112250 con 0x7fd6ac101de0 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 0x7fd6ac19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 0x7fd6ac19ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55286/0 (socket says 172.21.15.76:55286) 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 -- 172.21.15.76:0/2542614300 learned_addr learned my addr 172.21.15.76:0/2542614300 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b1555640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac102790 0x7fd6ac198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6ac101de0 0x7fd6ac198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 -- 172.21.15.76:0/2542614300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6ac101de0 msgr2=0x7fd6ac198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6ac101de0 0x7fd6ac198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 -- 172.21.15.76:0/2542614300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac102790 msgr2=0x7fd6ac198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac102790 0x7fd6ac198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 -- 172.21.15.76:0/2542614300 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac19d520 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.911+0000 7fd6b2557640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 0x7fd6ac19ce40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400eaa0 tx=0x7fd6a400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.912+0000 7fd69effd640 1 -- 172.21.15.76:0/2542614300 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4004d20 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.912+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ac19d810 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.912+0000 7fd69effd640 1 -- 172.21.15.76:0/2542614300 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6a4005020 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.912+0000 7fd69effd640 1 -- 172.21.15.76:0/2542614300 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a40116b0 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.912+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ac1a50f0 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.914+0000 7fd69effd640 1 -- 172.21.15.76:0/2542614300 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd6a40051d0 con 0x7fd6ac106f10 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.914+0000 7fd6b6393740 1 Processor -- start 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.914+0000 7fd6b6393740 1 -- start start 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 0x56465fff9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564660004d40 0x564660007130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b6393740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56465ff5f280 con 0x56465fff9b60 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b6393740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56465ff06b10 con 0x564660004d40 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b6393740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56465ff5b240 con 0x56465fffa480 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 0x56465fff9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd69effd640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd6980a33b0 0x7fd6980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 0x56465fff9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55288/0 (socket says 172.21.15.76:55288) 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 -- 172.21.15.76:0/983154778 learned_addr learned my addr 172.21.15.76:0/983154778 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b2557640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd6980a33b0 0x7fd6980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564660004d40 0x564660007130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd69effd640 1 -- 172.21.15.76:0/2542614300 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd6a40d0090 con 0x7fd6ac106f10 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 -- 172.21.15.76:0/983154778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 msgr2=0x564660004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 -- 172.21.15.76:0/983154778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564660004d40 msgr2=0x564660007130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564660004d40 0x564660007130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 -- 172.21.15.76:0/983154778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465ff131f0 con 0x56465fff9b60 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b1555640 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 0x56465fff9f40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0006aa0 tx=0x7fd6a00095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2a8f5d5faca6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.915+0000 7fd6b2557640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd6980a33b0 0x7fd6980a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009270 tx=0x7fd6a4097e30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd697fff640 1 -- 172.21.15.76:0/983154778 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0017610 con 0x56465fff9b60 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd697fff640 1 -- 172.21.15.76:0/983154778 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6a001c070 con 0x56465fff9b60 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd697fff640 1 -- 172.21.15.76:0/983154778 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0015a80 con 0x56465fff9b60 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 -- 172.21.15.76:0/983154778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 msgr2=0x56465fff9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 0x56465fff9f40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0006aa0 tx=0x7fd6a00095d0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 -- 172.21.15.76:0/983154778 shutdown_connections 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564660004d40 0x564660007130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 --2- 172.21.15.76:0/983154778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fff9b60 0x56465fff9f40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 -- 172.21.15.76:0/983154778 >> 172.21.15.76:0/983154778 conn(0x56465fff60f0 msgr2=0x56465fff64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 -- 172.21.15.76:0/983154778 shutdown_connections 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.916+0000 7fd6b6393740 1 -- 172.21.15.76:0/983154778 wait complete. 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 -- start start 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 Processor -- start 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660001c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660002150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660002690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564660007910 con 0x564660004d40 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56465ff19f10 con 0x56465fff9b60 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564660007a90 con 0x56465fffa480 2024-09-19T07:56:07.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b6393740 10 client.0 _ll_register_callbacks cb 0x56465fee2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b1555640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660002690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b1555640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660002690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55294/0 (socket says 172.21.15.76:55294) 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b1555640 1 -- 172.21.15.76:0/2239119017 learned_addr learned my addr 172.21.15.76:0/2239119017 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.917+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660002150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1555640 1 -- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 msgr2=0x564660002150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1555640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660002150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1555640 1 -- 172.21.15.76:0/2239119017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 msgr2=0x564660001c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1555640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660001c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1555640 1 -- 172.21.15.76:0/2239119017 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465fcd06a0 con 0x564660004d40 2024-09-19T07:56:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660002150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b1555640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660002690 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009740 tx=0x7fd6a00153e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58ca6cb140572ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6957fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6957fa640 1 -- 172.21.15.76:0/2239119017 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0015a50 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6957fa640 1 -- 172.21.15.76:0/2239119017 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd6a0017410 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6a001c070 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6957fa640 1 -- 172.21.15.76:0/2239119017 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd6a0017610 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b6393740 10 client.16485 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564660013510 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.918+0000 7fd6957fa640 1 -- 172.21.15.76:0/2239119017 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6a001c070 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6957fa640 1 -- 172.21.15.76:0/2239119017 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd6a00209f0 con 0x564660004d40 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b6393740 10 client.16485 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b6393740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:07.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b6393740 20 client.16485 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564660014970 0x564660016d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b6393740 4 client.16485 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56465ff6c7f0 con 0x564660014970 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564660014970 0x564660016d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6957fa640 10 client.16485 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.919+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564660014970 0x564660016d60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee55532b0e3cd209 server_cookie=5f893d8758298843 in_seq=0 out_seq=0 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6957fa640 1 -- 172.21.15.76:0/2239119017 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56465ff6c7f0 con 0x564660014970 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6957fa640 10 client.16485 handle_command_reply: tid=0 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 client.16485 shutdown 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 msgr2=0x564660002690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660002690 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009740 tx=0x7fd6a00153e0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 shutdown_connections 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564660014970 0x564660016d60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660002690 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fffa480 0x564660002150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6957fa640 0 client.16485 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2239119017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660001c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.920+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 >> 172.21.15.76:0/2239119017 conn(0x56465fff60f0 msgr2=0x56465fffbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.921+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 shutdown_connections 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.921+0000 7fd6b6393740 1 -- 172.21.15.76:0/2239119017 wait complete. 2024-09-19T07:56:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.921+0000 7fd6b6393740 20 client.16485 trim_cache size 0 max 16384 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 Processor -- start 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 -- start start 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 0x56466001c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564660004d40 0x56466001c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1b0510 con 0x56465fffa480 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1add20 con 0x56465fff9b60 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b6393740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1abb70 con 0x564660004d40 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 0x56466001c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 0x56466001c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55300/0 (socket says 172.21.15.76:55300) 2024-09-19T07:56:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 -- 172.21.15.76:0/2847220280 learned_addr learned my addr 172.21.15.76:0/2847220280 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1555640 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 -- 172.21.15.76:0/2847220280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564660004d40 msgr2=0x56466001c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564660004d40 0x56466001c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 -- 172.21.15.76:0/2847220280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 msgr2=0x564660003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660003a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 -- 172.21.15.76:0/2847220280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646600044e0 con 0x56465fffa480 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.938+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 0x56466001c360 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009900 tx=0x7fd6a8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d2b872314d0074 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6977fe640 1 -- 172.21.15.76:0/2847220280 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8035070 con 0x56465fffa480 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6977fe640 1 -- 172.21.15.76:0/2847220280 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6a8048070 con 0x56465fffa480 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6977fe640 1 -- 172.21.15.76:0/2847220280 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8004920 con 0x56465fffa480 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 -- 172.21.15.76:0/2847220280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 msgr2=0x56466001c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 0x56466001c360 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009900 tx=0x7fd6a8005e80 comp rx=0 tx=0).stop 2024-09-19T07:56:07.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 -- 172.21.15.76:0/2847220280 shutdown_connections 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564660004d40 0x56466001c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56465fffa480 0x56466001c360 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 --2- 172.21.15.76:0/2847220280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fff9b60 0x564660003a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 -- 172.21.15.76:0/2847220280 >> 172.21.15.76:0/2847220280 conn(0x56465fff60f0 msgr2=0x564660003360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 -- 172.21.15.76:0/2847220280 shutdown_connections 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.939+0000 7fd6b6393740 1 -- 172.21.15.76:0/2847220280 wait complete. 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 -- start start 2024-09-19T07:56:07.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 Processor -- start 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fff9b60 0x56466000d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fffa480 0x564660008810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660008d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1ac1e0 con 0x564660004d40 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1ad650 con 0x56465fffa480 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac1ac8b0 con 0x56465fff9b60 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b6393740 10 client.0 _ll_register_callbacks cb 0x7fd6a0009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b1555640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660008d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b1555640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660008d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55304/0 (socket says 172.21.15.76:55304) 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b1555640 1 -- 172.21.15.76:0/1017004242 learned_addr learned my addr 172.21.15.76:0/1017004242 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.940+0000 7fd6b1555640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fff9b60 0x56466000d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fffa480 0x564660008810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1555640 1 -- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fff9b60 msgr2=0x56466000d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1555640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fff9b60 0x56466000d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1555640 1 -- 172.21.15.76:0/1017004242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fffa480 msgr2=0x564660008810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1555640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fffa480 0x564660008810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1555640 1 -- 172.21.15.76:0/1017004242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646600095c0 con 0x564660004d40 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fffa480 0x564660008810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b1555640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660008d90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0015fd0 tx=0x7fd6a00157d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80314306438bc0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6957fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6957fa640 1 -- 172.21.15.76:0/1017004242 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0017460 con 0x564660004d40 2024-09-19T07:56:07.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6957fa640 1 -- 172.21.15.76:0/1017004242 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd6a0009420 con 0x564660004d40 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6a8048070 con 0x564660004d40 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6957fa640 1 -- 172.21.15.76:0/1017004242 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd6a0009620 con 0x564660004d40 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b6393740 10 client.16491 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56466007f410 con 0x564660004d40 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.941+0000 7fd6957fa640 1 -- 172.21.15.76:0/1017004242 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6a8048070 con 0x564660004d40 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6957fa640 1 -- 172.21.15.76:0/1017004242 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd6a0022c70 con 0x564660004d40 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b6393740 10 client.16491 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b6393740 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b6393740 20 client.16491 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b6393740 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56466007faa0 0x564660081ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b6393740 4 client.16491 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56465ff66d00 con 0x56466007faa0 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56466007faa0 0x564660081ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:07.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6957fa640 10 client.16491 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.942+0000 7fd6b1d56640 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56466007faa0 0x564660081ec0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e8a4f103a71c441 server_cookie=862810e9483e7381 in_seq=0 out_seq=0 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.943+0000 7fd6957fa640 1 -- 172.21.15.76:0/1017004242 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56465ff66d00 con 0x56466007faa0 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.943+0000 7fd6957fa640 10 client.16491 handle_command_reply: tid=0 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.943+0000 7fd6b6393740 1 client.16491 shutdown 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.943+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 msgr2=0x564660008d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.943+0000 7fd6b6393740 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660008d90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0015fd0 tx=0x7fd6a00157d0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 shutdown_connections 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x56466007faa0 0x564660081ec0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564660004d40 0x564660008d90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56465fffa480 0x564660008810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 --2- 172.21.15.76:0/1017004242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56465fff9b60 0x56466000d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 >> 172.21.15.76:0/1017004242 conn(0x56465fff60f0 msgr2=0x5646600023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:07.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6957fa640 0 client.16491 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 shutdown_connections 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 1 -- 172.21.15.76:0/1017004242 wait complete. 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b6393740 20 client.16491 trim_cache size 0 max 16384 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "ade5cb25-7796-4d12-b6bc-aa76af036fd6", 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:56:07.949 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd6980a33b0 msgr2=0x7fd6980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd6980a33b0 0x7fd6980a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009270 tx=0x7fd6a4097e30 comp rx=0 tx=0).stop 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 msgr2=0x7fd6ac19ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 0x7fd6ac19ce40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400eaa0 tx=0x7fd6a400eea0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 shutdown_connections 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd6980a33b0 0x7fd6980a5870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd6ac106f10 0x7fd6ac19ce40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6ac102790 0x7fd6ac198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 --2- 172.21.15.76:0/2542614300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6ac101de0 0x7fd6ac198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:07.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.944+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 >> 172.21.15.76:0/2542614300 conn(0x7fd6ac0fd880 msgr2=0x7fd6ac0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:07.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.945+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 shutdown_connections 2024-09-19T07:56:07.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:07.945+0000 7fd6b3fba640 1 -- 172.21.15.76:0/2542614300 wait complete. 2024-09-19T07:56:08.711 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:56:08.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:08 smithi076 ceph-mon[30930]: pgmap v152: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T07:56:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:08 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:56:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:08 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:08 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:56:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:08 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:09.001 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:09.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:08 smithi152 ceph-mon[35117]: pgmap v152: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T07:56:09.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:08 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:56:09.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:08 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:09.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:08 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:56:09.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:08 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:08 smithi137 ceph-mon[35309]: pgmap v152: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T07:56:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:08 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:56:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:08 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:08 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:56:09.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:08 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:09.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 -- 172.21.15.76:0/499934343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180102790 msgr2=0x7f41801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 --2- 172.21.15.76:0/499934343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180102790 0x7f41801067e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4170009900 tx=0x7f417002a410 comp rx=0 tx=0).stop 2024-09-19T07:56:09.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 -- 172.21.15.76:0/499934343 shutdown_connections 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 --2- 172.21.15.76:0/499934343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4180106f10 0x7f418010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 --2- 172.21.15.76:0/499934343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180102790 0x7f41801067e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 --2- 172.21.15.76:0/499934343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4180101de0 0x7f41801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.458+0000 7f4186b01640 1 -- 172.21.15.76:0/499934343 >> 172.21.15.76:0/499934343 conn(0x7f41800fd8c0 msgr2=0x7f41800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 -- 172.21.15.76:0/499934343 shutdown_connections 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 -- 172.21.15.76:0/499934343 wait complete. 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 Processor -- start 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 -- start start 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4180101de0 0x7f4180198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4180102790 0x7f4180198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 0x7f418019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4180112150 con 0x7f4180106f10 2024-09-19T07:56:09.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4180111fd0 con 0x7f4180101de0 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f4186b01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41801122d0 con 0x7f4180102790 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.459+0000 7f418509e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 0x7f418019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 0x7f418019cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55310/0 (socket says 172.21.15.76:55310) 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 -- 172.21.15.76:0/1113318576 learned_addr learned my addr 172.21.15.76:0/1113318576 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f4177fff640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4180102790 0x7f4180198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418489d640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4180101de0 0x7f4180198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 -- 172.21.15.76:0/1113318576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4180102790 msgr2=0x7f4180198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4180102790 0x7f4180198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 -- 172.21.15.76:0/1113318576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4180101de0 msgr2=0x7f4180198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4180101de0 0x7f4180198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 -- 172.21.15.76:0/1113318576 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418019d620 con 0x7f4180106f10 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f418509e640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 0x7f418019cf40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f417800b970 tx=0x7f417800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:09.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f4175ffb640 1 -- 172.21.15.76:0/1113318576 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178019070 con 0x7f4180106f10 2024-09-19T07:56:09.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418019d910 con 0x7f4180106f10 2024-09-19T07:56:09.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f4175ffb640 1 -- 172.21.15.76:0/1113318576 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f417800cb40 con 0x7f4180106f10 2024-09-19T07:56:09.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f4175ffb640 1 -- 172.21.15.76:0/1113318576 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178007700 con 0x7f4180106f10 2024-09-19T07:56:09.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.460+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41801a51f0 con 0x7f4180106f10 2024-09-19T07:56:09.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.463+0000 7f4188eda740 1 Processor -- start 2024-09-19T07:56:09.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.463+0000 7f4175ffb640 1 -- 172.21.15.76:0/1113318576 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f417801c070 con 0x7f4180106f10 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.463+0000 7f4188eda740 1 -- start start 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4188eda740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3adc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4188eda740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3aeb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4188eda740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3aede80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4188eda740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5597e3a422e0 con 0x5597e3adcca0 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4188eda740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5597e39e9ce0 con 0x5597e3adc380 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4188eda740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5597e3a3e2a0 con 0x5597e3aeba90 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3aeb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3aeb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55320/0 (socket says 172.21.15.76:55320) 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 -- 172.21.15.76:0/2749472089 learned_addr learned my addr 172.21.15.76:0/2749472089 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4175ffb640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41680a33b0 0x7f41680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4177fff640 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3adc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4177fff640 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3aede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 -- 172.21.15.76:0/2749472089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 msgr2=0x5597e3aede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3aede80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 -- 172.21.15.76:0/2749472089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 msgr2=0x5597e3adc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3adc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418509e640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41680a33b0 0x7f41680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f418489d640 1 -- 172.21.15.76:0/2749472089 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e39ce440 con 0x5597e3adcca0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4177fff640 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3aede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.464+0000 7f4175ffb640 1 -- 172.21.15.76:0/1113318576 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f41780cf2d0 con 0x7f4180106f10 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f418489d640 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3aeb550 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b820 tx=0x7f417c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e651705c4017d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f4166ffd640 1 -- 172.21.15.76:0/2749472089 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c00d950 con 0x5597e3adcca0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f4166ffd640 1 -- 172.21.15.76:0/2749472089 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f417c019070 con 0x5597e3adcca0 2024-09-19T07:56:09.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f4166ffd640 1 -- 172.21.15.76:0/2749472089 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c012640 con 0x5597e3adcca0 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f4188eda740 1 -- 172.21.15.76:0/2749472089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 msgr2=0x5597e3aeb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f4188eda740 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3aeb550 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b820 tx=0x7f417c00bce0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.465+0000 7f418509e640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41680a33b0 0x7f41680a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41780ccfc0 tx=0x7f417800e040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- 172.21.15.76:0/2749472089 shutdown_connections 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3aede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3aeb550 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 --2- 172.21.15.76:0/2749472089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3adc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- 172.21.15.76:0/2749472089 >> 172.21.15.76:0/2749472089 conn(0x5597e3ad8a30 msgr2=0x5597e3ad8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- 172.21.15.76:0/2749472089 shutdown_connections 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- 172.21.15.76:0/2749472089 wait complete. 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- start start 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 Processor -- start 2024-09-19T07:56:09.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3aeb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3ae8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3ae8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5597e3aee660 con 0x5597e3adcca0 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5597e39fd050 con 0x5597e3adc380 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5597e3aee7e0 con 0x5597e3aeba90 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.466+0000 7f4188eda740 10 client.0 _ll_register_callbacks cb 0x5597e3a3d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3ae8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3ae8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55334/0 (socket says 172.21.15.76:55334) 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 -- 172.21.15.76:0/2451275576 learned_addr learned my addr 172.21.15.76:0/2451275576 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f4177fff640 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3aeb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 -- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 msgr2=0x5597e3ae8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3ae8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 -- 172.21.15.76:0/2451275576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 msgr2=0x5597e3aeb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3aeb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 -- 172.21.15.76:0/2451275576 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e37b33c0 con 0x5597e3adcca0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f418489d640 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3ae8680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f417c004700 tx=0x7f417c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706967e0eea1e597 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f415ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f415ffff640 1 -- 172.21.15.76:0/2451275576 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c023070 con 0x5597e3adcca0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f415ffff640 1 -- 172.21.15.76:0/2451275576 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f417c014840 con 0x5597e3adcca0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417c019070 con 0x5597e3adcca0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f415ffff640 1 -- 172.21.15.76:0/2451275576 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f417c02f050 con 0x5597e3adcca0 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f4188eda740 10 client.16503 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:09.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.467+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5597e3af9fc0 con 0x5597e3adcca0 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f415ffff640 1 -- 172.21.15.76:0/2451275576 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f417c019070 con 0x5597e3adcca0 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f415ffff640 1 -- 172.21.15.76:0/2451275576 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f417c013070 con 0x5597e3adcca0 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4188eda740 10 client.16503 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4188eda740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4188eda740 20 client.16503 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4188eda740 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3afd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4188eda740 4 client.16503 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597e3a4f850 con 0x5597e3afb310 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.468+0000 7f4177fff640 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3afd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f4177fff640 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3afd700 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae77023354aff33 server_cookie=91c34d97932b555a in_seq=0 out_seq=0 2024-09-19T07:56:09.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f415ffff640 10 client.16503 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:09.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f415ffff640 1 -- 172.21.15.76:0/2451275576 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597e3a4f850 con 0x5597e3afb310 2024-09-19T07:56:09.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f415ffff640 10 client.16503 handle_command_reply: tid=0 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f4188eda740 1 client.16503 shutdown 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 msgr2=0x5597e3ae8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.469+0000 7f4188eda740 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3ae8680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f417c004700 tx=0x7f417c00dc00 comp rx=0 tx=0).stop 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 shutdown_connections 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3ae8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3afd700 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f415ffff640 0 client.16503 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adcca0 0x5597e3ae8680 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 --2- 172.21.15.76:0/2451275576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3aeb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 >> 172.21.15.76:0/2451275576 conn(0x5597e3ad8a30 msgr2=0x5597e3ade790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 shutdown_connections 2024-09-19T07:56:09.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 1 -- 172.21.15.76:0/2451275576 wait complete. 2024-09-19T07:56:09.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.470+0000 7f4188eda740 20 client.16503 trim_cache size 0 max 16384 2024-09-19T07:56:09.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 Processor -- start 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 -- start start 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 0x5597e3af7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adcca0 0x5597e3ae6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3b02d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f41801ae480 con 0x5597e3adc380 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41801abc90 con 0x5597e3adcca0 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4188eda740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41801a9ae0 con 0x5597e3aeba90 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 0x5597e3af7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 0x5597e3af7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55342/0 (socket says 172.21.15.76:55342) 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 -- 172.21.15.76:0/269465592 learned_addr learned my addr 172.21.15.76:0/269465592 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:09.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 -- 172.21.15.76:0/269465592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 msgr2=0x5597e3b02d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3b02d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 -- 172.21.15.76:0/269465592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adcca0 msgr2=0x5597e3ae6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adcca0 0x5597e3ae6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 -- 172.21.15.76:0/269465592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e3afdb60 con 0x5597e3adc380 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.486+0000 7f4177fff640 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 0x5597e3af7900 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f41700092a0 tx=0x7f4170031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2125c09d667aa9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f41667fc640 1 -- 172.21.15.76:0/269465592 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170049030 con 0x5597e3adc380 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f41667fc640 1 -- 172.21.15.76:0/269465592 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4170042070 con 0x5597e3adc380 2024-09-19T07:56:09.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f41667fc640 1 -- 172.21.15.76:0/269465592 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170035040 con 0x5597e3adc380 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 -- 172.21.15.76:0/269465592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 msgr2=0x5597e3af7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 0x5597e3af7900 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f41700092a0 tx=0x7f4170031400 comp rx=0 tx=0).stop 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 -- 172.21.15.76:0/269465592 shutdown_connections 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3aeba90 0x5597e3b02d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adcca0 0x5597e3ae6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 --2- 172.21.15.76:0/269465592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3adc380 0x5597e3af7900 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 -- 172.21.15.76:0/269465592 >> 172.21.15.76:0/269465592 conn(0x5597e3ad8a30 msgr2=0x5597e3aea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 -- 172.21.15.76:0/269465592 shutdown_connections 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.487+0000 7f4188eda740 1 -- 172.21.15.76:0/269465592 wait complete. 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 -- start start 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 Processor -- start 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3af4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3adcca0 0x5597e3aef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 0x5597e3aefc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f41801aa150 con 0x5597e3aeba90 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41801ab5c0 con 0x5597e3adc380 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41801aa820 con 0x5597e3adcca0 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4188eda740 10 client.0 _ll_register_callbacks cb 0x7f417c00b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:09.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4177fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 0x5597e3aefc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4177fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 0x5597e3aefc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55352/0 (socket says 172.21.15.76:55352) 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4177fff640 1 -- 172.21.15.76:0/1784282550 learned_addr learned my addr 172.21.15.76:0/1784282550 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f418489d640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3adcca0 0x5597e3aef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.488+0000 7f4177fff640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3af4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4177fff640 1 -- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3adcca0 msgr2=0x5597e3aef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4177fff640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3adcca0 0x5597e3aef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4177fff640 1 -- 172.21.15.76:0/1784282550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 msgr2=0x5597e3af4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4177fff640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3af4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4177fff640 1 -- 172.21.15.76:0/1784282550 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e3af0470 con 0x5597e3aeba90 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4177fff640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 0x5597e3aefc40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4170004940 tx=0x7f41700047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af115849fb342428 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f415ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f415ffff640 1 -- 172.21.15.76:0/1784282550 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170056020 con 0x5597e3aeba90 2024-09-19T07:56:09.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f415ffff640 1 -- 172.21.15.76:0/1784282550 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f41700035f0 con 0x5597e3aeba90 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4170042070 con 0x5597e3aeba90 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f415ffff640 1 -- 172.21.15.76:0/1784282550 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4170061050 con 0x5597e3aeba90 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4188eda740 10 client.16509 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5597e3b65ea0 con 0x5597e3aeba90 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f415ffff640 1 -- 172.21.15.76:0/1784282550 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4170042070 con 0x5597e3aeba90 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.489+0000 7f415ffff640 1 -- 172.21.15.76:0/1784282550 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f417003a040 con 0x5597e3aeba90 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 10 client.16509 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 20 client.16509 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3b685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 4 client.16509 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597e3a49d60 con 0x5597e3afb310 2024-09-19T07:56:09.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f418489d640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3b685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f418489d640 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3b685b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e50d8a59a3b98775 server_cookie=8ea190a1e7b912ad in_seq=0 out_seq=0 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f415ffff640 10 client.16509 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f415ffff640 1 -- 172.21.15.76:0/1784282550 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5597e3a49d60 con 0x5597e3afb310 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f415ffff640 10 client.16509 handle_command_reply: tid=0 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.490+0000 7f4188eda740 1 client.16509 shutdown 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 msgr2=0x5597e3aefc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 0x5597e3aefc40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4170004940 tx=0x7f41700047a0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 shutdown_connections 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5597e3afb310 0x5597e3b685b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5597e3aeba90 0x5597e3aefc40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597e3adcca0 0x5597e3aef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 --2- 172.21.15.76:0/1784282550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5597e3adc380 0x5597e3af4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f415ffff640 0 client.16509 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 >> 172.21.15.76:0/1784282550 conn(0x5597e3ad8a30 msgr2=0x5597e3ad7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 shutdown_connections 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 1 -- 172.21.15.76:0/1784282550 wait complete. 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4188eda740 20 client.16509 trim_cache size 0 max 16384 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:56:09.498 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:56:09.499 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:09.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41680a33b0 msgr2=0x7f41680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.491+0000 7f4186b01640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41680a33b0 0x7f41680a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41780ccfc0 tx=0x7f417800e040 comp rx=0 tx=0).stop 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 msgr2=0x7f418019cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 0x7f418019cf40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f417800b970 tx=0x7f417800be30 comp rx=0 tx=0).stop 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 shutdown_connections 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f41680a33b0 0x7f41680a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4180106f10 0x7f418019cf40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4180102790 0x7f4180198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 --2- 172.21.15.76:0/1113318576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4180101de0 0x7f4180198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 >> 172.21.15.76:0/1113318576 conn(0x7f41800fd8c0 msgr2=0x7f41800fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 shutdown_connections 2024-09-19T07:56:09.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:09.492+0000 7f4186b01640 1 -- 172.21.15.76:0/1113318576 wait complete. 2024-09-19T07:56:10.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:09 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:56:10.149 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:09 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:56:10.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:09 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:56:10.177 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:56:10.177 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:56:10.424 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:10.820 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:10 smithi076 ceph-mon[30930]: pgmap v153: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 -- 172.21.15.76:0/3617992558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e181027a0 msgr2=0x7f6e181067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/3617992558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e181027a0 0x7f6e181067f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009900 tx=0x7f6e0402a410 comp rx=0 tx=0).stop 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 -- 172.21.15.76:0/3617992558 shutdown_connections 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/3617992558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18106f20 0x7f6e1810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/3617992558 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e181027a0 0x7f6e181067f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/3617992558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e18101df0 0x7f6e181021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:10.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 -- 172.21.15.76:0/3617992558 >> 172.21.15.76:0/3617992558 conn(0x7f6e180fd8f0 msgr2=0x7f6e180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 -- 172.21.15.76:0/3617992558 shutdown_connections 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 -- 172.21.15.76:0/3617992558 wait complete. 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 Processor -- start 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.899+0000 7f6e1f01a640 1 -- start start 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18101df0 0x7f6e18198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e181027a0 0x7f6e18198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 0x7f6e1819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6e181120e0 con 0x7f6e18106f20 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18111f60 con 0x7f6e18101df0 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18112260 con 0x7f6e181027a0 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 0x7f6e1819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 0x7f6e1819cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55368/0 (socket says 172.21.15.76:55368) 2024-09-19T07:56:10.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 -- 172.21.15.76:0/997293881 learned_addr learned my addr 172.21.15.76:0/997293881 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1cdb6640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18101df0 0x7f6e18198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 -- 172.21.15.76:0/997293881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e181027a0 msgr2=0x7f6e18198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e181027a0 0x7f6e18198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 -- 172.21.15.76:0/997293881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18101df0 msgr2=0x7f6e18198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18101df0 0x7f6e18198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 -- 172.21.15.76:0/997293881 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1819d5d0 con 0x7f6e18106f20 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1cdb6640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18101df0 0x7f6e18198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1d5b7640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 0x7f6e1819cef0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000cce0 tx=0x7f6e1000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000f450 con 0x7f6e18106f20 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1819d8c0 con 0x7f6e18106f20 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e1000faf0 con 0x7f6e18106f20 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.900+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10018cc0 con 0x7f6e18106f20 2024-09-19T07:56:10.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.901+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e181a51a0 con 0x7f6e18106f20 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.902+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e181021d0 con 0x7f6e18106f20 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.903+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6e1000f5f0 con 0x7f6e18106f20 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.903+0000 7f6e15ffb640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e080a33b0 0x7f6e080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.904+0000 7f6e1cdb6640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e080a33b0 0x7f6e080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.904+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6e100d0330 con 0x7f6e18106f20 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.904+0000 7f6e1cdb6640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e080a33b0 0x7f6e080a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009930 tx=0x7f6e0c008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:10.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:10.908+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e10014030 con 0x7f6e18106f20 2024-09-19T07:56:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:10 smithi152 ceph-mon[35117]: pgmap v153: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:11.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.108+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e1810a100 con 0x7f6e18106f20 2024-09-19T07:56:11.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.109+0000 7f6e15ffb640 1 -- 172.21.15.76:0/997293881 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7f6e1009ccb0 con 0x7f6e18106f20 2024-09-19T07:56:11.110 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:56:11.111 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:56:11.111 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:56:11.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e080a33b0 msgr2=0x7f6e080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e080a33b0 0x7f6e080a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009930 tx=0x7f6e0c008040 comp rx=0 tx=0).stop 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 msgr2=0x7f6e1819cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 0x7f6e1819cef0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000cce0 tx=0x7f6e1000a620 comp rx=0 tx=0).stop 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 shutdown_connections 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6e080a33b0 0x7f6e080a5870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6e18106f20 0x7f6e1819cef0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e181027a0 0x7f6e18198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 --2- 172.21.15.76:0/997293881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e18101df0 0x7f6e18198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.111+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 >> 172.21.15.76:0/997293881 conn(0x7f6e180fd8f0 msgr2=0x7f6e180fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.112+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 shutdown_connections 2024-09-19T07:56:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:11.112+0000 7f6e1f01a640 1 -- 172.21.15.76:0/997293881 wait complete. 2024-09-19T07:56:11.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:10 smithi137 ceph-mon[35309]: pgmap v153: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:11.734 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:56:11.984 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:12.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:11 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/997293881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:12.105 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:11 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/997293881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:12.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:11 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/997293881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 -- 172.21.15.76:0/2873067346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100350 msgr2=0x7efeb0100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 --2- 172.21.15.76:0/2873067346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100350 0x7efeb0100730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efea0009930 tx=0x7efea002a420 comp rx=0 tx=0).stop 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 -- 172.21.15.76:0/2873067346 shutdown_connections 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 --2- 172.21.15.76:0/2873067346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb0106f50 0x7efeb010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 --2- 172.21.15.76:0/2873067346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efeb0100d00 0x7efeb0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 --2- 172.21.15.76:0/2873067346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100350 0x7efeb0100730 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 -- 172.21.15.76:0/2873067346 >> 172.21.15.76:0/2873067346 conn(0x7efeb0077210 msgr2=0x7efeb00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 -- 172.21.15.76:0/2873067346 shutdown_connections 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.482+0000 7efeb5be2640 1 -- 172.21.15.76:0/2873067346 wait complete. 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 Processor -- start 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 -- start start 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efeb0100350 0x7efeb0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 0x7efeb0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb0106f50 0x7efeb019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01120c0 con 0x7efeb0100d00 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0111f40 con 0x7efeb0106f50 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.483+0000 7efeb5be2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0112240 con 0x7efeb0100350 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 0x7efeb0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 0x7efeb0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55386/0 (socket says 172.21.15.76:55386) 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 -- 172.21.15.76:0/849422229 learned_addr learned my addr 172.21.15.76:0/849422229 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:12.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efeb0100350 0x7efeb0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaffff640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb0106f50 0x7efeb019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 -- 172.21.15.76:0/849422229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efeb0100350 msgr2=0x7efeb0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efeb0100350 0x7efeb0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 -- 172.21.15.76:0/849422229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb0106f50 msgr2=0x7efeb019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb0106f50 0x7efeb019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 -- 172.21.15.76:0/849422229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb019d4d0 con 0x7efeb0100d00 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeaeffd640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 0x7efeb0198a60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efe9800d770 tx=0x7efe9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeacff9640 1 -- 172.21.15.76:0/849422229 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98017070 con 0x7efeb0100d00 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb019d7c0 con 0x7efeb0100d00 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeacff9640 1 -- 172.21.15.76:0/849422229 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efe98009c30 con 0x7efeb0100d00 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeacff9640 1 -- 172.21.15.76:0/849422229 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9800f6b0 con 0x7efeb0100d00 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.484+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01a50a0 con 0x7efeb0100d00 2024-09-19T07:56:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.486+0000 7efeacff9640 1 -- 172.21.15.76:0/849422229 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efe9801a070 con 0x7efeb0100d00 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 Processor -- start 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 -- start start 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeacff9640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efe9c0a33b0 0x7efe9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdd0b40 0x556b3bdcf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdcf5d0 0x556b3bdcfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 0x556b3bde0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b3bd352f0 con 0x556b3bdde780 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556b3bcdccf0 con 0x556b3bdcf5d0 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b3bd312b0 con 0x556b3bdd0b40 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeaffff640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efe9c0a33b0 0x7efe9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeacff9640 1 -- 172.21.15.76:0/849422229 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7efe980cf970 con 0x7efeb0100d00 2024-09-19T07:56:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeaffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 0x556b3bde0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeaffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 0x556b3bde0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55398/0 (socket says 172.21.15.76:55398) 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeaffff640 1 -- 172.21.15.76:0/220242776 learned_addr learned my addr 172.21.15.76:0/220242776 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdd0b40 0x556b3bdcf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.487+0000 7efeaeffd640 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdcf5d0 0x556b3bdcfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 -- 172.21.15.76:0/220242776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdd0b40 msgr2=0x556b3bdcf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdd0b40 0x556b3bdcf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 -- 172.21.15.76:0/220242776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdcf5d0 msgr2=0x556b3bdcfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdcf5d0 0x556b3bdcfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 -- 172.21.15.76:0/220242776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3bcc13a0 con 0x556b3bdde780 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efe9c0a33b0 0x7efe9c0a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efea800bfd0 tx=0x7efea800bd40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efeaffff640 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 0x556b3bde0b70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efea8010d90 tx=0x7efea801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b827b99190c184 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efea5ffb640 1 -- 172.21.15.76:0/220242776 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800ee60 con 0x556b3bdde780 2024-09-19T07:56:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efea5ffb640 1 -- 172.21.15.76:0/220242776 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efea8010e80 con 0x556b3bdde780 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.488+0000 7efea5ffb640 1 -- 172.21.15.76:0/220242776 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8004030 con 0x556b3bdde780 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 -- 172.21.15.76:0/220242776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 msgr2=0x556b3bde0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 0x556b3bde0b70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efea8010d90 tx=0x7efea801a000 comp rx=0 tx=0).stop 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 -- 172.21.15.76:0/220242776 shutdown_connections 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdde780 0x556b3bde0b70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdcf5d0 0x556b3bdcfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/220242776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdd0b40 0x556b3bdcf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 -- 172.21.15.76:0/220242776 >> 172.21.15.76:0/220242776 conn(0x556b3bd98310 msgr2=0x556b3bdcbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 -- 172.21.15.76:0/220242776 shutdown_connections 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 -- 172.21.15.76:0/220242776 wait complete. 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 -- start start 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.489+0000 7efeb7fbb740 1 Processor -- start 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdcf5d0 0x556b3bdde170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 0x556b3bddb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdde780 0x556b3bddba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b3bde1420 con 0x556b3bdd0b40 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556b3bcf0060 con 0x556b3bdde780 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b3bde15a0 con 0x556b3bdcf5d0 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 10 client.0 _ll_register_callbacks cb 0x556b3ba438c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 0x556b3bddb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 0x556b3bddb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55402/0 (socket says 172.21.15.76:55402) 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 -- 172.21.15.76:0/4123513559 learned_addr learned my addr 172.21.15.76:0/4123513559 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaffff640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdde780 0x556b3bddba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 -- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdcf5d0 msgr2=0x556b3bdde170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdcf5d0 0x556b3bdde170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdcf5d0 0x556b3bdde170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 -- 172.21.15.76:0/4123513559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdde780 msgr2=0x556b3bddba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdde780 0x556b3bddba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 -- 172.21.15.76:0/4123513559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3baa63c0 con 0x556b3bdd0b40 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaffff640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdde780 0x556b3bddba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdcf5d0 0x556b3bdde170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeaeffd640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 0x556b3bddb420 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efe98010fd0 tx=0x7efe980c6ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b100a8ab808346d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efe8effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efe8effd640 1 -- 172.21.15.76:0/4123513559 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98021030 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efe8effd640 1 -- 172.21.15.76:0/4123513559 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7efe98099ef0 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b3bd42860 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efe8effd640 1 -- 172.21.15.76:0/4123513559 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efe9809bbf0 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 10 client.16527 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.490+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556b3bdecf10 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efe8effd640 1 -- 172.21.15.76:0/4123513559 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x556b3bd42860 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efe8effd640 1 -- 172.21.15.76:0/4123513559 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efe980c6820 con 0x556b3bdd0b40 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeb7fbb740 10 client.16527 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeb7fbb740 10 client.16527 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeb7fbb740 20 client.16527 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3bdee370 0x556b3bdf0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeb7fbb740 4 client.16527 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b3bd3cd70 con 0x556b3bdee370 2024-09-19T07:56:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.491+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3bdee370 0x556b3bdf0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.492+0000 7efe8effd640 10 client.16527 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.492+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3bdee370 0x556b3bdf0810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36a1e0fca0ecf9d3 server_cookie=de10b44ebd1c001c in_seq=0 out_seq=0 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.492+0000 7efe8effd640 1 -- 172.21.15.76:0/4123513559 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b3bd3cd70 con 0x556b3bdee370 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.492+0000 7efe8effd640 10 client.16527 handle_command_reply: tid=0 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.492+0000 7efeb7fbb740 1 client.16527 shutdown 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 msgr2=0x556b3bddb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 0x556b3bddb420 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efe98010fd0 tx=0x7efe980c6ce0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 shutdown_connections 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3bdee370 0x556b3bdf0810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdde780 0x556b3bddba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdd0b40 0x556b3bddb420 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/4123513559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdcf5d0 0x556b3bdde170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efe8effd640 0 client.16527 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 >> 172.21.15.76:0/4123513559 conn(0x556b3bd98310 msgr2=0x556b3bdd1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 shutdown_connections 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 1 -- 172.21.15.76:0/4123513559 wait complete. 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.493+0000 7efeb7fbb740 20 client.16527 trim_cache size 0 max 16384 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.505+0000 7efeb7fbb740 1 Processor -- start 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 -- start start 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bdea710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bddace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bddd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01ae230 con 0x556b3bdcf5d0 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01aba40 con 0x556b3bdd0b40 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01a9890 con 0x556b3bdde780 2024-09-19T07:56:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bdea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bdea710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55414/0 (socket says 172.21.15.76:55414) 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 -- 172.21.15.76:0/122336107 learned_addr learned my addr 172.21.15.76:0/122336107 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaffff640 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bddd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 -- 172.21.15.76:0/122336107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 msgr2=0x556b3bddd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bddd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaeffd640 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bddace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 -- 172.21.15.76:0/122336107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 msgr2=0x556b3bddace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bddace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 -- 172.21.15.76:0/122336107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3bdcfbe0 con 0x556b3bdcf5d0 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaeffd640 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bddace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bdea710 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efea002a940 tx=0x7efea002aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22b22a4f334e495 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efea57fa640 1 -- 172.21.15.76:0/122336107 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0035040 con 0x556b3bdcf5d0 2024-09-19T07:56:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efea57fa640 1 -- 172.21.15.76:0/122336107 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efea0005540 con 0x556b3bdcf5d0 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.506+0000 7efea57fa640 1 -- 172.21.15.76:0/122336107 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0031640 con 0x556b3bdcf5d0 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 -- 172.21.15.76:0/122336107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 msgr2=0x556b3bdea710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bdea710 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efea002a940 tx=0x7efea002aaf0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 -- 172.21.15.76:0/122336107 shutdown_connections 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bddd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bddace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/122336107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bdea710 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 -- 172.21.15.76:0/122336107 >> 172.21.15.76:0/122336107 conn(0x556b3bd98310 msgr2=0x556b3bddcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 -- 172.21.15.76:0/122336107 shutdown_connections 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 -- 172.21.15.76:0/122336107 wait complete. 2024-09-19T07:56:12.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.507+0000 7efeb7fbb740 1 -- start start 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 Processor -- start 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bde6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bde6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bde3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01a9f00 con 0x556b3bdcf5d0 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01ab370 con 0x556b3bdd0b40 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01aa5d0 con 0x556b3bdde780 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeb7fbb740 10 client.0 _ll_register_callbacks cb 0x7efe9800d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bde6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bde6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55424/0 (socket says 172.21.15.76:55424) 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 -- 172.21.15.76:0/2221808950 learned_addr learned my addr 172.21.15.76:0/2221808950 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaeffd640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bde6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaffff640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bde3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 -- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 msgr2=0x556b3bde3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bde3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 -- 172.21.15.76:0/2221808950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 msgr2=0x556b3bde6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bde6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 -- 172.21.15.76:0/2221808950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3bde3d90 con 0x556b3bdcf5d0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaeffd640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bde6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaffff640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bde3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efeaf7fe640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bde6880 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efea00092a0 tx=0x7efea0004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceabaf671865cd41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.508+0000 7efe8effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efe8effd640 1 -- 172.21.15.76:0/2221808950 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0050030 con 0x556b3bdcf5d0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efe8effd640 1 -- 172.21.15.76:0/2221808950 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7efea0042050 con 0x556b3bdcf5d0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea0005540 con 0x556b3bdcf5d0 2024-09-19T07:56:12.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efe8effd640 1 -- 172.21.15.76:0/2221808950 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efea0035040 con 0x556b3bdcf5d0 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 10 client.16533 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556b3be59740 con 0x556b3bdcf5d0 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efe8effd640 1 -- 172.21.15.76:0/2221808950 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efea0005540 con 0x556b3bdcf5d0 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efe8effd640 1 -- 172.21.15.76:0/2221808950 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7efea00051f0 con 0x556b3bdcf5d0 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 10 client.16533 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 10 client.16533 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 20 client.16533 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3be59e70 0x556b3be5c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 4 client.16533 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b3bcb9170 con 0x556b3be59e70 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.509+0000 7efeaeffd640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3be59e70 0x556b3be5c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efe8effd640 10 client.16533 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeaeffd640 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3be59e70 0x556b3be5c290 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a617e3393c309109 server_cookie=c5287a2eb43c77aa in_seq=0 out_seq=0 2024-09-19T07:56:12.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efe8effd640 1 -- 172.21.15.76:0/2221808950 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b3bcb9170 con 0x556b3be59e70 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efe8effd640 10 client.16533 handle_command_reply: tid=0 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 client.16533 shutdown 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 msgr2=0x556b3bde6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bde6880 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efea00092a0 tx=0x7efea0004460 comp rx=0 tx=0).stop 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 shutdown_connections 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556b3be59e70 0x556b3be5c290 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b3bdde780 0x556b3bde3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b3bdd0b40 0x556b3bde6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efe8effd640 0 client.16533 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 --2- 172.21.15.76:0/2221808950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b3bdcf5d0 0x556b3bde6880 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 >> 172.21.15.76:0/2221808950 conn(0x556b3bd98310 msgr2=0x556b3bddd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 shutdown_connections 2024-09-19T07:56:12.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 1 -- 172.21.15.76:0/2221808950 wait complete. 2024-09-19T07:56:12.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.510+0000 7efeb7fbb740 20 client.16533 trim_cache size 0 max 16384 2024-09-19T07:56:12.530 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efe9c0a33b0 msgr2=0x7efe9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efe9c0a33b0 0x7efe9c0a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efea800bfd0 tx=0x7efea800bd40 comp rx=0 tx=0).stop 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 msgr2=0x7efeb0198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 0x7efeb0198a60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efe9800d770 tx=0x7efe9800dc30 comp rx=0 tx=0).stop 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 shutdown_connections 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7efe9c0a33b0 0x7efe9c0a5870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb0106f50 0x7efeb019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efeb0100d00 0x7efeb0198a60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 --2- 172.21.15.76:0/849422229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efeb0100350 0x7efeb0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 >> 172.21.15.76:0/849422229 conn(0x7efeb0077210 msgr2=0x7efeb0105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 shutdown_connections 2024-09-19T07:56:12.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:12.511+0000 7efeb5be2640 1 -- 172.21.15.76:0/849422229 wait complete. 2024-09-19T07:56:13.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:12 smithi152 ceph-mon[35117]: pgmap v154: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:56:13.082 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:12 smithi076 ceph-mon[30930]: pgmap v154: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:56:13.109 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:56:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:12 smithi137 ceph-mon[35309]: pgmap v154: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:56:13.359 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 -- 172.21.15.76:0/4068873247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 msgr2=0x7fce2c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 --2- 172.21.15.76:0/4068873247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c10eaa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fce24009ca0 tx=0x7fce2402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 -- 172.21.15.76:0/4068873247 shutdown_connections 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 --2- 172.21.15.76:0/4068873247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c10eaa0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 --2- 172.21.15.76:0/4068873247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 0x7fce2c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 --2- 172.21.15.76:0/4068873247 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2c101df0 0x7fce2c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 -- 172.21.15.76:0/4068873247 >> 172.21.15.76:0/4068873247 conn(0x7fce2c0fd8b0 msgr2=0x7fce2c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 -- 172.21.15.76:0/4068873247 shutdown_connections 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.853+0000 7fce34297640 1 -- 172.21.15.76:0/4068873247 wait complete. 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 Processor -- start 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 -- start start 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2c101df0 0x7fce2c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 0x7fce2c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1120a0 con 0x7fce2c106f20 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c111f20 con 0x7fce2c101df0 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.854+0000 7fce34297640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c112220 con 0x7fce2c1027a0 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46558/0 (socket says 172.21.15.76:46558) 2024-09-19T07:56:13.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 -- 172.21.15.76:0/984680257 learned_addr learned my addr 172.21.15.76:0/984680257 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32033640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2c101df0 0x7fce2c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce31832640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 0x7fce2c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 -- 172.21.15.76:0/984680257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 msgr2=0x7fce2c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 0x7fce2c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 -- 172.21.15.76:0/984680257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2c101df0 msgr2=0x7fce2c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2c101df0 0x7fce2c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 -- 172.21.15.76:0/984680257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c19d3d0 con 0x7fce2c106f20 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce31832640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 0x7fce2c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce32834640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c19ccf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fce24009dc0 tx=0x7fce24031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce237fe640 1 -- 172.21.15.76:0/984680257 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2402fba0 con 0x7fce2c106f20 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce237fe640 1 -- 172.21.15.76:0/984680257 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce2402fd40 con 0x7fce2c106f20 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c19d660 con 0x7fce2c106f20 2024-09-19T07:56:13.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce237fe640 1 -- 172.21.15.76:0/984680257 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24046a70 con 0x7fce2c106f20 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.855+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c1a4fa0 con 0x7fce2c106f20 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce237fe640 1 -- 172.21.15.76:0/984680257 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fce240305c0 con 0x7fce2c106f20 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 Processor -- start 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 -- start start 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb25e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb25ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb26b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55efbb1c42f0 con 0x55efbb25fb40 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55efbb16bcf0 con 0x55efbb25e5d0 2024-09-19T07:56:13.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce36670740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55efbb1c02b0 con 0x55efbb269370 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.858+0000 7fce31832640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb25e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb25e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46570/0 (socket says 172.21.15.76:46570) 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 -- 172.21.15.76:0/3832166532 learned_addr learned my addr 172.21.15.76:0/3832166532 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce237fe640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fce180a33b0 0x7fce180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb26b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce32033640 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb25ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce32834640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fce180a33b0 0x7fce180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 -- 172.21.15.76:0/3832166532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 msgr2=0x55efbb26b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb26b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 -- 172.21.15.76:0/3832166532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 msgr2=0x55efbb25ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce237fe640 1 -- 172.21.15.76:0/984680257 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fce240f1300 con 0x7fce2c106f20 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb25ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 -- 172.21.15.76:0/3832166532 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbb1503a0 con 0x55efbb25fb40 2024-09-19T07:56:13.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce31832640 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb25e090 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005e10 tx=0x7fce1c0085c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2cdd809a537608 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:13.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce20dea640 1 -- 172.21.15.76:0/3832166532 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c018030 con 0x55efbb25fb40 2024-09-19T07:56:13.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce32834640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fce180a33b0 0x7fce180a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce240bd390 tx=0x7fce2408d2b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:13.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce20dea640 1 -- 172.21.15.76:0/3832166532 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce1c005520 con 0x55efbb25fb40 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.859+0000 7fce20dea640 1 -- 172.21.15.76:0/3832166532 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00c820 con 0x55efbb25fb40 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 -- 172.21.15.76:0/3832166532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 msgr2=0x55efbb25e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb25e090 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005e10 tx=0x7fce1c0085c0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 -- 172.21.15.76:0/3832166532 shutdown_connections 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb26b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb25ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 --2- 172.21.15.76:0/3832166532 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb25e090 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 -- 172.21.15.76:0/3832166532 >> 172.21.15.76:0/3832166532 conn(0x55efbb227310 msgr2=0x55efbb25ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:13.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 -- 172.21.15.76:0/3832166532 shutdown_connections 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 -- 172.21.15.76:0/3832166532 wait complete. 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 -- start start 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.860+0000 7fce36670740 1 Processor -- start 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb268ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb265f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb2664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55efbb26c070 con 0x55efbb25fb40 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55efbb17f060 con 0x55efbb25e5d0 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55efbb26c1f0 con 0x55efbb269370 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 10 client.0 _ll_register_callbacks cb 0x55efbaed28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb265f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb265f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46580/0 (socket says 172.21.15.76:46580) 2024-09-19T07:56:13.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 -- 172.21.15.76:0/3828540894 learned_addr learned my addr 172.21.15.76:0/3828540894 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 -- 172.21.15.76:0/3828540894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 msgr2=0x55efbb2664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb2664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 -- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 msgr2=0x55efbb268ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce31832640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb268ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb268ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 -- 172.21.15.76:0/3828540894 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbaf353c0 con 0x55efbb25fb40 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce31832640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb268ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce32033640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb265f90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce28012790 tx=0x7fce28012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255118f949394c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce15ffb640 1 -- 172.21.15.76:0/3828540894 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28010dc0 con 0x55efbb25fb40 2024-09-19T07:56:13.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce15ffb640 1 -- 172.21.15.76:0/3828540894 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fce28005020 con 0x55efbb25fb40 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.861+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce1c005520 con 0x55efbb25fb40 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce15ffb640 1 -- 172.21.15.76:0/3828540894 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fce28005260 con 0x55efbb25fb40 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 10 client.16545 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55efbb277a80 con 0x55efbb25fb40 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce15ffb640 1 -- 172.21.15.76:0/3828540894 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce1c005520 con 0x55efbb25fb40 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce15ffb640 1 -- 172.21.15.76:0/3828540894 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fce2801a5f0 con 0x55efbb25fb40 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 10 client.16545 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 10 client.16545 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 20 client.16545 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb279000 0x55efbb27b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 4 client.16545 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efbb1d1860 con 0x55efbb279000 2024-09-19T07:56:13.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.862+0000 7fce31832640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb279000 0x55efbb27b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.863+0000 7fce15ffb640 10 client.16545 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.863+0000 7fce31832640 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb279000 0x55efbb27b480 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8cb33386df2d55e4 server_cookie=56a5a933d179e482 in_seq=0 out_seq=0 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce15ffb640 1 -- 172.21.15.76:0/3828540894 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55efbb1d1860 con 0x55efbb279000 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce15ffb640 10 client.16545 handle_command_reply: tid=0 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 client.16545 shutdown 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 msgr2=0x55efbb265f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb265f90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce28012790 tx=0x7fce28012c50 comp rx=0 tx=0).stop 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 shutdown_connections 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb279000 0x55efbb27b480 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb269370 0x55efbb2664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb265f90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 --2- 172.21.15.76:0/3828540894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb25e5d0 0x55efbb268ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 >> 172.21.15.76:0/3828540894 conn(0x55efbb227310 msgr2=0x55efbb260930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce15ffb640 0 client.16545 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 shutdown_connections 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 1 -- 172.21.15.76:0/3828540894 wait complete. 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.864+0000 7fce36670740 20 client.16545 trim_cache size 0 max 16384 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 Processor -- start 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 -- start start 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb261120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb261660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb280d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1b0400 con 0x55efbb25fb40 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1adc10 con 0x55efbb269370 2024-09-19T07:56:13.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce36670740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1aba60 con 0x55efbb25e5d0 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce32033640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb261660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce32033640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb261660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46594/0 (socket says 172.21.15.76:46594) 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.877+0000 7fce32033640 1 -- 172.21.15.76:0/3083941168 learned_addr learned my addr 172.21.15.76:0/3083941168 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce31832640 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb261120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce31832640 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb280d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce32033640 1 -- 172.21.15.76:0/3083941168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 msgr2=0x55efbb261120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce32033640 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb261120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce32033640 1 -- 172.21.15.76:0/3083941168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 msgr2=0x55efbb280d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce32033640 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb280d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce32033640 1 -- 172.21.15.76:0/3083941168 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbb27bb00 con 0x55efbb25fb40 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce31832640 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb280d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce32033640 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb261660 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fce2801aae0 tx=0x7fce28005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca82454f335c475 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:13.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce17fff640 1 -- 172.21.15.76:0/3083941168 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28031020 con 0x55efbb25fb40 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce17fff640 1 -- 172.21.15.76:0/3083941168 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce28005400 con 0x55efbb25fb40 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.878+0000 7fce17fff640 1 -- 172.21.15.76:0/3083941168 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28012290 con 0x55efbb25fb40 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 -- 172.21.15.76:0/3083941168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 msgr2=0x55efbb261660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb261660 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fce2801aae0 tx=0x7fce28005a10 comp rx=0 tx=0).stop 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 -- 172.21.15.76:0/3083941168 shutdown_connections 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb280d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb261660 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 --2- 172.21.15.76:0/3083941168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb261120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 -- 172.21.15.76:0/3083941168 >> 172.21.15.76:0/3083941168 conn(0x55efbb227310 msgr2=0x55efbb268010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 -- 172.21.15.76:0/3083941168 shutdown_connections 2024-09-19T07:56:13.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 -- 172.21.15.76:0/3083941168 wait complete. 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 -- start start 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.879+0000 7fce36670740 1 Processor -- start 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb271480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb2719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb26e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ac0d0 con 0x55efbb25fb40 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ad540 con 0x55efbb269370 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ac7a0 con 0x55efbb25e5d0 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce36670740 10 client.0 _ll_register_callbacks cb 0x7fce2800a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:13.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb2719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb2719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46610/0 (socket says 172.21.15.76:46610) 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 -- 172.21.15.76:0/3361904014 learned_addr learned my addr 172.21.15.76:0/3361904014 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce31832640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb26e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce31832640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb271480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 -- 172.21.15.76:0/3361904014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 msgr2=0x55efbb271480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb271480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 -- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 msgr2=0x55efbb26e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb26e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 -- 172.21.15.76:0/3361904014 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbb25b960 con 0x55efbb25fb40 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce31832640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb271480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce32033640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb2719c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fce28000c00 tx=0x7fce28010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8641ec058ad75f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:13.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.880+0000 7fce15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce15ffb640 1 -- 172.21.15.76:0/3361904014 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28039030 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce15ffb640 1 -- 172.21.15.76:0/3361904014 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fce28012040 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce28005400 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce15ffb640 1 -- 172.21.15.76:0/3361904014 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fce28043050 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 10 client.16551 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55efbb2e4210 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce15ffb640 1 -- 172.21.15.76:0/3361904014 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce28005400 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce15ffb640 1 -- 172.21.15.76:0/3361904014 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fce280035f0 con 0x55efbb25fb40 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 10 client.16551 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 10 client.16551 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 20 client.16551 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb2e48c0 0x55efbb2e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:13.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 4 client.16551 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.881+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efbb1cbd70 con 0x55efbb2e48c0 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce31832640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb2e48c0 0x55efbb2e6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce31832640 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb2e48c0 0x55efbb2e6cb0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a805ac1d78b99291 server_cookie=159530f4152d5a52 in_seq=0 out_seq=0 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce15ffb640 10 client.16551 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce15ffb640 1 -- 172.21.15.76:0/3361904014 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55efbb1cbd70 con 0x55efbb2e48c0 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce15ffb640 10 client.16551 handle_command_reply: tid=0 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 client.16551 shutdown 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 msgr2=0x55efbb2719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb2719c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fce28000c00 tx=0x7fce28010df0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 shutdown_connections 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55efbb2e48c0 0x55efbb2e6cb0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55efbb269370 0x55efbb26e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55efbb25fb40 0x55efbb2719c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 --2- 172.21.15.76:0/3361904014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55efbb25e5d0 0x55efbb271480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 >> 172.21.15.76:0/3361904014 conn(0x55efbb227310 msgr2=0x55efbb259310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.882+0000 7fce15ffb640 0 client.16551 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 shutdown_connections 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce36670740 1 -- 172.21.15.76:0/3361904014 wait complete. 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce36670740 20 client.16551 trim_cache size 0 max 16384 2024-09-19T07:56:13.900 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:13.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fce180a33b0 msgr2=0x7fce180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fce180a33b0 0x7fce180a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce240bd390 tx=0x7fce2408d2b0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 msgr2=0x7fce2c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c19ccf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fce24009dc0 tx=0x7fce24031b10 comp rx=0 tx=0).stop 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 shutdown_connections 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fce180a33b0 0x7fce180a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fce2c106f20 0x7fce2c19ccf0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce2c1027a0 0x7fce2c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 --2- 172.21.15.76:0/984680257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce2c101df0 0x7fce2c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 >> 172.21.15.76:0/984680257 conn(0x7fce2c0fd8b0 msgr2=0x7fce2c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 shutdown_connections 2024-09-19T07:56:13.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:13.883+0000 7fce34297640 1 -- 172.21.15.76:0/984680257 wait complete. 2024-09-19T07:56:14.689 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:56:14.937 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:14.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:14 smithi076 ceph-mon[30930]: pgmap v155: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:56:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:14 smithi152 ceph-mon[35117]: pgmap v155: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:56:15.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:14 smithi137 ceph-mon[35309]: pgmap v155: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:56:15.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 -- 172.21.15.76:0/2185663110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8106a80 msgr2=0x7f7fa8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 --2- 172.21.15.76:0/2185663110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8106a80 0x7f7fa8106e60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009930 tx=0x7f7f9c02a420 comp rx=0 tx=0).stop 2024-09-19T07:56:15.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 -- 172.21.15.76:0/2185663110 shutdown_connections 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 --2- 172.21.15.76:0/2185663110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8101420 0x7f7fa810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 --2- 172.21.15.76:0/2185663110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa8100a80 0x7f7fa8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 --2- 172.21.15.76:0/2185663110 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8106a80 0x7f7fa8106e60 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 -- 172.21.15.76:0/2185663110 >> 172.21.15.76:0/2185663110 conn(0x7f7fa80fc7a0 msgr2=0x7f7fa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 -- 172.21.15.76:0/2185663110 shutdown_connections 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.384+0000 7f7faef96640 1 -- 172.21.15.76:0/2185663110 wait complete. 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 Processor -- start 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 -- start start 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 0x7f7fa8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa8101420 0x7f7fa8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8106a80 0x7f7fa819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8110f60 con 0x7f7fa8100a80 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8110de0 con 0x7f7fa8101420 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7faef96640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81110e0 con 0x7f7fa8106a80 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7facd32640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 0x7f7fa8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7facd32640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 0x7f7fa8198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46638/0 (socket says 172.21.15.76:46638) 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7facd32640 1 -- 172.21.15.76:0/4000491112 learned_addr learned my addr 172.21.15.76:0/4000491112 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7fad533640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8106a80 0x7f7fa819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.385+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa8101420 0x7f7fa8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7facd32640 1 -- 172.21.15.76:0/4000491112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8106a80 msgr2=0x7f7fa819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7facd32640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8106a80 0x7f7fa819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7facd32640 1 -- 172.21.15.76:0/4000491112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa8101420 msgr2=0x7f7fa8198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7facd32640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa8101420 0x7f7fa8198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7facd32640 1 -- 172.21.15.76:0/4000491112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa819d4d0 con 0x7f7fa8100a80 2024-09-19T07:56:15.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7fad533640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8106a80 0x7f7fa819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7facd32640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 0x7f7fa8198520 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009230 tx=0x7f7f9c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7fa5ffb640 1 -- 172.21.15.76:0/4000491112 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c03f030 con 0x7f7fa8100a80 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7fa5ffb640 1 -- 172.21.15.76:0/4000491112 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f9c003af0 con 0x7f7fa8100a80 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa819d760 con 0x7f7fa8100a80 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7fa5ffb640 1 -- 172.21.15.76:0/4000491112 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c035070 con 0x7f7fa8100a80 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.386+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa81a50a0 con 0x7f7fa8100a80 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 Processor -- start 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fa5ffb640 1 -- 172.21.15.76:0/4000491112 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7f9c042030 con 0x7f7fa8100a80 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 -- start start 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 0x556b8346b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b8346ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b83476370 0x556b83478760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b833d12f0 con 0x556b8346cb40 2024-09-19T07:56:15.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556b83378cf0 con 0x556b83476370 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fb136f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b833cd2b0 con 0x556b8346b5d0 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 0x556b8346b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 0x556b8346b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46642/0 (socket says 172.21.15.76:46642) 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fad533640 1 -- 172.21.15.76:0/1462959815 learned_addr learned my addr 172.21.15.76:0/1462959815 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7facd32640 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b8346ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.389+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b83476370 0x556b83478760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fad533640 1 -- 172.21.15.76:0/1462959815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 msgr2=0x556b8346ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fad533640 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b8346ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fad533640 1 -- 172.21.15.76:0/1462959815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b83476370 msgr2=0x556b83478760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fad533640 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b83476370 0x556b83478760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fad533640 1 -- 172.21.15.76:0/1462959815 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8335d3a0 con 0x556b8346cb40 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b83476370 0x556b83478760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:15.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fa5ffb640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f980a33b0 0x7f7f980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fad533640 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 0x556b8346b090 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009f30 tx=0x7f7fa0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1268118696d0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7facd32640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f980a33b0 0x7f7f980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7f92ffd640 1 -- 172.21.15.76:0/1462959815 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0016070 con 0x556b8346cb40 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7f92ffd640 1 -- 172.21.15.76:0/1462959815 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fa001bb60 con 0x556b8346cb40 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7f92ffd640 1 -- 172.21.15.76:0/1462959815 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0012d20 con 0x556b8346cb40 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.390+0000 7f7fa5ffb640 1 -- 172.21.15.76:0/4000491112 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7f9c0f06d0 con 0x7f7fa8100a80 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 -- 172.21.15.76:0/1462959815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 msgr2=0x556b8346b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 0x556b8346b090 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009f30 tx=0x7f7fa0010800 comp rx=0 tx=0).stop 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7facd32640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f980a33b0 0x7f7f980a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0ede70 tx=0x7f7f9c009260 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 -- 172.21.15.76:0/1462959815 shutdown_connections 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b83476370 0x556b83478760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b8346ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 --2- 172.21.15.76:0/1462959815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346cb40 0x556b8346b090 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 -- 172.21.15.76:0/1462959815 >> 172.21.15.76:0/1462959815 conn(0x556b83434310 msgr2=0x556b83467c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 -- 172.21.15.76:0/1462959815 shutdown_connections 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 -- 172.21.15.76:0/1462959815 wait complete. 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 -- start start 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.391+0000 7f7fb136f740 1 Processor -- start 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b83475cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83472ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 0x556b83473600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556b83479070 con 0x556b83476370 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556b8338c060 con 0x556b8346cb40 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b834791f0 con 0x556b8346b5d0 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fb136f740 10 client.0 _ll_register_callbacks cb 0x556b830df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:15.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 0x556b83473600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 0x556b83473600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46652/0 (socket says 172.21.15.76:46652) 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 -- 172.21.15.76:0/3946708313 learned_addr learned my addr 172.21.15.76:0/3946708313 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b83475cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83472ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 -- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 msgr2=0x556b83475cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b83475cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 -- 172.21.15.76:0/3946708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 msgr2=0x556b83472ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83472ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 -- 172.21.15.76:0/3946708313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b831423c0 con 0x556b83476370 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7fad533640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 0x556b83473600 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0005c00 tx=0x7f7fa0012900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d290a2a6e1215f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.392+0000 7f7f87fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:15.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7f87fff640 1 -- 172.21.15.76:0/3946708313 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0016040 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa001bb60 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7f87fff640 1 -- 172.21.15.76:0/3946708313 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7fa001b460 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7f87fff640 1 -- 172.21.15.76:0/3946708313 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7fa001b660 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 10 client.16563 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556b83484a50 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7f87fff640 1 -- 172.21.15.76:0/3946708313 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fa001bb60 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7f87fff640 1 -- 172.21.15.76:0/3946708313 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f7fa000f040 con 0x556b83476370 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 10 client.16563 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 20 client.16563 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b83485eb0 0x556b834882a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 4 client.16563 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b833de860 con 0x556b83485eb0 2024-09-19T07:56:15.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.393+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b83485eb0 0x556b834882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.394+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b83485eb0 0x556b834882a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b38dc24771678489 server_cookie=b17f1ce1da88c296 in_seq=0 out_seq=0 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.394+0000 7f7f87fff640 10 client.16563 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.394+0000 7f7f87fff640 1 -- 172.21.15.76:0/3946708313 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b833de860 con 0x556b83485eb0 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.394+0000 7f7f87fff640 10 client.16563 handle_command_reply: tid=0 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 client.16563 shutdown 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 msgr2=0x556b83473600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 0x556b83473600 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0005c00 tx=0x7f7fa0012900 comp rx=0 tx=0).stop 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 shutdown_connections 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b83485eb0 0x556b834882a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b83476370 0x556b83473600 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83472ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3946708313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b8346b5d0 0x556b83475cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7f87fff640 0 client.16563 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:15.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 >> 172.21.15.76:0/3946708313 conn(0x556b83434310 msgr2=0x556b8346d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:15.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 shutdown_connections 2024-09-19T07:56:15.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 1 -- 172.21.15.76:0/3946708313 wait complete. 2024-09-19T07:56:15.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.395+0000 7f7fb136f740 20 client.16563 trim_cache size 0 max 16384 2024-09-19T07:56:15.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 Processor -- start 2024-09-19T07:56:15.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 -- start start 2024-09-19T07:56:15.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b83467e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83482310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b83471fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81b0550 con 0x556b8346b5d0 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81add60 con 0x556b8346cb40 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fb136f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81abbb0 con 0x556b83476370 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b83467e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b83467e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46658/0 (socket says 172.21.15.76:46658) 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fad533640 1 -- 172.21.15.76:0/3026531327 learned_addr learned my addr 172.21.15.76:0/3026531327 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:15.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.412+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83482310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7fad533640 1 -- 172.21.15.76:0/3026531327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 msgr2=0x556b83471fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7fad533640 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b83471fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7fad533640 1 -- 172.21.15.76:0/3026531327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 msgr2=0x556b83482310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7fad533640 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83482310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7fad533640 1 -- 172.21.15.76:0/3026531327 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b83473c00 con 0x556b8346b5d0 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7fad533640 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b83467e10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0011010 tx=0x7f7fa0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2acf2098603ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7f927fc640 1 -- 172.21.15.76:0/3026531327 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0016070 con 0x556b8346b5d0 2024-09-19T07:56:15.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7f927fc640 1 -- 172.21.15.76:0/3026531327 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fa001bb60 con 0x556b8346b5d0 2024-09-19T07:56:15.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.413+0000 7f7f927fc640 1 -- 172.21.15.76:0/3026531327 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0012970 con 0x556b8346b5d0 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- 172.21.15.76:0/3026531327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 msgr2=0x556b83467e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b83467e10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0011010 tx=0x7f7fa0009bf0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- 172.21.15.76:0/3026531327 shutdown_connections 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b83471fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b83482310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- 172.21.15.76:0/3026531327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b83467e10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- 172.21.15.76:0/3026531327 >> 172.21.15.76:0/3026531327 conn(0x556b83434310 msgr2=0x556b834718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- 172.21.15.76:0/3026531327 shutdown_connections 2024-09-19T07:56:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- 172.21.15.76:0/3026531327 wait complete. 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- start start 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 Processor -- start 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b8347e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b8347eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b8346f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81ac220 con 0x556b8346b5d0 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81ad690 con 0x556b8346cb40 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.414+0000 7f7fb136f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81ac8f0 con 0x556b83476370 2024-09-19T07:56:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fb136f740 10 client.0 _ll_register_callbacks cb 0x7f7fa0009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b8347e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b8347e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46664/0 (socket says 172.21.15.76:46664) 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 -- 172.21.15.76:0/2441939388 learned_addr learned my addr 172.21.15.76:0/2441939388 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b8347eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b8346f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 -- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 msgr2=0x556b8346f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b8346f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 -- 172.21.15.76:0/2441939388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 msgr2=0x556b8347eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:15.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b8347eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 -- 172.21.15.76:0/2441939388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b83470000 con 0x556b8346b5d0 2024-09-19T07:56:15.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fad533640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b8347e660 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00126b0 tx=0x7f7fa0009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ed8fc30f3cb39d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:15.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7f87fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7f87fff640 1 -- 172.21.15.76:0/2441939388 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0043060 con 0x556b8346b5d0 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7f87fff640 1 -- 172.21.15.76:0/2441939388 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f7fa001b460 con 0x556b8346b5d0 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa001bb60 con 0x556b8346b5d0 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7f87fff640 1 -- 172.21.15.76:0/2441939388 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7fa0016070 con 0x556b8346b5d0 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fb136f740 10 client.16569 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.415+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556b834f04d0 con 0x556b8346b5d0 2024-09-19T07:56:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7f87fff640 1 -- 172.21.15.76:0/2441939388 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7fa001bb60 con 0x556b8346b5d0 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7f87fff640 1 -- 172.21.15.76:0/2441939388 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f7fa001d470 con 0x556b8346b5d0 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fb136f740 10 client.16569 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fb136f740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fb136f740 20 client.16569 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fb136f740 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b834f0b10 0x556b834f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fb136f740 4 client.16569 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b833d8d70 con 0x556b834f0b10 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.416+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b834f0b10 0x556b834f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7f87fff640 10 client.16569 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fa7fff640 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b834f0b10 0x556b834f2f30 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b549b6029f74ab5e server_cookie=ab2100e35b01aab in_seq=0 out_seq=0 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7f87fff640 1 -- 172.21.15.76:0/2441939388 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b833d8d70 con 0x556b834f0b10 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7f87fff640 10 client.16569 handle_command_reply: tid=0 2024-09-19T07:56:15.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 client.16569 shutdown 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 msgr2=0x556b8347e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b8347e660 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00126b0 tx=0x7f7fa0009c60 comp rx=0 tx=0).stop 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 shutdown_connections 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b83476370 0x556b8346f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556b8346cb40 0x556b8347eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556b834f0b10 0x556b834f2f30 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 --2- 172.21.15.76:0/2441939388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556b8346b5d0 0x556b8347e660 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7f87fff640 0 client.16569 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 >> 172.21.15.76:0/2441939388 conn(0x556b83434310 msgr2=0x556b834720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 shutdown_connections 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 1 -- 172.21.15.76:0/2441939388 wait complete. 2024-09-19T07:56:15.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.417+0000 7f7fb136f740 20 client.16569 trim_cache size 0 max 16384 2024-09-19T07:56:15.435 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:15.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f980a33b0 msgr2=0x7f7f980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f980a33b0 0x7f7f980a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0ede70 tx=0x7f7f9c009260 comp rx=0 tx=0).stop 2024-09-19T07:56:15.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 msgr2=0x7f7fa8198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:15.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 0x7f7fa8198520 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009230 tx=0x7f7f9c004270 comp rx=0 tx=0).stop 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 shutdown_connections 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f980a33b0 0x7f7f980a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fa8106a80 0x7f7fa819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa8101420 0x7f7fa8198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 --2- 172.21.15.76:0/4000491112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fa8100a80 0x7f7fa8198520 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 >> 172.21.15.76:0/4000491112 conn(0x7f7fa80fc7a0 msgr2=0x7f7fa806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 shutdown_connections 2024-09-19T07:56:15.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:15.418+0000 7f7faef96640 1 -- 172.21.15.76:0/4000491112 wait complete. 2024-09-19T07:56:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:16 smithi152 ceph-mon[35117]: pgmap v156: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:17.086 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:56:17.087 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:56:17.114 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:16 smithi076 ceph-mon[30930]: pgmap v156: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:16 smithi137 ceph-mon[35309]: pgmap v156: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:56:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 -- 172.21.15.76:0/2057605055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30101420 msgr2=0x7f0b3010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2057605055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30101420 0x7f0b3010d950 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009cd0 tx=0x7f0b2802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 -- 172.21.15.76:0/2057605055 shutdown_connections 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2057605055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30101420 0x7f0b3010d950 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2057605055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30100a80 0x7f0b30100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2057605055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30106a80 0x7f0b30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 -- 172.21.15.76:0/2057605055 >> 172.21.15.76:0/2057605055 conn(0x7f0b300fc7a0 msgr2=0x7f0b300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 -- 172.21.15.76:0/2057605055 shutdown_connections 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.804+0000 7f0b35e97640 1 -- 172.21.15.76:0/2057605055 wait complete. 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 Processor -- start 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 -- start start 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 0x7f0b30199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30101420 0x7f0b30199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30106a80 0x7f0b301a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30110fe0 con 0x7f0b30100a80 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30110e60 con 0x7f0b30101420 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.805+0000 7f0b35e97640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30111160 con 0x7f0b30106a80 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 0x7f0b30199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 0x7f0b30199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46692/0 (socket says 172.21.15.76:46692) 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2195143664 learned_addr learned my addr 172.21.15.76:0/2195143664 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2effd640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30101420 0x7f0b30199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30106a80 0x7f0b301a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2195143664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30106a80 msgr2=0x7f0b301a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30106a80 0x7f0b301a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2195143664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30101420 msgr2=0x7f0b30199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30101420 0x7f0b30199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2195143664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b301a4910 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2effd640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30101420 0x7f0b30199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30106a80 0x7f0b301a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 0x7f0b30199350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b4a0 tx=0x7f0b2000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2cff9640 1 -- 172.21.15.76:0/2195143664 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20014070 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2cff9640 1 -- 172.21.15.76:0/2195143664 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b20010b10 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b301a4ae0 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b2cff9640 1 -- 172.21.15.76:0/2195143664 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20017d60 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.806+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b301a5070 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.808+0000 7f0b2cff9640 1 -- 172.21.15.76:0/2195143664 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0b20017070 con 0x7f0b30100a80 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 Processor -- start 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 -- start start 2024-09-19T07:56:17.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88a91e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88aa0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88aa3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564d889f7280 con 0x564d88a92340 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d8899eb10 con 0x564d88aa1150 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b38270740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564d889f3240 con 0x564d88a91a20 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2cff9640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b180a3430 0x7f0b180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88aa0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88aa0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46698/0 (socket says 172.21.15.76:46698) 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/4227345353 learned_addr learned my addr 172.21.15.76:0/4227345353 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b180a3430 0x7f0b180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88a91e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.809+0000 7f0b2cff9640 1 -- 172.21.15.76:0/2195143664 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0b200cf020 con 0x7f0b30100a80 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2effd640 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88aa3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/4227345353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 msgr2=0x564d88a91e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88a91e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/4227345353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 msgr2=0x564d88aa3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88aa3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/4227345353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d889ab1f0 con 0x564d88a92340 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88aa0c10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0b200cc790 tx=0x7f0b200177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eaece2d5210f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b180a3430 0x7f0b180a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009a60 tx=0x7f0b280317e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b15ffb640 1 -- 172.21.15.76:0/4227345353 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b200cce60 con 0x564d88a92340 2024-09-19T07:56:17.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b15ffb640 1 -- 172.21.15.76:0/4227345353 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b2009f760 con 0x564d88a92340 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.810+0000 7f0b15ffb640 1 -- 172.21.15.76:0/4227345353 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2001e070 con 0x564d88a92340 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 -- 172.21.15.76:0/4227345353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 msgr2=0x564d88aa0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88aa0c10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0b200cc790 tx=0x7f0b200177c0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 -- 172.21.15.76:0/4227345353 shutdown_connections 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88aa3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88aa0c10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 --2- 172.21.15.76:0/4227345353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88a91e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 -- 172.21.15.76:0/4227345353 >> 172.21.15.76:0/4227345353 conn(0x564d88a8e0f0 msgr2=0x564d88a8e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 -- 172.21.15.76:0/4227345353 shutdown_connections 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 -- 172.21.15.76:0/4227345353 wait complete. 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 -- start start 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.811+0000 7f0b38270740 1 Processor -- start 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 0x564d88a9e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88a9e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88a9ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564d88aa3cc0 con 0x564d88a91a20 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d889b1f10 con 0x564d88aa1150 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564d88aa3e40 con 0x564d88a92340 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 10 client.0 _ll_register_callbacks cb 0x564d8897aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 0x564d88a9e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 0x564d88a9e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46704/0 (socket says 172.21.15.76:46704) 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2467805835 learned_addr learned my addr 172.21.15.76:0/2467805835 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88a9ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 msgr2=0x564d88a9e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88a9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2467805835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 msgr2=0x564d88a9ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88a9ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 -- 172.21.15.76:0/2467805835 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d887686a0 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88a9ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 0x564d88a9e010 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0b200ccd10 tx=0x7f0b200a4140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757dcb02d540f8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b0effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b0effd640 1 -- 172.21.15.76:0/2467805835 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b200cce60 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b0effd640 1 -- 172.21.15.76:0/2467805835 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0b2009a800 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.812+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b2009f760 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b0effd640 1 -- 172.21.15.76:0/2467805835 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b2001e070 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 10 client.16581 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564d88aaf910 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b0effd640 1 -- 172.21.15.76:0/2467805835 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b2009f760 con 0x564d88a91a20 2024-09-19T07:56:17.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b0effd640 1 -- 172.21.15.76:0/2467805835 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0b20097100 con 0x564d88a91a20 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 10 client.16581 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 20 client.16581 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88ab0c60 0x564d88ab3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 4 client.16581 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d88a047f0 con 0x564d88ab0c60 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.813+0000 7f0b2effd640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88ab0c60 0x564d88ab3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.814+0000 7f0b2effd640 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88ab0c60 0x564d88ab3050 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cad47fdf5edfb5a6 server_cookie=2a5fc4e3416fc161 in_seq=0 out_seq=0 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.814+0000 7f0b0effd640 10 client.16581 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.814+0000 7f0b0effd640 1 -- 172.21.15.76:0/2467805835 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d88a047f0 con 0x564d88ab0c60 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.814+0000 7f0b0effd640 10 client.16581 handle_command_reply: tid=0 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.814+0000 7f0b38270740 1 client.16581 shutdown 2024-09-19T07:56:17.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 msgr2=0x564d88a9e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 0x564d88a9e010 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0b200ccd10 tx=0x7f0b200a4140 comp rx=0 tx=0).stop 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 shutdown_connections 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88a9ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88a9e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88ab0c60 0x564d88ab3050 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 --2- 172.21.15.76:0/2467805835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a91a20 0x564d88a9e010 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 >> 172.21.15.76:0/2467805835 conn(0x564d88a8e0f0 msgr2=0x564d88a93e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b0effd640 0 client.16581 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:17.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 shutdown_connections 2024-09-19T07:56:17.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 1 -- 172.21.15.76:0/2467805835 wait complete. 2024-09-19T07:56:17.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.815+0000 7f0b38270740 20 client.16581 trim_cache size 0 max 16384 2024-09-19T07:56:17.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 Processor -- start 2024-09-19T07:56:17.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 -- start start 2024-09-19T07:56:17.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88a91a20 0x564d88ab6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88ab65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 0x564d88a9b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0b301ae340 con 0x564d88aa1150 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b301abb50 con 0x564d88a91a20 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b38270740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b301a99a0 con 0x564d88a92340 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 0x564d88a9b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 0x564d88a9b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46708/0 (socket says 172.21.15.76:46708) 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2ffff640 1 -- 172.21.15.76:0/3299235134 learned_addr learned my addr 172.21.15.76:0/3299235134 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88a91a20 0x564d88ab6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2effd640 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88ab65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2ffff640 1 -- 172.21.15.76:0/3299235134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 msgr2=0x564d88ab65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.833+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88ab65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b2ffff640 1 -- 172.21.15.76:0/3299235134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88a91a20 msgr2=0x564d88ab6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88a91a20 0x564d88ab6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b2ffff640 1 -- 172.21.15.76:0/3299235134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88a9c560 con 0x564d88aa1150 2024-09-19T07:56:17.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 0x564d88a9b290 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0b28003c60 tx=0x7f0b2803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294ba04922e25dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:17.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b157fa640 1 -- 172.21.15.76:0/3299235134 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28004040 con 0x564d88aa1150 2024-09-19T07:56:17.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b157fa640 1 -- 172.21.15.76:0/3299235134 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b28036040 con 0x564d88aa1150 2024-09-19T07:56:17.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.834+0000 7f0b157fa640 1 -- 172.21.15.76:0/3299235134 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28030d20 con 0x564d88aa1150 2024-09-19T07:56:17.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 -- 172.21.15.76:0/3299235134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 msgr2=0x564d88a9b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 0x564d88a9b290 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0b28003c60 tx=0x7f0b2803a000 comp rx=0 tx=0).stop 2024-09-19T07:56:17.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 -- 172.21.15.76:0/3299235134 shutdown_connections 2024-09-19T07:56:17.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88aa1150 0x564d88a9b290 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a92340 0x564d88ab65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 --2- 172.21.15.76:0/3299235134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88a91a20 0x564d88ab6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 -- 172.21.15.76:0/3299235134 >> 172.21.15.76:0/3299235134 conn(0x564d88a8e0f0 msgr2=0x564d88a9cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 -- 172.21.15.76:0/3299235134 shutdown_connections 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 -- 172.21.15.76:0/3299235134 wait complete. 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 -- start start 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.835+0000 7f0b38270740 1 Processor -- start 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88ab4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88ab46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88b1a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0b301aa010 con 0x564d88a92340 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b301ab480 con 0x564d88aa1150 2024-09-19T07:56:17.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b301aa6e0 con 0x564d88a91a20 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 10 client.0 _ll_register_callbacks cb 0x7f0b200a4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88ab46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88ab46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46718/0 (socket says 172.21.15.76:46718) 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 -- 172.21.15.76:0/716311362 learned_addr learned my addr 172.21.15.76:0/716311362 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88ab4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2ffff640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88b1a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 -- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 msgr2=0x564d88ab4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88ab4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 -- 172.21.15.76:0/716311362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 msgr2=0x564d88b1a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88b1a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 -- 172.21.15.76:0/716311362 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d88ab4f90 con 0x564d88a92340 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b2effd640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88ab46b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x564d88a8f1e0 tx=0x7f0b240118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b0d82279b87859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b0effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:17.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b0effd640 1 -- 172.21.15.76:0/716311362 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24004220 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b0effd640 1 -- 172.21.15.76:0/716311362 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0b240043c0 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.836+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b28036040 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b0effd640 1 -- 172.21.15.76:0/716311362 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b2402a050 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 10 client.16587 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564d88b1bcc0 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b0effd640 1 -- 172.21.15.76:0/716311362 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b28036040 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b0effd640 1 -- 172.21.15.76:0/716311362 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0b24003c60 con 0x564d88a92340 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 10 client.16587 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 20 client.16587 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88b1c480 0x564d88b1e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 4 client.16587 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:56:17.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564d889fed00 con 0x564d88b1c480 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.837+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88b1c480 0x564d88b1e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.838+0000 7f0b0effd640 10 client.16587 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.838+0000 7f0b2f7fe640 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88b1c480 0x564d88b1e8a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a043b4a779065eda server_cookie=e277b70c3949c7e7 in_seq=0 out_seq=0 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b0effd640 1 -- 172.21.15.76:0/716311362 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564d889fed00 con 0x564d88b1c480 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b0effd640 10 client.16587 handle_command_reply: tid=0 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 client.16587 shutdown 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 msgr2=0x564d88ab46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88ab46b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x564d88a8f1e0 tx=0x7f0b240118d0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 shutdown_connections 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d88aa1150 0x564d88b1a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564d88b1c480 0x564d88b1e8a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564d88a92340 0x564d88ab46b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 --2- 172.21.15.76:0/716311362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564d88a91a20 0x564d88ab4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b0effd640 0 client.16587 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 >> 172.21.15.76:0/716311362 conn(0x564d88a8e0f0 msgr2=0x564d88a9c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 shutdown_connections 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 1 -- 172.21.15.76:0/716311362 wait complete. 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.839+0000 7f0b38270740 20 client.16587 trim_cache size 0 max 16384 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "a76c564a-d555-47e6-be68-315140fd816c", 2024-09-19T07:56:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:56:17.845 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:17.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b180a3430 msgr2=0x7f0b180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b180a3430 0x7f0b180a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009a60 tx=0x7f0b280317e0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 msgr2=0x7f0b30199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:17.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 0x7f0b30199350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b4a0 tx=0x7f0b2000b960 comp rx=0 tx=0).stop 2024-09-19T07:56:17.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 shutdown_connections 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b180a3430 0x7f0b180a58f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b30106a80 0x7f0b301a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b30101420 0x7f0b30199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 --2- 172.21.15.76:0/2195143664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b30100a80 0x7f0b30199350 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 >> 172.21.15.76:0/2195143664 conn(0x7f0b300fc7a0 msgr2=0x7f0b300fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 shutdown_connections 2024-09-19T07:56:17.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:17.840+0000 7f0b35e97640 1 -- 172.21.15.76:0/2195143664 wait complete. 2024-09-19T07:56:18.710 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:56:19.005 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:18 smithi152 ceph-mon[35117]: pgmap v157: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:56:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:18 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:56:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:18 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:18 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:56:19.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:18 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:19.126 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:18 smithi076 ceph-mon[30930]: pgmap v157: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:56:19.126 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:18 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:56:19.126 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:18 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:19.126 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:18 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:56:19.126 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:18 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:18 smithi137 ceph-mon[35309]: pgmap v157: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:56:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:18 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:56:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:18 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:18 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:56:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:18 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:19.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 -- 172.21.15.76:0/1755037902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102ef0 msgr2=0x7f3c3010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 --2- 172.21.15.76:0/1755037902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102ef0 0x7f3c3010da40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009ca0 tx=0x7f3c2802a950 comp rx=0 tx=0).stop 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 -- 172.21.15.76:0/1755037902 shutdown_connections 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 --2- 172.21.15.76:0/1755037902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102ef0 0x7f3c3010da40 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 --2- 172.21.15.76:0/1755037902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c30102570 0x7f3c301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 --2- 172.21.15.76:0/1755037902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c30100e20 0x7f3c30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 -- 172.21.15.76:0/1755037902 >> 172.21.15.76:0/1755037902 conn(0x7f3c300fc7d0 msgr2=0x7f3c300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 -- 172.21.15.76:0/1755037902 shutdown_connections 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 -- 172.21.15.76:0/1755037902 wait complete. 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 Processor -- start 2024-09-19T07:56:19.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.437+0000 7f3c37a25640 1 -- start start 2024-09-19T07:56:19.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c37a25640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c30100e20 0x7f3c301993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c37a25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 0x7f3c301998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c37a25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c30102ef0 0x7f3c301a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c37a25640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301110a0 con 0x7f3c30102570 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c37a25640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30110f20 con 0x7f3c30102ef0 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c37a25640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30111220 con 0x7f3c30100e20 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 0x7f3c301998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 0x7f3c301998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46742/0 (socket says 172.21.15.76:46742) 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 -- 172.21.15.76:0/2444672170 learned_addr learned my addr 172.21.15.76:0/2444672170 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c357c1640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c30100e20 0x7f3c301993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c30102ef0 0x7f3c301a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 -- 172.21.15.76:0/2444672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c30100e20 msgr2=0x7f3c301993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c30100e20 0x7f3c301993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 -- 172.21.15.76:0/2444672170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c30102ef0 msgr2=0x7f3c301a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c30102ef0 0x7f3c301a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 -- 172.21.15.76:0/2444672170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c301a4970 con 0x7f3c30102570 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 0x7f3c301998f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000d770 tx=0x7f3c2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.438+0000 7f3c267fc640 1 -- 172.21.15.76:0/2444672170 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20017070 con 0x7f3c30102570 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.439+0000 7f3c267fc640 1 -- 172.21.15.76:0/2444672170 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c20005520 con 0x7f3c30102570 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.439+0000 7f3c267fc640 1 -- 172.21.15.76:0/2444672170 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20010460 con 0x7f3c30102570 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.439+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c301a4b40 con 0x7f3c30102570 2024-09-19T07:56:19.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.439+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c301a5030 con 0x7f3c30102570 2024-09-19T07:56:19.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 Processor -- start 2024-09-19T07:56:19.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c267fc640 1 -- 172.21.15.76:0/2444672170 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3c20004ea0 con 0x7f3c30102570 2024-09-19T07:56:19.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 -- start start 2024-09-19T07:56:19.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 0x55ea71b68880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b68dc0 0x55ea71b73140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b75a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55ea71ace2e0 con 0x55ea71b684a0 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ea71a75ce0 con 0x55ea71b68dc0 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea71aca2a0 con 0x55ea71b73680 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c35fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 0x55ea71b68880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c35fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 0x55ea71b68880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46750/0 (socket says 172.21.15.76:46750) 2024-09-19T07:56:19.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c35fc2640 1 -- 172.21.15.76:0/3161071626 learned_addr learned my addr 172.21.15.76:0/3161071626 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:19.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c357c1640 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b68dc0 0x55ea71b73140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.442+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b75a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c35fc2640 1 -- 172.21.15.76:0/3161071626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 msgr2=0x55ea71b75a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b75a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c35fc2640 1 -- 172.21.15.76:0/3161071626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b68dc0 msgr2=0x55ea71b73140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b68dc0 0x55ea71b73140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c35fc2640 1 -- 172.21.15.76:0/3161071626 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71a5a440 con 0x55ea71b684a0 2024-09-19T07:56:19.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c267fc640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3c1c0a33b0 0x7f3c1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c357c1640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3c1c0a33b0 0x7f3c1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c267fc640 1 -- 172.21.15.76:0/2444672170 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f3c200cf7d0 con 0x7f3c30102570 2024-09-19T07:56:19.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 0x55ea71b68880 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009880 tx=0x7f3c280098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6925e9d84ba0d489 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c1b7fe640 1 -- 172.21.15.76:0/3161071626 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28034050 con 0x55ea71b684a0 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c1b7fe640 1 -- 172.21.15.76:0/3161071626 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c2802fc70 con 0x55ea71b684a0 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.443+0000 7f3c1b7fe640 1 -- 172.21.15.76:0/3161071626 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28004460 con 0x55ea71b684a0 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 -- 172.21.15.76:0/3161071626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 msgr2=0x55ea71b68880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c357c1640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3c1c0a33b0 0x7f3c1c0a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55ea71b65890 tx=0x7f3c2c00b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 0x55ea71b68880 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009880 tx=0x7f3c280098b0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 -- 172.21.15.76:0/3161071626 shutdown_connections 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b75a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b68dc0 0x55ea71b73140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/3161071626 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b684a0 0x55ea71b68880 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 -- 172.21.15.76:0/3161071626 >> 172.21.15.76:0/3161071626 conn(0x55ea71b64a30 msgr2=0x55ea71b64e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 -- 172.21.15.76:0/3161071626 shutdown_connections 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 -- 172.21.15.76:0/3161071626 wait complete. 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 -- start start 2024-09-19T07:56:19.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.444+0000 7f3c39dfe740 1 Processor -- start 2024-09-19T07:56:19.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b72f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 0x55ea71b701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55ea71b76250 con 0x55ea71b68dc0 2024-09-19T07:56:19.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ea71a89050 con 0x55ea71b684a0 2024-09-19T07:56:19.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea71b763d0 con 0x55ea71b73680 2024-09-19T07:56:19.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c39dfe740 10 client.0 _ll_register_callbacks cb 0x55ea71ac9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:19.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 0x55ea71b701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 0x55ea71b701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46762/0 (socket says 172.21.15.76:46762) 2024-09-19T07:56:19.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 -- 172.21.15.76:0/1909659191 learned_addr learned my addr 172.21.15.76:0/1909659191 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:19.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c357c1640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b72f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 -- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 msgr2=0x55ea71b70710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b70710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 -- 172.21.15.76:0/1909659191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 msgr2=0x55ea71b72f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b72f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 -- 172.21.15.76:0/1909659191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7183f3c0 con 0x55ea71b68dc0 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c357c1640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b72f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:56:19.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 0x55ea71b701d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009610 tx=0x7f3c2009b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713cfcf4f1143a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.445+0000 7f3c18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c18ff9640 1 -- 172.21.15.76:0/1909659191 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20020070 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c18ff9640 1 -- 172.21.15.76:0/1909659191 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f3c200cd140 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c2802fc70 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c18ff9640 1 -- 172.21.15.76:0/1909659191 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3c2009c150 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 10 client.16599 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ea71b81bc0 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c18ff9640 1 -- 172.21.15.76:0/1909659191 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c2802fc70 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c18ff9640 1 -- 172.21.15.76:0/1909659191 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f3c200980c0 con 0x55ea71b68dc0 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 10 client.16599 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:19.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 20 client.16599 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71b82fd0 0x55ea71b85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 4 client.16599 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea71adb850 con 0x55ea71b82fd0 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.446+0000 7f3c357c1640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71b82fd0 0x55ea71b85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.447+0000 7f3c357c1640 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71b82fd0 0x55ea71b85470 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2a0dcb07371e788 server_cookie=7f1b3218a88110da in_seq=0 out_seq=0 2024-09-19T07:56:19.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.447+0000 7f3c18ff9640 10 client.16599 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:19.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.447+0000 7f3c18ff9640 1 -- 172.21.15.76:0/1909659191 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea71adb850 con 0x55ea71b82fd0 2024-09-19T07:56:19.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.447+0000 7f3c18ff9640 10 client.16599 handle_command_reply: tid=0 2024-09-19T07:56:19.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 client.16599 shutdown 2024-09-19T07:56:19.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 msgr2=0x55ea71b701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 0x55ea71b701d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009610 tx=0x7f3c2009b590 comp rx=0 tx=0).stop 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 shutdown_connections 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b73680 0x55ea71b70710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71b82fd0 0x55ea71b85470 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b68dc0 0x55ea71b701d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/1909659191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b72f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c18ff9640 0 client.16599 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 >> 172.21.15.76:0/1909659191 conn(0x55ea71b64a30 msgr2=0x55ea71b63b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 shutdown_connections 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 1 -- 172.21.15.76:0/1909659191 wait complete. 2024-09-19T07:56:19.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.448+0000 7f3c39dfe740 20 client.16599 trim_cache size 0 max 16384 2024-09-19T07:56:19.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.464+0000 7f3c39dfe740 1 Processor -- start 2024-09-19T07:56:19.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.464+0000 7f3c39dfe740 1 -- start start 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b7f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b8acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71b8b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301b03b0 con 0x55ea71b73680 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301adbc0 con 0x55ea71b684a0 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301aba10 con 0x55ea71b68dc0 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71b8b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71b8b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46774/0 (socket says 172.21.15.76:46774) 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 -- 172.21.15.76:0/4218048015 learned_addr learned my addr 172.21.15.76:0/4218048015 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b8acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c357c1640 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b7f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 -- 172.21.15.76:0/4218048015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 msgr2=0x55ea71b8acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b8acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 -- 172.21.15.76:0/4218048015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 msgr2=0x55ea71b7f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b7f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 -- 172.21.15.76:0/4218048015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea71b65ae0 con 0x55ea71b73680 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71b8b230 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3c2802fe40 tx=0x7f3c28005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b00f9ae8e13a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.465+0000 7f3c1affd640 1 -- 172.21.15.76:0/4218048015 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28050070 con 0x55ea71b73680 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c1affd640 1 -- 172.21.15.76:0/4218048015 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c2802fec0 con 0x55ea71b73680 2024-09-19T07:56:19.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c1affd640 1 -- 172.21.15.76:0/4218048015 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c280042d0 con 0x55ea71b73680 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 -- 172.21.15.76:0/4218048015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 msgr2=0x55ea71b8b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71b8b230 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3c2802fe40 tx=0x7f3c28005df0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 -- 172.21.15.76:0/4218048015 shutdown_connections 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71b8b230 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b8acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/4218048015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b7f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 -- 172.21.15.76:0/4218048015 >> 172.21.15.76:0/4218048015 conn(0x55ea71b64a30 msgr2=0x55ea71b6b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 -- 172.21.15.76:0/4218048015 shutdown_connections 2024-09-19T07:56:19.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 -- 172.21.15.76:0/4218048015 wait complete. 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 -- start start 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.466+0000 7f3c39dfe740 1 Processor -- start 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b76d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71be5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301ac080 con 0x55ea71b73680 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301ad4f0 con 0x55ea71b684a0 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301ac750 con 0x55ea71b68dc0 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c39dfe740 10 client.0 _ll_register_callbacks cb 0x7f3c2000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71be5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71be5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46784/0 (socket says 172.21.15.76:46784) 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 -- 172.21.15.76:0/2879628442 learned_addr learned my addr 172.21.15.76:0/2879628442 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:19.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c34fc0640 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 -- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 msgr2=0x55ea71b772c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b772c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 -- 172.21.15.76:0/2879628442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 msgr2=0x55ea71b76d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b76d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.467+0000 7f3c35fc2640 1 -- 172.21.15.76:0/2879628442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea71b656c0 con 0x55ea71b73680 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c35fc2640 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71be5c80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009ca0 tx=0x7f3c2802fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764c09231aa94eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c18ff9640 1 -- 172.21.15.76:0/2879628442 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28034070 con 0x55ea71b73680 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c18ff9640 1 -- 172.21.15.76:0/2879628442 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f3c28004070 con 0x55ea71b73680 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c2802fec0 con 0x55ea71b73680 2024-09-19T07:56:19.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c18ff9640 1 -- 172.21.15.76:0/2879628442 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3c28050040 con 0x55ea71b73680 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 10 client.16605 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ea71bed520 con 0x55ea71b73680 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c18ff9640 1 -- 172.21.15.76:0/2879628442 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c2802fec0 con 0x55ea71b73680 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c18ff9640 1 -- 172.21.15.76:0/2879628442 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f3c28041070 con 0x55ea71b73680 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 10 client.16605 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 20 client.16605 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71bed7c0 0x55ea71befbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 4 client.16605 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ea71ad5d60 con 0x55ea71bed7c0 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.468+0000 7f3c357c1640 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71bed7c0 0x55ea71befbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c357c1640 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71bed7c0 0x55ea71befbb0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc142d693114eb1c server_cookie=259c6bb7ea56f511 in_seq=0 out_seq=0 2024-09-19T07:56:19.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c18ff9640 10 client.16605 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c18ff9640 1 -- 172.21.15.76:0/2879628442 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ea71ad5d60 con 0x55ea71bed7c0 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c18ff9640 10 client.16605 handle_command_reply: tid=0 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 client.16605 shutdown 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 msgr2=0x55ea71be5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71be5c80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009ca0 tx=0x7f3c2802fca0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 shutdown_connections 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ea71bed7c0 0x55ea71befbb0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c18ff9640 0 client.16605 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ea71b73680 0x55ea71be5c80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea71b68dc0 0x55ea71b772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 --2- 172.21.15.76:0/2879628442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ea71b684a0 0x55ea71b76d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 >> 172.21.15.76:0/2879628442 conn(0x55ea71b64a30 msgr2=0x55ea71b71a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 shutdown_connections 2024-09-19T07:56:19.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 1 -- 172.21.15.76:0/2879628442 wait complete. 2024-09-19T07:56:19.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.469+0000 7f3c39dfe740 20 client.16605 trim_cache size 0 max 16384 2024-09-19T07:56:19.476 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:19.476 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:56:19.476 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:56:19.476 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3c1c0a33b0 msgr2=0x7f3c1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3c1c0a33b0 0x7f3c1c0a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55ea71b65890 tx=0x7f3c2c00b410 comp rx=0 tx=0).stop 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 msgr2=0x7f3c301998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 0x7f3c301998f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000d770 tx=0x7f3c2000dc30 comp rx=0 tx=0).stop 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 shutdown_connections 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3c1c0a33b0 0x7f3c1c0a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3c30102ef0 0x7f3c301a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c30102570 0x7f3c301998f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 --2- 172.21.15.76:0/2444672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c30100e20 0x7f3c301993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:19.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 >> 172.21.15.76:0/2444672170 conn(0x7f3c300fc7d0 msgr2=0x7f3c30106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:19.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 shutdown_connections 2024-09-19T07:56:19.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:19.470+0000 7f3c37a25640 1 -- 172.21.15.76:0/2444672170 wait complete. 2024-09-19T07:56:20.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:19 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:56:20.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:19 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:56:20.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:19 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:56:20.272 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:56:20.272 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:56:20.518 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:20.889 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:20 smithi076 ceph-mon[30930]: pgmap v158: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:56:20.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 -- 172.21.15.76:0/235976940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68100a80 msgr2=0x7fbd68100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:20.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 --2- 172.21.15.76:0/235976940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68100a80 0x7fbd68100ee0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009930 tx=0x7fbd5802a420 comp rx=0 tx=0).stop 2024-09-19T07:56:20.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 -- 172.21.15.76:0/235976940 shutdown_connections 2024-09-19T07:56:20.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 --2- 172.21.15.76:0/235976940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68101420 0x7fbd6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:20.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 --2- 172.21.15.76:0/235976940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68100a80 0x7fbd68100ee0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:20.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 --2- 172.21.15.76:0/235976940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68106a80 0x7fbd68106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 -- 172.21.15.76:0/235976940 >> 172.21.15.76:0/235976940 conn(0x7fbd680fc7a0 msgr2=0x7fbd680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 -- 172.21.15.76:0/235976940 shutdown_connections 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.968+0000 7fbd702d9640 1 -- 172.21.15.76:0/235976940 wait complete. 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 Processor -- start 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 -- start start 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68100a80 0x7fbd68198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 0x7fbd68198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68106a80 0x7fbd6819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:20.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68110fa0 con 0x7fbd68101420 2024-09-19T07:56:20.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68110e20 con 0x7fbd68106a80 2024-09-19T07:56:20.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd702d9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68111120 con 0x7fbd68100a80 2024-09-19T07:56:20.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 0x7fbd68198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:20.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 0x7fbd68198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46802/0 (socket says 172.21.15.76:46802) 2024-09-19T07:56:20.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 -- 172.21.15.76:0/2150213997 learned_addr learned my addr 172.21.15.76:0/2150213997 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:20.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6e075640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68100a80 0x7fbd68198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 -- 172.21.15.76:0/2150213997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68100a80 msgr2=0x7fbd68198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6e876640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68106a80 0x7fbd6819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68100a80 0x7fbd68198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 -- 172.21.15.76:0/2150213997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68106a80 msgr2=0x7fbd6819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68106a80 0x7fbd6819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6d874640 1 -- 172.21.15.76:0/2150213997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6819d4c0 con 0x7fbd68101420 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6e075640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68100a80 0x7fbd68198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:20.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.969+0000 7fbd6e876640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68106a80 0x7fbd6819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.970+0000 7fbd6d874640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 0x7fbd68198a50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009230 tx=0x7fbd58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.970+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5803f030 con 0x7fbd68101420 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.970+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbd58003af0 con 0x7fbd68101420 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.970+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6819d750 con 0x7fbd68101420 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.970+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58035070 con 0x7fbd68101420 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.970+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a5090 con 0x7fbd68101420 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.971+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd681021c0 con 0x7fbd68101420 2024-09-19T07:56:20.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.973+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbd58042030 con 0x7fbd68101420 2024-09-19T07:56:20.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.973+0000 7fbd5f7fe640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbd540a33b0 0x7fbd540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:20.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.973+0000 7fbd6e075640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbd540a33b0 0x7fbd540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:20.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.973+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fbd580f0a10 con 0x7fbd68101420 2024-09-19T07:56:20.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.974+0000 7fbd6e075640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbd540a33b0 0x7fbd540a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd64005fd0 tx=0x7fbd6400b5d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:20.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:20.977+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd580bd450 con 0x7fbd68101420 2024-09-19T07:56:21.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:20 smithi152 ceph-mon[35117]: pgmap v158: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:56:21.157 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:20 smithi137 ceph-mon[35309]: pgmap v158: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:56:21.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.181+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd6810a000 con 0x7fbd68101420 2024-09-19T07:56:21.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.181+0000 7fbd5f7fe640 1 -- 172.21.15.76:0/2150213997 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7fbd580bcd50 con 0x7fbd68101420 2024-09-19T07:56:21.182 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:56:21.182 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:56:21.182 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:56:21.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbd540a33b0 msgr2=0x7fbd540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:21.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbd540a33b0 0x7fbd540a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd64005fd0 tx=0x7fbd6400b5d0 comp rx=0 tx=0).stop 2024-09-19T07:56:21.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 msgr2=0x7fbd68198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:21.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 0x7fbd68198a50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009230 tx=0x7fbd58004270 comp rx=0 tx=0).stop 2024-09-19T07:56:21.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 shutdown_connections 2024-09-19T07:56:21.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbd540a33b0 0x7fbd540a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd68106a80 0x7fbd6819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbd68101420 0x7fbd68198a50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 --2- 172.21.15.76:0/2150213997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd68100a80 0x7fbd68198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 >> 172.21.15.76:0/2150213997 conn(0x7fbd680fc7a0 msgr2=0x7fbd6806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 shutdown_connections 2024-09-19T07:56:21.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:21.184+0000 7fbd702d9640 1 -- 172.21.15.76:0/2150213997 wait complete. 2024-09-19T07:56:21.977 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:56:22.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:21 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2150213997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:22.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:21 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2150213997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:22.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:21 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2150213997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:22.223 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:22.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.686+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2474824910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100d00 msgr2=0x7f2a88106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2474824910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100d00 0x7f2a88106840 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009930 tx=0x7f2a7c02a420 comp rx=0 tx=0).stop 2024-09-19T07:56:22.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2474824910 shutdown_connections 2024-09-19T07:56:22.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2474824910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88106f50 0x7f2a8810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2474824910 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100d00 0x7f2a88106840 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2474824910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88100350 0x7f2a88100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2474824910 >> 172.21.15.76:0/2474824910 conn(0x7f2a88077210 msgr2=0x7f2a880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:22.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2474824910 shutdown_connections 2024-09-19T07:56:22.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2474824910 wait complete. 2024-09-19T07:56:22.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 Processor -- start 2024-09-19T07:56:22.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.687+0000 7f2a8e22b640 1 -- start start 2024-09-19T07:56:22.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 0x7f2a881985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88100d00 0x7f2a88198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88106f50 0x7f2a8819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881120c0 con 0x7f2a88100350 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111f40 con 0x7f2a88100d00 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88112240 con 0x7f2a88106f50 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 0x7f2a881985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 0x7f2a881985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46814/0 (socket says 172.21.15.76:46814) 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 -- 172.21.15.76:0/2497017271 learned_addr learned my addr 172.21.15.76:0/2497017271 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88100d00 0x7f2a88198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 -- 172.21.15.76:0/2497017271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88106f50 msgr2=0x7f2a8819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88106f50 0x7f2a8819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 -- 172.21.15.76:0/2497017271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88100d00 msgr2=0x7f2a88198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88100d00 0x7f2a88198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 -- 172.21.15.76:0/2497017271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8819d560 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88100d00 0x7f2a88198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a877fe640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 0x7f2a881985b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800cce0 tx=0x7f2a7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a84ff9640 1 -- 172.21.15.76:0/2497017271 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78004b20 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a84ff9640 1 -- 172.21.15.76:0/2497017271 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a78004cc0 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a84ff9640 1 -- 172.21.15.76:0/2497017271 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800f870 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8819d850 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.688+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a881a5130 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.691+0000 7f2a84ff9640 1 -- 172.21.15.76:0/2497017271 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2a7800fa10 con 0x7f2a88100350 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 Processor -- start 2024-09-19T07:56:22.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 -- start start 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222698c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x56222698ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5622268f22f0 con 0x56222698c5d0 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562226899cf0 con 0x56222699b780 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a90604740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5622268ee2b0 con 0x56222698db40 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a84ff9640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a700a3430 0x7f2a700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x56222698ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x56222698ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46824/0 (socket says 172.21.15.76:46824) 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 -- 172.21.15.76:0/4036570165 learned_addr learned my addr 172.21.15.76:0/4036570165 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:22.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a87fff640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a700a3430 0x7f2a700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a87fff640 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222698c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a84ff9640 1 -- 172.21.15.76:0/2497017271 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2a780cfe30 con 0x7f2a88100350 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 -- 172.21.15.76:0/4036570165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 msgr2=0x56222698c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222698c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 -- 172.21.15.76:0/4036570165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 msgr2=0x56222699db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.692+0000 7f2a877fe640 1 -- 172.21.15.76:0/4036570165 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222687e3a0 con 0x56222698c5d0 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a877fe640 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x56222698ca10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2a7809bdb0 tx=0x7f2a7809bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a343e1d4f16300 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a87fff640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a700a3430 0x7f2a700a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000ee20 tx=0x7f2a80005ca0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a6dffb640 1 -- 172.21.15.76:0/4036570165 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7801d070 con 0x56222698c5d0 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a6dffb640 1 -- 172.21.15.76:0/4036570165 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a7809c7b0 con 0x56222698c5d0 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a6dffb640 1 -- 172.21.15.76:0/4036570165 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a780cd7a0 con 0x56222698c5d0 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 -- 172.21.15.76:0/4036570165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 msgr2=0x56222698ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x56222698ca10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2a7809bdb0 tx=0x7f2a7809bfb0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 -- 172.21.15.76:0/4036570165 shutdown_connections 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x56222698ca10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 --2- 172.21.15.76:0/4036570165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222698c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 -- 172.21.15.76:0/4036570165 >> 172.21.15.76:0/4036570165 conn(0x562226955310 msgr2=0x562226988c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.693+0000 7f2a90604740 1 -- 172.21.15.76:0/4036570165 shutdown_connections 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 -- 172.21.15.76:0/4036570165 wait complete. 2024-09-19T07:56:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 -- start start 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 Processor -- start 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x56222699b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222698db40 0x5622269984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 0x562226998c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56222699e420 con 0x56222699b780 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622268ad060 con 0x56222698db40 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56222699e5a0 con 0x56222698c5d0 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a90604740 10 client.0 _ll_register_callbacks cb 0x5622266008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:22.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 0x562226998c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 0x562226998c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46838/0 (socket says 172.21.15.76:46838) 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.694+0000 7f2a87fff640 1 -- 172.21.15.76:0/3813984427 learned_addr learned my addr 172.21.15.76:0/3813984427 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a877fe640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x56222699b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222698db40 0x5622269984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a87fff640 1 -- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 msgr2=0x56222699b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a87fff640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x56222699b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a87fff640 1 -- 172.21.15.76:0/3813984427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222698db40 msgr2=0x5622269984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a87fff640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222698db40 0x5622269984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a87fff640 1 -- 172.21.15.76:0/3813984427 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622266633c0 con 0x56222699b780 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222698db40 0x5622269984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a87fff640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 0x562226998c60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2a80012570 tx=0x7f2a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb956d0c302dd44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:22.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a66ffd640 1 -- 172.21.15.76:0/3813984427 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80023070 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a7809c7b0 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a66ffd640 1 -- 172.21.15.76:0/3813984427 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2a80004020 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a66ffd640 1 -- 172.21.15.76:0/3813984427 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2a8002e050 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a90604740 10 client.16623 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5622269a9fd0 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.695+0000 7f2a66ffd640 1 -- 172.21.15.76:0/3813984427 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a7809c7b0 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a66ffd640 1 -- 172.21.15.76:0/3813984427 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2a8000f040 con 0x56222699b780 2024-09-19T07:56:22.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a90604740 10 client.16623 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a90604740 10 client.16623 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a90604740 20 client.16623 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a90604740 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5622269ab430 0x5622269ad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a90604740 4 client.16623 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622268ff860 con 0x5622269ab430 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a877fe640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5622269ab430 0x5622269ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a877fe640 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5622269ab430 0x5622269ad890 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4cd2f650293ccf7 server_cookie=c8ce73b3b0e5aada in_seq=0 out_seq=0 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.696+0000 7f2a66ffd640 10 client.16623 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a66ffd640 1 -- 172.21.15.76:0/3813984427 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622268ff860 con 0x5622269ab430 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a66ffd640 10 client.16623 handle_command_reply: tid=0 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 client.16623 shutdown 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 msgr2=0x562226998c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 0x562226998c60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2a80012570 tx=0x7f2a800046c0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 shutdown_connections 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5622269ab430 0x5622269ad890 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222699b780 0x562226998c60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222698db40 0x5622269984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 --2- 172.21.15.76:0/3813984427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x56222699b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a66ffd640 0 client.16623 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 >> 172.21.15.76:0/3813984427 conn(0x562226955310 msgr2=0x56222698e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.697+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 shutdown_connections 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.698+0000 7f2a90604740 1 -- 172.21.15.76:0/3813984427 wait complete. 2024-09-19T07:56:22.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.698+0000 7f2a90604740 20 client.16623 trim_cache size 0 max 16384 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 Processor -- start 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 -- start start 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x5622269974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 0x5622269b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x5622269b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881ae470 con 0x56222698db40 2024-09-19T07:56:22.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881abc80 con 0x56222699b780 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a90604740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881a9ad0 con 0x56222698c5d0 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 0x5622269b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 0x5622269b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46844/0 (socket says 172.21.15.76:46844) 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 -- 172.21.15.76:0/4102923287 learned_addr learned my addr 172.21.15.76:0/4102923287 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a87fff640 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x5622269b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a877fe640 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x5622269974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 -- 172.21.15.76:0/4102923287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 msgr2=0x5622269974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x5622269974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 -- 172.21.15.76:0/4102923287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 msgr2=0x5622269b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x5622269b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 -- 172.21.15.76:0/4102923287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622269884f0 con 0x56222698db40 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.711+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 0x5622269b3160 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30395d43cb4f766c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a6d7fa640 1 -- 172.21.15.76:0/4102923287 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c035070 con 0x56222698db40 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a6d7fa640 1 -- 172.21.15.76:0/4102923287 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a7c0318c0 con 0x56222698db40 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a6d7fa640 1 -- 172.21.15.76:0/4102923287 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c004920 con 0x56222698db40 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 -- 172.21.15.76:0/4102923287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 msgr2=0x5622269b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 0x5622269b3160 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c032e50 comp rx=0 tx=0).stop 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 -- 172.21.15.76:0/4102923287 shutdown_connections 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x5622269b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698db40 0x5622269b3160 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 --2- 172.21.15.76:0/4102923287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698c5d0 0x5622269974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 -- 172.21.15.76:0/4102923287 >> 172.21.15.76:0/4102923287 conn(0x562226955310 msgr2=0x562226996da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:22.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.712+0000 7f2a90604740 1 -- 172.21.15.76:0/4102923287 shutdown_connections 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 -- 172.21.15.76:0/4102923287 wait complete. 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 -- start start 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 Processor -- start 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x5622269a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222699f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881aa140 con 0x56222698c5d0 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881ab5b0 con 0x56222699b780 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881aa810 con 0x56222698db40 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a90604740 10 client.0 _ll_register_callbacks cb 0x7f2a80005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:22.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x5622269a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x5622269a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46852/0 (socket says 172.21.15.76:46852) 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.713+0000 7f2a877fe640 1 -- 172.21.15.76:0/2416895421 learned_addr learned my addr 172.21.15.76:0/2416895421 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a87fff640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222699f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a877fe640 1 -- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 msgr2=0x56222699f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a877fe640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222699f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a877fe640 1 -- 172.21.15.76:0/2416895421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 msgr2=0x56222699fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a877fe640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a877fe640 1 -- 172.21.15.76:0/2416895421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562226a15130 con 0x56222698c5d0 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a87fff640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:22.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a877fe640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x5622269a4110 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800ab20 tx=0x7f2a780078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc19680a9fcf83f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a66ffd640 1 -- 172.21.15.76:0/2416895421 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7801d040 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a66ffd640 1 -- 172.21.15.76:0/2416895421 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2a7809a3b0 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a7c0318c0 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a66ffd640 1 -- 172.21.15.76:0/2416895421 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2a780a4d20 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a90604740 10 client.16629 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562226a162d0 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a66ffd640 1 -- 172.21.15.76:0/2416895421 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a7c0318c0 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.714+0000 7f2a66ffd640 1 -- 172.21.15.76:0/2416895421 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f2a80010d20 con 0x56222698c5d0 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 10 client.16629 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 10 client.16629 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 20 client.16629 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:22.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x562226a165b0 0x562226a189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 4 client.16629 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622268f9d70 con 0x562226a165b0 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x562226a165b0 0x562226a189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a66ffd640 10 client.16629 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a86ffd640 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x562226a165b0 0x562226a189a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc0da48c1728e853 server_cookie=ed5e8a7bfe354176 in_seq=0 out_seq=0 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a66ffd640 1 -- 172.21.15.76:0/2416895421 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622268f9d70 con 0x562226a165b0 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a66ffd640 10 client.16629 handle_command_reply: tid=0 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.715+0000 7f2a90604740 1 client.16629 shutdown 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 msgr2=0x5622269a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x5622269a4110 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800ab20 tx=0x7f2a780078d0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 shutdown_connections 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x562226a165b0 0x562226a189a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56222699b780 0x56222699fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.722 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a66ffd640 0 client.16629 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56222698db40 0x56222699f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 --2- 172.21.15.76:0/2416895421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56222698c5d0 0x5622269a4110 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 >> 172.21.15.76:0/2416895421 conn(0x562226955310 msgr2=0x5622269975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 shutdown_connections 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 1 -- 172.21.15.76:0/2416895421 wait complete. 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a90604740 20 client.16629 trim_cache size 0 max 16384 2024-09-19T07:56:22.723 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:22.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a700a3430 msgr2=0x7f2a700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a700a3430 0x7f2a700a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000ee20 tx=0x7f2a80005ca0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 msgr2=0x7f2a881985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 0x7f2a881985b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800cce0 tx=0x7f2a7800a620 comp rx=0 tx=0).stop 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 shutdown_connections 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a700a3430 0x7f2a700a58f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88106f50 0x7f2a8819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a88100d00 0x7f2a88198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 --2- 172.21.15.76:0/2497017271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a88100350 0x7f2a881985b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 >> 172.21.15.76:0/2497017271 conn(0x7f2a88077210 msgr2=0x7f2a881052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.716+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 shutdown_connections 2024-09-19T07:56:22.725 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:22.717+0000 7f2a8e22b640 1 -- 172.21.15.76:0/2497017271 wait complete. 2024-09-19T07:56:22.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:22 smithi076 ceph-mon[30930]: pgmap v159: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:56:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:22 smithi152 ceph-mon[35117]: pgmap v159: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:56:23.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:22 smithi137 ceph-mon[35309]: pgmap v159: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:56:23.551 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:56:23.800 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:24.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:23 smithi152 ceph-mon[35117]: pgmap v160: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:56:24.069 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:23 smithi076 ceph-mon[30930]: pgmap v160: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:56:24.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:23 smithi137 ceph-mon[35309]: pgmap v160: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 -- 172.21.15.76:0/3338602793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 msgr2=0x7fb2e41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 --2- 172.21.15.76:0/3338602793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e41067e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009900 tx=0x7fb2d802a410 comp rx=0 tx=0).stop 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 -- 172.21.15.76:0/3338602793 shutdown_connections 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 --2- 172.21.15.76:0/3338602793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4106f10 0x7fb2e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 --2- 172.21.15.76:0/3338602793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e41067e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 --2- 172.21.15.76:0/3338602793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e4101de0 0x7fb2e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 -- 172.21.15.76:0/3338602793 >> 172.21.15.76:0/3338602793 conn(0x7fb2e40fd8c0 msgr2=0x7fb2e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:24.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 -- 172.21.15.76:0/3338602793 shutdown_connections 2024-09-19T07:56:24.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.290+0000 7fb2e8952640 1 -- 172.21.15.76:0/3338602793 wait complete. 2024-09-19T07:56:24.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.291+0000 7fb2e8952640 1 Processor -- start 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.291+0000 7fb2e8952640 1 -- start start 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e8952640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4101de0 0x7fb2e41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e8952640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e8952640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e4106f10 0x7fb2e419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e8952640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41120e0 con 0x7fb2e4102790 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e8952640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e4111f60 con 0x7fb2e4101de0 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e8952640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e4112260 con 0x7fb2e4106f10 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e4198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37652/0 (socket says 172.21.15.76:37652) 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2284023955 learned_addr learned my addr 172.21.15.76:0/2284023955 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:24.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e259c640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4101de0 0x7fb2e41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e4106f10 0x7fb2e419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2284023955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e4106f10 msgr2=0x7fb2e419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e4106f10 0x7fb2e419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2284023955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4101de0 msgr2=0x7fb2e41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4101de0 0x7fb2e41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2284023955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e419d490 con 0x7fb2e4102790 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e259c640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4101de0 0x7fb2e41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.292+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e4198a20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8004770 tx=0x7fb2d8032970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.293+0000 7fb2d37fe640 1 -- 172.21.15.76:0/2284023955 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d803f030 con 0x7fb2e4102790 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.293+0000 7fb2d37fe640 1 -- 172.21.15.76:0/2284023955 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2d8032d70 con 0x7fb2e4102790 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.293+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e419d720 con 0x7fb2e4102790 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.293+0000 7fb2d37fe640 1 -- 172.21.15.76:0/2284023955 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8035070 con 0x7fb2e4102790 2024-09-19T07:56:24.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.293+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e41a5060 con 0x7fb2e4102790 2024-09-19T07:56:24.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.295+0000 7fb2ead2b740 1 Processor -- start 2024-09-19T07:56:24.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.295+0000 7fb2d37fe640 1 -- 172.21.15.76:0/2284023955 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb2d8042030 con 0x7fb2e4102790 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.295+0000 7fb2ead2b740 1 -- start start 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f9ea2062f0 con 0x55f9ea2a1b40 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f9ea1adcf0 con 0x55f9ea2ab370 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9ea2022b0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37664/0 (socket says 172.21.15.76:37664) 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/4118545857 learned_addr learned my addr 172.21.15.76:0/4118545857 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e259c640 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/4118545857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 msgr2=0x55f9ea2a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2d37fe640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb2cc0a33b0 0x7fb2cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/4118545857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 msgr2=0x55f9ea2ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/4118545857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ea1923a0 con 0x55f9ea2a1b40 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e259c640 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2d37fe640 1 -- 172.21.15.76:0/2284023955 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb2d80f0140 con 0x7fb2e4102790 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb2cc0a33b0 0x7fb2cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a0090 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009f40 tx=0x7fb2dc010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33294371e7718cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.296+0000 7fb2d0ff9640 1 -- 172.21.15.76:0/4118545857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc003d30 con 0x55f9ea2a1b40 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2d0ff9640 1 -- 172.21.15.76:0/4118545857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2dc004660 con 0x55f9ea2a1b40 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2d0ff9640 1 -- 172.21.15.76:0/4118545857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc01c5f0 con 0x55f9ea2a1b40 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 -- 172.21.15.76:0/4118545857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 msgr2=0x55f9ea2a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb2cc0a33b0 0x7fb2cc0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc01c000 tx=0x7fb2dc01ceb0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a0090 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009f40 tx=0x7fb2dc010860 comp rx=0 tx=0).stop 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 -- 172.21.15.76:0/4118545857 shutdown_connections 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/4118545857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a0090 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 -- 172.21.15.76:0/4118545857 >> 172.21.15.76:0/4118545857 conn(0x55f9ea269310 msgr2=0x55f9ea29cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 -- 172.21.15.76:0/4118545857 shutdown_connections 2024-09-19T07:56:24.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.297+0000 7fb2ead2b740 1 -- 172.21.15.76:0/4118545857 wait complete. 2024-09-19T07:56:24.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 -- start start 2024-09-19T07:56:24.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 Processor -- start 2024-09-19T07:56:24.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55f9ea2ae070 con 0x55f9ea2ab370 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f9ea1c1060 con 0x55f9ea2a1b40 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f9ea2ae1f0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2ead2b740 10 client.0 _ll_register_callbacks cb 0x55f9e9f148c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2e2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2e2d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37678/0 (socket says 172.21.15.76:37678) 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/2070747595 learned_addr learned my addr 172.21.15.76:0/2070747595 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.298+0000 7fb2e259c640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/2070747595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 msgr2=0x55f9ea2aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2a1b40 msgr2=0x55f9ea2a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e2d9d640 1 -- 172.21.15.76:0/2070747595 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e9f773c0 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a8530 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc01dff0 tx=0x7fb2dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9263f9e97a25e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/2070747595 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc036060 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/2070747595 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb2dc011500 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2dc004660 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/2070747595 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb2dc02d040 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2ead2b740 10 client.16641 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.299+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f9ea2b9a10 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/2070747595 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2dc004660 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/2070747595 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb2dc004ca0 con 0x55f9ea2ab370 2024-09-19T07:56:24.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2ead2b740 10 client.16641 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2ead2b740 10 client.16641 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2ead2b740 20 client.16641 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea2bae20 0x55f9ea2bd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2ead2b740 4 client.16641 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9ea213860 con 0x55f9ea2bae20 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2e259c640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea2bae20 0x55f9ea2bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2c9ffb640 10 client.16641 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.300+0000 7fb2e259c640 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea2bae20 0x55f9ea2bd210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95a0c0fb833ae039 server_cookie=477122668b4fb502 in_seq=0 out_seq=0 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/2070747595 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9ea213860 con 0x55f9ea2bae20 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2c9ffb640 10 client.16641 handle_command_reply: tid=0 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 client.16641 shutdown 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 msgr2=0x55f9ea2a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a8530 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc01dff0 tx=0x7fb2dc017000 comp rx=0 tx=0).stop 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 shutdown_connections 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea2bae20 0x55f9ea2bd210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a8530 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2070747595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2c9ffb640 0 client.16641 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 >> 172.21.15.76:0/2070747595 conn(0x55f9ea269310 msgr2=0x55f9ea2a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.301+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 shutdown_connections 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.302+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2070747595 wait complete. 2024-09-19T07:56:24.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.302+0000 7fb2ead2b740 20 client.16641 trim_cache size 0 max 16384 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 Processor -- start 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 -- start start 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41b0510 con 0x55f9ea2a1b40 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41add20 con 0x55f9ea2ab370 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.314+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41abb70 con 0x55f9ea2a05d0 2024-09-19T07:56:24.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37680/0 (socket says 172.21.15.76:37680) 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2514560002 learned_addr learned my addr 172.21.15.76:0/2514560002 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2514560002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 msgr2=0x55f9ea2b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2514560002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 msgr2=0x55f9ea2a3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 -- 172.21.15.76:0/2514560002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ea2a3ba0 con 0x55f9ea2a1b40 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a3120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80bc350 tx=0x7fb2d80b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85bed5d350bedc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2cbfff640 1 -- 172.21.15.76:0/2514560002 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8049040 con 0x55f9ea2a1b40 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2cbfff640 1 -- 172.21.15.76:0/2514560002 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2d80bcac0 con 0x55f9ea2a1b40 2024-09-19T07:56:24.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.315+0000 7fb2cbfff640 1 -- 172.21.15.76:0/2514560002 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80b8a50 con 0x55f9ea2a1b40 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2514560002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 msgr2=0x55f9ea2a3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a3120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80bc350 tx=0x7fb2d80b8040 comp rx=0 tx=0).stop 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2514560002 shutdown_connections 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2a3120 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/2514560002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2514560002 >> 172.21.15.76:0/2514560002 conn(0x55f9ea269310 msgr2=0x55f9ea2aa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:24.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2514560002 shutdown_connections 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- 172.21.15.76:0/2514560002 wait complete. 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- start start 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 Processor -- start 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41ac1e0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41ad650 con 0x55f9ea2ab370 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41ac8b0 con 0x55f9ea2a1b40 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2ead2b740 10 client.0 _ll_register_callbacks cb 0x7fb2dc02a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.316+0000 7fb2e259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37688/0 (socket says 172.21.15.76:37688) 2024-09-19T07:56:24.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 -- 172.21.15.76:0/382885288 learned_addr learned my addr 172.21.15.76:0/382885288 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 -- 172.21.15.76:0/382885288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a1b40 msgr2=0x55f9ea2aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 -- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 msgr2=0x55f9ea2af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 -- 172.21.15.76:0/382885288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ea2af8b0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e2d9d640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2e259c640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b3a00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55f9ea2bd810 tx=0x7fb2d40138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ad1ab40eb63814 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/382885288 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4005220 con 0x55f9ea2a05d0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/382885288 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb2d40053c0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2d80bcac0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/382885288 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb2d402a050 con 0x55f9ea2a05d0 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2ead2b740 10 client.16647 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f9ea3256d0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.317+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/382885288 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2d80bcac0 con 0x55f9ea2a05d0 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/382885288 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fb2d4025030 con 0x55f9ea2a05d0 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2ead2b740 10 client.16647 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2ead2b740 10 client.16647 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2ead2b740 20 client.16647 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea325eb0 0x55f9ea3282d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2ead2b740 4 client.16647 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9ea20dd70 con 0x55f9ea325eb0 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea325eb0 0x55f9ea3282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2c9ffb640 10 client.16647 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:24.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.318+0000 7fb2e1d9b640 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea325eb0 0x55f9ea3282d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8f6ec027228deda server_cookie=e51c868d531cc8e7 in_seq=0 out_seq=0 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2c9ffb640 1 -- 172.21.15.76:0/382885288 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9ea20dd70 con 0x55f9ea325eb0 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2c9ffb640 10 client.16647 handle_command_reply: tid=0 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 client.16647 shutdown 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 msgr2=0x55f9ea2b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b3a00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55f9ea2bd810 tx=0x7fb2d40138f0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 shutdown_connections 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55f9ea325eb0 0x55f9ea3282d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9ea2ab370 0x55f9ea2af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f9ea2a1b40 0x55f9ea2aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2c9ffb640 0 client.16647 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 --2- 172.21.15.76:0/382885288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55f9ea2a05d0 0x55f9ea2b3a00 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 >> 172.21.15.76:0/382885288 conn(0x55f9ea269310 msgr2=0x55f9ea29b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:24.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 shutdown_connections 2024-09-19T07:56:24.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 1 -- 172.21.15.76:0/382885288 wait complete. 2024-09-19T07:56:24.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2ead2b740 20 client.16647 trim_cache size 0 max 16384 2024-09-19T07:56:24.325 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb2cc0a33b0 msgr2=0x7fb2cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.319+0000 7fb2e8952640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb2cc0a33b0 0x7fb2cc0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc01c000 tx=0x7fb2dc01ceb0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 msgr2=0x7fb2e4198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e4198a20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8004770 tx=0x7fb2d8032970 comp rx=0 tx=0).stop 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 shutdown_connections 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb2cc0a33b0 0x7fb2cc0a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e4106f10 0x7fb2e419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb2e4102790 0x7fb2e4198a20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 --2- 172.21.15.76:0/2284023955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2e4101de0 0x7fb2e41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 >> 172.21.15.76:0/2284023955 conn(0x7fb2e40fd8c0 msgr2=0x7fb2e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 shutdown_connections 2024-09-19T07:56:24.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:24.320+0000 7fb2e8952640 1 -- 172.21.15.76:0/2284023955 wait complete. 2024-09-19T07:56:25.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:24 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:56:25.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:24 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:56:25.181 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:24 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:56:25.207 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:56:25.470 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:25.885 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:25 smithi076 ceph-mon[30930]: pgmap v161: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:56:25.885 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:25 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:56:25.885 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:25 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:56:25.885 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:25 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:56:25.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.968+0000 7f50a827c640 1 -- 172.21.15.76:0/2699730066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0102570 msgr2=0x7f50a01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.968+0000 7f50a827c640 1 --2- 172.21.15.76:0/2699730066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0102570 0x7f50a01029b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5090009900 tx=0x7f509002a480 comp rx=0 tx=0).stop 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- 172.21.15.76:0/2699730066 shutdown_connections 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 --2- 172.21.15.76:0/2699730066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 0x7f50a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 --2- 172.21.15.76:0/2699730066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0102570 0x7f50a01029b0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 --2- 172.21.15.76:0/2699730066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0100e20 0x7f50a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- 172.21.15.76:0/2699730066 >> 172.21.15.76:0/2699730066 conn(0x7f50a00fc7d0 msgr2=0x7f50a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- 172.21.15.76:0/2699730066 shutdown_connections 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- 172.21.15.76:0/2699730066 wait complete. 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 Processor -- start 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- start start 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 0x7f50a01994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0102570 0x7f50a01999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 0x7f50a01a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f50a0111160 con 0x7f50a0100e20 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50a0110fe0 con 0x7f50a0102ef0 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.969+0000 7f50a827c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01112e0 con 0x7f50a0102570 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 0x7f50a01994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 0x7f50a01994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37704/0 (socket says 172.21.15.76:37704) 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 -- 172.21.15.76:0/2298475510 learned_addr learned my addr 172.21.15.76:0/2298475510 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a5817640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0102570 0x7f50a01999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6819640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 0x7f50a01a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 -- 172.21.15.76:0/2298475510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0102570 msgr2=0x7f50a01999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0102570 0x7f50a01999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 -- 172.21.15.76:0/2298475510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 msgr2=0x7f50a01a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:25.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 0x7f50a01a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 -- 172.21.15.76:0/2298475510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a01a4a70 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a5817640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0102570 0x7f50a01999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6819640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 0x7f50a01a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a6018640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 0x7f50a01994b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f509800ba50 tx=0x7f509800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50977fe640 1 -- 172.21.15.76:0/2298475510 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098019070 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50977fe640 1 -- 172.21.15.76:0/2298475510 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f509800cbe0 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a01a4c40 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50977fe640 1 -- 172.21.15.76:0/2298475510 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098007770 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.970+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a01a5180 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.972+0000 7f50977fe640 1 -- 172.21.15.76:0/2298475510 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f509801c070 con 0x7f50a0100e20 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 Processor -- start 2024-09-19T07:56:25.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 -- start start 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50977fe640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f508c0a33b0 0x7f508c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b3e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b3ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556759aa42f0 con 0x556759b4d780 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556759a4bcf0 con 0x556759b3fb40 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.973+0000 7f50aa655740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556759aa02b0 con 0x556759b3e5d0 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6819640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f508c0a33b0 0x7f508c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50977fe640 1 -- 172.21.15.76:0/2298475510 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f50980cf300 con 0x7f50a0100e20 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b3e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b3e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:51312/0 (socket says 172.21.15.76:51312) 2024-09-19T07:56:25.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 -- 172.21.15.76:0/1859312256 learned_addr learned my addr 172.21.15.76:0/1859312256 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a5817640 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b3ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 -- 172.21.15.76:0/1859312256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 msgr2=0x556759b3ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b3ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 -- 172.21.15.76:0/1859312256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 msgr2=0x556759b4fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 -- 172.21.15.76:0/1859312256 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556759a303a0 con 0x556759b3fb40 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6819640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f508c0a33b0 0x7f508c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f509c006e10 tx=0x7f509c00a560 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f50a6018640 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b3e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f509800ba20 tx=0x7f5098007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc89da900ab3ac35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f5094dea640 1 -- 172.21.15.76:0/1859312256 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50980ae590 con 0x556759b3fb40 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f5094dea640 1 -- 172.21.15.76:0/1859312256 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f509809bd90 con 0x556759b3fb40 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.974+0000 7f5094dea640 1 -- 172.21.15.76:0/1859312256 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50980ae1d0 con 0x556759b3fb40 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 -- 172.21.15.76:0/1859312256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 msgr2=0x556759b3e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:25.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b3e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f509800ba20 tx=0x7f5098007f90 comp rx=0 tx=0).stop 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 -- 172.21.15.76:0/1859312256 shutdown_connections 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b3ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 --2- 172.21.15.76:0/1859312256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b3e090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 -- 172.21.15.76:0/1859312256 >> 172.21.15.76:0/1859312256 conn(0x556759b07310 msgr2=0x556759b3ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 -- 172.21.15.76:0/1859312256 shutdown_connections 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.975+0000 7f50aa655740 1 -- 172.21.15.76:0/1859312256 wait complete. 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 -- start start 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 Processor -- start 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b4d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b4a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556759b50480 con 0x556759b4d780 2024-09-19T07:56:25.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556759a5f060 con 0x556759b3fb40 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556759b50600 con 0x556759b3e5d0 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50aa655740 10 client.0 _ll_register_callbacks cb 0x5567597b28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37710/0 (socket says 172.21.15.76:37710) 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 -- 172.21.15.76:0/3650724104 learned_addr learned my addr 172.21.15.76:0/3650724104 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a5817640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b4a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6018640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b4d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 -- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 msgr2=0x556759b4d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:25.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b4d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 -- 172.21.15.76:0/3650724104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 msgr2=0x556759b4a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b4a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6819640 1 -- 172.21.15.76:0/3650724104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567598153c0 con 0x556759b4d780 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.976+0000 7f50a6018640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50a6819640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4aa60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f509c014ca0 tx=0x7f509c006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa99a4c3efbca8d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f5089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f5089ffb640 1 -- 172.21.15.76:0/3650724104 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c014cd0 con 0x556759b4d780 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f5089ffb640 1 -- 172.21.15.76:0/3650724104 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f509c020440 con 0x556759b4d780 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f509809bd90 con 0x556759b4d780 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f5089ffb640 1 -- 172.21.15.76:0/3650724104 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f509c014e70 con 0x556759b4d780 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 10 client.16659 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556759b5bf50 con 0x556759b4d780 2024-09-19T07:56:25.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f5089ffb640 1 -- 172.21.15.76:0/3650724104 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f509809bd90 con 0x556759b4d780 2024-09-19T07:56:25.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f5089ffb640 1 -- 172.21.15.76:0/3650724104 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f509c015040 con 0x556759b4d780 2024-09-19T07:56:25.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 10 client.16659 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:25.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:25.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 20 client.16659 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:25.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759b5d460 0x556759b5f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 4 client.16659 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.977+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556759ab1860 con 0x556759b5d460 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.978+0000 7f50a6018640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759b5d460 0x556759b5f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.978+0000 7f5089ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.978+0000 7f50a6018640 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759b5d460 0x556759b5f8e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3df7a711a4154411 server_cookie=80e2a7f53d793b91 in_seq=0 out_seq=0 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f5089ffb640 1 -- 172.21.15.76:0/3650724104 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556759ab1860 con 0x556759b5d460 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f5089ffb640 10 client.16659 handle_command_reply: tid=0 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 client.16659 shutdown 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 msgr2=0x556759b4aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4aa60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f509c014ca0 tx=0x7f509c006da0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 shutdown_connections 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759b5d460 0x556759b5f8e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b4aa60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3fb40 0x556759b4a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f5089ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 --2- 172.21.15.76:0/3650724104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3e5d0 0x556759b4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 >> 172.21.15.76:0/3650724104 conn(0x556759b07310 msgr2=0x556759b409c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 shutdown_connections 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 1 -- 172.21.15.76:0/3650724104 wait complete. 2024-09-19T07:56:25.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.979+0000 7f50aa655740 20 client.16659 trim_cache size 0 max 16384 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 Processor -- start 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 -- start start 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b59720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b3a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b3ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01ae380 con 0x556759b4d780 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01abb90 con 0x556759b3e5d0 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50aa655740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01a99e0 con 0x556759b3fb40 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b3ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b3ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37724/0 (socket says 172.21.15.76:37724) 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.992+0000 7f50a6819640 1 -- 172.21.15.76:0/3251320654 learned_addr learned my addr 172.21.15.76:0/3251320654 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:26.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6018640 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b59720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a5817640 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b3a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6819640 1 -- 172.21.15.76:0/3251320654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 msgr2=0x556759b3a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6819640 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b3a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6819640 1 -- 172.21.15.76:0/3251320654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 msgr2=0x556759b59720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6819640 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b59720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6819640 1 -- 172.21.15.76:0/3251320654 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556759b5ff60 con 0x556759b4d780 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6018640 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b59720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f50a6819640 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b3ac40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f509c0143c0 tx=0x7f509c021ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f50553fa904e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f508bfff640 1 -- 172.21.15.76:0/3251320654 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c036020 con 0x556759b4d780 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f508bfff640 1 -- 172.21.15.76:0/3251320654 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f509c025070 con 0x556759b4d780 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.993+0000 7f508bfff640 1 -- 172.21.15.76:0/3251320654 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c005c20 con 0x556759b4d780 2024-09-19T07:56:26.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 -- 172.21.15.76:0/3251320654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 msgr2=0x556759b3ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b3ac40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f509c0143c0 tx=0x7f509c021ff0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 -- 172.21.15.76:0/3251320654 shutdown_connections 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b3ac40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b3a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 --2- 172.21.15.76:0/3251320654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b59720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 -- 172.21.15.76:0/3251320654 >> 172.21.15.76:0/3251320654 conn(0x556759b07310 msgr2=0x556759b4a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 -- 172.21.15.76:0/3251320654 shutdown_connections 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 -- 172.21.15.76:0/3251320654 wait complete. 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 -- start start 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.994+0000 7f50aa655740 1 Processor -- start 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b55e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b47010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b47550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01aa050 con 0x556759b4d780 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01ab4c0 con 0x556759b3e5d0 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50a01aa720 con 0x556759b3fb40 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 10 client.0 _ll_register_callbacks cb 0x7f509c0163c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b47550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b47550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37734/0 (socket says 172.21.15.76:37734) 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 -- 172.21.15.76:0/2224361189 learned_addr learned my addr 172.21.15.76:0/2224361189 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6018640 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b55e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 -- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 msgr2=0x556759b47010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b47010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 -- 172.21.15.76:0/2224361189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 msgr2=0x556759b55e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b55e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 -- 172.21.15.76:0/2224361189 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556759b47bf0 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50a6819640 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b47550 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f509c00a450 tx=0x7f509c005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e07465ee7398a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f5089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f5089ffb640 1 -- 172.21.15.76:0/2224361189 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c036030 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f509c025070 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f5089ffb640 1 -- 172.21.15.76:0/2224361189 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f509c0067e0 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f5089ffb640 1 -- 172.21.15.76:0/2224361189 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f509c00a890 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 10 client.16665 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.995+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556759bc8010 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f5089ffb640 1 -- 172.21.15.76:0/2224361189 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f509c025070 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f5089ffb640 1 -- 172.21.15.76:0/2224361189 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f509c03b450 con 0x556759b4d780 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50aa655740 10 client.16665 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50aa655740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50aa655740 20 client.16665 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:26.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50aa655740 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759bc8640 0x556759bcaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50aa655740 4 client.16665 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556759aabd70 con 0x556759bc8640 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.996+0000 7f50a6018640 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759bc8640 0x556759bcaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50a6018640 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759bc8640 0x556759bcaa60 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9c432e3d8c4d1c5 server_cookie=ed01c7af6bb64c7a in_seq=0 out_seq=0 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f5089ffb640 10 client.16665 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f5089ffb640 1 -- 172.21.15.76:0/2224361189 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556759aabd70 con 0x556759bc8640 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f5089ffb640 10 client.16665 handle_command_reply: tid=0 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 client.16665 shutdown 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 msgr2=0x556759b47550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b47550 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f509c00a450 tx=0x7f509c005fb0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 shutdown_connections 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556759bc8640 0x556759bcaa60 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556759b4d780 0x556759b47550 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556759b3fb40 0x556759b47010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 --2- 172.21.15.76:0/2224361189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556759b3e5d0 0x556759b55e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 >> 172.21.15.76:0/2224361189 conn(0x556759b07310 msgr2=0x556759b3a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f5089ffb640 0 client.16665 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 shutdown_connections 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 1 -- 172.21.15.76:0/2224361189 wait complete. 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.997+0000 7f50aa655740 20 client.16665 trim_cache size 0 max 16384 2024-09-19T07:56:26.008 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f508c0a33b0 msgr2=0x7f508c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f508c0a33b0 0x7f508c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f509c006e10 tx=0x7f509c00a560 comp rx=0 tx=0).stop 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 msgr2=0x7f50a01994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 0x7f50a01994b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f509800ba50 tx=0x7f509800bf10 comp rx=0 tx=0).stop 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 shutdown_connections 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f508c0a33b0 0x7f508c0a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50a0102ef0 0x7f50a01a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50a0102570 0x7f50a01999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 --2- 172.21.15.76:0/2298475510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f50a0100e20 0x7f50a01994b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:26.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 >> 172.21.15.76:0/2298475510 conn(0x7f50a00fc7d0 msgr2=0x7f50a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:26.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 shutdown_connections 2024-09-19T07:56:26.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:25.998+0000 7f50a827c640 1 -- 172.21.15.76:0/2298475510 wait complete. 2024-09-19T07:56:26.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:25 smithi152 ceph-mon[35117]: pgmap v161: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:56:26.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:25 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:56:26.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:25 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:56:26.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:25 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:56:26.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:25 smithi137 ceph-mon[35309]: pgmap v161: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:56:26.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:25 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:56:26.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:25 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:56:26.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:25 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:56:27.776 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:56:27.777 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:56:28.031 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:28.151 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:27 smithi076 ceph-mon[30930]: pgmap v162: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:56:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:27 smithi152 ceph-mon[35117]: pgmap v162: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:56:28.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:27 smithi137 ceph-mon[35309]: pgmap v162: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 -- 172.21.15.76:0/2517106251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8101420 msgr2=0x7fe7d810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 --2- 172.21.15.76:0/2517106251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8101420 0x7fe7d810d950 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009cd0 tx=0x7fe7d002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 -- 172.21.15.76:0/2517106251 shutdown_connections 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 --2- 172.21.15.76:0/2517106251 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8101420 0x7fe7d810d950 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 --2- 172.21.15.76:0/2517106251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 0x7fe7d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 --2- 172.21.15.76:0/2517106251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8106a80 0x7fe7d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 -- 172.21.15.76:0/2517106251 >> 172.21.15.76:0/2517106251 conn(0x7fe7d80fc7a0 msgr2=0x7fe7d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:28.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 -- 172.21.15.76:0/2517106251 shutdown_connections 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 -- 172.21.15.76:0/2517106251 wait complete. 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.501+0000 7fe7dd690640 1 Processor -- start 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 -- start start 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 0x7fe7d8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8101420 0x7fe7d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 0x7fe7d819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8110fa0 con 0x7fe7d8106a80 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8110e20 con 0x7fe7d8101420 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7dd690640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8111120 con 0x7fe7d8100a80 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 0x7fe7d819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 0x7fe7d819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37744/0 (socket says 172.21.15.76:37744) 2024-09-19T07:56:28.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 -- 172.21.15.76:0/445630071 learned_addr learned my addr 172.21.15.76:0/445630071 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 0x7fe7d8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8101420 0x7fe7d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 -- 172.21.15.76:0/445630071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 msgr2=0x7fe7d8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 0x7fe7d8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 -- 172.21.15.76:0/445630071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8101420 msgr2=0x7fe7d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8101420 0x7fe7d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d77fe640 1 -- 172.21.15.76:0/445630071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d819d400 con 0x7fe7d8106a80 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 0x7fe7d8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.502+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8101420 0x7fe7d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.503+0000 7fe7d77fe640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 0x7fe7d819cd20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0006010 tx=0x7fe7d0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.503+0000 7fe7bffff640 1 -- 172.21.15.76:0/445630071 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0004040 con 0x7fe7d8106a80 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.503+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d819d690 con 0x7fe7d8106a80 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.503+0000 7fe7bffff640 1 -- 172.21.15.76:0/445630071 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7d00046e0 con 0x7fe7d8106a80 2024-09-19T07:56:28.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.503+0000 7fe7bffff640 1 -- 172.21.15.76:0/445630071 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0046480 con 0x7fe7d8106a80 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.503+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d81a4fd0 con 0x7fe7d8106a80 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.505+0000 7fe7bffff640 1 -- 172.21.15.76:0/445630071 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe7d0030630 con 0x7fe7d8106a80 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.505+0000 7fe7dfa69740 1 Processor -- start 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.505+0000 7fe7dfa69740 1 -- start start 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f7a80 0x562e379f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a06c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 0x562e37a09540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562e3795d280 con 0x562e37a07150 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562e37904b10 con 0x562e379f7a80 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e37959240 con 0x562e379f83a0 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 0x562e37a09540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 0x562e37a09540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37746/0 (socket says 172.21.15.76:37746) 2024-09-19T07:56:28.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 -- 172.21.15.76:0/4139808440 learned_addr learned my addr 172.21.15.76:0/4139808440 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f7a80 0x562e379f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7bffff640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7c00a33b0 0x7fe7c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a06c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 -- 172.21.15.76:0/4139808440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 msgr2=0x562e37a06c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a06c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 -- 172.21.15.76:0/4139808440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f7a80 msgr2=0x562e379f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f7a80 0x562e379f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 -- 172.21.15.76:0/4139808440 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e379111f0 con 0x562e37a07150 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d77fe640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7c00a33b0 0x7fe7c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7bffff640 1 -- 172.21.15.76:0/445630071 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe7d002e030 con 0x7fe7d8106a80 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.506+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 0x562e37a09540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc012880 tx=0x7fe7cc00d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209ab7649892154b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:28.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7bd7fa640 1 -- 172.21.15.76:0/4139808440 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00aa60 con 0x562e37a07150 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7bd7fa640 1 -- 172.21.15.76:0/4139808440 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7cc005520 con 0x562e37a07150 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7bd7fa640 1 -- 172.21.15.76:0/4139808440 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc004c30 con 0x562e37a07150 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 -- 172.21.15.76:0/4139808440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 msgr2=0x562e37a09540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7d77fe640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7c00a33b0 0x7fe7c00a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00bd7e0 tx=0x7fe7d008c540 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 0x562e37a09540 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc012880 tx=0x7fe7cc00d440 comp rx=0 tx=0).stop 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 -- 172.21.15.76:0/4139808440 shutdown_connections 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e37a07150 0x562e37a09540 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a06c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/4139808440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f7a80 0x562e379f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 -- 172.21.15.76:0/4139808440 >> 172.21.15.76:0/4139808440 conn(0x562e379f40f0 msgr2=0x562e379f44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 -- 172.21.15.76:0/4139808440 shutdown_connections 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.507+0000 7fe7dfa69740 1 -- 172.21.15.76:0/4139808440 wait complete. 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 -- start start 2024-09-19T07:56:28.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 Processor -- start 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a04640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a04b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562e37a09cc0 con 0x562e379f7a80 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562e37917f10 con 0x562e37a07150 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e37a09e40 con 0x562e379f83a0 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7dfa69740 10 client.0 _ll_register_callbacks cb 0x562e378e0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a04100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37758/0 (socket says 172.21.15.76:37758) 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1857792214 learned_addr learned my addr 172.21.15.76:0/1857792214 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a04640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 msgr2=0x562e37a04640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a04640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1857792214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 msgr2=0x562e37a04b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a04b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.508+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1857792214 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e376ce6a0 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a04100 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00e010 tx=0x7fe7cc005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26904d63fd5135c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7baff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7baff5640 1 -- 172.21.15.76:0/1857792214 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc02a060 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7baff5640 1 -- 172.21.15.76:0/1857792214 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe7cc0049b0 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7cc005520 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7baff5640 1 -- 172.21.15.76:0/1857792214 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe7cc004bb0 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 10 client.16677 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562e37a159e0 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7baff5640 1 -- 172.21.15.76:0/1857792214 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7cc005520 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7baff5640 1 -- 172.21.15.76:0/1857792214 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fe7cc01d6d0 con 0x562e379f7a80 2024-09-19T07:56:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 10 client.16677 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 20 client.16677 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 4 client.16677 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.509+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e3796a7f0 con 0x562e37a16df0 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.510+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.510+0000 7fe7baff5640 10 client.16677 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.510+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a191e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bc174efc4c35df8 server_cookie=ee2852c67a07474e in_seq=0 out_seq=0 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7baff5640 1 -- 172.21.15.76:0/1857792214 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e3796a7f0 con 0x562e37a16df0 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7baff5640 10 client.16677 handle_command_reply: tid=0 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 client.16677 shutdown 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 msgr2=0x562e37a04100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a04100 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00e010 tx=0x7fe7cc005ce0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 shutdown_connections 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a04b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a04640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a191e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7baff5640 0 client.16677 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1857792214 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a04100 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 >> 172.21.15.76:0/1857792214 conn(0x562e379f40f0 msgr2=0x562e379f3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 shutdown_connections 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1857792214 wait complete. 2024-09-19T07:56:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.511+0000 7fe7dfa69740 20 client.16677 trim_cache size 0 max 16384 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 Processor -- start 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 -- start start 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a1e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f83a0 0x562e37a1ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e37a07150 0x562e37a01360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81ae1a0 con 0x562e379f7a80 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81ab9b0 con 0x562e379f83a0 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81a9800 con 0x562e37a07150 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a1e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a1e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37772/0 (socket says 172.21.15.76:37772) 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.528+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1975005227 learned_addr learned my addr 172.21.15.76:0/1975005227 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1975005227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e37a07150 msgr2=0x562e37a01360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e37a07150 0x562e37a01360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1975005227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f83a0 msgr2=0x562e37a1ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f83a0 0x562e37a1ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1975005227 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e37a030b0 con 0x562e379f7a80 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a1e810 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc015040 tx=0x7fe7cc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465c6d81a2c23ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7bcff9640 1 -- 172.21.15.76:0/1975005227 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc02a070 con 0x562e379f7a80 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7bcff9640 1 -- 172.21.15.76:0/1975005227 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7cc03a070 con 0x562e379f7a80 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.529+0000 7fe7bcff9640 1 -- 172.21.15.76:0/1975005227 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc01d690 con 0x562e379f7a80 2024-09-19T07:56:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1975005227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 msgr2=0x562e37a1e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a1e810 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc015040 tx=0x7fe7cc00d3b0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1975005227 shutdown_connections 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e37a07150 0x562e37a01360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e379f83a0 0x562e37a1ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1975005227 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a1e810 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1975005227 >> 172.21.15.76:0/1975005227 conn(0x562e379f40f0 msgr2=0x562e37a048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1975005227 shutdown_connections 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1975005227 wait complete. 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- start start 2024-09-19T07:56:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 Processor -- start 2024-09-19T07:56:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a0f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a0abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a0b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81a9e70 con 0x562e379f7a80 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81ab2e0 con 0x562e37a07150 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81aa540 con 0x562e379f83a0 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7dfa69740 10 client.0 _ll_register_callbacks cb 0x7fe7cc00de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a0f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7d67fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a0f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37784/0 (socket says 172.21.15.76:37784) 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.530+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1483043556 learned_addr learned my addr 172.21.15.76:0/1483043556 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:28.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a0abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a0b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 msgr2=0x562e37a0abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a0abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1483043556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 msgr2=0x562e37a0b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a0b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 -- 172.21.15.76:0/1483043556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e37a0b960 con 0x562e379f7a80 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7d67fc640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a0f8a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc037040 tx=0x7fe7cc012800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6051520974b7af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7baff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7baff5640 1 -- 172.21.15.76:0/1483043556 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc02a040 con 0x562e379f7a80 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7baff5640 1 -- 172.21.15.76:0/1483043556 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe7cc004660 con 0x562e379f7a80 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7cc03a070 con 0x562e379f7a80 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7baff5640 1 -- 172.21.15.76:0/1483043556 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe7cc004860 con 0x562e379f7a80 2024-09-19T07:56:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7dfa69740 10 client.16683 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.531+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562e37a818b0 con 0x562e379f7a80 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7baff5640 1 -- 172.21.15.76:0/1483043556 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7cc03a070 con 0x562e379f7a80 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7baff5640 1 -- 172.21.15.76:0/1483043556 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fe7cc00ac80 con 0x562e379f7a80 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7dfa69740 10 client.16683 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7dfa69740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7dfa69740 20 client.16683 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a83f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7dfa69740 4 client.16683 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562e37964d00 con 0x562e37a16df0 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a83f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7baff5640 10 client.16683 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.532+0000 7fe7d6ffd640 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a83f20 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3741b0a896999ec server_cookie=db973c3fdd8f9c3c in_seq=0 out_seq=0 2024-09-19T07:56:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7baff5640 1 -- 172.21.15.76:0/1483043556 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562e37964d00 con 0x562e37a16df0 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7baff5640 10 client.16683 handle_command_reply: tid=0 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7dfa69740 1 client.16683 shutdown 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 msgr2=0x562e37a0f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a0f8a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc037040 tx=0x7fe7cc012800 comp rx=0 tx=0).stop 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 shutdown_connections 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.533+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e37a07150 0x562e37a0b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e379f83a0 0x562e37a0abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562e37a16df0 0x562e37a83f20 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 1 --2- 172.21.15.76:0/1483043556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562e379f7a80 0x562e37a0f8a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7baff5640 0 client.16683 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 >> 172.21.15.76:0/1483043556 conn(0x562e379f40f0 msgr2=0x562e37a11f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 shutdown_connections 2024-09-19T07:56:28.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 1 -- 172.21.15.76:0/1483043556 wait complete. 2024-09-19T07:56:28.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dfa69740 20 client.16683 trim_cache size 0 max 16384 2024-09-19T07:56:28.541 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:28.541 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:56:28.541 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "847a3e38-de1c-4a11-acf0-261a79208e18", 2024-09-19T07:56:28.541 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:56:28.541 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7c00a33b0 msgr2=0x7fe7c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7c00a33b0 0x7fe7c00a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00bd7e0 tx=0x7fe7d008c540 comp rx=0 tx=0).stop 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 msgr2=0x7fe7d819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 0x7fe7d819cd20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0006010 tx=0x7fe7d0003f10 comp rx=0 tx=0).stop 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 shutdown_connections 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe7c00a33b0 0x7fe7c00a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe7d8106a80 0x7fe7d819cd20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7d8101420 0x7fe7d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 --2- 172.21.15.76:0/445630071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7d8100a80 0x7fe7d8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:28.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 >> 172.21.15.76:0/445630071 conn(0x7fe7d80fc7a0 msgr2=0x7fe7d8104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:28.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 shutdown_connections 2024-09-19T07:56:28.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:28.534+0000 7fe7dd690640 1 -- 172.21.15.76:0/445630071 wait complete. 2024-09-19T07:56:29.437 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:56:29.682 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:30.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:29 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:56:30.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:29 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:30.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:29 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:56:30.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:29 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:30.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:29 smithi076 ceph-mon[30930]: pgmap v163: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:56:30.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:29 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:56:30.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 -- 172.21.15.76:0/2706361611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 msgr2=0x7fc7e810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 --2- 172.21.15.76:0/2706361611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e810e600 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009ca0 tx=0x7fc7e002a950 comp rx=0 tx=0).stop 2024-09-19T07:56:30.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 -- 172.21.15.76:0/2706361611 shutdown_connections 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 --2- 172.21.15.76:0/2706361611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e810e600 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 --2- 172.21.15.76:0/2706361611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e81036c0 0x7fc7e810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 --2- 172.21.15.76:0/2706361611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7e8102da0 0x7fc7e8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 -- 172.21.15.76:0/2706361611 >> 172.21.15.76:0/2706361611 conn(0x7fc7e80fc7a0 msgr2=0x7fc7e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 -- 172.21.15.76:0/2706361611 shutdown_connections 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 -- 172.21.15.76:0/2706361611 wait complete. 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.201+0000 7fc7ee886640 1 Processor -- start 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 -- start start 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7e8102da0 0x7fc7e819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e81036c0 0x7fc7e819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8112100 con 0x7fc7e810c180 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8111f80 con 0x7fc7e8102da0 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ee886640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8112280 con 0x7fc7e81036c0 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e819efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37800/0 (socket says 172.21.15.76:37800) 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 -- 172.21.15.76:0/714072783 learned_addr learned my addr 172.21.15.76:0/714072783 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7e8102da0 0x7fc7e819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 -- 172.21.15.76:0/714072783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e81036c0 msgr2=0x7fc7e819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e81036c0 0x7fc7e819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e81036c0 0x7fc7e819ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 -- 172.21.15.76:0/714072783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7e8102da0 msgr2=0x7fc7e819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7e8102da0 0x7fc7e819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.202+0000 7fc7ece23640 1 -- 172.21.15.76:0/714072783 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e819f6b0 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.203+0000 7fc7ece23640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e819efd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0005cc0 tx=0x7fc7e002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.203+0000 7fc7e57fa640 1 -- 172.21.15.76:0/714072783 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0034040 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.203+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e819f940 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.203+0000 7fc7e57fa640 1 -- 172.21.15.76:0/714072783 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7e0030940 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.203+0000 7fc7e57fa640 1 -- 172.21.15.76:0/714072783 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00456e0 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.203+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e81a7280 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e57fa640 1 -- 172.21.15.76:0/714072783 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc7e0037020 con 0x7fc7e810c180 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 Processor -- start 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 -- start start 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f15a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f165140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 0x55dc9f167a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55dc9f0c02e0 con 0x55dc9f165680 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dc9f067ce0 con 0x55dc9f15adc0 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc9f0bc2a0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 0x55dc9f167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 0x55dc9f167a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37810/0 (socket says 172.21.15.76:37810) 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e77fe640 1 -- 172.21.15.76:0/3406694136 learned_addr learned my addr 172.21.15.76:0/3406694136 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e57fa640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7d00a33b0 0x7fc7d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7ece23640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7d00a33b0 0x7fc7d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.206+0000 7fc7e77fe640 1 -- 172.21.15.76:0/3406694136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 msgr2=0x55dc9f15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7e77fe640 1 -- 172.21.15.76:0/3406694136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 msgr2=0x55dc9f165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f165140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7e77fe640 1 -- 172.21.15.76:0/3406694136 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9f04c440 con 0x55dc9f165680 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7e57fa640 1 -- 172.21.15.76:0/714072783 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fc7e00f0d10 con 0x7fc7e810c180 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 0x55dc9f167a70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc005fd0 tx=0x7fc7dc00e5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc3512d83028e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7ece23640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7d00a33b0 0x7fc7d00a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00b9500 tx=0x7fc7e002a950 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7ce7fc640 1 -- 172.21.15.76:0/3406694136 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc018030 con 0x55dc9f165680 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7ce7fc640 1 -- 172.21.15.76:0/3406694136 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7dc005520 con 0x55dc9f165680 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.207+0000 7fc7ce7fc640 1 -- 172.21.15.76:0/3406694136 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0106d0 con 0x55dc9f165680 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/3406694136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 msgr2=0x55dc9f167a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 0x55dc9f167a70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc005fd0 tx=0x7fc7dc00e5b0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/3406694136 shutdown_connections 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f165680 0x55dc9f167a70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/3406694136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/3406694136 >> 172.21.15.76:0/3406694136 conn(0x55dc9f156a30 msgr2=0x55dc9f156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/3406694136 shutdown_connections 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/3406694136 wait complete. 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 -- start start 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.208+0000 7fc7f0c5f740 1 Processor -- start 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f162200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f165680 0x55dc9f162740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55dc9f168250 con 0x55dc9f15a4a0 2024-09-19T07:56:30.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dc9f07b050 con 0x55dc9f15adc0 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc9f1683d0 con 0x55dc9f165680 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 10 client.0 _ll_register_callbacks cb 0x55dc9f0bb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37818/0 (socket says 172.21.15.76:37818) 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 -- 172.21.15.76:0/4263601968 learned_addr learned my addr 172.21.15.76:0/4263601968 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f165680 0x55dc9f162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 -- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f165680 msgr2=0x55dc9f162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f165680 0x55dc9f162740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 -- 172.21.15.76:0/4263601968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 msgr2=0x55dc9f162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f162200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 -- 172.21.15.76:0/4263601968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9ee313c0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f164f50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00ede0 tx=0x7fc7dc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46396b382e77f4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7c77fe640 1 -- 172.21.15.76:0/4263601968 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc018050 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc005520 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.209+0000 7fc7c77fe640 1 -- 172.21.15.76:0/4263601968 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fc7dc01d660 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7c77fe640 1 -- 172.21.15.76:0/4263601968 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc7dc02f050 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 10 client.16695 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dc9f173ba0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7c77fe640 1 -- 172.21.15.76:0/4263601968 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7dc005520 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7c77fe640 1 -- 172.21.15.76:0/4263601968 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fc7dc00f040 con 0x55dc9f15a4a0 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 10 client.16695 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:30.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 20 client.16695 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f174fb0 0x55dc9f1773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 4 client.16695 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc9f0cd850 con 0x55dc9f174fb0 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.210+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f174fb0 0x55dc9f1773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.211+0000 7fc7c77fe640 10 client.16695 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.211+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f174fb0 0x55dc9f1773a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b01a2610490c3419 server_cookie=1aeffa70968694f3 in_seq=0 out_seq=0 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.211+0000 7fc7c77fe640 1 -- 172.21.15.76:0/4263601968 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc9f0cd850 con 0x55dc9f174fb0 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.211+0000 7fc7c77fe640 10 client.16695 handle_command_reply: tid=0 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.211+0000 7fc7f0c5f740 1 client.16695 shutdown 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 msgr2=0x55dc9f164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f164f50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00ede0 tx=0x7fc7dc004f90 comp rx=0 tx=0).stop 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 shutdown_connections 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f165680 0x55dc9f162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f174fb0 0x55dc9f1773a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/4263601968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f164f50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7c77fe640 0 client.16695 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 >> 172.21.15.76:0/4263601968 conn(0x55dc9f156a30 msgr2=0x55dc9f15c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 shutdown_connections 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/4263601968 wait complete. 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.212+0000 7fc7f0c5f740 20 client.16695 trim_cache size 0 max 16384 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 Processor -- start 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 -- start start 2024-09-19T07:56:30.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 0x55dc9f1714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f17cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81b2680 con 0x55dc9f156a30 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81afe90 con 0x55dc9f15adc0 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81adce0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 0x55dc9f1714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7e77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 0x55dc9f1714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37820/0 (socket says 172.21.15.76:37820) 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.229+0000 7fc7e77fe640 1 -- 172.21.15.76:0/924189354 learned_addr learned my addr 172.21.15.76:0/924189354 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e77fe640 1 -- 172.21.15.76:0/924189354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 msgr2=0x55dc9f1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f1621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e77fe640 1 -- 172.21.15.76:0/924189354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 msgr2=0x55dc9f17cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f17cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e77fe640 1 -- 172.21.15.76:0/924189354 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9f156860 con 0x55dc9f156a30 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 0x55dc9f1714b0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0108a0 tx=0x7fc7dc0053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce77b7bef1ad734 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7cdffb640 1 -- 172.21.15.76:0/924189354 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc018070 con 0x55dc9f156a30 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7cdffb640 1 -- 172.21.15.76:0/924189354 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7dc019040 con 0x55dc9f156a30 2024-09-19T07:56:30.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.230+0000 7fc7cdffb640 1 -- 172.21.15.76:0/924189354 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0106d0 con 0x55dc9f156a30 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/924189354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 msgr2=0x55dc9f1714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 0x55dc9f1714b0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0108a0 tx=0x7fc7dc0053c0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/924189354 shutdown_connections 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f17cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f15a4a0 0x55dc9f1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/924189354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f156a30 0x55dc9f1714b0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/924189354 >> 172.21.15.76:0/924189354 conn(0x55dc9f1628a0 msgr2=0x55dc9f15d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/924189354 shutdown_connections 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/924189354 wait complete. 2024-09-19T07:56:30.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 -- start start 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.231+0000 7fc7f0c5f740 1 Processor -- start 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f156a30 0x55dc9f1687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f1ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81ae350 con 0x55dc9f15a4a0 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81af7c0 con 0x55dc9f15adc0 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81aea20 con 0x55dc9f156a30 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 10 client.0 _ll_register_callbacks cb 0x7fc7dc00ef20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f168ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37828/0 (socket says 172.21.15.76:37828) 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 -- 172.21.15.76:0/959433891 learned_addr learned my addr 172.21.15.76:0/959433891 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f156a30 0x55dc9f1687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f1ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 -- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f156a30 msgr2=0x55dc9f1687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f156a30 0x55dc9f1687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 -- 172.21.15.76:0/959433891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 msgr2=0x55dc9f1ddb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f1ddb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 -- 172.21.15.76:0/959433891 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9f1de0b0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f156a30 0x55dc9f1687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7e7fff640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f168ce0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800be00 tx=0x7fc7d800b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502baef28728026e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7c77fe640 1 -- 172.21.15.76:0/959433891 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8024400 con 0x55dc9f15a4a0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7c77fe640 1 -- 172.21.15.76:0/959433891 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fc7d80245a0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.232+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc019040 con 0x55dc9f15a4a0 2024-09-19T07:56:30.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7c77fe640 1 -- 172.21.15.76:0/959433891 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc7d80247a0 con 0x55dc9f15a4a0 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 10 client.16701 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dc9f1df280 con 0x55dc9f15a4a0 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7c77fe640 1 -- 172.21.15.76:0/959433891 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7dc019040 con 0x55dc9f15a4a0 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7c77fe640 1 -- 172.21.15.76:0/959433891 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fc7d802cc20 con 0x55dc9f15a4a0 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 10 client.16701 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 20 client.16701 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f165680 0x55dc9f1e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 4 client.16701 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc9f0c7d60 con 0x55dc9f165680 2024-09-19T07:56:30.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.233+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f165680 0x55dc9f1e1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7e77fe640 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f165680 0x55dc9f1e1a80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f78b527dd98377f server_cookie=fd2caf7b0cbac208 in_seq=0 out_seq=0 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7c77fe640 10 client.16701 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7c77fe640 1 -- 172.21.15.76:0/959433891 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dc9f0c7d60 con 0x55dc9f165680 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7c77fe640 10 client.16701 handle_command_reply: tid=0 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 client.16701 shutdown 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 msgr2=0x55dc9f168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f168ce0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800be00 tx=0x7fc7d800b570 comp rx=0 tx=0).stop 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 shutdown_connections 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc9f15adc0 0x55dc9f1ddb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc9f165680 0x55dc9f1e1a80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc9f15a4a0 0x55dc9f168ce0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 --2- 172.21.15.76:0/959433891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc9f156a30 0x55dc9f1687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 >> 172.21.15.76:0/959433891 conn(0x55dc9f1628a0 msgr2=0x55dc9f160ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7c77fe640 0 client.16701 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 shutdown_connections 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 1 -- 172.21.15.76:0/959433891 wait complete. 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.234+0000 7fc7f0c5f740 20 client.16701 trim_cache size 0 max 16384 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:56:30.251 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7d00a33b0 msgr2=0x7fc7d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7d00a33b0 0x7fc7d00a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00b9500 tx=0x7fc7e002a950 comp rx=0 tx=0).stop 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 msgr2=0x7fc7e819efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e819efd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0005cc0 tx=0x7fc7e002f790 comp rx=0 tx=0).stop 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 shutdown_connections 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7d00a33b0 0x7fc7d00a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7e810c180 0x7fc7e819efd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e81036c0 0x7fc7e819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 --2- 172.21.15.76:0/714072783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7e8102da0 0x7fc7e819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:30.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 >> 172.21.15.76:0/714072783 conn(0x7fc7e80fc7a0 msgr2=0x7fc7e810d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:30.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 shutdown_connections 2024-09-19T07:56:30.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:30.235+0000 7fc7ee886640 1 -- 172.21.15.76:0/714072783 wait complete. 2024-09-19T07:56:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:29 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:56:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:29 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:29 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:56:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:29 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:29 smithi152 ceph-mon[35117]: pgmap v163: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:56:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:29 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:56:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:29 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:56:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:29 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:29 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:56:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:29 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:29 smithi137 ceph-mon[35309]: pgmap v163: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:56:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:29 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:56:31.019 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:56:31.019 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:56:31.275 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 -- 172.21.15.76:0/3565787490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe2810c180 msgr2=0x7fbe2810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3565787490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe2810c180 0x7fbe2810e610 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009900 tx=0x7fbe1802a480 comp rx=0 tx=0).stop 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 -- 172.21.15.76:0/3565787490 shutdown_connections 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3565787490 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe2810c180 0x7fbe2810e610 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3565787490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe28103700 0x7fbe2810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3565787490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe28102de0 0x7fbe281031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 -- 172.21.15.76:0/3565787490 >> 172.21.15.76:0/3565787490 conn(0x7fbe280fc7a0 msgr2=0x7fbe280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 -- 172.21.15.76:0/3565787490 shutdown_connections 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.794+0000 7fbe2d597640 1 -- 172.21.15.76:0/3565787490 wait complete. 2024-09-19T07:56:31.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 Processor -- start 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 -- start start 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe28102de0 0x7fbe28198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 0x7fbe281989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe2810c180 0x7fbe2819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281120e0 con 0x7fbe28103700 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe28111f60 con 0x7fbe2810c180 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe2d597640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbe28112260 con 0x7fbe28102de0 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe267fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 0x7fbe281989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe267fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 0x7fbe281989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37844/0 (socket says 172.21.15.76:37844) 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe267fc640 1 -- 172.21.15.76:0/3926312948 learned_addr learned my addr 172.21.15.76:0/3926312948 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe26ffd640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe28102de0 0x7fbe28198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.795+0000 7fbe277fe640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe2810c180 0x7fbe2819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:31.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe267fc640 1 -- 172.21.15.76:0/3926312948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe28102de0 msgr2=0x7fbe28198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe267fc640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe28102de0 0x7fbe28198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe267fc640 1 -- 172.21.15.76:0/3926312948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe2810c180 msgr2=0x7fbe2819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe267fc640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe2810c180 0x7fbe2819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe267fc640 1 -- 172.21.15.76:0/3926312948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2819d420 con 0x7fbe28103700 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe277fe640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe2810c180 0x7fbe2819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe267fc640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 0x7fbe281989b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000d950 tx=0x7fbe1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10017070 con 0x7fbe28103700 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2819d710 con 0x7fbe28103700 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe10009c30 con 0x7fbe28103700 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000f740 con 0x7fbe28103700 2024-09-19T07:56:31.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.796+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe281a4ff0 con 0x7fbe28103700 2024-09-19T07:56:31.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.797+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe281031c0 con 0x7fbe28103700 2024-09-19T07:56:31.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.798+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbe10010a80 con 0x7fbe28103700 2024-09-19T07:56:31.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.799+0000 7fbe1ffff640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbe140a3430 0x7fbe140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:31.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.799+0000 7fbe26ffd640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbe140a3430 0x7fbe140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:31.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.799+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fbe100cf9c0 con 0x7fbe28103700 2024-09-19T07:56:31.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.800+0000 7fbe26ffd640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbe140a3430 0x7fbe140a58f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005fd0 tx=0x7fbe20009680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:31.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:31.803+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe10009de0 con 0x7fbe28103700 2024-09-19T07:56:32.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.004+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe281a5220 con 0x7fbe28103700 2024-09-19T07:56:32.005 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:31 smithi076 ceph-mon[30930]: pgmap v164: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:56:32.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.005+0000 7fbe1ffff640 1 -- 172.21.15.76:0/3926312948 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11924 (secure 0 0 0) 0x7fbe1009c2e0 con 0x7fbe28103700 2024-09-19T07:56:32.005 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:56:32.005 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":31,"btime":"2024-09-19T07:54:33:600536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:54:32.750543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:56:32.006 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 31 2024-09-19T07:56:32.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbe140a3430 msgr2=0x7fbe140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:32.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbe140a3430 0x7fbe140a58f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005fd0 tx=0x7fbe20009680 comp rx=0 tx=0).stop 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 msgr2=0x7fbe281989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 0x7fbe281989b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000d950 tx=0x7fbe1000de10 comp rx=0 tx=0).stop 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 shutdown_connections 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbe140a3430 0x7fbe140a58f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe2810c180 0x7fbe2819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe28103700 0x7fbe281989b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 --2- 172.21.15.76:0/3926312948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe28102de0 0x7fbe28198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 >> 172.21.15.76:0/3926312948 conn(0x7fbe280fc7a0 msgr2=0x7fbe280fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 shutdown_connections 2024-09-19T07:56:32.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:32.007+0000 7fbe2d597640 1 -- 172.21.15.76:0/3926312948 wait complete. 2024-09-19T07:56:32.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:31 smithi152 ceph-mon[35117]: pgmap v164: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:56:32.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:31 smithi137 ceph-mon[35309]: pgmap v164: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:56:32.742 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:56:32.994 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:33.115 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:32 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3926312948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:33.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:32 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3926312948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:33.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:32 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3926312948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 -- 172.21.15.76:0/1596830260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec102d40 msgr2=0x7f0dec103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1596830260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec102d40 0x7f0dec103120 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009900 tx=0x7f0de002a480 comp rx=0 tx=0).stop 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 -- 172.21.15.76:0/1596830260 shutdown_connections 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1596830260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dec10c170 0x7f0dec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1596830260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec103660 0x7f0dec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1596830260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec102d40 0x7f0dec103120 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 -- 172.21.15.76:0/1596830260 >> 172.21.15.76:0/1596830260 conn(0x7f0dec0fc7a0 msgr2=0x7f0dec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 -- 172.21.15.76:0/1596830260 shutdown_connections 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.471+0000 7f0df14d6640 1 -- 172.21.15.76:0/1596830260 wait complete. 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.472+0000 7f0df14d6640 1 Processor -- start 2024-09-19T07:56:33.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.472+0000 7f0df14d6640 1 -- start start 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.472+0000 7f0df14d6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dec102d40 0x7f0dec198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.472+0000 7f0df14d6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 0x7f0dec198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0df14d6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec10c170 0x7f0dec19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0df14d6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec112090 con 0x7f0dec103660 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0df14d6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec111f10 con 0x7f0dec102d40 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0df14d6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec112210 con 0x7f0dec10c170 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 0x7f0dec198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 0x7f0dec198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37434/0 (socket says 172.21.15.76:37434) 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 -- 172.21.15.76:0/1163990819 learned_addr learned my addr 172.21.15.76:0/1163990819 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dec102d40 0x7f0dec198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec10c170 0x7f0dec19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 -- 172.21.15.76:0/1163990819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec10c170 msgr2=0x7f0dec19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec10c170 0x7f0dec19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 -- 172.21.15.76:0/1163990819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dec102d40 msgr2=0x7f0dec198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dec102d40 0x7f0dec198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 -- 172.21.15.76:0/1163990819 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec19d4c0 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec10c170 0x7f0dec19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 0x7f0dec198a50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00d750 tx=0x7f0ddc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dd3fff640 1 -- 172.21.15.76:0/1163990819 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc017070 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec19d7b0 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dd3fff640 1 -- 172.21.15.76:0/1163990819 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ddc005020 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0dd3fff640 1 -- 172.21.15.76:0/1163990819 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc004dd0 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.473+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec1a5090 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.475+0000 7f0dd3fff640 1 -- 172.21.15.76:0/1163990819 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0ddc0051d0 con 0x7f0dec103660 2024-09-19T07:56:33.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 Processor -- start 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 -- start start 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0dd3fff640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0dd40a33b0 0x7f0dd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 0x5645f9c37090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c37a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c42370 0x5645f9c44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5645f9b9d2f0 con 0x5645f9c38b40 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5645f9b44cf0 con 0x5645f9c375d0 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0df38af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5645f9b992b0 con 0x5645f9c42370 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 0x5645f9c37090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 0x5645f9c37090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37438/0 (socket says 172.21.15.76:37438) 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0dd40a33b0 0x7f0dd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0deaffd640 1 -- 172.21.15.76:0/1155061736 learned_addr learned my addr 172.21.15.76:0/1155061736 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:33.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.476+0000 7f0dd3fff640 1 -- 172.21.15.76:0/1163990819 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0ddc0cf760 con 0x7f0dec103660 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c37a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deaffd640 1 -- 172.21.15.76:0/1155061736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c42370 msgr2=0x5645f9c44760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c42370 0x5645f9c44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deaffd640 1 -- 172.21.15.76:0/1155061736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 msgr2=0x5645f9c37a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c37a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deaffd640 1 -- 172.21.15.76:0/1155061736 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f9b293a0 con 0x5645f9c38b40 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0dd40a33b0 0x7f0dd40a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005fd0 tx=0x7f0de400e6c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 0x5645f9c37090 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009900 tx=0x7f0de0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0e016e84ca53b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0dd17fa640 1 -- 172.21.15.76:0/1155061736 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0040070 con 0x5645f9c38b40 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0dd17fa640 1 -- 172.21.15.76:0/1155061736 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0de0031a00 con 0x5645f9c38b40 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.477+0000 7f0dd17fa640 1 -- 172.21.15.76:0/1155061736 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0035040 con 0x5645f9c38b40 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- 172.21.15.76:0/1155061736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 msgr2=0x5645f9c37090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 0x5645f9c37090 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009900 tx=0x7f0de0005c00 comp rx=0 tx=0).stop 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- 172.21.15.76:0/1155061736 shutdown_connections 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c42370 0x5645f9c44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- 172.21.15.76:0/1155061736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c38b40 0x5645f9c37090 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- 172.21.15.76:0/1155061736 >> 172.21.15.76:0/1155061736 conn(0x5645f9c00310 msgr2=0x5645f9c33c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- 172.21.15.76:0/1155061736 shutdown_connections 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- 172.21.15.76:0/1155061736 wait complete. 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- start start 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 Processor -- start 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c41be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c38b40 0x5645f9c3ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c3f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5645f9c45010 con 0x5645f9c42370 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5645f9b58060 con 0x5645f9c375d0 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.478+0000 7f0df38af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5645f9c45190 con 0x5645f9c38b40 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0df38af740 10 client.0 _ll_register_callbacks cb 0x5645f98ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c3f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c3f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37450/0 (socket says 172.21.15.76:37450) 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3975753689 learned_addr learned my addr 172.21.15.76:0/3975753689 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deaffd640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c41be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c38b40 0x5645f9c3ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c38b40 msgr2=0x5645f9c3ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c38b40 0x5645f9c3ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3975753689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 msgr2=0x5645f9c41be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c41be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3975753689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f990e3c0 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deaffd640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c41be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c3f3d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f0de4011bd0 tx=0x7f0de4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c59d1c2c85650f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0dceff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0dceff5640 1 -- 172.21.15.76:0/3975753689 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4012b50 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0dceff5640 1 -- 172.21.15.76:0/3975753689 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0de4012cf0 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de0031a00 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0dceff5640 1 -- 172.21.15.76:0/3975753689 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0de402c050 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0df38af740 10 client.16719 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5645f9c509f0 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.479+0000 7f0dceff5640 1 -- 172.21.15.76:0/3975753689 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0de0031a00 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0dceff5640 1 -- 172.21.15.76:0/3975753689 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0de400f040 con 0x5645f9c42370 2024-09-19T07:56:33.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0df38af740 10 client.16719 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0df38af740 10 client.16719 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0df38af740 20 client.16719 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0df38af740 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9c51f00 0x5645f9c54370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0df38af740 4 client.16719 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645f9baa860 con 0x5645f9c51f00 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0deaffd640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9c51f00 0x5645f9c54370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0dceff5640 10 client.16719 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.480+0000 7f0deaffd640 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9c51f00 0x5645f9c54370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=206d99eaf57221d8 server_cookie=80206f57225c031e in_seq=0 out_seq=0 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0dceff5640 1 -- 172.21.15.76:0/3975753689 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645f9baa860 con 0x5645f9c51f00 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0dceff5640 10 client.16719 handle_command_reply: tid=0 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 client.16719 shutdown 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 msgr2=0x5645f9c3f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c3f3d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f0de4011bd0 tx=0x7f0de4004a40 comp rx=0 tx=0).stop 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 shutdown_connections 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9c51f00 0x5645f9c54370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c3f3d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0dceff5640 0 client.16719 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c38b40 0x5645f9c3ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 --2- 172.21.15.76:0/3975753689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c375d0 0x5645f9c41be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 >> 172.21.15.76:0/3975753689 conn(0x5645f9c00310 msgr2=0x5645f9c39960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 shutdown_connections 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 1 -- 172.21.15.76:0/3975753689 wait complete. 2024-09-19T07:56:33.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.481+0000 7f0df38af740 20 client.16719 trim_cache size 0 max 16384 2024-09-19T07:56:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.494+0000 7f0df38af740 1 Processor -- start 2024-09-19T07:56:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.494+0000 7f0df38af740 1 -- start start 2024-09-19T07:56:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0df38af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c3a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0df38af740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0df38af740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c59c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0df38af740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1b04b0 con 0x5645f9c42370 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0df38af740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1adcc0 con 0x5645f9c38b40 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0df38af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1abb10 con 0x5645f9c375d0 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c59c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c59c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37452/0 (socket says 172.21.15.76:37452) 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3412101796 learned_addr learned my addr 172.21.15.76:0/3412101796 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deaffd640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c3a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3412101796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 msgr2=0x5645f9c3a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c3a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3412101796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 msgr2=0x5645f9c3a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c3a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 -- 172.21.15.76:0/3412101796 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f9c341a0 con 0x5645f9c42370 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deaffd640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c3a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c59c40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0de4011800 tx=0x7f0de4011830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147887b8184ab9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0dd0ff9640 1 -- 172.21.15.76:0/3412101796 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4004b60 con 0x5645f9c42370 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0dd0ff9640 1 -- 172.21.15.76:0/3412101796 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0de4018070 con 0x5645f9c42370 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.495+0000 7f0dd0ff9640 1 -- 172.21.15.76:0/3412101796 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de401fe30 con 0x5645f9c42370 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 -- 172.21.15.76:0/3412101796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 msgr2=0x5645f9c59c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c59c40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0de4011800 tx=0x7f0de4011830 comp rx=0 tx=0).stop 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 -- 172.21.15.76:0/3412101796 shutdown_connections 2024-09-19T07:56:33.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c59c40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c3a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 --2- 172.21.15.76:0/3412101796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c3a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 -- 172.21.15.76:0/3412101796 >> 172.21.15.76:0/3412101796 conn(0x5645f9c00310 msgr2=0x5645f9c40f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 -- 172.21.15.76:0/3412101796 shutdown_connections 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 -- 172.21.15.76:0/3412101796 wait complete. 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.496+0000 7f0df38af740 1 -- start start 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 Processor -- start 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c4ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c46090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ac180 con 0x5645f9c42370 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ad5f0 con 0x5645f9c38b40 2024-09-19T07:56:33.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ac850 con 0x5645f9c375d0 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0df38af740 10 client.0 _ll_register_callbacks cb 0x7f0de40118d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37458/0 (socket says 172.21.15.76:37458) 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 -- 172.21.15.76:0/1277219564 learned_addr learned my addr 172.21.15.76:0/1277219564 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0dea7fc640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c46090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c4ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 -- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 msgr2=0x5645f9c4ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c4ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 -- 172.21.15.76:0/1277219564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 msgr2=0x5645f9c46090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c46090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 -- 172.21.15.76:0/1277219564 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f9c34960 con 0x5645f9c42370 2024-09-19T07:56:33.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0deb7fe640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c467d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0de4004940 tx=0x7f0de4012e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428b9b75ace95b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.497+0000 7f0dceff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0dceff5640 1 -- 172.21.15.76:0/1277219564 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de401f6d0 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0dceff5640 1 -- 172.21.15.76:0/1277219564 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0de401f870 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de4018070 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0dceff5640 1 -- 172.21.15.76:0/1277219564 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0de403b460 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 10 client.16725 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5645f9cbcb50 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0dceff5640 1 -- 172.21.15.76:0/1277219564 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0de4018070 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0dceff5640 1 -- 172.21.15.76:0/1277219564 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0de402f040 con 0x5645f9c42370 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 10 client.16725 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 10 client.16725 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 20 client.16725 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9cbd1b0 0x5645f9cbf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:33.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 4 client.16725 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645f9ba4d70 con 0x5645f9cbd1b0 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.498+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9cbd1b0 0x5645f9cbf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0deaffd640 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9cbd1b0 0x5645f9cbf5d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=102aee8c247aeab4 server_cookie=10d0e09e3f525c38 in_seq=0 out_seq=0 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0dceff5640 10 client.16725 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0dceff5640 1 -- 172.21.15.76:0/1277219564 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645f9ba4d70 con 0x5645f9cbd1b0 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0dceff5640 10 client.16725 handle_command_reply: tid=0 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 client.16725 shutdown 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 msgr2=0x5645f9c467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c467d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0de4004940 tx=0x7f0de4012e20 comp rx=0 tx=0).stop 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 shutdown_connections 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5645f9cbd1b0 0x5645f9cbf5d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5645f9c42370 0x5645f9c467d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645f9c38b40 0x5645f9c46090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 --2- 172.21.15.76:0/1277219564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5645f9c375d0 0x5645f9c4ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0dceff5640 0 client.16725 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 >> 172.21.15.76:0/1277219564 conn(0x5645f9c00310 msgr2=0x5645f9c324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 shutdown_connections 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 1 -- 172.21.15.76:0/1277219564 wait complete. 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.499+0000 7f0df38af740 20 client.16725 trim_cache size 0 max 16384 2024-09-19T07:56:33.511 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:33.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0dd40a33b0 msgr2=0x7f0dd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0dd40a33b0 0x7f0dd40a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005fd0 tx=0x7f0de400e6c0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 msgr2=0x7f0dec198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:33.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 0x7f0dec198a50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00d750 tx=0x7f0ddc00dc10 comp rx=0 tx=0).stop 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 shutdown_connections 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0dd40a33b0 0x7f0dd40a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec10c170 0x7f0dec19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0dec103660 0x7f0dec198a50 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 --2- 172.21.15.76:0/1163990819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dec102d40 0x7f0dec198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 >> 172.21.15.76:0/1163990819 conn(0x7f0dec0fc7a0 msgr2=0x7f0dec0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 shutdown_connections 2024-09-19T07:56:33.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:33.500+0000 7f0df14d6640 1 -- 172.21.15.76:0/1163990819 wait complete. 2024-09-19T07:56:34.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:33 smithi076 ceph-mon[30930]: pgmap v165: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:34.281 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:56:34.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:33 smithi152 ceph-mon[35117]: pgmap v165: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:33 smithi137 ceph-mon[35309]: pgmap v165: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:34.527 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:35.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 -- 172.21.15.76:0/3564309013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c106a80 msgr2=0x7f246c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 --2- 172.21.15.76:0/3564309013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c106a80 0x7f246c106e60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f245c009930 tx=0x7f245c02a420 comp rx=0 tx=0).stop 2024-09-19T07:56:35.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 -- 172.21.15.76:0/3564309013 shutdown_connections 2024-09-19T07:56:35.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 --2- 172.21.15.76:0/3564309013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f246c101420 0x7f246c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 --2- 172.21.15.76:0/3564309013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f246c100a80 0x7f246c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 --2- 172.21.15.76:0/3564309013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c106a80 0x7f246c106e60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 -- 172.21.15.76:0/3564309013 >> 172.21.15.76:0/3564309013 conn(0x7f246c0fc7a0 msgr2=0x7f246c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 -- 172.21.15.76:0/3564309013 shutdown_connections 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.055+0000 7f2470b2a640 1 -- 172.21.15.76:0/3564309013 wait complete. 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 Processor -- start 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 -- start start 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f246c100a80 0x7f246c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 0x7f246c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f246c106a80 0x7f246c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f246c110f60 con 0x7f246c101420 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f246c110de0 con 0x7f246c106a80 2024-09-19T07:56:35.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2470b2a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1110e0 con 0x7f246c100a80 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 0x7f246c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 0x7f246c197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37486/0 (socket says 172.21.15.76:37486) 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 -- 172.21.15.76:0/1161796898 learned_addr learned my addr 172.21.15.76:0/1161796898 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f246a59c640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f246c100a80 0x7f246c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f246ad9d640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f246c106a80 0x7f246c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 -- 172.21.15.76:0/1161796898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f246c100a80 msgr2=0x7f246c197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f246c100a80 0x7f246c197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 -- 172.21.15.76:0/1161796898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f246c106a80 msgr2=0x7f246c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f246c106a80 0x7f246c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.056+0000 7f2469d9b640 1 -- 172.21.15.76:0/1161796898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c19c3d0 con 0x7f246c101420 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.057+0000 7f2469d9b640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 0x7f246c197960 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f246000d950 tx=0x7f246000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.057+0000 7f245b7fe640 1 -- 172.21.15.76:0/1161796898 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460017070 con 0x7f246c101420 2024-09-19T07:56:35.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.057+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246c19c6c0 con 0x7f246c101420 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.057+0000 7f245b7fe640 1 -- 172.21.15.76:0/1161796898 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2460009c30 con 0x7f246c101420 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.057+0000 7f245b7fe640 1 -- 172.21.15.76:0/1161796898 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246000f740 con 0x7f246c101420 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.057+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246c1a3fa0 con 0x7f246c101420 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.059+0000 7f245b7fe640 1 -- 172.21.15.76:0/1161796898 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2460010a80 con 0x7f246c101420 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.059+0000 7f2472f03740 1 Processor -- start 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.059+0000 7f2472f03740 1 -- start start 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f245b7fe640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24540a33b0 0x7f24540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2472f03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfd4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2472f03740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfd4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2472f03740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 0x55d8fcfe3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2472f03740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d8fcf3a2f0 con 0x55d8fcfe1580 2024-09-19T07:56:35.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2472f03740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8fcee1cf0 con 0x55d8fcfd45d0 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2472f03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d8fcf362b0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24540a33b0 0x7f24540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 0x55d8fcfe3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f245b7fe640 1 -- 172.21.15.76:0/1161796898 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f24600cfa80 con 0x7f246c101420 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 0x55d8fcfe3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37494/0 (socket says 172.21.15.76:37494) 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 -- 172.21.15.76:0/844328883 learned_addr learned my addr 172.21.15.76:0/844328883 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f2469d9b640 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfd4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246a59c640 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfd4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 -- 172.21.15.76:0/844328883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfd5b40 msgr2=0x55d8fcfd4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfd4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 -- 172.21.15.76:0/844328883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 msgr2=0x55d8fcfd4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfd4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 -- 172.21.15.76:0/844328883 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8fcec63a0 con 0x55d8fcfe1580 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24540a33b0 0x7f24540a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2464013b30 tx=0x7f246400bd10 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.060+0000 7f246ad9d640 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 0x55d8fcfe3970 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2464010d30 tx=0x7f246401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9159c190720145e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2458ff9640 1 -- 172.21.15.76:0/844328883 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464021070 con 0x55d8fcfe1580 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2458ff9640 1 -- 172.21.15.76:0/844328883 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f246400ee50 con 0x55d8fcfe1580 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2458ff9640 1 -- 172.21.15.76:0/844328883 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640044e0 con 0x55d8fcfe1580 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 -- 172.21.15.76:0/844328883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 msgr2=0x55d8fcfe3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 0x55d8fcfe3970 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2464010d30 tx=0x7f246401a000 comp rx=0 tx=0).stop 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 -- 172.21.15.76:0/844328883 shutdown_connections 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfe1580 0x55d8fcfe3970 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfd4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 --2- 172.21.15.76:0/844328883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfd4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.061+0000 7f2472f03740 1 -- 172.21.15.76:0/844328883 >> 172.21.15.76:0/844328883 conn(0x55d8fcf9d310 msgr2=0x55d8fcfd0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:35.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 -- 172.21.15.76:0/844328883 shutdown_connections 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 -- 172.21.15.76:0/844328883 wait complete. 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 -- start start 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 Processor -- start 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfde220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfde810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d8fcfe4220 con 0x55d8fcfd45d0 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8fcef5060 con 0x55d8fcfd5b40 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d8fcfe43a0 con 0x55d8fcfe1580 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2472f03740 10 client.0 _ll_register_callbacks cb 0x55d8fcc488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f246a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f246a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37496/0 (socket says 172.21.15.76:37496) 2024-09-19T07:56:35.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f246a59c640 1 -- 172.21.15.76:0/2360756706 learned_addr learned my addr 172.21.15.76:0/2360756706 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f246ad9d640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfde810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.062+0000 7f2469d9b640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfde220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246a59c640 1 -- 172.21.15.76:0/2360756706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 msgr2=0x55d8fcfde810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246a59c640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfde810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246a59c640 1 -- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd5b40 msgr2=0x55d8fcfde220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246a59c640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfde220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246a59c640 1 -- 172.21.15.76:0/2360756706 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8fccab3c0 con 0x55d8fcfd45d0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246ad9d640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfde810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f246a59c640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe0f70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f245c009930 tx=0x7f245c031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8515323f50d91743 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2451ffb640 1 -- 172.21.15.76:0/2360756706 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c03f070 con 0x55d8fcfd45d0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f246400ee50 con 0x55d8fcfd45d0 2024-09-19T07:56:35.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2451ffb640 1 -- 172.21.15.76:0/2360756706 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f245c004450 con 0x55d8fcfd45d0 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2451ffb640 1 -- 172.21.15.76:0/2360756706 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f245c035070 con 0x55d8fcfd45d0 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2472f03740 10 client.16737 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d8fcfefd60 con 0x55d8fcfd45d0 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2451ffb640 1 -- 172.21.15.76:0/2360756706 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f246400ee50 con 0x55d8fcfd45d0 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2451ffb640 1 -- 172.21.15.76:0/2360756706 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f245c004c20 con 0x55d8fcfd45d0 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2472f03740 10 client.16737 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.063+0000 7f2472f03740 10 client.16737 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2472f03740 20 client.16737 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2472f03740 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fcff1170 0x55d8fcff35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2472f03740 4 client.16737 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8fcf47860 con 0x55d8fcff1170 2024-09-19T07:56:35.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2469d9b640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fcff1170 0x55d8fcff35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2469d9b640 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fcff1170 0x55d8fcff35a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5889eebc2d3298f server_cookie=ef7029419b8c392c in_seq=0 out_seq=0 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.064+0000 7f2451ffb640 10 client.16737 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2451ffb640 1 -- 172.21.15.76:0/2360756706 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8fcf47860 con 0x55d8fcff1170 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2451ffb640 10 client.16737 handle_command_reply: tid=0 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 client.16737 shutdown 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 msgr2=0x55d8fcfe0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe0f70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f245c009930 tx=0x7f245c031870 comp rx=0 tx=0).stop 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 shutdown_connections 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fcff1170 0x55d8fcff35a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfde810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfde220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2451ffb640 0 client.16737 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 --2- 172.21.15.76:0/2360756706 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe0f70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 >> 172.21.15.76:0/2360756706 conn(0x55d8fcf9d310 msgr2=0x55d8fcfd6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:35.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 shutdown_connections 2024-09-19T07:56:35.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 1 -- 172.21.15.76:0/2360756706 wait complete. 2024-09-19T07:56:35.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.065+0000 7f2472f03740 20 client.16737 trim_cache size 0 max 16384 2024-09-19T07:56:35.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 Processor -- start 2024-09-19T07:56:35.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 -- start start 2024-09-19T07:56:35.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfed510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcff8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcff93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1ae320 con 0x55d8fcfd5b40 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1abb30 con 0x55d8fcfd45d0 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2472f03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1a9980 con 0x55d8fcfe1580 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2469d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcff8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2469d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcff8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37508/0 (socket says 172.21.15.76:37508) 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2469d9b640 1 -- 172.21.15.76:0/321170768 learned_addr learned my addr 172.21.15.76:0/321170768 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f246a59c640 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f246ad9d640 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcff93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2469d9b640 1 -- 172.21.15.76:0/321170768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 msgr2=0x55d8fcff93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.078+0000 7f2469d9b640 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcff93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2469d9b640 1 -- 172.21.15.76:0/321170768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 msgr2=0x55d8fcfed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2469d9b640 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfed510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2469d9b640 1 -- 172.21.15.76:0/321170768 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8fcfd4be0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f246a59c640 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2469d9b640 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcff8e70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2460009610 tx=0x7f246009bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9a03d2f47d765a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2453fff640 1 -- 172.21.15.76:0/321170768 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460020040 con 0x55d8fcfd5b40 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2453fff640 1 -- 172.21.15.76:0/321170768 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24600a00b0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2453fff640 1 -- 172.21.15.76:0/321170768 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24600b6f60 con 0x55d8fcfd5b40 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2472f03740 1 -- 172.21.15.76:0/321170768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 msgr2=0x55d8fcff8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.079+0000 7f2472f03740 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcff8e70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2460009610 tx=0x7f246009bbf0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- 172.21.15.76:0/321170768 shutdown_connections 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcff93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcff8e70 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 --2- 172.21.15.76:0/321170768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- 172.21.15.76:0/321170768 >> 172.21.15.76:0/321170768 conn(0x55d8fcf9d310 msgr2=0x55d8fcfd9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- 172.21.15.76:0/321170768 shutdown_connections 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- 172.21.15.76:0/321170768 wait complete. 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- start start 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 Processor -- start 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfdb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfdb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1a9ff0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1ab460 con 0x55d8fcfd45d0 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f246c1aa6c0 con 0x55d8fcfe1580 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2472f03740 10 client.0 _ll_register_callbacks cb 0x7f245c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2469d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfdb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2469d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfdb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37522/0 (socket says 172.21.15.76:37522) 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f2469d9b640 1 -- 172.21.15.76:0/2267295546 learned_addr learned my addr 172.21.15.76:0/2267295546 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.080+0000 7f246ad9d640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfdb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f246a59c640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2469d9b640 1 -- 172.21.15.76:0/2267295546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 msgr2=0x55d8fcfdb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2469d9b640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfdb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2469d9b640 1 -- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 msgr2=0x55d8fcfe9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2469d9b640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2469d9b640 1 -- 172.21.15.76:0/2267295546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8fd05ae40 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f246ad9d640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfdb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2469d9b640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfdb0c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f24600cd220 tx=0x7f24600a49e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23759684ec03f778 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2451ffb640 1 -- 172.21.15.76:0/2267295546 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460020070 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2451ffb640 1 -- 172.21.15.76:0/2267295546 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f2460098370 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24600a00b0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2451ffb640 1 -- 172.21.15.76:0/2267295546 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2460065050 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2472f03740 10 client.16743 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d8fd05bfd0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.081+0000 7f2451ffb640 1 -- 172.21.15.76:0/2267295546 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24600a00b0 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2451ffb640 1 -- 172.21.15.76:0/2267295546 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f24600a1240 con 0x55d8fcfd5b40 2024-09-19T07:56:35.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 10 client.16743 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 10 client.16743 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 20 client.16743 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fd05c6a0 0x55d8fd05eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 4 client.16743 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8fcf41d70 con 0x55d8fd05c6a0 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f246a59c640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fd05c6a0 0x55d8fd05eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2451ffb640 10 client.16743 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f246a59c640 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fd05c6a0 0x55d8fd05eac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4ed4a6129a74d04e server_cookie=a87b65d058c79822 in_seq=0 out_seq=0 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2451ffb640 1 -- 172.21.15.76:0/2267295546 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8fcf41d70 con 0x55d8fd05c6a0 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2451ffb640 10 client.16743 handle_command_reply: tid=0 2024-09-19T07:56:35.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.082+0000 7f2472f03740 1 client.16743 shutdown 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 msgr2=0x55d8fcfdb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfdb0c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f24600cd220 tx=0x7f24600a49e0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 shutdown_connections 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d8fd05c6a0 0x55d8fd05eac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d8fcfe1580 0x55d8fcfdb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d8fcfd5b40 0x55d8fcfdb0c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2451ffb640 0 client.16743 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:56:35.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 --2- 172.21.15.76:0/2267295546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8fcfd45d0 0x55d8fcfe9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 >> 172.21.15.76:0/2267295546 conn(0x55d8fcf9d310 msgr2=0x55d8fcfcf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:35.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 shutdown_connections 2024-09-19T07:56:35.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 1 -- 172.21.15.76:0/2267295546 wait complete. 2024-09-19T07:56:35.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2472f03740 20 client.16743 trim_cache size 0 max 16384 2024-09-19T07:56:35.097 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24540a33b0 msgr2=0x7f24540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2470b2a640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24540a33b0 0x7f24540a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2464013b30 tx=0x7f246400bd10 comp rx=0 tx=0).stop 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 msgr2=0x7f246c197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.083+0000 7f2470b2a640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 0x7f246c197960 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f246000d950 tx=0x7f246000de10 comp rx=0 tx=0).stop 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 shutdown_connections 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f24540a33b0 0x7f24540a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f246c106a80 0x7f246c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f246c101420 0x7f246c197960 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 --2- 172.21.15.76:0/1161796898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f246c100a80 0x7f246c197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:35.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 >> 172.21.15.76:0/1161796898 conn(0x7f246c0fc7a0 msgr2=0x7f246c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:35.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 shutdown_connections 2024-09-19T07:56:35.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:35.084+0000 7f2470b2a640 1 -- 172.21.15.76:0/1161796898 wait complete. 2024-09-19T07:56:35.891 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:56:36.140 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:36.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:35 smithi076 ceph-mon[30930]: pgmap v166: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:36.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:35 smithi152 ceph-mon[35117]: pgmap v166: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:36.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:35 smithi137 ceph-mon[35309]: pgmap v166: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:36.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 -- 172.21.15.76:0/605930614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c1036c0 msgr2=0x7f0b5c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 --2- 172.21.15.76:0/605930614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c1036c0 0x7f0b5c10bbb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009900 tx=0x7f0b4402a480 comp rx=0 tx=0).stop 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 -- 172.21.15.76:0/605930614 shutdown_connections 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 --2- 172.21.15.76:0/605930614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5c10c180 0x7f0b5c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 --2- 172.21.15.76:0/605930614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c1036c0 0x7f0b5c10bbb0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 --2- 172.21.15.76:0/605930614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c102da0 0x7f0b5c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 -- 172.21.15.76:0/605930614 >> 172.21.15.76:0/605930614 conn(0x7f0b5c0fc7a0 msgr2=0x7f0b5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 -- 172.21.15.76:0/605930614 shutdown_connections 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.643+0000 7f0b621ea640 1 -- 172.21.15.76:0/605930614 wait complete. 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 Processor -- start 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 -- start start 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 0x7f0b5c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c1036c0 0x7f0b5c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5c10c180 0x7f0b5c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1120e0 con 0x7f0b5c102da0 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c111f60 con 0x7f0b5c10c180 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b621ea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c112260 con 0x7f0b5c1036c0 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 0x7f0b5c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.644+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 0x7f0b5c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37542/0 (socket says 172.21.15.76:37542) 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/2187977493 learned_addr learned my addr 172.21.15.76:0/2187977493 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b53fff640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c1036c0 0x7f0b5c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5c10c180 0x7f0b5c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/2187977493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c1036c0 msgr2=0x7f0b5c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c1036c0 0x7f0b5c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/2187977493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5c10c180 msgr2=0x7f0b5c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5c10c180 0x7f0b5c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/2187977493 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c19d490 con 0x7f0b5c102da0 2024-09-19T07:56:36.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 0x7f0b5c1984e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00c920 tx=0x7f0b4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b597fa640 1 -- 172.21.15.76:0/2187977493 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c007c70 con 0x7f0b5c102da0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c19d780 con 0x7f0b5c102da0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b597fa640 1 -- 172.21.15.76:0/2187977493 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b4c007e10 con 0x7f0b5c102da0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b597fa640 1 -- 172.21.15.76:0/2187977493 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c018940 con 0x7f0b5c102da0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.645+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c1a5060 con 0x7f0b5c102da0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.647+0000 7f0b597fa640 1 -- 172.21.15.76:0/2187977493 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0b4c018b20 con 0x7f0b5c102da0 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 Processor -- start 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 -- start start 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5558f5e802f0 con 0x5558f5f25370 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5558f5e27cf0 con 0x5558f5f1bb40 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b645c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5558f5e7c2b0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b53fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b53fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f27760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37546/0 (socket says 172.21.15.76:37546) 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b53fff640 1 -- 172.21.15.76:0/731064748 learned_addr learned my addr 172.21.15.76:0/731064748 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b597fa640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b480a33b0 0x7f0b480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.648+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b480a33b0 0x7f0b480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b597fa640 1 -- 172.21.15.76:0/2187977493 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0b4c0cfe50 con 0x7f0b5c102da0 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b53fff640 1 -- 172.21.15.76:0/731064748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 msgr2=0x5558f5f1aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b53fff640 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f1aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b53fff640 1 -- 172.21.15.76:0/731064748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 msgr2=0x5558f5f1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b53fff640 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b53fff640 1 -- 172.21.15.76:0/731064748 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f5e0c3a0 con 0x5558f5f25370 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b53fff640 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f27760 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009900 tx=0x7f0b44031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b03b77155f2cabb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b480a33b0 0x7f0b480a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009900 tx=0x7f0b54009650 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b51ffb640 1 -- 172.21.15.76:0/731064748 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44040070 con 0x5558f5f25370 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b51ffb640 1 -- 172.21.15.76:0/731064748 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b44005020 con 0x5558f5f25370 2024-09-19T07:56:36.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.649+0000 7f0b51ffb640 1 -- 172.21.15.76:0/731064748 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44035040 con 0x5558f5f25370 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 -- 172.21.15.76:0/731064748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 msgr2=0x5558f5f27760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f27760 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009900 tx=0x7f0b44031770 comp rx=0 tx=0).stop 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 -- 172.21.15.76:0/731064748 shutdown_connections 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f27760 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f1aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 --2- 172.21.15.76:0/731064748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 -- 172.21.15.76:0/731064748 >> 172.21.15.76:0/731064748 conn(0x5558f5ee3310 msgr2=0x5558f5f16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 -- 172.21.15.76:0/731064748 shutdown_connections 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 -- 172.21.15.76:0/731064748 wait complete. 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 -- start start 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.650+0000 7f0b645c3740 1 Processor -- start 2024-09-19T07:56:36.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f24cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f21f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f224e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5558f5f28010 con 0x5558f5f25370 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5558f5e3b060 con 0x5558f5f1bb40 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5558f5f28190 con 0x5558f5f1a5d0 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 10 client.0 _ll_register_callbacks cb 0x5558f5b8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37562/0 (socket says 172.21.15.76:37562) 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 -- 172.21.15.76:0/4036187499 learned_addr learned my addr 172.21.15.76:0/4036187499 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:36.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b53fff640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f21f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f24cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 -- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 msgr2=0x5558f5f24cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f24cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 -- 172.21.15.76:0/4036187499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 msgr2=0x5558f5f21f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f21f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 -- 172.21.15.76:0/4036187499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f5bf13c0 con 0x5558f5f25370 2024-09-19T07:56:36.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f24cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b53fff640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f21f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f224e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009b70 tx=0x7f0b54004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d7fa3f557e3382 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b3affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b3affd640 1 -- 172.21.15.76:0/4036187499 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5402a060 con 0x5558f5f25370 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b3affd640 1 -- 172.21.15.76:0/4036187499 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0b5401a9e0 con 0x5558f5f25370 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b44005020 con 0x5558f5f25370 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.651+0000 7f0b3affd640 1 -- 172.21.15.76:0/4036187499 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b54014040 con 0x5558f5f25370 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 10 client.16755 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5558f5f33a80 con 0x5558f5f25370 2024-09-19T07:56:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b3affd640 1 -- 172.21.15.76:0/4036187499 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b44005020 con 0x5558f5f25370 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b3affd640 1 -- 172.21.15.76:0/4036187499 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0b5402d410 con 0x5558f5f25370 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 10 client.16755 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 20 client.16755 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5f34f40 0x5558f5f37400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 4 client.16755 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558f5e8d860 con 0x5558f5f34f40 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.652+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5f34f40 0x5558f5f37400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.653+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5f34f40 0x5558f5f37400 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a423a601304334d8 server_cookie=b54f3fb9f68760ef in_seq=0 out_seq=0 2024-09-19T07:56:36.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.653+0000 7f0b3affd640 10 client.16755 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b3affd640 1 -- 172.21.15.76:0/4036187499 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558f5e8d860 con 0x5558f5f34f40 2024-09-19T07:56:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b3affd640 10 client.16755 handle_command_reply: tid=0 2024-09-19T07:56:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 client.16755 shutdown 2024-09-19T07:56:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 msgr2=0x5558f5f224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f224e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009b70 tx=0x7f0b54004b50 comp rx=0 tx=0).stop 2024-09-19T07:56:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 shutdown_connections 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5f34f40 0x5558f5f37400 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f25370 0x5558f5f224e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f21f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 --2- 172.21.15.76:0/4036187499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1a5d0 0x5558f5f24cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b3affd640 0 client.16755 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 >> 172.21.15.76:0/4036187499 conn(0x5558f5ee3310 msgr2=0x5558f5f1c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 shutdown_connections 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 1 -- 172.21.15.76:0/4036187499 wait complete. 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.654+0000 7f0b645c3740 20 client.16755 trim_cache size 0 max 16384 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 Processor -- start 2024-09-19T07:56:36.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 -- start start 2024-09-19T07:56:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f23ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1bb40 0x5558f5f26760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f25370 0x5558f5f26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1b0400 con 0x5558f5f1a5d0 2024-09-19T07:56:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1adc10 con 0x5558f5f25370 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b645c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1aba60 con 0x5558f5f1bb40 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f23ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f23ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37568/0 (socket says 172.21.15.76:37568) 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.667+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/665294320 learned_addr learned my addr 172.21.15.76:0/665294320 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b53fff640 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1bb40 0x5558f5f26760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/665294320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1bb40 msgr2=0x5558f5f26760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1bb40 0x5558f5f26760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f25370 0x5558f5f26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/665294320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f25370 msgr2=0x5558f5f26ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f25370 0x5558f5f26ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/665294320 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f5f16ed0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5bfff640 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f25370 0x5558f5f26ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f23ef0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c09bdd0 tx=0x7f0b4c0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b488c7122d71b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b517fa640 1 -- 172.21.15.76:0/665294320 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c018e10 con 0x5558f5f1a5d0 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b517fa640 1 -- 172.21.15.76:0/665294320 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b4c09a3d0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.668+0000 7f0b517fa640 1 -- 172.21.15.76:0/665294320 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0a0240 con 0x5558f5f1a5d0 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 -- 172.21.15.76:0/665294320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 msgr2=0x5558f5f23ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f23ef0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c09bdd0 tx=0x7f0b4c0bc040 comp rx=0 tx=0).stop 2024-09-19T07:56:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 -- 172.21.15.76:0/665294320 shutdown_connections 2024-09-19T07:56:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f25370 0x5558f5f26ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f1bb40 0x5558f5f26760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 --2- 172.21.15.76:0/665294320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f23ef0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 -- 172.21.15.76:0/665294320 >> 172.21.15.76:0/665294320 conn(0x5558f5ee3310 msgr2=0x5558f5f237e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 -- 172.21.15.76:0/665294320 shutdown_connections 2024-09-19T07:56:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 -- 172.21.15.76:0/665294320 wait complete. 2024-09-19T07:56:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 -- start start 2024-09-19T07:56:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 Processor -- start 2024-09-19T07:56:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.669+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f3ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f3cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f25370 0x5558f5f3d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1ac0d0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1ad540 con 0x5558f5f1bb40 2024-09-19T07:56:36.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1ac7a0 con 0x5558f5f25370 2024-09-19T07:56:36.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 10 client.0 _ll_register_callbacks cb 0x7f0b5400b530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:36.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f3ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f3ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37574/0 (socket says 172.21.15.76:37574) 2024-09-19T07:56:36.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/515608533 learned_addr learned my addr 172.21.15.76:0/515608533 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:36.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b53fff640 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f3cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f25370 msgr2=0x5558f5f3d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f25370 0x5558f5f3d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/515608533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 msgr2=0x5558f5f3cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f3cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 -- 172.21.15.76:0/515608533 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f5f2bd90 con 0x5558f5f1a5d0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b5b7fe640 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f3ca60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0a4810 tx=0x7f0b4c098370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8680ef405bb53e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b3affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b3affd640 1 -- 172.21.15.76:0/515608533 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c07e020 con 0x5558f5f1a5d0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b3affd640 1 -- 172.21.15.76:0/515608533 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0b4c0a0220 con 0x5558f5f1a5d0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c09a3d0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b3affd640 1 -- 172.21.15.76:0/515608533 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b4c0cd7c0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 10 client.16761 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:36.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.670+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5558f5fa0080 con 0x5558f5f1a5d0 2024-09-19T07:56:36.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b3affd640 1 -- 172.21.15.76:0/515608533 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b4c09a3d0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b3affd640 1 -- 172.21.15.76:0/515608533 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f0b4c0a48b0 con 0x5558f5f1a5d0 2024-09-19T07:56:36.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b645c3740 10 client.16761 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:36.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b645c3740 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:36.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b645c3740 20 client.16761 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b645c3740 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5fa0740 0x5558f5fa2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b645c3740 4 client.16761 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558f5e87d70 con 0x5558f5fa0740 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.671+0000 7f0b53fff640 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5fa0740 0x5558f5fa2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b3affd640 10 client.16761 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b53fff640 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5fa0740 0x5558f5fa2b30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8c17105c4c33661 server_cookie=88d24bfc29ae42bb in_seq=0 out_seq=0 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b3affd640 1 -- 172.21.15.76:0/515608533 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558f5e87d70 con 0x5558f5fa0740 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b3affd640 10 client.16761 handle_command_reply: tid=0 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 client.16761 shutdown 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 msgr2=0x5558f5f3ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f3ca60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0a4810 tx=0x7f0b4c098370 comp rx=0 tx=0).stop 2024-09-19T07:56:36.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 shutdown_connections 2024-09-19T07:56:36.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5558f5f25370 0x5558f5f3d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5558f5f1bb40 0x5558f5f3cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5558f5fa0740 0x5558f5fa2b30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 --2- 172.21.15.76:0/515608533 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558f5f1a5d0 0x5558f5f3ca60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 >> 172.21.15.76:0/515608533 conn(0x5558f5ee3310 msgr2=0x5558f5f24000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:36.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b3affd640 0 client.16761 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:36.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 shutdown_connections 2024-09-19T07:56:36.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 1 -- 172.21.15.76:0/515608533 wait complete. 2024-09-19T07:56:36.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.672+0000 7f0b645c3740 20 client.16761 trim_cache size 0 max 16384 2024-09-19T07:56:36.698 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b480a33b0 msgr2=0x7f0b480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b480a33b0 0x7f0b480a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009900 tx=0x7f0b54009650 comp rx=0 tx=0).stop 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 msgr2=0x7f0b5c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 0x7f0b5c1984e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00c920 tx=0x7f0b4c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 shutdown_connections 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0b480a33b0 0x7f0b480a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5c10c180 0x7f0b5c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c1036c0 0x7f0b5c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 --2- 172.21.15.76:0/2187977493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0b5c102da0 0x7f0b5c1984e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:36.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 >> 172.21.15.76:0/2187977493 conn(0x7f0b5c0fc7a0 msgr2=0x7f0b5c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:36.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 shutdown_connections 2024-09-19T07:56:36.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:36.673+0000 7f0b621ea640 1 -- 172.21.15.76:0/2187977493 wait complete. 2024-09-19T07:56:38.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:37 smithi076 ceph-mon[30930]: pgmap v167: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:38.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:37 smithi152 ceph-mon[35117]: pgmap v167: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:38.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:37 smithi137 ceph-mon[35309]: pgmap v167: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:38.467 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:56:38.468 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:56:38.727 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:39.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.235+0000 7f4dc861c640 1 -- 172.21.15.76:0/2202621799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0102790 msgr2=0x7f4dc01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.235+0000 7f4dc861c640 1 --2- 172.21.15.76:0/2202621799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0102790 0x7f4dc01067e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009900 tx=0x7f4db002a410 comp rx=0 tx=0).stop 2024-09-19T07:56:39.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- 172.21.15.76:0/2202621799 shutdown_connections 2024-09-19T07:56:39.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 --2- 172.21.15.76:0/2202621799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dc0106f10 0x7f4dc010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 --2- 172.21.15.76:0/2202621799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0102790 0x7f4dc01067e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 --2- 172.21.15.76:0/2202621799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc0101de0 0x7f4dc01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- 172.21.15.76:0/2202621799 >> 172.21.15.76:0/2202621799 conn(0x7f4dc00fd8c0 msgr2=0x7f4dc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- 172.21.15.76:0/2202621799 shutdown_connections 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- 172.21.15.76:0/2202621799 wait complete. 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 Processor -- start 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- start start 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dc0101de0 0x7f4dc00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc0102790 0x7f4dc0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 0x7f4dc0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0112090 con 0x7f4dc0106f10 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0111f10 con 0x7f4dc0102790 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.236+0000 7f4dc861c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0112210 con 0x7f4dc0101de0 2024-09-19T07:56:39.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 0x7f4dc0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 0x7f4dc0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37600/0 (socket says 172.21.15.76:37600) 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/4135073641 learned_addr learned my addr 172.21.15.76:0/4135073641 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dc0101de0 0x7f4dc00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc0102790 0x7f4dc0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/4135073641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dc0101de0 msgr2=0x7f4dc00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dc0101de0 0x7f4dc00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/4135073641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc0102790 msgr2=0x7f4dc0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc0102790 0x7f4dc0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/4135073641 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc01a69f0 con 0x7f4dc0106f10 2024-09-19T07:56:39.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 0x7f4dc0074f70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4db800eaa0 tx=0x7f4db800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:39.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4db77fe640 1 -- 172.21.15.76:0/4135073641 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db800cdb0 con 0x7f4dc0106f10 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4db77fe640 1 -- 172.21.15.76:0/4135073641 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4db8004b20 con 0x7f4dc0106f10 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc01a6ce0 con 0x7f4dc0106f10 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4db77fe640 1 -- 172.21.15.76:0/4135073641 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8011760 con 0x7f4dc0106f10 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.237+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc01a71f0 con 0x7f4dc0106f10 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4db77fe640 1 -- 172.21.15.76:0/4135073641 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4db8004cd0 con 0x7f4dc0106f10 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 Processor -- start 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 -- start start 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4db77fe640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dac0a33b0 0x7f4dac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e8faf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e905800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e905d40 0x55b41e908130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b41e860280 con 0x55b41e8fab60 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b41e807b10 con 0x55b41e8fb480 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.240+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b41e85c240 con 0x55b41e905d40 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dac0a33b0 0x7f4dac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e8faf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e8faf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37612/0 (socket says 172.21.15.76:37612) 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc6bb9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e905d40 0x55b41e908130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 -- 172.21.15.76:0/1549286813 learned_addr learned my addr 172.21.15.76:0/1549286813 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4db77fe640 1 -- 172.21.15.76:0/4135073641 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4db80cfe60 con 0x7f4dc0106f10 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e905800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 -- 172.21.15.76:0/1549286813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e905d40 msgr2=0x55b41e908130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e905d40 0x55b41e908130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 -- 172.21.15.76:0/1549286813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 msgr2=0x55b41e905800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e905800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 -- 172.21.15.76:0/1549286813 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b41e8141f0 con 0x55b41e8fab60 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e8faf40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00ac20 tx=0x7f4dbc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334522ab32bc4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dac0a33b0 0x7f4dac0a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009230 tx=0x7f4db00318a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4db4ff9640 1 -- 172.21.15.76:0/1549286813 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc01d070 con 0x55b41e8fab60 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4db4ff9640 1 -- 172.21.15.76:0/1549286813 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4dbc018b40 con 0x55b41e8fab60 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.241+0000 7f4db4ff9640 1 -- 172.21.15.76:0/1549286813 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc010bc0 con 0x55b41e8fab60 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 -- 172.21.15.76:0/1549286813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 msgr2=0x55b41e8faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e8faf40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00ac20 tx=0x7f4dbc00f790 comp rx=0 tx=0).stop 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 -- 172.21.15.76:0/1549286813 shutdown_connections 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e905d40 0x55b41e908130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.247 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e905800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/1549286813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e8faf40 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 -- 172.21.15.76:0/1549286813 >> 172.21.15.76:0/1549286813 conn(0x55b41e8f70f0 msgr2=0x55b41e8f74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 -- 172.21.15.76:0/1549286813 shutdown_connections 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 -- 172.21.15.76:0/1549286813 wait complete. 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.242+0000 7f4dca9f5740 1 -- start start 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 Processor -- start 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e9057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 0x55b41e902b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e9032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b41e908910 con 0x55b41e8fb480 2024-09-19T07:56:39.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b41e81af10 con 0x55b41e905d40 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b41e908a90 con 0x55b41e8fab60 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dca9f5740 10 client.0 _ll_register_callbacks cb 0x55b41e7e3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 0x55b41e902b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 0x55b41e902b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37618/0 (socket says 172.21.15.76:37618) 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 -- 172.21.15.76:0/267384475 learned_addr learned my addr 172.21.15.76:0/267384475 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc63b8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e9057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e9032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 -- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 msgr2=0x55b41e9057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e9057f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 -- 172.21.15.76:0/267384475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 msgr2=0x55b41e9032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e9032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.243+0000 7f4dc5bb7640 1 -- 172.21.15.76:0/267384475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b41e5d16a0 con 0x55b41e8fb480 2024-09-19T07:56:39.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 0x55b41e902b40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4db00096c0 tx=0x7f4db002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb88da11dd5b605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4da9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4da9ffb640 1 -- 172.21.15.76:0/267384475 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db004e070 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4da9ffb640 1 -- 172.21.15.76:0/267384475 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4db00037f0 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dbc018b40 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4da9ffb640 1 -- 172.21.15.76:0/267384475 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4db005a050 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 10 client.16773 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b41e914470 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4da9ffb640 1 -- 172.21.15.76:0/267384475 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4dbc018b40 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4da9ffb640 1 -- 172.21.15.76:0/267384475 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4db003db70 con 0x55b41e8fb480 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 10 client.16773 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 20 client.16773 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:39.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e915940 0x55b41e917d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 4 client.16773 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:39.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.244+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b41e86d7f0 con 0x55b41e915940 2024-09-19T07:56:39.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.245+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e915940 0x55b41e917d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.245+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e915940 0x55b41e917d80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7970ecb663c79511 server_cookie=1058a3fe958af57c in_seq=0 out_seq=0 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.245+0000 7f4da9ffb640 10 client.16773 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4da9ffb640 1 -- 172.21.15.76:0/267384475 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b41e86d7f0 con 0x55b41e915940 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4da9ffb640 10 client.16773 handle_command_reply: tid=0 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 client.16773 shutdown 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 msgr2=0x55b41e902b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 0x55b41e902b40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4db00096c0 tx=0x7f4db002a410 comp rx=0 tx=0).stop 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 shutdown_connections 2024-09-19T07:56:39.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e9032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e915940 0x55b41e917d80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fb480 0x55b41e902b40 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/267384475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e9057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 >> 172.21.15.76:0/267384475 conn(0x55b41e8f70f0 msgr2=0x55b41e8fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4da9ffb640 0 client.16773 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 shutdown_connections 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 1 -- 172.21.15.76:0/267384475 wait complete. 2024-09-19T07:56:39.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.246+0000 7f4dca9f5740 20 client.16773 trim_cache size 0 max 16384 2024-09-19T07:56:39.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 Processor -- start 2024-09-19T07:56:39.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 -- start start 2024-09-19T07:56:39.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e901410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fb480 0x55b41e901950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e91d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01b26e0 con 0x55b41e8fab60 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01afef0 con 0x55b41e905d40 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01add40 con 0x55b41e8fb480 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dc63b8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e901410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dc63b8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e901410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37628/0 (socket says 172.21.15.76:37628) 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.263+0000 7f4dc63b8640 1 -- 172.21.15.76:0/3403085805 learned_addr learned my addr 172.21.15.76:0/3403085805 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dc63b8640 1 -- 172.21.15.76:0/3403085805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fb480 msgr2=0x55b41e901950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fb480 0x55b41e901950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dc63b8640 1 -- 172.21.15.76:0/3403085805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 msgr2=0x55b41e91d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e91d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dc63b8640 1 -- 172.21.15.76:0/3403085805 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b41e8f6f20 con 0x55b41e8fab60 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e901410 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000c00 tx=0x7f4dbc00a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbbaf2a78e51990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:39.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dabfff640 1 -- 172.21.15.76:0/3403085805 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc01d040 con 0x55b41e8fab60 2024-09-19T07:56:39.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dabfff640 1 -- 172.21.15.76:0/3403085805 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4dbc01e040 con 0x55b41e8fab60 2024-09-19T07:56:39.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dabfff640 1 -- 172.21.15.76:0/3403085805 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0186c0 con 0x55b41e8fab60 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3403085805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 msgr2=0x55b41e901410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e901410 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000c00 tx=0x7f4dbc00a670 comp rx=0 tx=0).stop 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3403085805 shutdown_connections 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e905d40 0x55b41e91d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fb480 0x55b41e901950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3403085805 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e8fab60 0x55b41e901410 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.264+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3403085805 >> 172.21.15.76:0/3403085805 conn(0x55b41e8f70f0 msgr2=0x55b41e8fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:39.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3403085805 shutdown_connections 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3403085805 wait complete. 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 -- start start 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 Processor -- start 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e8ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e900280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 0x55b41e9007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01ae3b0 con 0x55b41e905d40 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01af820 con 0x55b41e8fb480 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01aea80 con 0x55b41e8fab60 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dca9f5740 10 client.0 _ll_register_callbacks cb 0x7f4db0031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dc6bb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 0x55b41e9007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dc6bb9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 0x55b41e9007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37636/0 (socket says 172.21.15.76:37636) 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/3983865125 learned_addr learned my addr 172.21.15.76:0/3983865125 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.265+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e8ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc5bb7640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e900280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 msgr2=0x55b41e8ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e8ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/3983865125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 msgr2=0x55b41e900280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e900280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc6bb9640 1 -- 172.21.15.76:0/3983865125 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b41e90c6b0 con 0x55b41e905d40 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dc6bb9640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 0x55b41e9007c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4db80cd5b0 tx=0x7f4db800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b089928f6de074c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4da9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:39.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4da9ffb640 1 -- 172.21.15.76:0/3983865125 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db801f040 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4da9ffb640 1 -- 172.21.15.76:0/3983865125 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4db80a0170 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dbc01e040 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4da9ffb640 1 -- 172.21.15.76:0/3983865125 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4db80a4d50 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dca9f5740 10 client.16779 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b41e980b40 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4da9ffb640 1 -- 172.21.15.76:0/3983865125 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4dbc01e040 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.266+0000 7f4da9ffb640 1 -- 172.21.15.76:0/3983865125 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4db800f040 con 0x55b41e905d40 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dca9f5740 10 client.16779 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dca9f5740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dca9f5740 20 client.16779 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e9812f0 0x55b41e983710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:39.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dca9f5740 4 client.16779 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b41e867d00 con 0x55b41e9812f0 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e9812f0 0x55b41e983710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4dc63b8640 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e9812f0 0x55b41e983710 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64aa0e1c9e62593d server_cookie=10f546f2ea352e4a in_seq=0 out_seq=0 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.267+0000 7f4da9ffb640 10 client.16779 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.268+0000 7f4da9ffb640 1 -- 172.21.15.76:0/3983865125 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b41e867d00 con 0x55b41e9812f0 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.268+0000 7f4da9ffb640 10 client.16779 handle_command_reply: tid=0 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.268+0000 7f4dca9f5740 1 client.16779 shutdown 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.268+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 msgr2=0x55b41e9007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.268+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 0x55b41e9007c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f4db80cd5b0 tx=0x7f4db800ea20 comp rx=0 tx=0).stop 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 shutdown_connections 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b41e9812f0 0x55b41e983710 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b41e905d40 0x55b41e9007c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b41e8fb480 0x55b41e900280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 --2- 172.21.15.76:0/3983865125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b41e8fab60 0x55b41e8ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 >> 172.21.15.76:0/3983865125 conn(0x55b41e8f70f0 msgr2=0x55b41e901390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4da9ffb640 0 client.16779 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 shutdown_connections 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 1 -- 172.21.15.76:0/3983865125 wait complete. 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dca9f5740 20 client.16779 trim_cache size 0 max 16384 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:39.275 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:56:39.276 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "a6a62276-a6e0-498a-89fc-4d85d0221e2a", 2024-09-19T07:56:39.276 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:56:39.276 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:39.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dac0a33b0 msgr2=0x7f4dac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dac0a33b0 0x7f4dac0a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009230 tx=0x7f4db00318a0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 msgr2=0x7f4dc0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 0x7f4dc0074f70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4db800eaa0 tx=0x7f4db800ef60 comp rx=0 tx=0).stop 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 shutdown_connections 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4dac0a33b0 0x7f4dac0a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4dc0106f10 0x7f4dc0074f70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc0102790 0x7f4dc0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 --2- 172.21.15.76:0/4135073641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dc0101de0 0x7f4dc00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:39.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.269+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 >> 172.21.15.76:0/4135073641 conn(0x7f4dc00fd8c0 msgr2=0x7f4dc00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:39.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.270+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 shutdown_connections 2024-09-19T07:56:39.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:39.270+0000 7f4dc861c640 1 -- 172.21.15.76:0/4135073641 wait complete. 2024-09-19T07:56:40.086 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:56:40.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:39 smithi076 ceph-mon[30930]: pgmap v168: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:56:40.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:39 smithi152 ceph-mon[35117]: pgmap v168: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:56:40.333 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:56:40.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:39 smithi137 ceph-mon[35309]: pgmap v168: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:56:40.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 -- 172.21.15.76:0/2767258856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10112b90 msgr2=0x7f9a10114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 --2- 172.21.15.76:0/2767258856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10112b90 0x7f9a10114f80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009ca0 tx=0x7f9a0802a950 comp rx=0 tx=0).stop 2024-09-19T07:56:40.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 -- 172.21.15.76:0/2767258856 shutdown_connections 2024-09-19T07:56:40.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 --2- 172.21.15.76:0/2767258856 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10112b90 0x7f9a10114f80 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 --2- 172.21.15.76:0/2767258856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a10074eb0 0x7f9a10112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 --2- 172.21.15.76:0/2767258856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a10074590 0x7f9a10074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 -- 172.21.15.76:0/2767258856 >> 172.21.15.76:0/2767258856 conn(0x7f9a100fd8c0 msgr2=0x7f9a100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 -- 172.21.15.76:0/2767258856 shutdown_connections 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.794+0000 7f9a16e89640 1 -- 172.21.15.76:0/2767258856 wait complete. 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 Processor -- start 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 -- start start 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 0x7f9a101a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a10074eb0 0x7f9a101a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a10112b90 0x7f9a1019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101186b0 con 0x7f9a10074590 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10118530 con 0x7f9a10074eb0 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a16e89640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10118830 con 0x7f9a10112b90 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a14c25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 0x7f9a101a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a14c25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 0x7f9a101a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37656/0 (socket says 172.21.15.76:37656) 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a14c25640 1 -- 172.21.15.76:0/4190400143 learned_addr learned my addr 172.21.15.76:0/4190400143 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.795+0000 7f9a15426640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a10112b90 0x7f9a1019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a14c25640 1 -- 172.21.15.76:0/4190400143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a10112b90 msgr2=0x7f9a1019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a14c25640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a10112b90 0x7f9a1019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a14c25640 1 -- 172.21.15.76:0/4190400143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a10074eb0 msgr2=0x7f9a101a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a14c25640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a10074eb0 0x7f9a101a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a14c25640 1 -- 172.21.15.76:0/4190400143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1019f070 con 0x7f9a10074590 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a14c25640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 0x7f9a101a4780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400d770 tx=0x7f9a0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a0dffb640 1 -- 172.21.15.76:0/4190400143 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04017070 con 0x7f9a10074590 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1019f360 con 0x7f9a10074590 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a0dffb640 1 -- 172.21.15.76:0/4190400143 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a04005520 con 0x7f9a10074590 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a0dffb640 1 -- 172.21.15.76:0/4190400143 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04010460 con 0x7f9a10074590 2024-09-19T07:56:40.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.796+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101ab650 con 0x7f9a10074590 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.798+0000 7f9a0dffb640 1 -- 172.21.15.76:0/4190400143 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9a04004ea0 con 0x7f9a10074590 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 Processor -- start 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 -- start start 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bd4a0 0x55dc678bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bddc0 0x55dc678c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a0dffb640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9a000a33b0 0x7f9a000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55dc678232e0 con 0x55dc678c8680 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dc677cace0 con 0x55dc678bd4a0 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a19262740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc6781f2a0 con 0x55dc678bddc0 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a15426640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9a000a33b0 0x7f9a000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37666/0 (socket says 172.21.15.76:37666) 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a15426640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bd4a0 0x55dc678bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a0ffff640 1 -- 172.21.15.76:0/1605249278 learned_addr learned my addr 172.21.15.76:0/1605249278 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a14c25640 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bddc0 0x55dc678c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.799+0000 7f9a0dffb640 1 -- 172.21.15.76:0/4190400143 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9a040cf960 con 0x7f9a10074590 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a0ffff640 1 -- 172.21.15.76:0/1605249278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bddc0 msgr2=0x55dc678c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bddc0 0x55dc678c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a0ffff640 1 -- 172.21.15.76:0/1605249278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bd4a0 msgr2=0x55dc678bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bd4a0 0x55dc678bd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a0ffff640 1 -- 172.21.15.76:0/1605249278 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc677af440 con 0x55dc678c8680 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a15426640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9a000a33b0 0x7f9a000a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006010 tx=0x7f9a080098e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678caa70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a900 tx=0x7f99fc00adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fbb262bf0bf6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f99faffd640 1 -- 172.21.15.76:0/1605249278 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00cd80 con 0x55dc678c8680 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f99faffd640 1 -- 172.21.15.76:0/1605249278 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99fc00f950 con 0x55dc678c8680 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.800+0000 7f99faffd640 1 -- 172.21.15.76:0/1605249278 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0189c0 con 0x55dc678c8680 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 -- 172.21.15.76:0/1605249278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 msgr2=0x55dc678caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678caa70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a900 tx=0x7f99fc00adc0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 -- 172.21.15.76:0/1605249278 shutdown_connections 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678caa70 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bddc0 0x55dc678c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 --2- 172.21.15.76:0/1605249278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bd4a0 0x55dc678bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 -- 172.21.15.76:0/1605249278 >> 172.21.15.76:0/1605249278 conn(0x55dc678b9a30 msgr2=0x55dc678b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:40.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 -- 172.21.15.76:0/1605249278 shutdown_connections 2024-09-19T07:56:40.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 -- 172.21.15.76:0/1605249278 wait complete. 2024-09-19T07:56:40.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 -- start start 2024-09-19T07:56:40.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.801+0000 7f9a19262740 1 Processor -- start 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 0x55dc678c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678c8680 0x55dc678c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55dc678cb250 con 0x55dc678bddc0 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dc677de050 con 0x55dc678c8680 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc678cb3d0 con 0x55dc678bd4a0 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 10 client.0 _ll_register_callbacks cb 0x55dc6781e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 0x55dc678c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 0x55dc678c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37682/0 (socket says 172.21.15.76:37682) 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 -- 172.21.15.76:0/2900136396 learned_addr learned my addr 172.21.15.76:0/2900136396 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a14c25640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a15426640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678c8680 0x55dc678c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 -- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 msgr2=0x55dc678c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 -- 172.21.15.76:0/2900136396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678c8680 msgr2=0x55dc678c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678c8680 0x55dc678c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 -- 172.21.15.76:0/2900136396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc675943c0 con 0x55dc678bddc0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 0x55dc678c51d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0058b0 tx=0x7f99fc005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e3f7eb47c6445a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f99effff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f99effff640 1 -- 172.21.15.76:0/2900136396 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc028060 con 0x55dc678bddc0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f99effff640 1 -- 172.21.15.76:0/2900136396 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f99fc00f450 con 0x55dc678bddc0 2024-09-19T07:56:40.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.802+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99fc00f950 con 0x55dc678bddc0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f99effff640 1 -- 172.21.15.76:0/2900136396 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f99fc00f650 con 0x55dc678bddc0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 10 client.16791 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dc678d6b70 con 0x55dc678bddc0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f99effff640 1 -- 172.21.15.76:0/2900136396 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99fc00f950 con 0x55dc678bddc0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f99effff640 1 -- 172.21.15.76:0/2900136396 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f99fc023950 con 0x55dc678bddc0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 10 client.16791 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 20 client.16791 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc678d7ec0 0x55dc678da2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 4 client.16791 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc67830850 con 0x55dc678d7ec0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.803+0000 7f9a14c25640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc678d7ec0 0x55dc678da2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.804+0000 7f99effff640 10 client.16791 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.804+0000 7f9a14c25640 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc678d7ec0 0x55dc678da2b0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3804069340881de5 server_cookie=4075892dc72d385e in_seq=0 out_seq=0 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f99effff640 1 -- 172.21.15.76:0/2900136396 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc67830850 con 0x55dc678d7ec0 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f99effff640 10 client.16791 handle_command_reply: tid=0 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 client.16791 shutdown 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 msgr2=0x55dc678c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 0x55dc678c51d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0058b0 tx=0x7f99fc005ac0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 shutdown_connections 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678c8680 0x55dc678c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc678d7ec0 0x55dc678da2b0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bddc0 0x55dc678c51d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 --2- 172.21.15.76:0/2900136396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 >> 172.21.15.76:0/2900136396 conn(0x55dc678b9a30 msgr2=0x55dc678bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:40.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f99effff640 0 client.16791 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:40.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 shutdown_connections 2024-09-19T07:56:40.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 1 -- 172.21.15.76:0/2900136396 wait complete. 2024-09-19T07:56:40.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.805+0000 7f9a19262740 20 client.16791 trim_cache size 0 max 16384 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 Processor -- start 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 -- start start 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101b6b90 con 0x55dc678c8680 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101b43a0 con 0x55dc678bddc0 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a19262740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101b21f0 con 0x55dc678bd4a0 2024-09-19T07:56:40.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a15426640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a15426640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678dcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37690/0 (socket says 172.21.15.76:37690) 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a15426640 1 -- 172.21.15.76:0/3382378327 learned_addr learned my addr 172.21.15.76:0/3382378327 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.822+0000 7f9a14c25640 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a15426640 1 -- 172.21.15.76:0/3382378327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 msgr2=0x55dc678c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a15426640 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a15426640 1 -- 172.21.15.76:0/3382378327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 msgr2=0x55dc678c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a15426640 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a15426640 1 -- 172.21.15.76:0/3382378327 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc678c4180 con 0x55dc678c8680 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a15426640 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678dcef0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9a10076600 tx=0x7f9a0802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abd8ed0dae0ea8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:40.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f99fa7fc640 1 -- 172.21.15.76:0/3382378327 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08034040 con 0x55dc678c8680 2024-09-19T07:56:40.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f99fa7fc640 1 -- 172.21.15.76:0/3382378327 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a0803f070 con 0x55dc678c8680 2024-09-19T07:56:40.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f99fa7fc640 1 -- 172.21.15.76:0/3382378327 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08004780 con 0x55dc678c8680 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a19262740 1 -- 172.21.15.76:0/3382378327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 msgr2=0x55dc678dcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.823+0000 7f9a19262740 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678dcef0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9a10076600 tx=0x7f9a0802a950 comp rx=0 tx=0).stop 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- 172.21.15.76:0/3382378327 shutdown_connections 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678c8680 0x55dc678dcef0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 --2- 172.21.15.76:0/3382378327 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678bd4a0 0x55dc678c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- 172.21.15.76:0/3382378327 >> 172.21.15.76:0/3382378327 conn(0x55dc678b9a30 msgr2=0x55dc678c00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:40.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- 172.21.15.76:0/3382378327 shutdown_connections 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- 172.21.15.76:0/3382378327 wait complete. 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- start start 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 Processor -- start 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 0x55dc678dd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678c8680 0x55dc678dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101b2860 con 0x55dc678bd4a0 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101b3cd0 con 0x55dc678bddc0 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101b2f30 con 0x55dc678c8680 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a19262740 10 client.0 _ll_register_callbacks cb 0x7f9a08009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.824+0000 7f9a14c25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 0x55dc678dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 0x55dc678dd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37702/0 (socket says 172.21.15.76:37702) 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 -- 172.21.15.76:0/481578848 learned_addr learned my addr 172.21.15.76:0/481578848 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:56:40.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a15426640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678c8680 0x55dc678dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 -- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678c8680 msgr2=0x55dc678dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678c8680 0x55dc678dacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 -- 172.21.15.76:0/481578848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 msgr2=0x55dc678da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678da770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 -- 172.21.15.76:0/481578848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc678bdbf0 con 0x55dc678bd4a0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a15426640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678c8680 0x55dc678dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a14c25640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 0x55dc678dd420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9a0409b8e0 tx=0x7f9a040cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4172fd14c2e7aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f99effff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f99effff640 1 -- 172.21.15.76:0/481578848 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a040b9060 con 0x55dc678bd4a0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f99effff640 1 -- 172.21.15.76:0/481578848 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9a04099ee0 con 0x55dc678bd4a0 2024-09-19T07:56:40.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a0803f070 con 0x55dc678bd4a0 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f99effff640 1 -- 172.21.15.76:0/481578848 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9a040b2040 con 0x55dc678bd4a0 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a19262740 10 client.16797 fetch_fsmap learned FSMap version 31 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dc67942410 con 0x55dc678bd4a0 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.825+0000 7f99effff640 1 -- 172.21.15.76:0/481578848 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a0803f070 con 0x55dc678bd4a0 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f99effff640 1 -- 172.21.15.76:0/481578848 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f9a040cd2d0 con 0x55dc678bd4a0 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a19262740 10 client.16797 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a19262740 10 client.16797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a19262740 20 client.16797 populate_metadata read hostname 'smithi076' 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a19262740 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc67942b90 0x55dc67944fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a19262740 4 client.16797 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc678c5aa0 con 0x55dc67942b90 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc67942b90 0x55dc67944fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:56:40.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f9a0ffff640 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc67942b90 0x55dc67944fb0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7667cd19582a615 server_cookie=e339e801d0799025 in_seq=0 out_seq=0 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f99effff640 10 client.16797 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.826+0000 7f99effff640 1 -- 172.21.15.76:0/481578848 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dc678c5aa0 con 0x55dc67942b90 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f99effff640 10 client.16797 handle_command_reply: tid=0 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 client.16797 shutdown 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 msgr2=0x55dc678dd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 0x55dc678dd420 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9a0409b8e0 tx=0x7f9a040cf040 comp rx=0 tx=0).stop 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 shutdown_connections 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc678c8680 0x55dc678dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dc678bddc0 0x55dc678da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dc67942b90 0x55dc67944fb0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 --2- 172.21.15.76:0/481578848 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dc678bd4a0 0x55dc678dd420 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f99effff640 0 client.16797 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 >> 172.21.15.76:0/481578848 conn(0x55dc678b9a30 msgr2=0x55dc678c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:40.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 shutdown_connections 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 1 -- 172.21.15.76:0/481578848 wait complete. 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a19262740 20 client.16797 trim_cache size 0 max 16384 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: "a6a62276-a6e0-498a-89fc-4d85d0221e2a": { 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "a6a62276-a6e0-498a-89fc-4d85d0221e2a", 2024-09-19T07:56:40.833 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9a000a33b0 msgr2=0x7f9a000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a16e89640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9a000a33b0 0x7f9a000a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006010 tx=0x7f9a080098e0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 msgr2=0x7f9a101a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:56:40.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.827+0000 7f9a16e89640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 0x7f9a101a4780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400d770 tx=0x7f9a0400dc30 comp rx=0 tx=0).stop 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 shutdown_connections 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9a000a33b0 0x7f9a000a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a10112b90 0x7f9a1019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a10074eb0 0x7f9a101a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 --2- 172.21.15.76:0/4190400143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9a10074590 0x7f9a101a4780 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 >> 172.21.15.76:0/4190400143 conn(0x7f9a100fd8c0 msgr2=0x7f9a100fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 shutdown_connections 2024-09-19T07:56:40.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:56:40.828+0000 7f9a16e89640 1 -- 172.21.15.76:0/4190400143 wait complete. 2024-09-19T07:56:41.190 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:40 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:56:41.190 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:40 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:41.190 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:40 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:56:41.190 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:40 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:41.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:40 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:56:41.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:40 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:41.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:40 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:56:41.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:40 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:41.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:40 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:56:41.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:40 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:41.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:40 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:56:41.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:40 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:56:41.633 INFO:tasks.cephfs.filesystem:scrub status for tag:a6a62276-a6e0-498a-89fc-4d85d0221e2a - {'path': '/', 'tag': 'a6a62276-a6e0-498a-89fc-4d85d0221e2a', 'options': 'recursive,force'} 2024-09-19T07:56:42.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:41 smithi152 ceph-mon[35117]: pgmap v169: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:56:42.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:41 smithi137 ceph-mon[35309]: pgmap v169: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:56:42.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:41 smithi076 ceph-mon[30930]: pgmap v169: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:56:44.206 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:43 smithi137 ceph-mon[35309]: pgmap v170: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:44.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:43 smithi152 ceph-mon[35117]: pgmap v170: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:44.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:43 smithi076 ceph-mon[30930]: pgmap v170: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:45.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:44 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:56:45.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:44 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:56:45.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:44 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:56:46.212 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:45 smithi152 ceph-mon[35117]: pgmap v171: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:46.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:45 smithi137 ceph-mon[35309]: pgmap v171: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:46.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:45 smithi076 ceph-mon[30930]: pgmap v171: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:48.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:47 smithi152 ceph-mon[35117]: pgmap v172: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:48.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:47 smithi137 ceph-mon[35309]: pgmap v172: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:48.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:47 smithi076 ceph-mon[30930]: pgmap v172: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:50.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:49 smithi152 ceph-mon[35117]: pgmap v173: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:56:50.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:49 smithi137 ceph-mon[35309]: pgmap v173: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:56:50.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:49 smithi076 ceph-mon[30930]: pgmap v173: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:56:52.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:51 smithi152 ceph-mon[35117]: pgmap v174: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:56:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:51 smithi137 ceph-mon[35309]: pgmap v174: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:56:52.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:51 smithi076 ceph-mon[30930]: pgmap v174: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:56:54.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:53 smithi152 ceph-mon[35117]: pgmap v175: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:54.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:53 smithi137 ceph-mon[35309]: pgmap v175: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:54.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:53 smithi076 ceph-mon[30930]: pgmap v175: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:56:56.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:55 smithi152 ceph-mon[35117]: pgmap v176: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:56.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:55 smithi137 ceph-mon[35309]: pgmap v176: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:56.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:55 smithi076 ceph-mon[30930]: pgmap v176: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:56:58.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:57 smithi152 ceph-mon[35117]: pgmap v177: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:58.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:57 smithi137 ceph-mon[35309]: pgmap v177: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:56:58.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:57 smithi076 ceph-mon[30930]: pgmap v177: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:00.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:56:59 smithi152 ceph-mon[35117]: pgmap v178: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:00.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:56:59 smithi137 ceph-mon[35309]: pgmap v178: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:00.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:56:59 smithi076 ceph-mon[30930]: pgmap v178: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:02.245 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:01 smithi076 ceph-mon[30930]: pgmap v179: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:02.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:01 smithi152 ceph-mon[35117]: pgmap v179: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:02.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:01 smithi137 ceph-mon[35309]: pgmap v179: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:04.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:03 smithi152 ceph-mon[35117]: pgmap v180: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:03 smithi137 ceph-mon[35309]: pgmap v180: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:04.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:03 smithi076 ceph-mon[30930]: pgmap v180: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:06.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:05 smithi152 ceph-mon[35117]: pgmap v181: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:06.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:05 smithi137 ceph-mon[35309]: pgmap v181: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:06.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:05 smithi076 ceph-mon[30930]: pgmap v181: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:08.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:07 smithi152 ceph-mon[35117]: pgmap v182: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T07:57:08.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:07 smithi137 ceph-mon[35309]: pgmap v182: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T07:57:08.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:07 smithi076 ceph-mon[30930]: pgmap v182: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T07:57:09.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:09 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:09.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:09 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:09.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:09 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:10.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:10 smithi152 ceph-mon[35117]: pgmap v183: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:10.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:10 smithi137 ceph-mon[35309]: pgmap v183: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:10.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:10 smithi076 ceph-mon[30930]: pgmap v183: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:11.634 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:57:11.995 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:12.116 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:12 smithi076 ceph-mon[30930]: pgmap v184: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:57:12.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:12 smithi152 ceph-mon[35117]: pgmap v184: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:57:12.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:12 smithi137 ceph-mon[35309]: pgmap v184: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:57:12.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 -- 172.21.15.76:0/2459533069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac102790 msgr2=0x7faeac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 --2- 172.21.15.76:0/2459533069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac102790 0x7faeac1067e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7faea8009900 tx=0x7faea802a410 comp rx=0 tx=0).stop 2024-09-19T07:57:12.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 -- 172.21.15.76:0/2459533069 shutdown_connections 2024-09-19T07:57:12.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 --2- 172.21.15.76:0/2459533069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac106f10 0x7faeac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 --2- 172.21.15.76:0/2459533069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac102790 0x7faeac1067e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 --2- 172.21.15.76:0/2459533069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac101de0 0x7faeac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 -- 172.21.15.76:0/2459533069 >> 172.21.15.76:0/2459533069 conn(0x7faeac0fd8c0 msgr2=0x7faeac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 -- 172.21.15.76:0/2459533069 shutdown_connections 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.481+0000 7faeb3328640 1 -- 172.21.15.76:0/2459533069 wait complete. 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 Processor -- start 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 -- start start 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 0x7faeac1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac102790 0x7faeac198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac106f10 0x7faeac19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1120f0 con 0x7faeac101de0 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111f70 con 0x7faeac102790 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb3328640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faeac112270 con 0x7faeac106f10 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb10c4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 0x7faeac1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb10c4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 0x7faeac1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60224/0 (socket says 172.21.15.76:60224) 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb10c4640 1 -- 172.21.15.76:0/3783536839 learned_addr learned my addr 172.21.15.76:0/3783536839 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb08c3640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac102790 0x7faeac198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb10c4640 1 -- 172.21.15.76:0/3783536839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac106f10 msgr2=0x7faeac19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.482+0000 7faeb18c5640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac106f10 0x7faeac19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb10c4640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac106f10 0x7faeac19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb10c4640 1 -- 172.21.15.76:0/3783536839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac102790 msgr2=0x7faeac198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb10c4640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac102790 0x7faeac198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb10c4640 1 -- 172.21.15.76:0/3783536839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeac19d560 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb18c5640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac106f10 0x7faeac19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb08c3640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac102790 0x7faeac198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb10c4640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 0x7faeac1985b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c970 tx=0x7fae9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faea27fc640 1 -- 172.21.15.76:0/3783536839 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c007bb0 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faea27fc640 1 -- 172.21.15.76:0/3783536839 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae9c007d50 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeac19d850 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faea27fc640 1 -- 172.21.15.76:0/3783536839 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00f4b0 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.483+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeac1a5130 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.485+0000 7faeb5701740 1 Processor -- start 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.485+0000 7faea27fc640 1 -- 172.21.15.76:0/3783536839 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fae9c0046c0 con 0x7faeac101de0 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.485+0000 7faeb5701740 1 -- start start 2024-09-19T07:57:12.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb5701740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace94880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb5701740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb5701740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7acea1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb5701740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a7acdfa2e0 con 0x55a7ace944a0 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb5701740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7acda1ce0 con 0x55a7ace9f680 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb5701740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a7acdf62a0 con 0x55a7ace94dc0 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace94880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace94880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60226/0 (socket says 172.21.15.76:60226) 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 -- 172.21.15.76:0/2792747967 learned_addr learned my addr 172.21.15.76:0/2792747967 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb10c4640 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb08c3640 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7acea1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 -- 172.21.15.76:0/2792747967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 msgr2=0x55a7ace9f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 -- 172.21.15.76:0/2792747967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 msgr2=0x55a7acea1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7acea1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 -- 172.21.15.76:0/2792747967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7acd86440 con 0x55a7ace944a0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb08c3640 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7acea1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faea27fc640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae980a3430 0x7fae980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.486+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace94880 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7faea4007f30 tx=0x7faea400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcdb6b44df58bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb10c4640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae980a3430 0x7fae980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7fae977fe640 1 -- 172.21.15.76:0/2792747967 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4014070 con 0x55a7ace944a0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7fae977fe640 1 -- 172.21.15.76:0/2792747967 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faea400fd50 con 0x55a7ace944a0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7fae977fe640 1 -- 172.21.15.76:0/2792747967 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea400edb0 con 0x55a7ace944a0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faea27fc640 1 -- 172.21.15.76:0/3783536839 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fae9c0cfb50 con 0x7faeac101de0 2024-09-19T07:57:12.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 -- 172.21.15.76:0/2792747967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 msgr2=0x55a7ace94880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace94880 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7faea4007f30 tx=0x7faea400c750 comp rx=0 tx=0).stop 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb10c4640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae980a3430 0x7fae980a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae9c0cd2f0 tx=0x7fae9c005740 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 -- 172.21.15.76:0/2792747967 shutdown_connections 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7acea1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 --2- 172.21.15.76:0/2792747967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace94880 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 -- 172.21.15.76:0/2792747967 >> 172.21.15.76:0/2792747967 conn(0x55a7ace90a30 msgr2=0x55a7ace90e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 -- 172.21.15.76:0/2792747967 shutdown_connections 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.487+0000 7faeb5701740 1 -- 172.21.15.76:0/2792747967 wait complete. 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 -- start start 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 Processor -- start 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace9ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7ace9c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a7acea2250 con 0x55a7ace944a0 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7acdb5050 con 0x55a7ace9f680 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a7acea23d0 con 0x55a7ace94dc0 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb5701740 10 client.0 _ll_register_callbacks cb 0x55a7acdf5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace9ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60228/0 (socket says 172.21.15.76:60228) 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.488+0000 7faeb18c5640 1 -- 172.21.15.76:0/4087409520 learned_addr learned my addr 172.21.15.76:0/4087409520 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb08c3640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb18c5640 1 -- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 msgr2=0x55a7ace9c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb18c5640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb18c5640 1 -- 172.21.15.76:0/4087409520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 msgr2=0x55a7ace9c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb18c5640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7ace9c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb18c5640 1 -- 172.21.15.76:0/4087409520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7acb6b3c0 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb08c3640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb18c5640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace9ef00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7faea4004b90 tx=0x7faea4007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15c89c0ff5e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7fae94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7fae94ff9640 1 -- 172.21.15.76:0/4087409520 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4028060 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7fae94ff9640 1 -- 172.21.15.76:0/4087409520 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7faea400f850 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea400fd50 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7fae94ff9640 1 -- 172.21.15.76:0/4087409520 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faea4014040 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb5701740 10 client.16809 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a7aceadad0 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7fae94ff9640 1 -- 172.21.15.76:0/4087409520 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faea400fd50 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.489+0000 7fae94ff9640 1 -- 172.21.15.76:0/4087409520 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7faea4023420 con 0x55a7ace944a0 2024-09-19T07:57:12.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb5701740 10 client.16809 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb5701740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb5701740 20 client.16809 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb5701740 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7aceaef90 0x55a7aceb1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb5701740 4 client.16809 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7ace07850 con 0x55a7aceaef90 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb08c3640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7aceaef90 0x55a7aceb1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7fae94ff9640 10 client.16809 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.490+0000 7faeb08c3640 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7aceaef90 0x55a7aceb1380 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f491e7e65bdbc922 server_cookie=2cacdf94e0629132 in_seq=0 out_seq=0 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7fae94ff9640 1 -- 172.21.15.76:0/4087409520 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7ace07850 con 0x55a7aceaef90 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7fae94ff9640 10 client.16809 handle_command_reply: tid=0 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 client.16809 shutdown 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 msgr2=0x55a7ace9ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace9ef00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7faea4004b90 tx=0x7faea4007c70 comp rx=0 tx=0).stop 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 shutdown_connections 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace9f680 0x55a7ace9c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace94dc0 0x55a7ace9c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7aceaef90 0x55a7aceb1380 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7fae94ff9640 0 client.16809 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 --2- 172.21.15.76:0/4087409520 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace944a0 0x55a7ace9ef00 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 >> 172.21.15.76:0/4087409520 conn(0x55a7ace90a30 msgr2=0x55a7ace96710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 shutdown_connections 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 1 -- 172.21.15.76:0/4087409520 wait complete. 2024-09-19T07:57:12.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.491+0000 7faeb5701740 20 client.16809 trim_cache size 0 max 16384 2024-09-19T07:57:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 Processor -- start 2024-09-19T07:57:12.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 -- start start 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7aceb6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7aceb6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7ace99410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1b05e0 con 0x55a7ace94dc0 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1ade20 con 0x55a7ace90a30 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.508+0000 7faeb5701740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1abc70 con 0x55a7ace944a0 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7ace99410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7ace99410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60244/0 (socket says 172.21.15.76:60244) 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 -- 172.21.15.76:0/2224428295 learned_addr learned my addr 172.21.15.76:0/2224428295 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7aceb6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb08c3640 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7aceb6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 -- 172.21.15.76:0/2224428295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 msgr2=0x55a7aceb6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7aceb6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 -- 172.21.15.76:0/2224428295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 msgr2=0x55a7aceb6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7aceb6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 -- 172.21.15.76:0/2224428295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ace90860 con 0x55a7ace94dc0 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7ace99410 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7faea4007840 tx=0x7faea401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda42ad45362f53c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7fae96ffd640 1 -- 172.21.15.76:0/2224428295 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea400fc00 con 0x55a7ace94dc0 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7fae96ffd640 1 -- 172.21.15.76:0/2224428295 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faea4023420 con 0x55a7ace94dc0 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.509+0000 7fae96ffd640 1 -- 172.21.15.76:0/2224428295 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea402b660 con 0x55a7ace94dc0 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 -- 172.21.15.76:0/2224428295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 msgr2=0x55a7ace99410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7ace99410 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7faea4007840 tx=0x7faea401b040 comp rx=0 tx=0).stop 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 -- 172.21.15.76:0/2224428295 shutdown_connections 2024-09-19T07:57:12.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7ace99410 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7aceb6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 --2- 172.21.15.76:0/2224428295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7aceb6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 -- 172.21.15.76:0/2224428295 >> 172.21.15.76:0/2224428295 conn(0x55a7ace9c850 msgr2=0x55a7ace8fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 -- 172.21.15.76:0/2224428295 shutdown_connections 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 -- 172.21.15.76:0/2224428295 wait complete. 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.510+0000 7faeb5701740 1 -- start start 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 Processor -- start 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7acea5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7acea6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7acf1cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1ac2e0 con 0x55a7ace94dc0 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1ad750 con 0x55a7ace90a30 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faeac1ac9b0 con 0x55a7ace944a0 2024-09-19T07:57:12.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb5701740 10 client.0 _ll_register_callbacks cb 0x7faea4007d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7acf1cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7acf1cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60258/0 (socket says 172.21.15.76:60258) 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 -- 172.21.15.76:0/2216230568 learned_addr learned my addr 172.21.15.76:0/2216230568 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7acea5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb08c3640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7acea6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 -- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 msgr2=0x55a7acea6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7acea6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 -- 172.21.15.76:0/2216230568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 msgr2=0x55a7acea5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7acea5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.511+0000 7faeb18c5640 1 -- 172.21.15.76:0/2216230568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ace916c0 con 0x55a7ace94dc0 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb18c5640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7acf1cd10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7faea4023fa0 tx=0x7faea400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0f6d23375227f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:12.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7fae94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7fae94ff9640 1 -- 172.21.15.76:0/2216230568 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4028070 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7fae94ff9640 1 -- 172.21.15.76:0/2216230568 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7faea400e9d0 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea4023420 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7fae94ff9640 1 -- 172.21.15.76:0/2216230568 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7faea40235d0 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 10 client.16815 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a7acf1e450 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7fae94ff9640 1 -- 172.21.15.76:0/2216230568 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faea4023420 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7fae94ff9640 1 -- 172.21.15.76:0/2216230568 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7faea4038c40 con 0x55a7ace94dc0 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 10 client.16815 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 20 client.16815 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7ace9f680 0x55a7acf20ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:12.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 4 client.16815 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.512+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7ace01d60 con 0x55a7ace9f680 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb08c3640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7ace9f680 0x55a7acf20ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb08c3640 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7ace9f680 0x55a7acf20ae0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a0087d9c9ac2f57 server_cookie=3abe1150bdce33f8 in_seq=0 out_seq=0 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7fae94ff9640 10 client.16815 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7fae94ff9640 1 -- 172.21.15.76:0/2216230568 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a7ace01d60 con 0x55a7ace9f680 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7fae94ff9640 10 client.16815 handle_command_reply: tid=0 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 client.16815 shutdown 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 msgr2=0x55a7acf1cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7acf1cd10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7faea4023fa0 tx=0x7faea400c750 comp rx=0 tx=0).stop 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 shutdown_connections 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a7ace9f680 0x55a7acf20ae0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a7ace94dc0 0x55a7acf1cd10 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7ace944a0 0x55a7acea6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 --2- 172.21.15.76:0/2216230568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7ace90a30 0x55a7acea5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 >> 172.21.15.76:0/2216230568 conn(0x55a7ace9c850 msgr2=0x55a7ace9da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.513+0000 7fae94ff9640 0 client.16815 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 shutdown_connections 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb5701740 1 -- 172.21.15.76:0/2216230568 wait complete. 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb5701740 20 client.16815 trim_cache size 0 max 16384 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:57:12.522 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:57:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae980a3430 msgr2=0x7fae980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae980a3430 0x7fae980a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae9c0cd2f0 tx=0x7fae9c005740 comp rx=0 tx=0).stop 2024-09-19T07:57:12.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 msgr2=0x7faeac1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 0x7faeac1985b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c970 tx=0x7fae9c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 shutdown_connections 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae980a3430 0x7fae980a58f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeac106f10 0x7faeac19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeac102790 0x7faeac198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 --2- 172.21.15.76:0/3783536839 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faeac101de0 0x7faeac1985b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 >> 172.21.15.76:0/3783536839 conn(0x7faeac0fd8c0 msgr2=0x7faeac0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 shutdown_connections 2024-09-19T07:57:12.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:12.514+0000 7faeb3328640 1 -- 172.21.15.76:0/3783536839 wait complete. 2024-09-19T07:57:13.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:57:13.319 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:57:13.569 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 -- 172.21.15.76:0/2962548462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944101de0 msgr2=0x7fd9441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/2962548462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944101de0 0x7fd9441021c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd934009900 tx=0x7fd93402a410 comp rx=0 tx=0).stop 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 -- 172.21.15.76:0/2962548462 shutdown_connections 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/2962548462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd944106f10 0x7fd94410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/2962548462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd944102790 0x7fd9441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/2962548462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944101de0 0x7fd9441021c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 -- 172.21.15.76:0/2962548462 >> 172.21.15.76:0/2962548462 conn(0x7fd9440fd8c0 msgr2=0x7fd9440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 -- 172.21.15.76:0/2962548462 shutdown_connections 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.074+0000 7fd94a9e8640 1 -- 172.21.15.76:0/2962548462 wait complete. 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 Processor -- start 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 -- start start 2024-09-19T07:57:14.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd944101de0 0x7fd944198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 0x7fd944198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd944106f10 0x7fd94419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441120d0 con 0x7fd944102790 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111f50 con 0x7fd944106f10 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd94a9e8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd944112250 con 0x7fd944101de0 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd9437fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 0x7fd944198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd9437fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 0x7fd944198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54948/0 (socket says 172.21.15.76:54948) 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd9437fe640 1 -- 172.21.15.76:0/3943320314 learned_addr learned my addr 172.21.15.76:0/3943320314 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.075+0000 7fd943fff640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd944101de0 0x7fd944198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd948f85640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd944106f10 0x7fd94419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9437fe640 1 -- 172.21.15.76:0/3943320314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd944101de0 msgr2=0x7fd944198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9437fe640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd944101de0 0x7fd944198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9437fe640 1 -- 172.21.15.76:0/3943320314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd944106f10 msgr2=0x7fd94419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9437fe640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd944106f10 0x7fd94419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9437fe640 1 -- 172.21.15.76:0/3943320314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94419d5c0 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9437fe640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 0x7fd944198b50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd93800b4a0 tx=0x7fd93800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938014070 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94419d8b0 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd938010b10 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938017d60 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.076+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9441a5190 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.077+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9441021c0 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.078+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd938017070 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.079+0000 7fd9417fa640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd92c0a33b0 0x7fd92c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.079+0000 7fd943fff640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd92c0a33b0 0x7fd92c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.079+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd9380cef60 con 0x7fd944102790 2024-09-19T07:57:14.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.079+0000 7fd943fff640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd92c0a33b0 0x7fd92c0a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd934009230 tx=0x7fd9340058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:14.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.083+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd93809b3a0 con 0x7fd944102790 2024-09-19T07:57:14.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.283+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd94410a120 con 0x7fd944102790 2024-09-19T07:57:14.284 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:14 smithi076 ceph-mon[30930]: pgmap v185: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:57:14.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.284+0000 7fd9417fa640 1 -- 172.21.15.76:0/3943320314 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11922 (secure 0 0 0) 0x7fd93809f6a0 con 0x7fd944102790 2024-09-19T07:57:14.285 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:57:14.285 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":32,"btime":"2024-09-19T07:57:07:987361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:07.753953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24457,24458,24478]},"id":1}]} 2024-09-19T07:57:14.285 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 32 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd92c0a33b0 msgr2=0x7fd92c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd92c0a33b0 0x7fd92c0a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd934009230 tx=0x7fd9340058d0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 msgr2=0x7fd944198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 0x7fd944198b50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd93800b4a0 tx=0x7fd93800b960 comp rx=0 tx=0).stop 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 shutdown_connections 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd92c0a33b0 0x7fd92c0a5870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd944106f10 0x7fd94419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd944102790 0x7fd944198b50 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 --2- 172.21.15.76:0/3943320314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd944101de0 0x7fd944198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 >> 172.21.15.76:0/3943320314 conn(0x7fd9440fd8c0 msgr2=0x7fd9440fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:14.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 shutdown_connections 2024-09-19T07:57:14.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:14.286+0000 7fd94a9e8640 1 -- 172.21.15.76:0/3943320314 wait complete. 2024-09-19T07:57:14.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:14 smithi152 ceph-mon[35117]: pgmap v185: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:57:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:14 smithi137 ceph-mon[35309]: pgmap v185: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T07:57:14.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:57:15.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:15 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3943320314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:57:15.196 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:15.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:15 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3943320314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:57:15.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:15 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3943320314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:57:15.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 -- 172.21.15.76:0/1212117343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 msgr2=0x7f81d8100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 --2- 172.21.15.76:0/1212117343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d8100ef0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009930 tx=0x7f81c802a420 comp rx=0 tx=0).stop 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 -- 172.21.15.76:0/1212117343 shutdown_connections 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 --2- 172.21.15.76:0/1212117343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81d8101430 0x7f81d810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 --2- 172.21.15.76:0/1212117343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d8100ef0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 --2- 172.21.15.76:0/1212117343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81d8106a90 0x7f81d8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 -- 172.21.15.76:0/1212117343 >> 172.21.15.76:0/1212117343 conn(0x7f81d80fc7d0 msgr2=0x7f81d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 -- 172.21.15.76:0/1212117343 shutdown_connections 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.678+0000 7f81dfa38640 1 -- 172.21.15.76:0/1212117343 wait complete. 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 Processor -- start 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 -- start start 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81d8101430 0x7f81d8199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81d8106a90 0x7f81d81a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8110ff0 con 0x7f81d8100a90 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8110e70 con 0x7f81d8106a90 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dfa38640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8111170 con 0x7f81d8101430 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dd7d4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dd7d4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d81993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54958/0 (socket says 172.21.15.76:54958) 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.679+0000 7f81dd7d4640 1 -- 172.21.15.76:0/3264428750 learned_addr learned my addr 172.21.15.76:0/3264428750 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81d8106a90 0x7f81d81a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81d8101430 0x7f81d8199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dd7d4640 1 -- 172.21.15.76:0/3264428750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81d8101430 msgr2=0x7f81d8199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81d8101430 0x7f81d8199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dd7d4640 1 -- 172.21.15.76:0/3264428750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81d8106a90 msgr2=0x7f81d81a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81d8106a90 0x7f81d81a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dd7d4640 1 -- 172.21.15.76:0/3264428750 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d81a4980 con 0x7f81d8100a90 2024-09-19T07:57:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d81993c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b4a0 tx=0x7f81d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81ce7fc640 1 -- 172.21.15.76:0/3264428750 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4014070 con 0x7f81d8100a90 2024-09-19T07:57:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d81a4b50 con 0x7f81d8100a90 2024-09-19T07:57:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81ce7fc640 1 -- 172.21.15.76:0/3264428750 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81d4010b10 con 0x7f81d8100a90 2024-09-19T07:57:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81ce7fc640 1 -- 172.21.15.76:0/3264428750 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4017d60 con 0x7f81d8100a90 2024-09-19T07:57:15.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.680+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d81a5060 con 0x7f81d8100a90 2024-09-19T07:57:15.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.682+0000 7f81ce7fc640 1 -- 172.21.15.76:0/3264428750 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f81d4017070 con 0x7f81d8100a90 2024-09-19T07:57:15.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 Processor -- start 2024-09-19T07:57:15.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 -- start start 2024-09-19T07:57:15.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c12090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c125d0 0x558b51c12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 0x558b51c1f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558b51b782f0 con 0x558b51c1d370 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b51b1fcf0 con 0x558b51c13b40 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81e1e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558b51b742b0 con 0x558b51c125d0 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81ce7fc640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81c40a33b0 0x7f81c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81dcfd3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 0x558b51c1f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81dcfd3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 0x558b51c1f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54962/0 (socket says 172.21.15.76:54962) 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3641780231 learned_addr learned my addr 172.21.15.76:0/3641780231 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c125d0 0x558b51c12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81c40a33b0 0x7f81c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.683+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c12090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3641780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c125d0 msgr2=0x558b51c12a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c125d0 0x558b51c12a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3641780231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 msgr2=0x558b51c12090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c12090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3641780231 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b51b043a0 con 0x558b51c1d370 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c125d0 0x558b51c12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81ce7fc640 1 -- 172.21.15.76:0/3264428750 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81d40ceff0 con 0x7f81d8100a90 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 0x558b51c1f760 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f81c802a940 tx=0x7f81c8031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295a19328ef0cdd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81c40a33b0 0x7f81c40a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81d00077f0 tx=0x7f81d0007780 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81c37fe640 1 -- 172.21.15.76:0/3641780231 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c803f070 con 0x558b51c1d370 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81c37fe640 1 -- 172.21.15.76:0/3641780231 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81c8031a30 con 0x558b51c1d370 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.684+0000 7f81c37fe640 1 -- 172.21.15.76:0/3641780231 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8035070 con 0x558b51c1d370 2024-09-19T07:57:15.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 -- 172.21.15.76:0/3641780231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 msgr2=0x558b51c1f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 0x558b51c1f760 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f81c802a940 tx=0x7f81c8031640 comp rx=0 tx=0).stop 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 -- 172.21.15.76:0/3641780231 shutdown_connections 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c1d370 0x558b51c1f760 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c125d0 0x558b51c12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3641780231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c12090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 -- 172.21.15.76:0/3641780231 >> 172.21.15.76:0/3641780231 conn(0x558b51bdb310 msgr2=0x558b51c0ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 -- 172.21.15.76:0/3641780231 shutdown_connections 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 -- 172.21.15.76:0/3641780231 wait complete. 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 -- start start 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.685+0000 7f81e1e11740 1 Processor -- start 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c1cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c19f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c1a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558b51c24420 con 0x558b51c125d0 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558b51b33060 con 0x558b51c13b40 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558b51c245a0 con 0x558b51c1d370 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81e1e11740 10 client.0 _ll_register_callbacks cb 0x558b518868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c1cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c1cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54972/0 (socket says 172.21.15.76:54972) 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1162736916 learned_addr learned my addr 172.21.15.76:0/1162736916 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c19f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c1a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 msgr2=0x558b51c1a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c1a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1162736916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 msgr2=0x558b51c19f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c19f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1162736916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b518e93c0 con 0x558b51c125d0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c19f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c1a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c1cc70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f81d4097d50 tx=0x7f81d409b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84745cacd51162c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.686+0000 7f81c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81c0ff9640 1 -- 172.21.15.76:0/1162736916 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d401e030 con 0x558b51c125d0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c8031a30 con 0x558b51c125d0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81c0ff9640 1 -- 172.21.15.76:0/1162736916 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81d40173f0 con 0x558b51c125d0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81c0ff9640 1 -- 172.21.15.76:0/1162736916 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f81d409f730 con 0x558b51c125d0 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 10 client.16833 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:15.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b51c2fe30 con 0x558b51c125d0 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81c0ff9640 1 -- 172.21.15.76:0/1162736916 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81c8031a30 con 0x558b51c125d0 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81c0ff9640 1 -- 172.21.15.76:0/1162736916 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7f81d40979f0 con 0x558b51c125d0 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 10 client.16833 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 10 client.16833 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 20 client.16833 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c312f0 0x558b51c33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 4 client.16833 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.687+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b51b85860 con 0x558b51c312f0 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.688+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c312f0 0x558b51c33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.688+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c312f0 0x558b51c33760 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=895d6030fd39399c server_cookie=9657048ffc7f6761 in_seq=0 out_seq=0 2024-09-19T07:57:15.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.688+0000 7f81c0ff9640 10 client.16833 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:15.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81c0ff9640 1 -- 172.21.15.76:0/1162736916 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b51b85860 con 0x558b51c312f0 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81c0ff9640 10 client.16833 handle_command_reply: tid=0 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 client.16833 shutdown 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 msgr2=0x558b51c1cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c1cc70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f81d4097d50 tx=0x7f81d409b6a0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 shutdown_connections 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c312f0 0x558b51c33760 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c1a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81c0ff9640 0 client.16833 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c19f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1162736916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c1cc70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 >> 172.21.15.76:0/1162736916 conn(0x558b51bdb310 msgr2=0x558b51c14960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:15.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 shutdown_connections 2024-09-19T07:57:15.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 1 -- 172.21.15.76:0/1162736916 wait complete. 2024-09-19T07:57:15.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.689+0000 7f81e1e11740 20 client.16833 trim_cache size 0 max 16384 2024-09-19T07:57:15.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 Processor -- start 2024-09-19T07:57:15.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 -- start start 2024-09-19T07:57:15.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c0ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c2d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c39030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81ae1b0 con 0x558b51c125d0 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81ab9f0 con 0x558b51c13b40 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81e1e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81a9840 con 0x558b51c1d370 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c0ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c0ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54988/0 (socket says 172.21.15.76:54988) 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1092225981 learned_addr learned my addr 172.21.15.76:0/1092225981 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c2d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c39030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1092225981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 msgr2=0x558b51c39030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c39030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1092225981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 msgr2=0x558b51c2d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c2d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.702+0000 7f81dd7d4640 1 -- 172.21.15.76:0/1092225981 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b51c33de0 con 0x558b51c125d0 2024-09-19T07:57:15.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c39030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:15.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c0ee10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f81d409b310 tx=0x7f81d409ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2611576ae0bf6ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:15.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81c2ffd640 1 -- 172.21.15.76:0/1092225981 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d401e030 con 0x558b51c125d0 2024-09-19T07:57:15.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81c2ffd640 1 -- 172.21.15.76:0/1092225981 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81d40b3070 con 0x558b51c125d0 2024-09-19T07:57:15.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81c2ffd640 1 -- 172.21.15.76:0/1092225981 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d40972c0 con 0x558b51c125d0 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 -- 172.21.15.76:0/1092225981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 msgr2=0x558b51c0ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c0ee10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f81d409b310 tx=0x7f81d409ac20 comp rx=0 tx=0).stop 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 -- 172.21.15.76:0/1092225981 shutdown_connections 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c39030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c13b40 0x558b51c2d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 --2- 172.21.15.76:0/1092225981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c125d0 0x558b51c0ee10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 -- 172.21.15.76:0/1092225981 >> 172.21.15.76:0/1092225981 conn(0x558b51bdb310 msgr2=0x558b51c0e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 -- 172.21.15.76:0/1092225981 shutdown_connections 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.703+0000 7f81e1e11740 1 -- 172.21.15.76:0/1092225981 wait complete. 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 -- start start 2024-09-19T07:57:15.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 Processor -- start 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c125d0 0x558b51c29dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 0x558b51c16a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c16f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81a9eb0 con 0x558b51c13b40 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81ab320 con 0x558b51c125d0 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81aa580 con 0x558b51c1d370 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81e1e11740 10 client.0 _ll_register_callbacks cb 0x7f81d40176c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81dcfd3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 0x558b51c16a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81dcfd3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 0x558b51c16a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55004/0 (socket says 172.21.15.76:55004) 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3709215404 learned_addr learned my addr 172.21.15.76:0/3709215404 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.704+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c125d0 0x558b51c29dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c16f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 msgr2=0x558b51c16f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c16f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3709215404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c125d0 msgr2=0x558b51c29dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c125d0 0x558b51c29dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81dcfd3640 1 -- 172.21.15.76:0/3709215404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b51c17580 con 0x558b51c13b40 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81ddfd5640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c16f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81dcfd3640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 0x558b51c16a50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x558b51c13070 tx=0x7f81c802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623e54ff4b84bbba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81c0ff9640 1 -- 172.21.15.76:0/3709215404 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8053060 con 0x558b51c13b40 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81c0ff9640 1 -- 172.21.15.76:0/3709215404 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f81c8004240 con 0x558b51c13b40 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81d40b3070 con 0x558b51c13b40 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81c0ff9640 1 -- 172.21.15.76:0/3709215404 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f81c8035040 con 0x558b51c13b40 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81e1e11740 10 client.16839 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:15.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b51c9bdd0 con 0x558b51c13b40 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.705+0000 7f81c0ff9640 1 -- 172.21.15.76:0/3709215404 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81d40b3070 con 0x558b51c13b40 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81c0ff9640 1 -- 172.21.15.76:0/3709215404 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7f81c80035f0 con 0x558b51c13b40 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81e1e11740 10 client.16839 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81e1e11740 10 client.16839 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81e1e11740 20 client.16839 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c9c200 0x558b51c9e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81e1e11740 4 client.16839 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b51b7fd70 con 0x558b51c9c200 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.706+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c9c200 0x558b51c9e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81dd7d4640 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c9c200 0x558b51c9e5f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58d8abfa0ea405ff server_cookie=addf79de1df893b6 in_seq=0 out_seq=0 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81c0ff9640 10 client.16839 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:15.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81c0ff9640 1 -- 172.21.15.76:0/3709215404 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b51b7fd70 con 0x558b51c9c200 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81c0ff9640 10 client.16839 handle_command_reply: tid=0 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 client.16839 shutdown 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 msgr2=0x558b51c16a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 0x558b51c16a50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x558b51c13070 tx=0x7f81c802a420 comp rx=0 tx=0).stop 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 shutdown_connections 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x558b51c9c200 0x558b51c9e5f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81c0ff9640 0 client.16839 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b51c1d370 0x558b51c16f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558b51c13b40 0x558b51c16a50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 --2- 172.21.15.76:0/3709215404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558b51c125d0 0x558b51c29dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 >> 172.21.15.76:0/3709215404 conn(0x558b51bdb310 msgr2=0x558b51c1bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:15.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 shutdown_connections 2024-09-19T07:57:15.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 1 -- 172.21.15.76:0/3709215404 wait complete. 2024-09-19T07:57:15.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.707+0000 7f81e1e11740 20 client.16839 trim_cache size 0 max 16384 2024-09-19T07:57:15.715 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:57:15.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81c40a33b0 msgr2=0x7f81c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81c40a33b0 0x7f81c40a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81d00077f0 tx=0x7f81d0007780 comp rx=0 tx=0).stop 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 msgr2=0x7f81d81993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d81993c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b4a0 tx=0x7f81d400b960 comp rx=0 tx=0).stop 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 shutdown_connections 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f81c40a33b0 0x7f81c40a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81d8106a90 0x7f81d81a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81d8101430 0x7f81d8199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 --2- 172.21.15.76:0/3264428750 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f81d8100a90 0x7f81d81993c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 >> 172.21.15.76:0/3264428750 conn(0x7f81d80fc7d0 msgr2=0x7f81d80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 shutdown_connections 2024-09-19T07:57:15.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:15.708+0000 7f81dfa38640 1 -- 172.21.15.76:0/3264428750 wait complete. 2024-09-19T07:57:16.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:16 smithi152 ceph-mon[35117]: pgmap v186: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:16.327 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:16 smithi076 ceph-mon[30930]: pgmap v186: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:16.356 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:57:16.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:16 smithi137 ceph-mon[35309]: pgmap v186: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T07:57:16.600 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/624903696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb7410c170 msgr2=0x7fbb7410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/624903696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb7410c170 0x7fbb7410e610 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009900 tx=0x7fbb6c02a480 comp rx=0 tx=0).stop 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/624903696 shutdown_connections 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/624903696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb7410c170 0x7fbb7410e610 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/624903696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb74103660 0x7fbb7410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/624903696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb74102d40 0x7fbb74103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/624903696 >> 172.21.15.76:0/624903696 conn(0x7fbb740fc7a0 msgr2=0x7fbb740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:17.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/624903696 shutdown_connections 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.095+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/624903696 wait complete. 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 Processor -- start 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 -- start start 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 0x7fbb741009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb74103660 0x7fbb74100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb7410c170 0x7fbb74101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbb74112170 con 0x7fbb74102d40 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb74111ff0 con 0x7fbb74103660 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb7a1c1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741122f0 con 0x7fbb7410c170 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb737fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 0x7fbb741009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb737fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 0x7fbb741009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55036/0 (socket says 172.21.15.76:55036) 2024-09-19T07:57:17.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb737fe640 1 -- 172.21.15.76:0/2149403239 learned_addr learned my addr 172.21.15.76:0/2149403239 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb74103660 0x7fbb74100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.096+0000 7fbb73fff640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb7410c170 0x7fbb74101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb737fe640 1 -- 172.21.15.76:0/2149403239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb7410c170 msgr2=0x7fbb74101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb737fe640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb7410c170 0x7fbb74101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb737fe640 1 -- 172.21.15.76:0/2149403239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb74103660 msgr2=0x7fbb74100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb737fe640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb74103660 0x7fbb74100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb737fe640 1 -- 172.21.15.76:0/2149403239 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb741a6ad0 con 0x7fbb74102d40 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb73fff640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb7410c170 0x7fbb74101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb737fe640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 0x7fbb741009a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400ba50 tx=0x7fbb6400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb70ff9640 1 -- 172.21.15.76:0/2149403239 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64019070 con 0x7fbb74102d40 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb741a6dc0 con 0x7fbb74102d40 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb70ff9640 1 -- 172.21.15.76:0/2149403239 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb6400cbe0 con 0x7fbb74102d40 2024-09-19T07:57:17.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb70ff9640 1 -- 172.21.15.76:0/2149403239 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64007770 con 0x7fbb74102d40 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.097+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb741a7270 con 0x7fbb74102d40 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb70ff9640 1 -- 172.21.15.76:0/2149403239 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbb6401c070 con 0x7fbb74102d40 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 Processor -- start 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 -- start start 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56004472f2f0 con 0x5600447d4370 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5600446d6cf0 con 0x5600447cab40 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56004472b2b0 con 0x5600447c95d0 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55042/0 (socket says 172.21.15.76:55042) 2024-09-19T07:57:17.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 -- 172.21.15.76:0/3145128738 learned_addr learned my addr 172.21.15.76:0/3145128738 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb73fff640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 -- 172.21.15.76:0/3145128738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 msgr2=0x5600447c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb737fe640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 -- 172.21.15.76:0/3145128738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 msgr2=0x5600447c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb72ffd640 1 -- 172.21.15.76:0/3145128738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600446bb3a0 con 0x5600447d4370 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb70ff9640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbb600a33b0 0x7fbb600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb73fff640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.100+0000 7fbb737fe640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb73fff640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbb600a33b0 0x7fbb600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d6760 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009a20 tx=0x7fbb5c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955ae9f8b2063d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:17.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb70ff9640 1 -- 172.21.15.76:0/2149403239 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fbb640cf2d0 con 0x7fbb74102d40 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb69ffb640 1 -- 172.21.15.76:0/3145128738 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c017070 con 0x5600447d4370 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb69ffb640 1 -- 172.21.15.76:0/3145128738 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb5c013470 con 0x5600447d4370 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb69ffb640 1 -- 172.21.15.76:0/3145128738 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c012610 con 0x5600447d4370 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb7c59a740 1 -- 172.21.15.76:0/3145128738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 msgr2=0x5600447d6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.101+0000 7fbb73fff640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbb600a33b0 0x7fbb600a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c005ab0 tx=0x7fbb6c0058b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d6760 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009a20 tx=0x7fbb5c009ee0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- 172.21.15.76:0/3145128738 shutdown_connections 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d6760 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/3145128738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- 172.21.15.76:0/3145128738 >> 172.21.15.76:0/3145128738 conn(0x560044792310 msgr2=0x5600447c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- 172.21.15.76:0/3145128738 shutdown_connections 2024-09-19T07:57:17.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- 172.21.15.76:0/3145128738 wait complete. 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- start start 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 Processor -- start 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5600447d7070 con 0x5600447d4370 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5600446ea060 con 0x5600447cab40 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.102+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5600447d71f0 con 0x5600447c95d0 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb7c59a740 10 client.0 _ll_register_callbacks cb 0x56004443d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55046/0 (socket says 172.21.15.76:55046) 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 -- 172.21.15.76:0/235556850 learned_addr learned my addr 172.21.15.76:0/235556850 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:17.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb737fe640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 -- 172.21.15.76:0/235556850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 msgr2=0x5600447d3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447d3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 -- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 msgr2=0x5600447d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 -- 172.21.15.76:0/235556850 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600444a03c0 con 0x5600447d4370 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb73fff640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d1450 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009900 tx=0x7fbb6c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eded32eda7a40757 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb52ffd640 1 -- 172.21.15.76:0/235556850 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c04c020 con 0x5600447d4370 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb52ffd640 1 -- 172.21.15.76:0/235556850 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fbb6c003d40 con 0x5600447d4370 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.103+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb5c013470 con 0x5600447d4370 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb52ffd640 1 -- 172.21.15.76:0/235556850 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbb6c057050 con 0x5600447d4370 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 10 client.16851 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:17.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5600447e2990 con 0x5600447d4370 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb52ffd640 1 -- 172.21.15.76:0/235556850 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb5c013470 con 0x5600447d4370 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb52ffd640 1 -- 172.21.15.76:0/235556850 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7fbb6c03b630 con 0x5600447d4370 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 10 client.16851 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 10 client.16851 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 20 client.16851 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447e3e50 0x5600447e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 4 client.16851 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56004473c860 con 0x5600447e3e50 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.104+0000 7fbb737fe640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447e3e50 0x5600447e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.105+0000 7fbb737fe640 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447e3e50 0x5600447e62f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c2ac9efe9b897f server_cookie=2de110276e576d1 in_seq=0 out_seq=0 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.105+0000 7fbb52ffd640 10 client.16851 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.105+0000 7fbb52ffd640 1 -- 172.21.15.76:0/235556850 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56004473c860 con 0x5600447e3e50 2024-09-19T07:57:17.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.105+0000 7fbb52ffd640 10 client.16851 handle_command_reply: tid=0 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.105+0000 7fbb7c59a740 1 client.16851 shutdown 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 msgr2=0x5600447d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d1450 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009900 tx=0x7fbb6c02a480 comp rx=0 tx=0).stop 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 shutdown_connections 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447e3e50 0x5600447e62f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447d4370 0x5600447d1450 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb52ffd640 0 client.16851 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/235556850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5600447c95d0 0x5600447d3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 >> 172.21.15.76:0/235556850 conn(0x560044792310 msgr2=0x5600447cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 shutdown_connections 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 1 -- 172.21.15.76:0/235556850 wait complete. 2024-09-19T07:57:17.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.106+0000 7fbb7c59a740 20 client.16851 trim_cache size 0 max 16384 2024-09-19T07:57:17.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 Processor -- start 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 -- start start 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447e0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741b2790 con 0x5600447c95d0 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741affd0 con 0x5600447cab40 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741ade20 con 0x560044792310 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447e0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55050/0 (socket says 172.21.15.76:55050) 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 -- 172.21.15.76:0/2063780332 learned_addr learned my addr 172.21.15.76:0/2063780332 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb737fe640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb73fff640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 -- 172.21.15.76:0/2063780332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 msgr2=0x5600447c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 -- 172.21.15.76:0/2063780332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 msgr2=0x5600447ebc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447ebc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 -- 172.21.15.76:0/2063780332 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600447c9d50 con 0x5600447c95d0 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb737fe640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb73fff640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447e0310 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x5600447ca070 tx=0x7fbb5c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b3614e06a5c3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.119+0000 7fbb697fa640 1 -- 172.21.15.76:0/2063780332 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c017040 con 0x5600447c95d0 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb697fa640 1 -- 172.21.15.76:0/2063780332 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb5c013970 con 0x5600447c95d0 2024-09-19T07:57:17.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb697fa640 1 -- 172.21.15.76:0/2063780332 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c026bd0 con 0x5600447c95d0 2024-09-19T07:57:17.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 -- 172.21.15.76:0/2063780332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 msgr2=0x5600447e0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447e0310 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x5600447ca070 tx=0x7fbb5c0047d0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 -- 172.21.15.76:0/2063780332 shutdown_connections 2024-09-19T07:57:17.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447e0310 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/2063780332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 -- 172.21.15.76:0/2063780332 >> 172.21.15.76:0/2063780332 conn(0x5600447d15b0 msgr2=0x5600447c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 -- 172.21.15.76:0/2063780332 shutdown_connections 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.120+0000 7fbb7c59a740 1 -- 172.21.15.76:0/2063780332 wait complete. 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 -- start start 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 Processor -- start 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447d8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741ae490 con 0x5600447c95d0 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741af900 con 0x5600447cab40 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb741aeb60 con 0x560044792310 2024-09-19T07:57:17.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb7c59a740 10 client.0 _ll_register_callbacks cb 0x7fbb6c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb72ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb72ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447d8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55066/0 (socket says 172.21.15.76:55066) 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb72ffd640 1 -- 172.21.15.76:0/310481946 learned_addr learned my addr 172.21.15.76:0/310481946 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb737fe640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.121+0000 7fbb73fff640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb72ffd640 1 -- 172.21.15.76:0/310481946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 msgr2=0x5600447d8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447d8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb72ffd640 1 -- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 msgr2=0x5600447d8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb72ffd640 1 -- 172.21.15.76:0/310481946 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56004484dc60 con 0x5600447c95d0 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb73fff640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:17.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb72ffd640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447d8790 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c008010 tx=0x7fbb5c0099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2857ccd397321c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb52ffd640 1 -- 172.21.15.76:0/310481946 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c02c070 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb52ffd640 1 -- 172.21.15.76:0/310481946 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fbb5c0059c0 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb5c013970 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb52ffd640 1 -- 172.21.15.76:0/310481946 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbb5c038050 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb7c59a740 10 client.16857 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56004484eeb0 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb52ffd640 1 -- 172.21.15.76:0/310481946 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb5c013970 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb52ffd640 1 -- 172.21.15.76:0/310481946 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7fbb5c006120 con 0x5600447c95d0 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb7c59a740 10 client.16857 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.122+0000 7fbb7c59a740 10 client.16857 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb7c59a740 20 client.16857 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:17.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447d4370 0x5600448511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb7c59a740 4 client.16857 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560044736d70 con 0x5600447d4370 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb737fe640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447d4370 0x5600448511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb737fe640 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447d4370 0x5600448511f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9421b25f9006d198 server_cookie=ecfa19a17b6cd266 in_seq=0 out_seq=0 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb52ffd640 10 client.16857 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb52ffd640 1 -- 172.21.15.76:0/310481946 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560044736d70 con 0x5600447d4370 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb52ffd640 10 client.16857 handle_command_reply: tid=0 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.123+0000 7fbb7c59a740 1 client.16857 shutdown 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 msgr2=0x5600447d8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447d8790 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c008010 tx=0x7fbb5c0099a0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 shutdown_connections 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5600447d4370 0x5600448511f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600447cab40 0x5600447d8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5600447c95d0 0x5600447d8790 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 --2- 172.21.15.76:0/310481946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560044792310 0x5600447d8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 >> 172.21.15.76:0/310481946 conn(0x5600447d15b0 msgr2=0x5600447c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb52ffd640 0 client.16857 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 shutdown_connections 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 1 -- 172.21.15.76:0/310481946 wait complete. 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7c59a740 20 client.16857 trim_cache size 0 max 16384 2024-09-19T07:57:17.132 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:57:17.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbb600a33b0 msgr2=0x7fbb600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbb600a33b0 0x7fbb600a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c005ab0 tx=0x7fbb6c0058b0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 msgr2=0x7fbb741009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:17.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 0x7fbb741009a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400ba50 tx=0x7fbb6400bf10 comp rx=0 tx=0).stop 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 shutdown_connections 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fbb600a33b0 0x7fbb600a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb7410c170 0x7fbb74101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb74103660 0x7fbb74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 --2- 172.21.15.76:0/2149403239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbb74102d40 0x7fbb741009a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 >> 172.21.15.76:0/2149403239 conn(0x7fbb740fc7a0 msgr2=0x7fbb740fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.124+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 shutdown_connections 2024-09-19T07:57:17.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:17.125+0000 7fbb7a1c1640 1 -- 172.21.15.76:0/2149403239 wait complete. 2024-09-19T07:57:17.882 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:57:18.128 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:18.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:18 smithi152 ceph-mon[35117]: pgmap v187: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:57:18.367 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:18 smithi076 ceph-mon[30930]: pgmap v187: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:57:18.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:18 smithi137 ceph-mon[35309]: pgmap v187: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:57:18.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3542295548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 msgr2=0x7f6f9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3542295548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f9810d950 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009cd0 tx=0x7f6f9002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3542295548 shutdown_connections 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3542295548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f9810d950 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3542295548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f98100a80 0x7f6f98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3542295548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f98106a80 0x7f6f98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3542295548 >> 172.21.15.76:0/3542295548 conn(0x7f6f980fc7a0 msgr2=0x7f6f980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3542295548 shutdown_connections 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.591+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3542295548 wait complete. 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 Processor -- start 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 -- start start 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f98100a80 0x7f6f98199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f981998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f98106a80 0x7f6f98199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98110fe0 con 0x7f6f98101420 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98110e60 con 0x7f6f98106a80 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6fa06f8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98111160 con 0x7f6f98100a80 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6f9dc93640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f981998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6f9dc93640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f981998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55074/0 (socket says 172.21.15.76:55074) 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6f9dc93640 1 -- 172.21.15.76:0/3317675935 learned_addr learned my addr 172.21.15.76:0/3317675935 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.592+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f98106a80 0x7f6f98199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f98100a80 0x7f6f98199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9dc93640 1 -- 172.21.15.76:0/3317675935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f98100a80 msgr2=0x7f6f98199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f98100a80 0x7f6f98199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9dc93640 1 -- 172.21.15.76:0/3317675935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f98106a80 msgr2=0x7f6f98199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f98106a80 0x7f6f98199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9dc93640 1 -- 172.21.15.76:0/3317675935 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f981a4790 con 0x7f6f98101420 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f981998d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800b4a0 tx=0x7f6f8800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f8f7fe640 1 -- 172.21.15.76:0/3317675935 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88015020 con 0x7f6f98101420 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f8f7fe640 1 -- 172.21.15.76:0/3317675935 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f88011d30 con 0x7f6f98101420 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f981a4a80 con 0x7f6f98101420 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6f8f7fe640 1 -- 172.21.15.76:0/3317675935 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800f2e0 con 0x7f6f98101420 2024-09-19T07:57:18.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.593+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f981a4f90 con 0x7f6f98101420 2024-09-19T07:57:18.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.595+0000 7f6f8f7fe640 1 -- 172.21.15.76:0/3317675935 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6f88018020 con 0x7f6f98101420 2024-09-19T07:57:18.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 Processor -- start 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 -- start start 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b0647090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b0647a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0654760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5559b05ad2f0 con 0x5559b0652370 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5559b0554cf0 con 0x5559b06475d0 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5559b05a92b0 con 0x5559b0648b40 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6f8f7fe640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6f840a3430 0x7f6f840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6f9dc93640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0654760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6f9dc93640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0654760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55076/0 (socket says 172.21.15.76:55076) 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6f9dc93640 1 -- 172.21.15.76:0/3704494677 learned_addr learned my addr 172.21.15.76:0/3704494677 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b0647a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.596+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b0647090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6f840a3430 0x7f6f840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f8f7fe640 1 -- 172.21.15.76:0/3317675935 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6f880cf490 con 0x7f6f98101420 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9e494640 1 -- 172.21.15.76:0/3704494677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 msgr2=0x5559b0647090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b0647090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9e494640 1 -- 172.21.15.76:0/3704494677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 msgr2=0x5559b0654760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0654760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9e494640 1 -- 172.21.15.76:0/3704494677 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b05393a0 con 0x5559b06475d0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0654760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b0647a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400abf0 tx=0x7f6f9400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a67cf3a8126b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6f840a3430 0x7f6f840a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f90006010 tx=0x7f6f900095c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f8cff9640 1 -- 172.21.15.76:0/3704494677 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94005220 con 0x5559b06475d0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f8cff9640 1 -- 172.21.15.76:0/3704494677 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f94004ca0 con 0x5559b06475d0 2024-09-19T07:57:18.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.597+0000 7f6f8cff9640 1 -- 172.21.15.76:0/3704494677 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94018940 con 0x5559b06475d0 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3704494677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 msgr2=0x5559b0647a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b0647a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400abf0 tx=0x7f6f9400f790 comp rx=0 tx=0).stop 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3704494677 shutdown_connections 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0654760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b0647a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3704494677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b0647090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3704494677 >> 172.21.15.76:0/3704494677 conn(0x5559b0610310 msgr2=0x5559b0643c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3704494677 shutdown_connections 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3704494677 wait complete. 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.598+0000 7f6fa2ad1740 1 -- start start 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 Processor -- start 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 0x5559b0651c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b064ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0652370 0x5559b064f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5559b0655070 con 0x5559b06475d0 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5559b0568060 con 0x5559b0652370 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5559b06551f0 con 0x5559b0648b40 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6fa2ad1740 10 client.0 _ll_register_callbacks cb 0x5559b02bb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 0x5559b0651c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 0x5559b0651c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55078/0 (socket says 172.21.15.76:55078) 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 -- 172.21.15.76:0/2604761347 learned_addr learned my addr 172.21.15.76:0/2604761347 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b064ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 -- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 msgr2=0x5559b064ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b064ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 -- 172.21.15.76:0/2604761347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0652370 msgr2=0x5559b064f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0652370 0x5559b064f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 -- 172.21.15.76:0/2604761347 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b031e3c0 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f9e494640 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 0x5559b0651c80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6f94018480 tx=0x7f6f94005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf11477db2c1146 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.599+0000 7f6f81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6f81ffb640 1 -- 172.21.15.76:0/2604761347 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94027070 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6f81ffb640 1 -- 172.21.15.76:0/2604761347 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6f94018660 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f94004ca0 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6f81ffb640 1 -- 172.21.15.76:0/2604761347 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6f94033050 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 10 client.16869 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5559b0660a60 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6f81ffb640 1 -- 172.21.15.76:0/2604761347 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f94004ca0 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6f81ffb640 1 -- 172.21.15.76:0/2604761347 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7f6f94023550 con 0x5559b06475d0 2024-09-19T07:57:18.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 10 client.16869 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 20 client.16869 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b0661e10 0x5559b0664200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 4 client.16869 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559b05ba860 con 0x5559b0661e10 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.600+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b0661e10 0x5559b0664200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.601+0000 7f6f81ffb640 10 client.16869 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.601+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b0661e10 0x5559b0664200 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d6a140f28eecf57 server_cookie=c3578ef445798764 in_seq=0 out_seq=0 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6f81ffb640 1 -- 172.21.15.76:0/2604761347 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559b05ba860 con 0x5559b0661e10 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6f81ffb640 10 client.16869 handle_command_reply: tid=0 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 client.16869 shutdown 2024-09-19T07:57:18.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 msgr2=0x5559b0651c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 0x5559b0651c80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6f94018480 tx=0x7f6f94005100 comp rx=0 tx=0).stop 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 shutdown_connections 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0652370 0x5559b064f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b064ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b0661e10 0x5559b0664200 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/2604761347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b06475d0 0x5559b0651c80 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6f81ffb640 0 client.16869 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 >> 172.21.15.76:0/2604761347 conn(0x5559b0610310 msgr2=0x5559b0649960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 shutdown_connections 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/2604761347 wait complete. 2024-09-19T07:57:18.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.602+0000 7f6fa2ad1740 20 client.16869 trim_cache size 0 max 16384 2024-09-19T07:57:18.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.614+0000 7f6fa2ad1740 1 Processor -- start 2024-09-19T07:57:18.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.614+0000 7f6fa2ad1740 1 -- start start 2024-09-19T07:57:18.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b065e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b06698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0669e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981b2660 con 0x5559b0652370 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981afea0 con 0x5559b06475d0 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981adcf0 con 0x5559b0648b40 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0669e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0669e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55086/0 (socket says 172.21.15.76:55086) 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3380757263 learned_addr learned my addr 172.21.15.76:0/3380757263 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b065e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b06698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3380757263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 msgr2=0x5559b06698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b06698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3380757263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 msgr2=0x5559b065e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b065e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3380757263 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b0651ff0 con 0x5559b0652370 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b065e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0669e00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009cd0 tx=0x7f6f90005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fca508b17f39d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.615+0000 7f6f83fff640 1 -- 172.21.15.76:0/3380757263 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90031430 con 0x5559b0652370 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6f83fff640 1 -- 172.21.15.76:0/3380757263 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f90036070 con 0x5559b0652370 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6f83fff640 1 -- 172.21.15.76:0/3380757263 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90054430 con 0x5559b0652370 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3380757263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 msgr2=0x5559b0669e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0669e00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009cd0 tx=0x7f6f90005ef0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3380757263 shutdown_connections 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b0669e00 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b0648b40 0x5559b06698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3380757263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b06475d0 0x5559b065e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3380757263 >> 172.21.15.76:0/3380757263 conn(0x5559b0610310 msgr2=0x5559b064e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3380757263 shutdown_connections 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3380757263 wait complete. 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.616+0000 7f6fa2ad1740 1 -- start start 2024-09-19T07:57:18.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 Processor -- start 2024-09-19T07:57:18.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b06475d0 0x5559b065adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0648b40 0x5559b064bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b064c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981ae360 con 0x5559b0652370 2024-09-19T07:57:18.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981af7d0 con 0x5559b0648b40 2024-09-19T07:57:18.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981aea30 con 0x5559b06475d0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6fa2ad1740 10 client.0 _ll_register_callbacks cb 0x7f6f8809b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b064c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b064c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55102/0 (socket says 172.21.15.76:55102) 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3137694903 learned_addr learned my addr 172.21.15.76:0/3137694903 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9dc93640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0648b40 0x5559b064bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b06475d0 0x5559b065adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b06475d0 msgr2=0x5559b065adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b06475d0 0x5559b065adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3137694903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0648b40 msgr2=0x5559b064bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0648b40 0x5559b064bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.617+0000 7f6f9ec95640 1 -- 172.21.15.76:0/3137694903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b06cb890 con 0x5559b0652370 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f9ec95640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b064c520 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6f9002ae00 tx=0x7f6f90005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a0c2e9bc382481 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:18.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f81ffb640 1 -- 172.21.15.76:0/3137694903 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90031430 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f81ffb640 1 -- 172.21.15.76:0/3137694903 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f6f90030b50 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f90036070 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f81ffb640 1 -- 172.21.15.76:0/3137694903 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6f90030d50 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 10 client.16875 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5559b06cc9f0 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f81ffb640 1 -- 172.21.15.76:0/3137694903 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f90036070 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6f81ffb640 1 -- 172.21.15.76:0/3137694903 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7f6f90030070 con 0x5559b0652370 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 10 client.16875 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 20 client.16875 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b06cd0f0 0x5559b06cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 4 client.16875 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:57:18.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.618+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559b064f800 con 0x5559b06cd0f0 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b06cd0f0 0x5559b06cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6f81ffb640 10 client.16875 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6f9e494640 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b06cd0f0 0x5559b06cf510 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988f983c946b5f05 server_cookie=d0e0773d3dea5706 in_seq=0 out_seq=0 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6f81ffb640 1 -- 172.21.15.76:0/3137694903 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559b064f800 con 0x5559b06cd0f0 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6f81ffb640 10 client.16875 handle_command_reply: tid=0 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6fa2ad1740 1 client.16875 shutdown 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 msgr2=0x5559b064c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.619+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b064c520 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6f9002ae00 tx=0x7f6f90005fa0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 shutdown_connections 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5559b06cd0f0 0x5559b06cf510 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5559b0652370 0x5559b064c520 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559b0648b40 0x5559b064bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 --2- 172.21.15.76:0/3137694903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5559b06475d0 0x5559b065adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 >> 172.21.15.76:0/3137694903 conn(0x5559b0610310 msgr2=0x5559b06424e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:18.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6f81ffb640 0 client.16875 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:18.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 shutdown_connections 2024-09-19T07:57:18.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 1 -- 172.21.15.76:0/3137694903 wait complete. 2024-09-19T07:57:18.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.620+0000 7f6fa2ad1740 20 client.16875 trim_cache size 0 max 16384 2024-09-19T07:57:18.626 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6f840a3430 msgr2=0x7f6f840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6f840a3430 0x7f6f840a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f90006010 tx=0x7f6f900095c0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 msgr2=0x7f6f981998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f981998d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800b4a0 tx=0x7f6f8800b8a0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 shutdown_connections 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6f840a3430 0x7f6f840a58f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f98106a80 0x7f6f98199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6f98101420 0x7f6f981998d0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 --2- 172.21.15.76:0/3317675935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f98100a80 0x7f6f98199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 >> 172.21.15.76:0/3317675935 conn(0x7f6f980fc7a0 msgr2=0x7f6f980fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 shutdown_connections 2024-09-19T07:57:18.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:18.621+0000 7f6fa06f8640 1 -- 172.21.15.76:0/3317675935 wait complete. 2024-09-19T07:57:20.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:20 smithi152 ceph-mon[35117]: pgmap v188: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:57:20.313 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:57:20.313 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:57:20.340 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:20 smithi076 ceph-mon[30930]: pgmap v188: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:57:20.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:20 smithi137 ceph-mon[35309]: pgmap v188: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:57:20.567 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:21.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 -- 172.21.15.76:0/2662649245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 msgr2=0x7f918410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 --2- 172.21.15.76:0/2662649245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918410ec40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f917c009930 tx=0x7f917c02a420 comp rx=0 tx=0).stop 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 -- 172.21.15.76:0/2662649245 shutdown_connections 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 --2- 172.21.15.76:0/2662649245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918410ec40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 --2- 172.21.15.76:0/2662649245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91841036e0 0x7f9184107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 --2- 172.21.15.76:0/2662649245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9184102d30 0x7f9184103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 -- 172.21.15.76:0/2662649245 >> 172.21.15.76:0/2662649245 conn(0x7f91840fc7d0 msgr2=0x7f91840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 -- 172.21.15.76:0/2662649245 shutdown_connections 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 -- 172.21.15.76:0/2662649245 wait complete. 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 Processor -- start 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.065+0000 7f918c326640 1 -- start start 2024-09-19T07:57:21.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9184102d30 0x7f91841986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91841036e0 0x7f9184198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9184112240 con 0x7f91841082a0 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91841120c0 con 0x7f9184102d30 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91841123c0 con 0x7f91841036e0 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918419cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55114/0 (socket says 172.21.15.76:55114) 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 -- 172.21.15.76:0/176335163 learned_addr learned my addr 172.21.15.76:0/176335163 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a0c2640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9184102d30 0x7f91841986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f91898c1640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91841036e0 0x7f9184198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 -- 172.21.15.76:0/176335163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91841036e0 msgr2=0x7f9184198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91841036e0 0x7f9184198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 -- 172.21.15.76:0/176335163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9184102d30 msgr2=0x7f91841986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9184102d30 0x7f91841986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 -- 172.21.15.76:0/176335163 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918419d650 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918a8c3640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918419cf70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f917c005ab0 tx=0x7f917c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f91837fe640 1 -- 172.21.15.76:0/176335163 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c03f030 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918419d8e0 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f91837fe640 1 -- 172.21.15.76:0/176335163 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f917c003d00 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.066+0000 7f91837fe640 1 -- 172.21.15.76:0/176335163 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c035070 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.067+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91841a5220 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.069+0000 7f91837fe640 1 -- 172.21.15.76:0/176335163 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f917c042030 con 0x7f91841082a0 2024-09-19T07:57:21.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.069+0000 7f918e6ff740 1 Processor -- start 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.069+0000 7f918e6ff740 1 -- start start 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a17e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a26c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a29540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918e6ff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555e4197d280 con 0x555e41a18340 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918e6ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e41924b10 con 0x555e41a17a20 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918e6ff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555e41979240 con 0x555e41a27150 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a26c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a26c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55124/0 (socket says 172.21.15.76:55124) 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 -- 172.21.15.76:0/2880710582 learned_addr learned my addr 172.21.15.76:0/2880710582 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f91837fe640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f916c0a33b0 0x7f916c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f91898c1640 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a17e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f91898c1640 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a29540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 -- 172.21.15.76:0/2880710582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 msgr2=0x555e41a29540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a8c3640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f916c0a33b0 0x7f916c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a29540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 -- 172.21.15.76:0/2880710582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 msgr2=0x555e41a17e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a17e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 -- 172.21.15.76:0/2880710582 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e419311f0 con 0x555e41a18340 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a26c10 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f917400a4b0 tx=0x7f91740096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707e86ed43a044ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f91837fe640 1 -- 172.21.15.76:0/176335163 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f917c0f0530 con 0x7f91841082a0 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.070+0000 7f9180dea640 1 -- 172.21.15.76:0/2880710582 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174013790 con 0x555e41a18340 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f9180dea640 1 -- 172.21.15.76:0/2880710582 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9174019070 con 0x555e41a18340 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f9180dea640 1 -- 172.21.15.76:0/2880710582 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91740122e0 con 0x555e41a18340 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 -- 172.21.15.76:0/2880710582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 msgr2=0x555e41a26c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918a8c3640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f916c0a33b0 0x7f916c0a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f917c0b9240 tx=0x7f917c0b83e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a26c10 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f917400a4b0 tx=0x7f91740096d0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 -- 172.21.15.76:0/2880710582 shutdown_connections 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a29540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a26c10 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2880710582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a17e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 -- 172.21.15.76:0/2880710582 >> 172.21.15.76:0/2880710582 conn(0x555e41a140f0 msgr2=0x555e41a144d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 -- 172.21.15.76:0/2880710582 shutdown_connections 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.071+0000 7f918e6ff740 1 -- 172.21.15.76:0/2880710582 wait complete. 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 -- start start 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 Processor -- start 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a18340 0x555e41a245f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a27150 0x555e41a24b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555e41a29d20 con 0x555e41a27150 2024-09-19T07:57:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e41937f10 con 0x555e41a17a20 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555e41a29ea0 con 0x555e41a18340 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918e6ff740 10 client.0 _ll_register_callbacks cb 0x555e41900a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f91898c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a27150 0x555e41a24b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f91898c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a27150 0x555e41a24b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55128/0 (socket says 172.21.15.76:55128) 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f91898c1640 1 -- 172.21.15.76:0/2568252410 learned_addr learned my addr 172.21.15.76:0/2568252410 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f91898c1640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.072+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a18340 0x555e41a245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918a0c2640 1 -- 172.21.15.76:0/2568252410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 msgr2=0x555e41a240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918a0c2640 1 -- 172.21.15.76:0/2568252410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a27150 msgr2=0x555e41a24b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a27150 0x555e41a24b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918a0c2640 1 -- 172.21.15.76:0/2568252410 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e416ee6a0 con 0x555e41a18340 2024-09-19T07:57:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918a0c2640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a18340 0x555e41a245f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9174014a20 tx=0x7f91740147a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4037f35331d99bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f9169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f9169ffb640 1 -- 172.21.15.76:0/2568252410 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91740139a0 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9174019070 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.073+0000 7f9169ffb640 1 -- 172.21.15.76:0/2568252410 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f9174013b40 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f9169ffb640 1 -- 172.21.15.76:0/2568252410 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9174013d40 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 10 client.26011 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555e41a359e0 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f9169ffb640 1 -- 172.21.15.76:0/2568252410 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9174019070 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f9169ffb640 1 -- 172.21.15.76:0/2568252410 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7f9174028410 con 0x555e41a18340 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 10 client.26011 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 10 client.26011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:21.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 20 client.26011 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:21.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41a36d90 0x555e41a39180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 4 client.26011 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:21.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e4198a7f0 con 0x555e41a36d90 2024-09-19T07:57:21.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.074+0000 7f91898c1640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41a36d90 0x555e41a39180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.075+0000 7f9169ffb640 10 client.26011 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:21.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.075+0000 7f91898c1640 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41a36d90 0x555e41a39180 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52cd9cdc26b54720 server_cookie=743ffa00576e4522 in_seq=0 out_seq=0 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.075+0000 7f9169ffb640 1 -- 172.21.15.76:0/2568252410 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e4198a7f0 con 0x555e41a36d90 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.075+0000 7f9169ffb640 10 client.26011 handle_command_reply: tid=0 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.075+0000 7f918e6ff740 1 client.26011 shutdown 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a18340 msgr2=0x555e41a245f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a18340 0x555e41a245f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9174014a20 tx=0x7f91740147a0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 shutdown_connections 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41a36d90 0x555e41a39180 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a27150 0x555e41a24b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a18340 0x555e41a245f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f9169ffb640 0 client.26011 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 --2- 172.21.15.76:0/2568252410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 >> 172.21.15.76:0/2568252410 conn(0x555e41a140f0 msgr2=0x555e41a19e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 shutdown_connections 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 1 -- 172.21.15.76:0/2568252410 wait complete. 2024-09-19T07:57:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.076+0000 7f918e6ff740 20 client.26011 trim_cache size 0 max 16384 2024-09-19T07:57:21.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 Processor -- start 2024-09-19T07:57:21.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 -- start start 2024-09-19T07:57:21.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a3e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a3ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a21330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f91841ae340 con 0x555e41a18340 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91841abb80 con 0x555e41a17a20 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918e6ff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91841a99d0 con 0x555e41a27150 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918a0c2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a3ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918a0c2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a3ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55142/0 (socket says 172.21.15.76:55142) 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.093+0000 7f918a0c2640 1 -- 172.21.15.76:0/3059223674 learned_addr learned my addr 172.21.15.76:0/3059223674 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f91898c1640 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a3e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f91898c1640 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a21330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f918a0c2640 1 -- 172.21.15.76:0/3059223674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 msgr2=0x555e41a21330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f918a0c2640 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a21330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f918a0c2640 1 -- 172.21.15.76:0/3059223674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 msgr2=0x555e41a3e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f918a0c2640 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a3e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f918a0c2640 1 -- 172.21.15.76:0/3059223674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e41a29e90 con 0x555e41a18340 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f91898c1640 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a21330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f918a0c2640 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a3ecc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f91740289d0 tx=0x7f91740049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8517ad7796c930c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f916bfff640 1 -- 172.21.15.76:0/3059223674 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91740096d0 con 0x555e41a18340 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f916bfff640 1 -- 172.21.15.76:0/3059223674 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9174019040 con 0x555e41a18340 2024-09-19T07:57:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.094+0000 7f916bfff640 1 -- 172.21.15.76:0/3059223674 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174030670 con 0x555e41a18340 2024-09-19T07:57:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 -- 172.21.15.76:0/3059223674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 msgr2=0x555e41a3ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a3ecc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f91740289d0 tx=0x7f91740049c0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 -- 172.21.15.76:0/3059223674 shutdown_connections 2024-09-19T07:57:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a21330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a18340 0x555e41a3ecc0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 --2- 172.21.15.76:0/3059223674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a17a20 0x555e41a3e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 -- 172.21.15.76:0/3059223674 >> 172.21.15.76:0/3059223674 conn(0x555e41a140f0 msgr2=0x555e41a26020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 -- 172.21.15.76:0/3059223674 shutdown_connections 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 -- 172.21.15.76:0/3059223674 wait complete. 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 -- start start 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 Processor -- start 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.095+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 0x555e41a2f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a18340 0x555e41a2f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a2c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f91841aa040 con 0x555e41a17a20 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91841ab4b0 con 0x555e41a18340 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91841aa710 con 0x555e41a27150 2024-09-19T07:57:21.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 10 client.0 _ll_register_callbacks cb 0x7f917800e9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 0x555e41a2f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 0x555e41a2f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55146/0 (socket says 172.21.15.76:55146) 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 -- 172.21.15.76:0/1224508153 learned_addr learned my addr 172.21.15.76:0/1224508153 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918a0c2640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a18340 0x555e41a2f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a2c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 -- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 msgr2=0x555e41a2c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a2c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 -- 172.21.15.76:0/1224508153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a18340 msgr2=0x555e41a2f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a18340 0x555e41a2f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 -- 172.21.15.76:0/1224508153 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e41a2c770 con 0x555e41a17a20 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f91898c1640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 0x555e41a2f130 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9178005fd0 tx=0x7f9178013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8d02e527416a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f9169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f9169ffb640 1 -- 172.21.15.76:0/1224508153 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178004220 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9174019040 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.096+0000 7f9169ffb640 1 -- 172.21.15.76:0/1224508153 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f91780043c0 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f9169ffb640 1 -- 172.21.15.76:0/1224508153 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f91780035f0 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 10 client.16893 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555e41aa20d0 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f9169ffb640 1 -- 172.21.15.76:0/1224508153 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9174019040 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f9169ffb640 1 -- 172.21.15.76:0/1224508153 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7f917802a030 con 0x555e41a17a20 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 10 client.16893 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 20 client.16893 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41aa27d0 0x555e41aa4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 4 client.16893 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:57:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555e41984d00 con 0x555e41aa27d0 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.097+0000 7f918a0c2640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41aa27d0 0x555e41aa4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.098+0000 7f918a0c2640 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41aa27d0 0x555e41aa4bf0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd350d4d572bede server_cookie=f630bc791a8c34a4 in_seq=0 out_seq=0 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.098+0000 7f9169ffb640 10 client.16893 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f9169ffb640 1 -- 172.21.15.76:0/1224508153 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555e41984d00 con 0x555e41aa27d0 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f9169ffb640 10 client.16893 handle_command_reply: tid=0 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 client.16893 shutdown 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 msgr2=0x555e41a2f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 0x555e41a2f130 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9178005fd0 tx=0x7f9178013040 comp rx=0 tx=0).stop 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 shutdown_connections 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555e41a27150 0x555e41a2c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e41a18340 0x555e41a2f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555e41aa27d0 0x555e41aa4bf0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 --2- 172.21.15.76:0/1224508153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555e41a17a20 0x555e41a2f130 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f9169ffb640 0 client.16893 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 >> 172.21.15.76:0/1224508153 conn(0x555e41a140f0 msgr2=0x555e41a31fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 shutdown_connections 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 1 -- 172.21.15.76:0/1224508153 wait complete. 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918e6ff740 20 client.16893 trim_cache size 0 max 16384 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "41aababa-729b-479d-aa20-19fd42803148", 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:57:21.106 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:57:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f916c0a33b0 msgr2=0x7f916c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f916c0a33b0 0x7f916c0a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f917c0b9240 tx=0x7f917c0b83e0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 msgr2=0x7f918419cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918419cf70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f917c005ab0 tx=0x7f917c0042f0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 shutdown_connections 2024-09-19T07:57:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f916c0a33b0 0x7f916c0a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91841082a0 0x7f918419cf70 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91841036e0 0x7f9184198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 --2- 172.21.15.76:0/176335163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9184102d30 0x7f91841986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:21.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.099+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 >> 172.21.15.76:0/176335163 conn(0x7f91840fc7d0 msgr2=0x7f91840fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:21.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.100+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 shutdown_connections 2024-09-19T07:57:21.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:21.100+0000 7f918c326640 1 -- 172.21.15.76:0/176335163 wait complete. 2024-09-19T07:57:21.823 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:57:22.112 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:22.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:22 smithi152 ceph-mon[35117]: pgmap v189: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:57:22.374 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:22 smithi076 ceph-mon[30930]: pgmap v189: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:57:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:22 smithi137 ceph-mon[35309]: pgmap v189: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:57:22.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 -- 172.21.15.76:0/1505327347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 msgr2=0x7fb6e8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 --2- 172.21.15.76:0/1505327347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8100ee0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc009930 tx=0x7fb6dc02a420 comp rx=0 tx=0).stop 2024-09-19T07:57:22.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 -- 172.21.15.76:0/1505327347 shutdown_connections 2024-09-19T07:57:22.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 --2- 172.21.15.76:0/1505327347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6e8101420 0x7fb6e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 --2- 172.21.15.76:0/1505327347 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8100ee0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 --2- 172.21.15.76:0/1505327347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e8106a80 0x7fb6e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 -- 172.21.15.76:0/1505327347 >> 172.21.15.76:0/1505327347 conn(0x7fb6e80fc7a0 msgr2=0x7fb6e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:22.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 -- 172.21.15.76:0/1505327347 shutdown_connections 2024-09-19T07:57:22.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.599+0000 7fb6ed225640 1 -- 172.21.15.76:0/1505327347 wait complete. 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 Processor -- start 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 -- start start 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6e8101420 0x7fb6e8198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e8106a80 0x7fb6e819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8111060 con 0x7fb6e8100a80 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8110ee0 con 0x7fb6e8101420 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6ed225640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81111e0 con 0x7fb6e8106a80 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6e6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.600+0000 7fb6e6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55166/0 (socket says 172.21.15.76:55166) 2024-09-19T07:57:22.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/3136303398 learned_addr learned my addr 172.21.15.76:0/3136303398 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e759e640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e8106a80 0x7fb6e819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e659c640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6e8101420 0x7fb6e8198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/3136303398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e8106a80 msgr2=0x7fb6e819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e8106a80 0x7fb6e819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/3136303398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6e8101420 msgr2=0x7fb6e8198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6e8101420 0x7fb6e8198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/3136303398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e819d640 con 0x7fb6e8100a80 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8198690 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b4a0 tx=0x7fb6d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6cffff640 1 -- 172.21.15.76:0/3136303398 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8014070 con 0x7fb6e8100a80 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6cffff640 1 -- 172.21.15.76:0/3136303398 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6d8010b10 con 0x7fb6e8100a80 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e819d930 con 0x7fb6e8100a80 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6cffff640 1 -- 172.21.15.76:0/3136303398 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8017d60 con 0x7fb6e8100a80 2024-09-19T07:57:22.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.601+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e81a5210 con 0x7fb6e8100a80 2024-09-19T07:57:22.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6cffff640 1 -- 172.21.15.76:0/3136303398 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb6d8017070 con 0x7fb6e8100a80 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 Processor -- start 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 -- start start 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcf9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcfba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b84fc542e0 con 0x55b84fcee4a0 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b84fbfbce0 con 0x55b84fceedc0 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b84fc502a0 con 0x55b84fcf9680 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6e759e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6e759e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55180/0 (socket says 172.21.15.76:55180) 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.604+0000 7fb6e759e640 1 -- 172.21.15.76:0/3364860831 learned_addr learned my addr 172.21.15.76:0/3364860831 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:22.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6cffff640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6d00a33b0 0x7fb6d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e659c640 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcfba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcf9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 -- 172.21.15.76:0/3364860831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 msgr2=0x55b84fcfba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcfba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 -- 172.21.15.76:0/3364860831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 msgr2=0x55b84fcf9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6cffff640 1 -- 172.21.15.76:0/3136303398 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb6d80cf100 con 0x7fb6e8100a80 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcf9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 -- 172.21.15.76:0/3364860831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84fbe0440 con 0x55b84fcee4a0 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcf9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6d00a33b0 0x7fb6d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6e759e640 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcee880 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000a5d0 tx=0x7fb6e000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cec66e4b515157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6cd7fa640 1 -- 172.21.15.76:0/3364860831 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e001a040 con 0x55b84fcee4a0 2024-09-19T07:57:22.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6cd7fa640 1 -- 172.21.15.76:0/3364860831 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6e0021ba0 con 0x55b84fcee4a0 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.605+0000 7fb6cd7fa640 1 -- 172.21.15.76:0/3364860831 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e001f350 con 0x55b84fcee4a0 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/3364860831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 msgr2=0x55b84fcee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6e759e640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6d00a33b0 0x7fb6d00a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0020000 tx=0x7fb6e0021000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcee880 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000a5d0 tx=0x7fb6e000aa90 comp rx=0 tx=0).stop 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/3364860831 shutdown_connections 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcfba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcf9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/3364860831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcee880 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/3364860831 >> 172.21.15.76:0/3364860831 conn(0x55b84fceaa30 msgr2=0x55b84fceae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/3364860831 shutdown_connections 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/3364860831 wait complete. 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.606+0000 7fb6ef5fe740 1 -- start start 2024-09-19T07:57:22.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 Processor -- start 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcf9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fcf62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcf9680 0x55b84fcf6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55b84fcfc250 con 0x55b84fcee4a0 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b84fc0f050 con 0x55b84fcf9680 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b84fcfc3d0 con 0x55b84fceedc0 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6ef5fe740 10 client.0 _ll_register_callbacks cb 0x55b84fc4f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcf9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcf9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55196/0 (socket says 172.21.15.76:55196) 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2319796776 learned_addr learned my addr 172.21.15.76:0/2319796776 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fcf62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 msgr2=0x55b84fcf62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fcf62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2319796776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcf9680 msgr2=0x55b84fcf6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcf9680 0x55b84fcf6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2319796776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84f9c53c0 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fcf62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcf9010 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b470 tx=0x7fb6d801ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebba84e096150f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6caff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6caff5640 1 -- 172.21.15.76:0/2319796776 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d801e040 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.607+0000 7fb6caff5640 1 -- 172.21.15.76:0/2319796776 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb6d8010cc0 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6e0021ba0 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6caff5640 1 -- 172.21.15.76:0/2319796776 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb6d801c120 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 10 client.16905 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b84fd07bb0 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6caff5640 1 -- 172.21.15.76:0/2319796776 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6e0021ba0 con 0x55b84fcee4a0 2024-09-19T07:57:22.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6caff5640 1 -- 172.21.15.76:0/2319796776 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7fb6d801ecf0 con 0x55b84fcee4a0 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 10 client.16905 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 20 client.16905 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd08fc0 0x55b84fd0b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 4 client.16905 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84fc61850 con 0x55b84fd08fc0 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.608+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd08fc0 0x55b84fd0b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.609+0000 7fb6caff5640 10 client.16905 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:22.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.609+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd08fc0 0x55b84fd0b410 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d23e5b44b1f2b5 server_cookie=d66818b43ebeee18 in_seq=0 out_seq=0 2024-09-19T07:57:22.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.609+0000 7fb6caff5640 1 -- 172.21.15.76:0/2319796776 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b84fc61850 con 0x55b84fd08fc0 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.609+0000 7fb6caff5640 10 client.16905 handle_command_reply: tid=0 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 client.16905 shutdown 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 msgr2=0x55b84fcf9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcf9010 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b470 tx=0x7fb6d801ec80 comp rx=0 tx=0).stop 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 shutdown_connections 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcf9680 0x55b84fcf6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fcf62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd08fc0 0x55b84fd0b410 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2319796776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fcf9010 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 >> 172.21.15.76:0/2319796776 conn(0x55b84fceaa30 msgr2=0x55b84fce9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:22.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6caff5640 0 client.16905 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:22.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 shutdown_connections 2024-09-19T07:57:22.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2319796776 wait complete. 2024-09-19T07:57:22.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.610+0000 7fb6ef5fe740 20 client.16905 trim_cache size 0 max 16384 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 Processor -- start 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 -- start start 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcee4a0 0x55b84fce9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fce9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 0x55b84fd10c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81b0440 con 0x55b84fcf9680 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81adc80 con 0x55b84fcee4a0 2024-09-19T07:57:22.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81abad0 con 0x55b84fceedc0 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 0x55b84fd10c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 0x55b84fd10c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55200/0 (socket says 172.21.15.76:55200) 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 -- 172.21.15.76:0/48102553 learned_addr learned my addr 172.21.15.76:0/48102553 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcee4a0 0x55b84fce9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e659c640 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fce9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 -- 172.21.15.76:0/48102553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 msgr2=0x55b84fce9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fce9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 -- 172.21.15.76:0/48102553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcee4a0 msgr2=0x55b84fce9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.627+0000 7fb6e759e640 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcee4a0 0x55b84fce9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.628+0000 7fb6e759e640 1 -- 172.21.15.76:0/48102553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84fcf5270 con 0x55b84fcf9680 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.628+0000 7fb6e659c640 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fce9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:22.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.628+0000 7fb6e759e640 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 0x55b84fd10c90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009700 tx=0x7fb6e0016f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3f754f2378d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.628+0000 7fb6ccff9640 1 -- 172.21.15.76:0/48102553 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e002d070 con 0x55b84fcf9680 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.628+0000 7fb6ccff9640 1 -- 172.21.15.76:0/48102553 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6e0009970 con 0x55b84fcf9680 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.628+0000 7fb6ccff9640 1 -- 172.21.15.76:0/48102553 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e001a070 con 0x55b84fcf9680 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/48102553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 msgr2=0x55b84fd10c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 0x55b84fd10c90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009700 tx=0x7fb6e0016f90 comp rx=0 tx=0).stop 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/48102553 shutdown_connections 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcf9680 0x55b84fd10c90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fceedc0 0x55b84fce9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/48102553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fcee4a0 0x55b84fce9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/48102553 >> 172.21.15.76:0/48102553 conn(0x55b84fceaa30 msgr2=0x55b84fce9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/48102553 shutdown_connections 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/48102553 wait complete. 2024-09-19T07:57:22.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- start start 2024-09-19T07:57:22.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 Processor -- start 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fd01da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81ac140 con 0x55b84fcee4a0 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81ad5b0 con 0x55b84fceedc0 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81ac810 con 0x55b84fcf9680 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6e6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fd01da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6e6d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fd01da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55204/0 (socket says 172.21.15.76:55204) 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2652355928 learned_addr learned my addr 172.21.15.76:0/2652355928 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:22.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.629+0000 7fb6ef5fe740 10 client.0 _ll_register_callbacks cb 0x7fb6d80176c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e759e640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 msgr2=0x55b84fcff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2652355928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 msgr2=0x55b84fcff0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcff0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e6d9d640 1 -- 172.21.15.76:0/2652355928 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84fcf6bb0 con 0x55b84fcee4a0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcff0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6e6d9d640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fd01da0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80042d0 tx=0x7fb6d8099940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a1d2c2c5cb5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6caff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6caff5640 1 -- 172.21.15.76:0/2652355928 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d801e040 con 0x55b84fcee4a0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6caff5640 1 -- 172.21.15.76:0/2652355928 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb6d8013170 con 0x55b84fcee4a0 2024-09-19T07:57:22.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6e0009970 con 0x55b84fcee4a0 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6caff5640 1 -- 172.21.15.76:0/2652355928 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb6d80976d0 con 0x55b84fcee4a0 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6ef5fe740 10 client.16911 fetch_fsmap learned FSMap version 32 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b84fd73a50 con 0x55b84fcee4a0 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.630+0000 7fb6caff5640 1 -- 172.21.15.76:0/2652355928 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6e0009970 con 0x55b84fcee4a0 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6caff5640 1 -- 172.21.15.76:0/2652355928 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 32) ==== 8366+0+0 (secure 0 0 0) 0x7fb6d80cca10 con 0x55b84fcee4a0 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6ef5fe740 10 client.16911 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6ef5fe740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6ef5fe740 20 client.16911 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd741f0 0x55b84fd76610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6ef5fe740 4 client.16911 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b84fc5bd60 con 0x55b84fd741f0 2024-09-19T07:57:22.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd741f0 0x55b84fd76610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6e659c640 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd741f0 0x55b84fd76610 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d38ebdb1327ecc4 server_cookie=4d75d4222f9e0de1 in_seq=0 out_seq=0 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.631+0000 7fb6caff5640 10 client.16911 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6caff5640 1 -- 172.21.15.76:0/2652355928 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b84fc5bd60 con 0x55b84fd741f0 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6caff5640 10 client.16911 handle_command_reply: tid=0 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 client.16911 shutdown 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 msgr2=0x55b84fd01da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fd01da0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80042d0 tx=0x7fb6d8099940 comp rx=0 tx=0).stop 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 shutdown_connections 2024-09-19T07:57:22.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b84fcf9680 0x55b84fcff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b84fceedc0 0x55b84fcff0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55b84fd741f0 0x55b84fd76610 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 --2- 172.21.15.76:0/2652355928 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b84fcee4a0 0x55b84fd01da0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 >> 172.21.15.76:0/2652355928 conn(0x55b84fceaa30 msgr2=0x55b84fce9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6caff5640 0 client.16911 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 shutdown_connections 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 1 -- 172.21.15.76:0/2652355928 wait complete. 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.632+0000 7fb6ef5fe740 20 client.16911 trim_cache size 0 max 16384 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:57:22.639 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: "41aababa-729b-479d-aa20-19fd42803148": { 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "41aababa-729b-479d-aa20-19fd42803148", 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:57:22.640 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6d00a33b0 msgr2=0x7fb6d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6d00a33b0 0x7fb6d00a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0020000 tx=0x7fb6e0021000 comp rx=0 tx=0).stop 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 msgr2=0x7fb6e8198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8198690 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b4a0 tx=0x7fb6d800b960 comp rx=0 tx=0).stop 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 shutdown_connections 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6d00a33b0 0x7fb6d00a5870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e8106a80 0x7fb6e819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6e8101420 0x7fb6e8198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 --2- 172.21.15.76:0/3136303398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6e8100a80 0x7fb6e8198690 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 >> 172.21.15.76:0/3136303398 conn(0x7fb6e80fc7a0 msgr2=0x7fb6e806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:22.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 shutdown_connections 2024-09-19T07:57:22.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:22.633+0000 7fb6ed225640 1 -- 172.21.15.76:0/3136303398 wait complete. 2024-09-19T07:57:23.248 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:23 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:57:23.248 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:23 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:57:23.248 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:23 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:57:23.248 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:23 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:57:23.277 INFO:tasks.cephfs.filesystem:scrub status for tag:41aababa-729b-479d-aa20-19fd42803148 - {'path': '/', 'tag': '41aababa-729b-479d-aa20-19fd42803148', 'options': 'recursive,force'} 2024-09-19T07:57:23.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:23 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:57:23.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:23 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:57:23.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:23 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:57:23.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:23 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:57:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:23 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:57:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:23 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:57:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:23 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:57:23.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:23 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:57:24.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:24 smithi152 ceph-mon[35117]: pgmap v190: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:57:24.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:24 smithi137 ceph-mon[35309]: pgmap v190: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:57:24.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:24 smithi076 ceph-mon[30930]: pgmap v190: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:57:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:25 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:57:25.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:25 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:57:25.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:25 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:57:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:26 smithi152 ceph-mon[35117]: pgmap v191: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:57:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:26 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:57:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:26 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:57:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:26 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:57:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:26 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:57:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:26 smithi137 ceph-mon[35309]: pgmap v191: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:57:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:26 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:57:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:26 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:57:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:26 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:57:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:26 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:57:26.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:26 smithi076 ceph-mon[30930]: pgmap v191: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:57:26.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:26 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:57:26.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:26 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:57:26.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:26 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:57:26.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:26 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:57:28.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:28 smithi152 ceph-mon[35117]: pgmap v192: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:57:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:28 smithi137 ceph-mon[35309]: pgmap v192: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:57:28.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:28 smithi076 ceph-mon[30930]: pgmap v192: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:57:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:30 smithi152 ceph-mon[35117]: pgmap v193: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:57:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:30 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:30 smithi137 ceph-mon[35309]: pgmap v193: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:57:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:30 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:30.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:30 smithi076 ceph-mon[30930]: pgmap v193: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:57:30.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:30 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:32.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:32 smithi152 ceph-mon[35117]: pgmap v194: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:57:32.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:32 smithi137 ceph-mon[35309]: pgmap v194: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:57:32.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:32 smithi076 ceph-mon[30930]: pgmap v194: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:57:34.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:34 smithi152 ceph-mon[35117]: pgmap v195: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:57:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:34 smithi137 ceph-mon[35309]: pgmap v195: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:57:34.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:34 smithi076 ceph-mon[30930]: pgmap v195: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:57:36.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:36 smithi152 ceph-mon[35117]: pgmap v196: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:57:36.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:36 smithi137 ceph-mon[35309]: pgmap v196: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:57:36.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:36 smithi076 ceph-mon[30930]: pgmap v196: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:57:38.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:38 smithi137 ceph-mon[35309]: pgmap v197: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:38.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:38 smithi076 ceph-mon[30930]: pgmap v197: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:38.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:38 smithi152 ceph-mon[35117]: pgmap v197: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:39.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:39 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:39.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:39 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:39.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:39 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:40.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:40 smithi137 ceph-mon[35309]: pgmap v198: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:40.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:40 smithi076 ceph-mon[30930]: pgmap v198: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:40.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:40 smithi152 ceph-mon[35117]: pgmap v198: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:42.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:42 smithi137 ceph-mon[35309]: pgmap v199: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:42.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:42 smithi076 ceph-mon[30930]: pgmap v199: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:42.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:42 smithi152 ceph-mon[35117]: pgmap v199: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:44.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:44 smithi137 ceph-mon[35309]: pgmap v200: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:44.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:44 smithi076 ceph-mon[30930]: pgmap v200: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:44.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:44 smithi152 ceph-mon[35117]: pgmap v200: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:46.363 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:46 smithi152 ceph-mon[35117]: pgmap v201: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:57:46.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:46 smithi137 ceph-mon[35309]: pgmap v201: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:57:46.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:46 smithi076 ceph-mon[30930]: pgmap v201: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:57:48.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:48 smithi137 ceph-mon[35309]: pgmap v202: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:48.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:48 smithi076 ceph-mon[30930]: pgmap v202: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:48.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:48 smithi152 ceph-mon[35117]: pgmap v202: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:50.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:50 smithi137 ceph-mon[35309]: pgmap v203: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:50.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:50 smithi076 ceph-mon[30930]: pgmap v203: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:50.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:50 smithi152 ceph-mon[35117]: pgmap v203: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:57:52.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:52 smithi137 ceph-mon[35309]: pgmap v204: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:52.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:52 smithi076 ceph-mon[30930]: pgmap v204: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:52.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:52 smithi152 ceph-mon[35117]: pgmap v204: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:57:53.278 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:57:53.539 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 -- 172.21.15.76:0/502743878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04101430 msgr2=0x7f5b0410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 --2- 172.21.15.76:0/502743878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04101430 0x7f5b0410d960 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009cd0 tx=0x7f5afc02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 -- 172.21.15.76:0/502743878 shutdown_connections 2024-09-19T07:57:54.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 --2- 172.21.15.76:0/502743878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04101430 0x7f5b0410d960 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 --2- 172.21.15.76:0/502743878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b04100a90 0x7f5b04100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 --2- 172.21.15.76:0/502743878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b04106a90 0x7f5b04106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 -- 172.21.15.76:0/502743878 >> 172.21.15.76:0/502743878 conn(0x7f5b040fc7d0 msgr2=0x7f5b040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 -- 172.21.15.76:0/502743878 shutdown_connections 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 -- 172.21.15.76:0/502743878 wait complete. 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 Processor -- start 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.015+0000 7f5b0a478640 1 -- start start 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b0a478640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b04100a90 0x7f5b041993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b0a478640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b04101430 0x7f5b04199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b0a478640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 0x7f5b041a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b0a478640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04110ff0 con 0x7f5b04106a90 2024-09-19T07:57:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b0a478640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04110e70 con 0x7f5b04100a90 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b0a478640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04111170 con 0x7f5b04101430 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 0x7f5b041a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 0x7f5b041a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34880/0 (socket says 172.21.15.76:34880) 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 -- 172.21.15.76:0/776781899 learned_addr learned my addr 172.21.15.76:0/776781899 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b03fff640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b04100a90 0x7f5b041993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5afbfff640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b04101430 0x7f5b04199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 -- 172.21.15.76:0/776781899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b04101430 msgr2=0x7f5b04199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b04101430 0x7f5b04199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 -- 172.21.15.76:0/776781899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b04100a90 msgr2=0x7f5b041993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b04100a90 0x7f5b041993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 -- 172.21.15.76:0/776781899 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b041a49a0 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.016+0000 7f5b08a15640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 0x7f5b041a4460 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5afc006010 tx=0x7f5afc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.017+0000 7f5b01ffb640 1 -- 172.21.15.76:0/776781899 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc004040 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.017+0000 7f5b01ffb640 1 -- 172.21.15.76:0/776781899 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5afc0046e0 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.017+0000 7f5b01ffb640 1 -- 172.21.15.76:0/776781899 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc030da0 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.017+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b041a4b70 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.017+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b041a5020 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 Processor -- start 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b01ffb640 1 -- 172.21.15.76:0/776781899 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5afc0305a0 con 0x7f5b04106a90 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 -- start start 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df159fc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a0b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a0de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55df159622e0 con 0x55df159fc380 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df15909ce0 con 0x55df159fcca0 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b0c851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df1595e2a0 con 0x55df15a0ba90 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df159fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df159fc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34886/0 (socket says 172.21.15.76:34886) 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5afbfff640 1 -- 172.21.15.76:0/2829495184 learned_addr learned my addr 172.21.15.76:0/2829495184 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.020+0000 7f5b03fff640 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a0b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a0de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5b01ffb640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5af00a33b0 0x7f5af00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 -- 172.21.15.76:0/2829495184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 msgr2=0x55df15a0de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a0de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 -- 172.21.15.76:0/2829495184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 msgr2=0x55df15a0b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a0b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 -- 172.21.15.76:0/2829495184 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df158ee440 con 0x55df159fc380 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5b01ffb640 1 -- 172.21.15.76:0/776781899 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5afc02e030 con 0x7f5b04106a90 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5b08a15640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5af00a33b0 0x7f5af00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afbfff640 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df159fc760 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5aec006aa0 tx=0x7f5aec0095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea3fdcf064a56a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afa7fc640 1 -- 172.21.15.76:0/2829495184 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec017610 con 0x55df159fc380 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afa7fc640 1 -- 172.21.15.76:0/2829495184 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec01c070 con 0x55df159fc380 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.021+0000 7f5afa7fc640 1 -- 172.21.15.76:0/2829495184 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec015950 con 0x55df159fc380 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 -- 172.21.15.76:0/2829495184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 msgr2=0x55df159fc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df159fc760 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5aec006aa0 tx=0x7f5aec0095d0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b08a15640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5af00a33b0 0x7f5af00a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009430 tx=0x7f5afc032ee0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:54.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 -- 172.21.15.76:0/2829495184 shutdown_connections 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a0de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a0b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 --2- 172.21.15.76:0/2829495184 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df159fc760 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 -- 172.21.15.76:0/2829495184 >> 172.21.15.76:0/2829495184 conn(0x55df159f8a30 msgr2=0x55df159f8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 -- 172.21.15.76:0/2829495184 shutdown_connections 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 -- 172.21.15.76:0/2829495184 wait complete. 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.022+0000 7f5b0c851740 1 -- start start 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 Processor -- start 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a0b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a08600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a08b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55df15a0e660 con 0x55df159fc380 2024-09-19T07:57:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df1591d050 con 0x55df159fcca0 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df15a0e7e0 con 0x55df15a0ba90 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b0c851740 10 client.0 _ll_register_callbacks cb 0x55df1595d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a0b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a0b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34892/0 (socket says 172.21.15.76:34892) 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 -- 172.21.15.76:0/1908681028 learned_addr learned my addr 172.21.15.76:0/1908681028 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a08600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 -- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 msgr2=0x55df15a08b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a08b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 -- 172.21.15.76:0/1908681028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 msgr2=0x55df15a08600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a08600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.023+0000 7f5afbfff640 1 -- 172.21.15.76:0/1908681028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df156d33c0 con 0x55df159fc380 2024-09-19T07:57:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a0b350 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5aec015480 tx=0x7f5aec006ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56315c7fac9b9c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5ae37fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1908681028 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec015be0 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1908681028 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5aec015d80 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aec01c070 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1908681028 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5aec017410 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5b0c851740 10 client.16923 fetch_fsmap learned FSMap version 34 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df15a19ff0 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1908681028 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec01c070 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1908681028 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 34) ==== 8358+0+0 (secure 0 0 0) 0x7f5aec022880 con 0x55df159fc380 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5b0c851740 10 client.16923 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5b0c851740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.024+0000 7f5b0c851740 20 client.16923 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:54.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.025+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a1b400 0x55df15a1d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.025+0000 7f5b0c851740 4 client.16923 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.025+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df1596f850 con 0x55df15a1b400 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.025+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a1b400 0x55df15a1d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.025+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a1b400 0x55df15a1d7f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17a708f64fdf14ab server_cookie=24a4252296740c5b in_seq=0 out_seq=0 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.025+0000 7f5ae37fe640 10 client.16923 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1908681028 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df1596f850 con 0x55df15a1b400 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5ae37fe640 10 client.16923 handle_command_reply: tid=0 2024-09-19T07:57:54.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 client.16923 shutdown 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 msgr2=0x55df15a0b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a0b350 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5aec015480 tx=0x7f5aec006ad0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 shutdown_connections 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df15a0ba90 0x55df15a08b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159fcca0 0x55df15a08600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a1b400 0x55df15a1d7f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1908681028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a0b350 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 >> 172.21.15.76:0/1908681028 conn(0x55df159f8a30 msgr2=0x55df159fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5ae37fe640 0 client.16923 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 shutdown_connections 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 1 -- 172.21.15.76:0/1908681028 wait complete. 2024-09-19T07:57:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.026+0000 7f5b0c851740 20 client.16923 trim_cache size 0 max 16384 2024-09-19T07:57:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 Processor -- start 2024-09-19T07:57:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 -- start start 2024-09-19T07:57:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a17900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fc380 0x55df15a06ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 0x55df159f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041ae1e0 con 0x55df159fcca0 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041aba80 con 0x55df159f8a30 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5b0c851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041a98f0 con 0x55df159fc380 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.044+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 0x55df159f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 0x55df159f7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34898/0 (socket says 172.21.15.76:34898) 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 -- 172.21.15.76:0/1183290819 learned_addr learned my addr 172.21.15.76:0/1183290819 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fc380 0x55df15a06ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a17900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 -- 172.21.15.76:0/1183290819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fc380 msgr2=0x55df15a06ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fc380 0x55df15a06ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 -- 172.21.15.76:0/1183290819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 msgr2=0x55df15a17900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a17900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 -- 172.21.15.76:0/1183290819 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df15a075b0 con 0x55df159fcca0 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 0x55df159f7a80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5aec010b90 tx=0x7f5aec010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2594807fdae5291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5af9ffb640 1 -- 172.21.15.76:0/1183290819 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec015ca0 con 0x55df159fcca0 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5af9ffb640 1 -- 172.21.15.76:0/1183290819 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec01c040 con 0x55df159fcca0 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.045+0000 7f5af9ffb640 1 -- 172.21.15.76:0/1183290819 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0175b0 con 0x55df159fcca0 2024-09-19T07:57:54.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 -- 172.21.15.76:0/1183290819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 msgr2=0x55df159f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 0x55df159f7a80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5aec010b90 tx=0x7f5aec010f90 comp rx=0 tx=0).stop 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 -- 172.21.15.76:0/1183290819 shutdown_connections 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fcca0 0x55df159f7a80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fc380 0x55df15a06ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1183290819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a17900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 -- 172.21.15.76:0/1183290819 >> 172.21.15.76:0/1183290819 conn(0x55df15a08ca0 msgr2=0x55df159f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 -- 172.21.15.76:0/1183290819 shutdown_connections 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 -- 172.21.15.76:0/1183290819 wait complete. 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.046+0000 7f5b0c851740 1 -- start start 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 Processor -- start 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a0fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a10040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fcca0 0x55df15a105a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041a9f40 con 0x55df159fc380 2024-09-19T07:57:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041ab3b0 con 0x55df159f8a30 2024-09-19T07:57:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041aa610 con 0x55df159fcca0 2024-09-19T07:57:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b0c851740 10 client.0 _ll_register_callbacks cb 0x7f5af400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:54.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a10040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a10040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34912/0 (socket says 172.21.15.76:34912) 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 -- 172.21.15.76:0/1686449882 learned_addr learned my addr 172.21.15.76:0/1686449882 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fcca0 0x55df15a105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a0fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 -- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fcca0 msgr2=0x55df15a105a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fcca0 0x55df15a105a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 -- 172.21.15.76:0/1686449882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 msgr2=0x55df15a0fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a0fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 -- 172.21.15.76:0/1686449882 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df159fcad0 con 0x55df159fc380 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a0fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5b03fff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a10040 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x55df15a09c40 tx=0x7f5af400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e2db7c9de6e0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:54.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.047+0000 7f5ae37fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1686449882 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4011440 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1686449882 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f5af40115e0 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aec01c040 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1686449882 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5af40117e0 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 10 client.16929 fetch_fsmap learned FSMap version 34 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df15a862e0 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1686449882 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec01c040 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1686449882 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 34) ==== 8358+0+0 (secure 0 0 0) 0x7f5af402ec40 con 0x55df159fc380 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 10 client.16929 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 20 client.16929 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a0ba90 0x55df15a88b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:54.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 4 client.16929 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.048+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55df15969d60 con 0x55df15a0ba90 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a0ba90 0x55df15a88b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5afbfff640 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a0ba90 0x55df15a88b30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6778279fe50406a1 server_cookie=4f382b9da48f8be2 in_seq=0 out_seq=0 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5ae37fe640 10 client.16929 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5ae37fe640 1 -- 172.21.15.76:0/1686449882 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55df15969d60 con 0x55df15a0ba90 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5ae37fe640 10 client.16929 handle_command_reply: tid=0 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 client.16929 shutdown 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 msgr2=0x55df15a10040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a10040 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x55df15a09c40 tx=0x7f5af400bd70 comp rx=0 tx=0).stop 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 shutdown_connections 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df159fcca0 0x55df15a105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df15a0ba90 0x55df15a88b30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df159fc380 0x55df15a10040 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 --2- 172.21.15.76:0/1686449882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df159f8a30 0x55df15a0fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 >> 172.21.15.76:0/1686449882 conn(0x55df15a08ca0 msgr2=0x55df159f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5ae37fe640 0 client.16929 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 shutdown_connections 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.049+0000 7f5b0c851740 1 -- 172.21.15.76:0/1686449882 wait complete. 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0c851740 20 client.16929 trim_cache size 0 max 16384 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:57:54.063 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:57:54.064 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:57:54.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5af00a33b0 msgr2=0x7f5af00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5af00a33b0 0x7f5af00a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009430 tx=0x7f5afc032ee0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 msgr2=0x7f5b041a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 0x7f5b041a4460 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5afc006010 tx=0x7f5afc003f10 comp rx=0 tx=0).stop 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 shutdown_connections 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5af00a33b0 0x7f5af00a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b04106a90 0x7f5b041a4460 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b04101430 0x7f5b04199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 --2- 172.21.15.76:0/776781899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b04100a90 0x7f5b041993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 >> 172.21.15.76:0/776781899 conn(0x7f5b040fc7d0 msgr2=0x7f5b040fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:54.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 shutdown_connections 2024-09-19T07:57:54.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:54.050+0000 7f5b0a478640 1 -- 172.21.15.76:0/776781899 wait complete. 2024-09-19T07:57:54.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:54 smithi076 ceph-mon[30930]: pgmap v205: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:54.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:54 smithi137 ceph-mon[35309]: pgmap v205: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:54.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:54 smithi152 ceph-mon[35117]: pgmap v205: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:54.822 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:57:54.822 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:57:55.091 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:55.363 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:55 smithi076 ceph-mon[30930]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:55.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:55 smithi137 ceph-mon[35309]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:55.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:55 smithi152 ceph-mon[35117]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:57:55.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 -- 172.21.15.76:0/331877194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 msgr2=0x7f8950100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 --2- 172.21.15.76:0/331877194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950100ee0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f893c009930 tx=0x7f893c02a420 comp rx=0 tx=0).stop 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 -- 172.21.15.76:0/331877194 shutdown_connections 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 --2- 172.21.15.76:0/331877194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8950101420 0x7f895010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 --2- 172.21.15.76:0/331877194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950100ee0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 --2- 172.21.15.76:0/331877194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8950106a80 0x7f8950106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 -- 172.21.15.76:0/331877194 >> 172.21.15.76:0/331877194 conn(0x7f89500fc7a0 msgr2=0x7f89500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 -- 172.21.15.76:0/331877194 shutdown_connections 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 -- 172.21.15.76:0/331877194 wait complete. 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 Processor -- start 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.596+0000 7f8957098640 1 -- start start 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:55.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8950101420 0x7f8950198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8950106a80 0x7f895019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8950112160 con 0x7f8950100a80 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8950111fe0 con 0x7f8950106a80 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89501122e0 con 0x7f8950101420 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34940/0 (socket says 172.21.15.76:34940) 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 -- 172.21.15.76:0/2737430287 learned_addr learned my addr 172.21.15.76:0/2737430287 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f894ffff640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8950101420 0x7f8950198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8955635640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8950106a80 0x7f895019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 -- 172.21.15.76:0/2737430287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8950101420 msgr2=0x7f8950198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8950101420 0x7f8950198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 -- 172.21.15.76:0/2737430287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8950106a80 msgr2=0x7f895019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8950106a80 0x7f895019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 -- 172.21.15.76:0/2737430287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895019d630 con 0x7f8950100a80 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8954e34640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950198680 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f894400b4a0 tx=0x7f894400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944014070 con 0x7f8950100a80 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8944010b10 con 0x7f8950100a80 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944017d60 con 0x7f8950100a80 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.597+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895019d920 con 0x7f8950100a80 2024-09-19T07:57:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.598+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89501a5200 con 0x7f8950100a80 2024-09-19T07:57:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.599+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8950100f60 con 0x7f8950100a80 2024-09-19T07:57:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.600+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8944017070 con 0x7f8950100a80 2024-09-19T07:57:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.600+0000 7f894dffb640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89400a33b0 0x7f89400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.601+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f89440cf360 con 0x7f8950100a80 2024-09-19T07:57:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.601+0000 7f894ffff640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89400a33b0 0x7f89400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.601+0000 7f894ffff640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89400a33b0 0x7f89400a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f893c009900 tx=0x7f893c0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:55.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.603+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f894409b740 con 0x7f8950100a80 2024-09-19T07:57:55.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.806+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89501999e0 con 0x7f8950100a80 2024-09-19T07:57:55.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.806+0000 7f894dffb640 1 -- 172.21.15.76:0/2737430287 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f89501999e0 con 0x7f8950100a80 2024-09-19T07:57:55.810 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:57:55.810 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:57:55.811 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T07:57:55.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89400a33b0 msgr2=0x7f89400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89400a33b0 0x7f89400a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f893c009900 tx=0x7f893c0058d0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 msgr2=0x7f8950198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950198680 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f894400b4a0 tx=0x7f894400b960 comp rx=0 tx=0).stop 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 shutdown_connections 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f89400a33b0 0x7f89400a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8950106a80 0x7f895019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8950101420 0x7f8950198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 --2- 172.21.15.76:0/2737430287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8950100a80 0x7f8950198680 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:55.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 >> 172.21.15.76:0/2737430287 conn(0x7f89500fc7a0 msgr2=0x7f89500fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:55.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 shutdown_connections 2024-09-19T07:57:55.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:55.809+0000 7f8957098640 1 -- 172.21.15.76:0/2737430287 wait complete. 2024-09-19T07:57:56.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:56 smithi137 ceph-mon[35309]: pgmap v206: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:57:56.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:56 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2737430287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:57:56.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:56 smithi076 ceph-mon[30930]: pgmap v206: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:57:56.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:56 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2737430287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:57:56.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:56 smithi152 ceph-mon[35117]: pgmap v206: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:57:56.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:56 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2737430287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:57:56.572 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:57:56.824 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:57.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 -- 172.21.15.76:0/3272050683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0100a80 msgr2=0x7f0ec0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/3272050683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0100a80 0x7f0ec0100ee0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009930 tx=0x7f0ea802a420 comp rx=0 tx=0).stop 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 -- 172.21.15.76:0/3272050683 shutdown_connections 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/3272050683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0101420 0x7f0ec010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/3272050683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0100a80 0x7f0ec0100ee0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/3272050683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec0106a80 0x7f0ec0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 -- 172.21.15.76:0/3272050683 >> 172.21.15.76:0/3272050683 conn(0x7f0ec00fc7a0 msgr2=0x7f0ec00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 -- 172.21.15.76:0/3272050683 shutdown_connections 2024-09-19T07:57:57.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 -- 172.21.15.76:0/3272050683 wait complete. 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.292+0000 7f0ec6eed640 1 Processor -- start 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 -- start start 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0100a80 0x7f0ec0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 0x7f0ec0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec0106a80 0x7f0ec01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0110fa0 con 0x7f0ec0101420 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0110e20 con 0x7f0ec0100a80 2024-09-19T07:57:57.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec6eed640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0111120 con 0x7f0ec0106a80 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 0x7f0ec0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 0x7f0ec0102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34956/0 (socket says 172.21.15.76:34956) 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 -- 172.21.15.76:0/70999252 learned_addr learned my addr 172.21.15.76:0/70999252 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0100a80 0x7f0ec0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 -- 172.21.15.76:0/70999252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec0106a80 msgr2=0x7f0ec01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec0106a80 0x7f0ec01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 -- 172.21.15.76:0/70999252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0100a80 msgr2=0x7f0ec0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0100a80 0x7f0ec0102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 -- 172.21.15.76:0/70999252 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec01a6a10 con 0x7f0ec0101420 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0100a80 0x7f0ec0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebffff640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 0x7f0ec0102b90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009a50 tx=0x7f0ea8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.293+0000 7f0ebdffb640 1 -- 172.21.15.76:0/70999252 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea803f030 con 0x7f0ec0101420 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.294+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec01a6ca0 con 0x7f0ec0101420 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.294+0000 7f0ebdffb640 1 -- 172.21.15.76:0/70999252 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ea8003af0 con 0x7f0ec0101420 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.294+0000 7f0ebdffb640 1 -- 172.21.15.76:0/70999252 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8035070 con 0x7f0ec0101420 2024-09-19T07:57:57.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.294+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec01a7180 con 0x7f0ec0101420 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ebdffb640 1 -- 172.21.15.76:0/70999252 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0ea8042030 con 0x7f0ec0101420 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 Processor -- start 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 -- start start 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d86370 0x5574a8d88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5574a8ce12f0 con 0x5574a8d7cb40 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5574a8c88cf0 con 0x5574a8d86370 2024-09-19T07:57:57.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.296+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5574a8cdd2b0 con 0x5574a8d7b5d0 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34972/0 (socket says 172.21.15.76:34972) 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 -- 172.21.15.76:0/3199782908 learned_addr learned my addr 172.21.15.76:0/3199782908 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ebffff640 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d86370 0x5574a8d88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ebdffb640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0eac0a33b0 0x7f0eac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 -- 172.21.15.76:0/3199782908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 msgr2=0x5574a8d7ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d7ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 -- 172.21.15.76:0/3199782908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d86370 msgr2=0x5574a8d88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d86370 0x5574a8d88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 -- 172.21.15.76:0/3199782908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a8c6d3a0 con 0x5574a8d7cb40 2024-09-19T07:57:57.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ebdffb640 1 -- 172.21.15.76:0/70999252 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0ea80f04d0 con 0x7f0ec0101420 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0eac0a33b0 0x7f0eac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0ec548a640 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7b090 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8007dd0 tx=0x7f0eb800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11179e2a06fec62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0eb6ffd640 1 -- 172.21.15.76:0/3199782908 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8016070 con 0x5574a8d7cb40 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0eb6ffd640 1 -- 172.21.15.76:0/3199782908 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0eb801bb00 con 0x5574a8d7cb40 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.297+0000 7f0eb6ffd640 1 -- 172.21.15.76:0/3199782908 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb801caf0 con 0x5574a8d7cb40 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 -- 172.21.15.76:0/3199782908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 msgr2=0x5574a8d7b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7b090 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8007dd0 tx=0x7f0eb800c6a0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec548a640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0eac0a33b0 0x7f0eac0a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0eb801d000 tx=0x7f0eb8020000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 -- 172.21.15.76:0/3199782908 shutdown_connections 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d86370 0x5574a8d88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/3199782908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7b090 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 -- 172.21.15.76:0/3199782908 >> 172.21.15.76:0/3199782908 conn(0x5574a8d44310 msgr2=0x5574a8d77c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:57.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 -- 172.21.15.76:0/3199782908 shutdown_connections 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 -- 172.21.15.76:0/3199782908 wait complete. 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.298+0000 7f0ec92c6740 1 -- start start 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 Processor -- start 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d85d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7cb40 0x5574a8d83000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5574a8d89070 con 0x5574a8d86370 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5574a8c9c060 con 0x5574a8d7b5d0 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5574a8d891f0 con 0x5574a8d7cb40 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec92c6740 10 client.0 _ll_register_callbacks cb 0x5574a89ef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d835d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:34988/0 (socket says 172.21.15.76:34988) 2024-09-19T07:57:57.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 -- 172.21.15.76:0/4003474548 learned_addr learned my addr 172.21.15.76:0/4003474548 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ebffff640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7cb40 0x5574a8d83000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d85d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 -- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7cb40 msgr2=0x5574a8d83000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7cb40 0x5574a8d83000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 -- 172.21.15.76:0/4003474548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 msgr2=0x5574a8d85d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d85d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.299+0000 7f0ec548a640 1 -- 172.21.15.76:0/4003474548 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a8a523c0 con 0x5574a8d86370 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec548a640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d835d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0eb801c430 tx=0x7f0eb801cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7af88c24bbb8745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0e9ffff640 1 -- 172.21.15.76:0/4003474548 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8016040 con 0x5574a8d86370 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0e9ffff640 1 -- 172.21.15.76:0/4003474548 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0eb801b400 con 0x5574a8d86370 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0eb801bb00 con 0x5574a8d86370 2024-09-19T07:57:57.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0e9ffff640 1 -- 172.21.15.76:0/4003474548 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0eb80078d0 con 0x5574a8d86370 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 10 client.16947 fetch_fsmap learned FSMap version 35 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5574a8d94af0 con 0x5574a8d86370 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0e9ffff640 1 -- 172.21.15.76:0/4003474548 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0eb801bb00 con 0x5574a8d86370 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0e9ffff640 1 -- 172.21.15.76:0/4003474548 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f0eb801a070 con 0x5574a8d86370 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 10 client.16947 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 10 client.16947 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 20 client.16947 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8d95f50 0x5574a8d98340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 4 client.16947 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.300+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574a8cee860 con 0x5574a8d95f50 2024-09-19T07:57:57.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.301+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8d95f50 0x5574a8d98340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.301+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8d95f50 0x5574a8d98340 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e73037da808dd4f server_cookie=ec414440b0ce809e in_seq=0 out_seq=0 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.301+0000 7f0e9ffff640 10 client.16947 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0e9ffff640 1 -- 172.21.15.76:0/4003474548 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574a8cee860 con 0x5574a8d95f50 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0e9ffff640 10 client.16947 handle_command_reply: tid=0 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 client.16947 shutdown 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 msgr2=0x5574a8d835d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d835d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0eb801c430 tx=0x7f0eb801cf80 comp rx=0 tx=0).stop 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 shutdown_connections 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8d95f50 0x5574a8d98340 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d835d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7cb40 0x5574a8d83000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/4003474548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d85d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0e9ffff640 0 client.16947 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:57.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.302+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 >> 172.21.15.76:0/4003474548 conn(0x5574a8d44310 msgr2=0x5574a8d7d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:57.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.303+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 shutdown_connections 2024-09-19T07:57:57.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.303+0000 7f0ec92c6740 1 -- 172.21.15.76:0/4003474548 wait complete. 2024-09-19T07:57:57.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.303+0000 7f0ec92c6740 20 client.16947 trim_cache size 0 max 16384 2024-09-19T07:57:57.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.315+0000 7f0ec92c6740 1 Processor -- start 2024-09-19T07:57:57.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.315+0000 7f0ec92c6740 1 -- start start 2024-09-19T07:57:57.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d92310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d86370 0x5574a8d7e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01b2690 con 0x5574a8d7cb40 2024-09-19T07:57:57.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01aff60 con 0x5574a8d7b5d0 2024-09-19T07:57:57.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01addb0 con 0x5574a8d86370 2024-09-19T07:57:57.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35002/0 (socket says 172.21.15.76:35002) 2024-09-19T07:57:57.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 -- 172.21.15.76:0/922336654 learned_addr learned my addr 172.21.15.76:0/922336654 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:57.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d92310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 -- 172.21.15.76:0/922336654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d86370 msgr2=0x5574a8d7e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d86370 0x5574a8d7e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 -- 172.21.15.76:0/922336654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 msgr2=0x5574a8d92310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d92310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 -- 172.21.15.76:0/922336654 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a8d7bd50 con 0x5574a8d7cb40 2024-09-19T07:57:57.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d92310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:57:57.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0ebffff640 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7e120 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80b9120 tx=0x7f0ea80b8b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0892111539297e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:57.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0eb67fc640 1 -- 172.21.15.76:0/922336654 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8049070 con 0x5574a8d7cb40 2024-09-19T07:57:57.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0eb67fc640 1 -- 172.21.15.76:0/922336654 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ea80bc750 con 0x5574a8d7cb40 2024-09-19T07:57:57.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.316+0000 7f0eb67fc640 1 -- 172.21.15.76:0/922336654 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80ede40 con 0x5574a8d7cb40 2024-09-19T07:57:57.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 -- 172.21.15.76:0/922336654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 msgr2=0x5574a8d7e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7e120 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80b9120 tx=0x7f0ea80b8b20 comp rx=0 tx=0).stop 2024-09-19T07:57:57.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 -- 172.21.15.76:0/922336654 shutdown_connections 2024-09-19T07:57:57.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d86370 0x5574a8d7e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d7cb40 0x5574a8d7e120 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/922336654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7b5d0 0x5574a8d92310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 -- 172.21.15.76:0/922336654 >> 172.21.15.76:0/922336654 conn(0x5574a8d44310 msgr2=0x5574a8d820f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:57.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 -- 172.21.15.76:0/922336654 shutdown_connections 2024-09-19T07:57:57.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 -- 172.21.15.76:0/922336654 wait complete. 2024-09-19T07:57:57.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 -- start start 2024-09-19T07:57:57.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.317+0000 7f0ec92c6740 1 Processor -- start 2024-09-19T07:57:57.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d8a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7cb40 0x5574a8d8a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d8ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01ae420 con 0x5574a8d86370 2024-09-19T07:57:57.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01af890 con 0x5574a8d7cb40 2024-09-19T07:57:57.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01aeaf0 con 0x5574a8d7b5d0 2024-09-19T07:57:57.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec92c6740 10 client.0 _ll_register_callbacks cb 0x7f0ea80b8a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:57.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d8ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d8ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35012/0 (socket says 172.21.15.76:35012) 2024-09-19T07:57:57.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 -- 172.21.15.76:0/2376723756 learned_addr learned my addr 172.21.15.76:0/2376723756 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:57.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ebffff640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7cb40 0x5574a8d8a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d8a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 -- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 msgr2=0x5574a8d8a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d8a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 -- 172.21.15.76:0/2376723756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7cb40 msgr2=0x5574a8d8a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7cb40 0x5574a8d8a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 -- 172.21.15.76:0/2376723756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a8dffab0 con 0x5574a8d86370 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d8a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0ec548a640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d8ae00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800cba0 tx=0x7f0eb8007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf6d7716f9a1d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.318+0000 7f0e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:57.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0e9ffff640 1 -- 172.21.15.76:0/2376723756 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803c030 con 0x5574a8d86370 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0e9ffff640 1 -- 172.21.15.76:0/2376723756 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f0eb8030470 con 0x5574a8d86370 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ea80bc750 con 0x5574a8d86370 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0e9ffff640 1 -- 172.21.15.76:0/2376723756 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0eb8007b30 con 0x5574a8d86370 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 10 client.16953 fetch_fsmap learned FSMap version 35 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5574a8e00d00 con 0x5574a8d86370 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0e9ffff640 1 -- 172.21.15.76:0/2376723756 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ea80bc750 con 0x5574a8d86370 2024-09-19T07:57:57.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0e9ffff640 1 -- 172.21.15.76:0/2376723756 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f0eb801a040 con 0x5574a8d86370 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 10 client.16953 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 10 client.16953 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 20 client.16953 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8e013c0 0x5574a8e037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 4 client.16953 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574a8ce8d70 con 0x5574a8e013c0 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.319+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8e013c0 0x5574a8e037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:57.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec4c89640 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8e013c0 0x5574a8e037b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c466863b3c6be28 server_cookie=1dbfdee2c884f6c9 in_seq=0 out_seq=0 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0e9ffff640 10 client.16953 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0e9ffff640 1 -- 172.21.15.76:0/2376723756 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574a8ce8d70 con 0x5574a8e013c0 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0e9ffff640 10 client.16953 handle_command_reply: tid=0 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 client.16953 shutdown 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 msgr2=0x5574a8d8ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d8ae00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800cba0 tx=0x7f0eb8007cd0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 shutdown_connections 2024-09-19T07:57:57.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5574a8e013c0 0x5574a8e037b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0e9ffff640 0 client.16953 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5574a8d86370 0x5574a8d8ae00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5574a8d7cb40 0x5574a8d8a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 --2- 172.21.15.76:0/2376723756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5574a8d7b5d0 0x5574a8d8a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 >> 172.21.15.76:0/2376723756 conn(0x5574a8d44310 msgr2=0x5574a8d84860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 shutdown_connections 2024-09-19T07:57:57.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 1 -- 172.21.15.76:0/2376723756 wait complete. 2024-09-19T07:57:57.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.320+0000 7f0ec92c6740 20 client.16953 trim_cache size 0 max 16384 2024-09-19T07:57:57.340 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0eac0a33b0 msgr2=0x7f0eac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0eac0a33b0 0x7f0eac0a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0eb801d000 tx=0x7f0eb8020000 comp rx=0 tx=0).stop 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 msgr2=0x7f0ec0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 0x7f0ec0102b90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009a50 tx=0x7f0ea8004270 comp rx=0 tx=0).stop 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 shutdown_connections 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f0eac0a33b0 0x7f0eac0a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec0106a80 0x7f0ec01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0ec0101420 0x7f0ec0102b90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 --2- 172.21.15.76:0/70999252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ec0100a80 0x7f0ec0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:57.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 >> 172.21.15.76:0/70999252 conn(0x7f0ec00fc7a0 msgr2=0x7f0ec0104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:57.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 shutdown_connections 2024-09-19T07:57:57.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:57.321+0000 7f0ec6eed640 1 -- 172.21.15.76:0/70999252 wait complete. 2024-09-19T07:57:58.072 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:57:58.318 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:57:58.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:57:58 smithi137 ceph-mon[35309]: pgmap v207: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:58.439 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:57:58 smithi076 ceph-mon[30930]: pgmap v207: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:58.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:57:58 smithi152 ceph-mon[35117]: pgmap v207: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:57:58.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 -- 172.21.15.76:0/3036651210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568100ca0 msgr2=0x7fd568106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3036651210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568100ca0 0x7fd568106840 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fd554009930 tx=0x7fd55402a420 comp rx=0 tx=0).stop 2024-09-19T07:57:58.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 -- 172.21.15.76:0/3036651210 shutdown_connections 2024-09-19T07:57:58.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3036651210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd568106f50 0x7fd56810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3036651210 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568100ca0 0x7fd568106840 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3036651210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5681002f0 0x7fd5681006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 -- 172.21.15.76:0/3036651210 >> 172.21.15.76:0/3036651210 conn(0x7fd568077210 msgr2=0x7fd5680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 -- 172.21.15.76:0/3036651210 shutdown_connections 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.814+0000 7fd56ec11640 1 -- 172.21.15.76:0/3036651210 wait complete. 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 Processor -- start 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 -- start start 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5681002f0 0x7fd5681a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd568100ca0 0x7fd5681a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 0x7fd56819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd568112120 con 0x7fd568106f50 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd568111fa0 con 0x7fd5681002f0 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56ec11640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681122a0 con 0x7fd568100ca0 2024-09-19T07:57:58.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56d1ae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 0x7fd56819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56d1ae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 0x7fd56819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35038/0 (socket says 172.21.15.76:35038) 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3418595698 learned_addr learned my addr 172.21.15.76:0/3418595698 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.815+0000 7fd567fff640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd568100ca0 0x7fd5681a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5681002f0 0x7fd5681a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3418595698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd568100ca0 msgr2=0x7fd5681a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd568100ca0 0x7fd5681a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3418595698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5681002f0 msgr2=0x7fd5681a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5681002f0 0x7fd5681a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3418595698 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56819aec0 con 0x7fd568106f50 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 0x7fd56819a650 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd56000eaa0 tx=0x7fd56000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd565ffb640 1 -- 172.21.15.76:0/3418595698 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560004d20 con 0x7fd568106f50 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56819b1b0 con 0x7fd568106f50 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd565ffb640 1 -- 172.21.15.76:0/3418595698 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd560005020 con 0x7fd568106f50 2024-09-19T07:57:58.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd565ffb640 1 -- 172.21.15.76:0/3418595698 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5600116b0 con 0x7fd568106f50 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.816+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5681a7330 con 0x7fd568106f50 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd565ffb640 1 -- 172.21.15.76:0/3418595698 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd5600051d0 con 0x7fd568106f50 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 Processor -- start 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 -- start start 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd565ffb640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd5580a33b0 0x7fd5580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5928090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 0x5621e5928a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e5935760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5621e588e2f0 con 0x5621e59285d0 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5621e5835cf0 con 0x5621e5929b40 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd570fea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5621e588a2b0 con 0x5621e5933370 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd567fff640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd5580a33b0 0x7fd5580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.819+0000 7fd565ffb640 1 -- 172.21.15.76:0/3418595698 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd5600cff80 con 0x7fd568106f50 2024-09-19T07:57:58.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 0x5621e5928a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 0x5621e5928a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35054/0 (socket says 172.21.15.76:35054) 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 -- 172.21.15.76:0/3002330162 learned_addr learned my addr 172.21.15.76:0/3002330162 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e5935760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5928090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 -- 172.21.15.76:0/3002330162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 msgr2=0x5621e5935760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e5935760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 -- 172.21.15.76:0/3002330162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 msgr2=0x5621e5928090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5928090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 -- 172.21.15.76:0/3002330162 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621e581a3a0 con 0x5621e59285d0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd5580a33b0 0x7fd5580a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5540096c0 tx=0x7fd554005fd0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd567fff640 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 0x5621e5928a10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd56806a100 tx=0x7fd554046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6b58dcf9849dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd552ffd640 1 -- 172.21.15.76:0/3002330162 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554032e60 con 0x5621e59285d0 2024-09-19T07:57:58.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd552ffd640 1 -- 172.21.15.76:0/3002330162 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd55403d450 con 0x5621e59285d0 2024-09-19T07:57:58.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.820+0000 7fd552ffd640 1 -- 172.21.15.76:0/3002330162 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55403c650 con 0x5621e59285d0 2024-09-19T07:57:58.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 -- 172.21.15.76:0/3002330162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 msgr2=0x5621e5928a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 0x5621e5928a10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd56806a100 tx=0x7fd554046000 comp rx=0 tx=0).stop 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 -- 172.21.15.76:0/3002330162 shutdown_connections 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e5935760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e59285d0 0x5621e5928a10 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 --2- 172.21.15.76:0/3002330162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5928090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 -- 172.21.15.76:0/3002330162 >> 172.21.15.76:0/3002330162 conn(0x5621e58f1310 msgr2=0x5621e5924c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 -- 172.21.15.76:0/3002330162 shutdown_connections 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.821+0000 7fd570fea740 1 -- 172.21.15.76:0/3002330162 wait complete. 2024-09-19T07:57:58.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 -- start start 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 Processor -- start 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e5932db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5930060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 0x5621e59307f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5621e5936010 con 0x5621e5933370 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5621e5849060 con 0x5621e5929b40 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5621e5936190 con 0x5621e59285d0 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd570fea740 10 client.0 _ll_register_callbacks cb 0x5621e559c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 0x5621e59307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 0x5621e59307f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35064/0 (socket says 172.21.15.76:35064) 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3994844375 learned_addr learned my addr 172.21.15.76:0/3994844375 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:58.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e5932db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd567fff640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5930060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3994844375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 msgr2=0x5621e5932db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e5932db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 msgr2=0x5621e5930060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5930060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.822+0000 7fd56d1ae640 1 -- 172.21.15.76:0/3994844375 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621e55ff3c0 con 0x5621e5933370 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 0x5621e59307f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fd56009bf00 tx=0x7fd56009bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96fe8ba1e7424f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd547fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd547fff640 1 -- 172.21.15.76:0/3994844375 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56001f040 con 0x5621e5933370 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd547fff640 1 -- 172.21.15.76:0/3994844375 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd5600bc070 con 0x5621e5933370 2024-09-19T07:57:58.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd55403d450 con 0x5621e5933370 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd547fff640 1 -- 172.21.15.76:0/3994844375 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd56009c200 con 0x5621e5933370 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 10 client.16965 fetch_fsmap learned FSMap version 35 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5621e5941bb0 con 0x5621e5933370 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd547fff640 1 -- 172.21.15.76:0/3994844375 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd55403d450 con 0x5621e5933370 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd547fff640 1 -- 172.21.15.76:0/3994844375 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd56000f040 con 0x5621e5933370 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 10 client.16965 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 10 client.16965 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 20 client.16965 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e5943010 0x5621e5945440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 4 client.16965 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.823+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621e589b860 con 0x5621e5943010 2024-09-19T07:57:58.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.824+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e5943010 0x5621e5945440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.824+0000 7fd547fff640 10 client.16965 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.824+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e5943010 0x5621e5945440 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adbf2a6b8bfa04fc server_cookie=12ac935fb54ccce9 in_seq=0 out_seq=0 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd547fff640 1 -- 172.21.15.76:0/3994844375 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621e589b860 con 0x5621e5943010 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd547fff640 10 client.16965 handle_command_reply: tid=0 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 client.16965 shutdown 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 msgr2=0x5621e59307f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 0x5621e59307f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fd56009bf00 tx=0x7fd56009bc90 comp rx=0 tx=0).stop 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 shutdown_connections 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e5943010 0x5621e5945440 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5933370 0x5621e59307f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5929b40 0x5621e5930060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 --2- 172.21.15.76:0/3994844375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e5932db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd547fff640 0 client.16965 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 >> 172.21.15.76:0/3994844375 conn(0x5621e58f1310 msgr2=0x5621e592a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 shutdown_connections 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 1 -- 172.21.15.76:0/3994844375 wait complete. 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.825+0000 7fd570fea740 20 client.16965 trim_cache size 0 max 16384 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 Processor -- start 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 -- start start 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e59285d0 0x5621e5924e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e592b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681b2680 con 0x5621e5929b40 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681aff50 con 0x5621e59285d0 2024-09-19T07:57:58.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd570fea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681adda0 con 0x5621e5933370 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.838+0000 7fd567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35072/0 (socket says 172.21.15.76:35072) 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 -- 172.21.15.76:0/98888550 learned_addr learned my addr 172.21.15.76:0/98888550 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 -- 172.21.15.76:0/98888550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 msgr2=0x5621e592b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e592b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e592b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e59285d0 0x5621e5924e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 -- 172.21.15.76:0/98888550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e59285d0 msgr2=0x5621e5924e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e59285d0 0x5621e5924e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 -- 172.21.15.76:0/98888550 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621e5925dd0 con 0x5621e5929b40 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd567fff640 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592f920 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x5621e5925ac0 tx=0x7fd55402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80926d461840b7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:58.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd5527fc640 1 -- 172.21.15.76:0/98888550 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540039c0 con 0x5621e5929b40 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd5527fc640 1 -- 172.21.15.76:0/98888550 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd55405b070 con 0x5621e5929b40 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.839+0000 7fd5527fc640 1 -- 172.21.15.76:0/98888550 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55403dc10 con 0x5621e5929b40 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 -- 172.21.15.76:0/98888550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 msgr2=0x5621e592f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592f920 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x5621e5925ac0 tx=0x7fd55402a420 comp rx=0 tx=0).stop 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 -- 172.21.15.76:0/98888550 shutdown_connections 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e5933370 0x5621e592b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592f920 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 --2- 172.21.15.76:0/98888550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e59285d0 0x5621e5924e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 -- 172.21.15.76:0/98888550 >> 172.21.15.76:0/98888550 conn(0x5621e58f1310 msgr2=0x5621e5924700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 -- 172.21.15.76:0/98888550 shutdown_connections 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 -- 172.21.15.76:0/98888550 wait complete. 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 -- start start 2024-09-19T07:57:58.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.840+0000 7fd570fea740 1 Processor -- start 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e593b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5933370 0x5621e592cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681ae410 con 0x5621e5929b40 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681af880 con 0x5621e5933370 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5681aeae0 con 0x5621e59285d0 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd570fea740 10 client.0 _ll_register_callbacks cb 0x7fd5600984a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35076/0 (socket says 172.21.15.76:35076) 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 -- 172.21.15.76:0/2374419293 learned_addr learned my addr 172.21.15.76:0/2374419293 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5933370 0x5621e592cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e593b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 -- 172.21.15.76:0/2374419293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 msgr2=0x5621e593b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e593b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 -- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5933370 msgr2=0x5621e592cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5933370 0x5621e592cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 -- 172.21.15.76:0/2374419293 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621e592d480 con 0x5621e5929b40 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e593b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd56d1ae640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5933370 0x5621e592cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd567fff640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592ca00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd55402a940 tx=0x7fd5540045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4227f5d9925ca7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.841+0000 7fd547fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd547fff640 1 -- 172.21.15.76:0/2374419293 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554065020 con 0x5621e5929b40 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd547fff640 1 -- 172.21.15.76:0/2374419293 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fd55403dda0 con 0x5621e5929b40 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd55405b070 con 0x5621e5929b40 2024-09-19T07:57:58.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd547fff640 1 -- 172.21.15.76:0/2374419293 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd554070050 con 0x5621e5929b40 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 10 client.16971 fetch_fsmap learned FSMap version 35 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5621e59ad9d0 con 0x5621e5929b40 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd547fff640 1 -- 172.21.15.76:0/2374419293 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd55405b070 con 0x5621e5929b40 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd547fff640 1 -- 172.21.15.76:0/2374419293 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd554061710 con 0x5621e5929b40 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 10 client.16971 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 10 client.16971 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:57:58.887 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 20 client.16971 populate_metadata read hostname 'smithi076' 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e59adc90 0x5621e59b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 4 client.16971 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621e5895d70 con 0x5621e59adc90 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.842+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e59adc90 0x5621e59b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd56c9ad640 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e59adc90 0x5621e59b00b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e08b143f1393cfac server_cookie=af09a6d5092bf94e in_seq=0 out_seq=0 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd547fff640 10 client.16971 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd547fff640 1 -- 172.21.15.76:0/2374419293 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621e5895d70 con 0x5621e59adc90 2024-09-19T07:57:58.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd547fff640 10 client.16971 handle_command_reply: tid=0 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 client.16971 shutdown 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 msgr2=0x5621e592ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592ca00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd55402a940 tx=0x7fd5540045d0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 shutdown_connections 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5621e59adc90 0x5621e59b00b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621e5933370 0x5621e592cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621e5929b40 0x5621e592ca00 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd547fff640 0 client.16971 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 --2- 172.21.15.76:0/2374419293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621e59285d0 0x5621e593b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 >> 172.21.15.76:0/2374419293 conn(0x5621e58f1310 msgr2=0x5621e5924700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 shutdown_connections 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 1 -- 172.21.15.76:0/2374419293 wait complete. 2024-09-19T07:57:58.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.843+0000 7fd570fea740 20 client.16971 trim_cache size 0 max 16384 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd5580a33b0 msgr2=0x7fd5580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd5580a33b0 0x7fd5580a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5540096c0 tx=0x7fd554005fd0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 msgr2=0x7fd56819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 0x7fd56819a650 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd56000eaa0 tx=0x7fd56000eea0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 shutdown_connections 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd5580a33b0 0x7fd5580a5870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd568106f50 0x7fd56819a650 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd568100ca0 0x7fd5681a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 --2- 172.21.15.76:0/3418595698 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5681002f0 0x7fd5681a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 >> 172.21.15.76:0/3418595698 conn(0x7fd568077210 msgr2=0x7fd568105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 shutdown_connections 2024-09-19T07:57:58.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:57:58.844+0000 7fd56ec11640 1 -- 172.21.15.76:0/3418595698 wait complete. 2024-09-19T07:57:59.693 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:57:59.940 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:00.337 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:00 smithi076 ceph-mon[30930]: pgmap v208: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:58:00.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:00 smithi137 ceph-mon[35309]: pgmap v208: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 -- 172.21.15.76:0/3277482840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c102570 msgr2=0x7f964c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 --2- 172.21.15.76:0/3277482840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c102570 0x7f964c1029b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9640009900 tx=0x7f964002a480 comp rx=0 tx=0).stop 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 -- 172.21.15.76:0/3277482840 shutdown_connections 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 --2- 172.21.15.76:0/3277482840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f964c102ef0 0x7f964c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 --2- 172.21.15.76:0/3277482840 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c102570 0x7f964c1029b0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 --2- 172.21.15.76:0/3277482840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f964c100e20 0x7f964c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 -- 172.21.15.76:0/3277482840 >> 172.21.15.76:0/3277482840 conn(0x7f964c0fc7d0 msgr2=0x7f964c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:00.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 -- 172.21.15.76:0/3277482840 shutdown_connections 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.428+0000 7f9650e32640 1 -- 172.21.15.76:0/3277482840 wait complete. 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 Processor -- start 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 -- start start 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 0x7f964c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f964c102570 0x7f964c1977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f964c102ef0 0x7f964c197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f964c111100 con 0x7f964c100e20 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110f80 con 0x7f964c102570 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f9650e32640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f964c111280 con 0x7f964c102ef0 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f964a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 0x7f964c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f964a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 0x7f964c197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35094/0 (socket says 172.21.15.76:35094) 2024-09-19T07:58:00.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.429+0000 7f964a59c640 1 -- 172.21.15.76:0/466449311 learned_addr learned my addr 172.21.15.76:0/466449311 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964ad9d640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f964c102ef0 0x7f964c197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f9649d9b640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f964c102570 0x7f964c1977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964a59c640 1 -- 172.21.15.76:0/466449311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f964c102ef0 msgr2=0x7f964c197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964a59c640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f964c102ef0 0x7f964c197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964a59c640 1 -- 172.21.15.76:0/466449311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f964c102570 msgr2=0x7f964c1977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964a59c640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f964c102570 0x7f964c1977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964a59c640 1 -- 172.21.15.76:0/466449311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c1a6af0 con 0x7f964c100e20 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f964a59c640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 0x7f964c197280 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f963c00d770 tx=0x7f963c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f963b7fe640 1 -- 172.21.15.76:0/466449311 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c017070 con 0x7f964c100e20 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c1a6de0 con 0x7f964c100e20 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f963b7fe640 1 -- 172.21.15.76:0/466449311 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f963c005520 con 0x7f964c100e20 2024-09-19T07:58:00.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f963b7fe640 1 -- 172.21.15.76:0/466449311 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c010460 con 0x7f964c100e20 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.430+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c1a7240 con 0x7f964c100e20 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.432+0000 7f963b7fe640 1 -- 172.21.15.76:0/466449311 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f963c004ea0 con 0x7f964c100e20 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 Processor -- start 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 -- start start 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d5b40 0x55583c9d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d45d0 0x55583c9d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55583c93a2f0 con 0x55583c9df370 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55583c8e1cf0 con 0x55583c9d45d0 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f965320b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55583c9362b0 con 0x55583c9d5b40 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f963b7fe640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96340a33b0 0x7f96340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f9649d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f9649d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35102/0 (socket says 172.21.15.76:35102) 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f9649d9b640 1 -- 172.21.15.76:0/3582768134 learned_addr learned my addr 172.21.15.76:0/3582768134 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f964ad9d640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96340a33b0 0x7f96340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f964a59c640 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d45d0 0x55583c9d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f964ad9d640 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d5b40 0x55583c9d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.433+0000 7f963b7fe640 1 -- 172.21.15.76:0/466449311 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f963c0cf820 con 0x7f964c100e20 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9649d9b640 1 -- 172.21.15.76:0/3582768134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d5b40 msgr2=0x55583c9d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9649d9b640 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d5b40 0x55583c9d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9649d9b640 1 -- 172.21.15.76:0/3582768134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d45d0 msgr2=0x55583c9d4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9649d9b640 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d45d0 0x55583c9d4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9649d9b640 1 -- 172.21.15.76:0/3582768134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583c8c63a0 con 0x55583c9df370 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9649d9b640 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9e1760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9640009900 tx=0x7f9640031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba53cfb8bf9b7cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:00.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f964ad9d640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96340a33b0 0x7f96340a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9644009440 tx=0x7f9644009390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9638ff9640 1 -- 172.21.15.76:0/3582768134 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640035030 con 0x55583c9df370 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9638ff9640 1 -- 172.21.15.76:0/3582768134 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9640040070 con 0x55583c9df370 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.434+0000 7f9638ff9640 1 -- 172.21.15.76:0/3582768134 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640005240 con 0x55583c9df370 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 -- 172.21.15.76:0/3582768134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 msgr2=0x55583c9e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9e1760 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9640009900 tx=0x7f9640031660 comp rx=0 tx=0).stop 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 -- 172.21.15.76:0/3582768134 shutdown_connections 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9e1760 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d45d0 0x55583c9d4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 --2- 172.21.15.76:0/3582768134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d5b40 0x55583c9d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 -- 172.21.15.76:0/3582768134 >> 172.21.15.76:0/3582768134 conn(0x55583c99d310 msgr2=0x55583c9d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 -- 172.21.15.76:0/3582768134 shutdown_connections 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 -- 172.21.15.76:0/3582768134 wait complete. 2024-09-19T07:58:00.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 -- start start 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.435+0000 7f965320b740 1 Processor -- start 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9deca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55583c9e2010 con 0x55583c9df370 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55583c8f5060 con 0x55583c9d5b40 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55583c9e2190 con 0x55583c9d45d0 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f965320b740 10 client.0 _ll_register_callbacks cb 0x55583c6488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35108/0 (socket says 172.21.15.76:35108) 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 -- 172.21.15.76:0/2569089248 learned_addr learned my addr 172.21.15.76:0/2569089248 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:00.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f9649d9b640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964a59c640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 -- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 msgr2=0x55583c9deca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9deca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 -- 172.21.15.76:0/2569089248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 msgr2=0x55583c9dbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9dbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 -- 172.21.15.76:0/2569089248 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55583c6ab3c0 con 0x55583c9df370 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f9649d9b640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9dbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964a59c640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f964ad9d640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dc490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f9644008ea0 tx=0x7f9644004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c4cc38cb674b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f9631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.436+0000 7f9631ffb640 1 -- 172.21.15.76:0/2569089248 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964402a060 con 0x55583c9df370 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9640040070 con 0x55583c9df370 2024-09-19T07:58:00.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f9631ffb640 1 -- 172.21.15.76:0/2569089248 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f96440255f0 con 0x55583c9df370 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f9631ffb640 1 -- 172.21.15.76:0/2569089248 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9644014040 con 0x55583c9df370 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 10 client.16983 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55583c9edab0 con 0x55583c9df370 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f9631ffb640 1 -- 172.21.15.76:0/2569089248 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9640040070 con 0x55583c9df370 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f9631ffb640 1 -- 172.21.15.76:0/2569089248 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9644024070 con 0x55583c9df370 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 10 client.16983 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 20 client.16983 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583c9ef350 0x55583c9f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 4 client.16983 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55583c947860 con 0x55583c9ef350 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.437+0000 7f964a59c640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583c9ef350 0x55583c9f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.438+0000 7f964a59c640 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583c9ef350 0x55583c9f17f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76de28f80b65972 server_cookie=1ecc723285897cfd in_seq=0 out_seq=0 2024-09-19T07:58:00.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.438+0000 7f9631ffb640 10 client.16983 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.438+0000 7f9631ffb640 1 -- 172.21.15.76:0/2569089248 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55583c947860 con 0x55583c9ef350 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.438+0000 7f9631ffb640 10 client.16983 handle_command_reply: tid=0 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.438+0000 7f965320b740 1 client.16983 shutdown 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 msgr2=0x55583c9dc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dc490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f9644008ea0 tx=0x7f9644004a40 comp rx=0 tx=0).stop 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 shutdown_connections 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583c9ef350 0x55583c9f17f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dc490 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f9631ffb640 0 client.16983 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9dbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 --2- 172.21.15.76:0/2569089248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 >> 172.21.15.76:0/2569089248 conn(0x55583c99d310 msgr2=0x55583c9d6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:00.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 shutdown_connections 2024-09-19T07:58:00.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 1 -- 172.21.15.76:0/2569089248 wait complete. 2024-09-19T07:58:00.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.439+0000 7f965320b740 20 client.16983 trim_cache size 0 max 16384 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 Processor -- start 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 -- start start 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9da820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1b2540 con 0x55583c9df370 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1afe10 con 0x55583c9d5b40 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f965320b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1adc60 con 0x55583c9d45d0 2024-09-19T07:58:00.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35118/0 (socket says 172.21.15.76:35118) 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 -- 172.21.15.76:0/1441341815 learned_addr learned my addr 172.21.15.76:0/1441341815 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964a59c640 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f9649d9b640 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9da820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 -- 172.21.15.76:0/1441341815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 msgr2=0x55583c9eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 -- 172.21.15.76:0/1441341815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 msgr2=0x55583c9da820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9da820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 -- 172.21.15.76:0/1441341815 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55583c9df010 con 0x55583c9df370 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.452+0000 7f964ad9d640 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dad60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9644009900 tx=0x7f964400d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fa7788c595770d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f9633fff640 1 -- 172.21.15.76:0/1441341815 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964403c020 con 0x55583c9df370 2024-09-19T07:58:00.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f9633fff640 1 -- 172.21.15.76:0/1441341815 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f964402db10 con 0x55583c9df370 2024-09-19T07:58:00.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f9633fff640 1 -- 172.21.15.76:0/1441341815 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9644038bd0 con 0x55583c9df370 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 -- 172.21.15.76:0/1441341815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 msgr2=0x55583c9dad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dad60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9644009900 tx=0x7f964400d070 comp rx=0 tx=0).stop 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 -- 172.21.15.76:0/1441341815 shutdown_connections 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9dad60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9da820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 --2- 172.21.15.76:0/1441341815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 -- 172.21.15.76:0/1441341815 >> 172.21.15.76:0/1441341815 conn(0x55583c99d310 msgr2=0x55583c9dbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:00.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 -- 172.21.15.76:0/1441341815 shutdown_connections 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.453+0000 7f965320b740 1 -- 172.21.15.76:0/1441341815 wait complete. 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 -- start start 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 Processor -- start 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9d8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1ae2d0 con 0x55583c9df370 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1af740 con 0x55583c9d5b40 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1ae9a0 con 0x55583c9d45d0 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f965320b740 10 client.0 _ll_register_callbacks cb 0x7f964400bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9d8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35120/0 (socket says 172.21.15.76:35120) 2024-09-19T07:58:00.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 -- 172.21.15.76:0/2013855331 learned_addr learned my addr 172.21.15.76:0/2013855331 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f9649d9b640 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 -- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 msgr2=0x55583c9e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 -- 172.21.15.76:0/2013855331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 msgr2=0x55583c9e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.454+0000 7f964ad9d640 1 -- 172.21.15.76:0/2013855331 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55583c9d8dc0 con 0x55583c9df370 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f964ad9d640 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9d8780 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9644008bc0 tx=0x7f9644038b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52b8f7ee908e2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f9631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f9631ffb640 1 -- 172.21.15.76:0/2013855331 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964403c030 con 0x55583c9df370 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f9631ffb640 1 -- 172.21.15.76:0/2013855331 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f964400ba10 con 0x55583c9df370 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f964402db10 con 0x55583c9df370 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f9631ffb640 1 -- 172.21.15.76:0/2013855331 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f964404f050 con 0x55583c9df370 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 10 client.16989 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:00.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55583ca59a10 con 0x55583c9df370 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f9631ffb640 1 -- 172.21.15.76:0/2013855331 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f964402db10 con 0x55583c9df370 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f9631ffb640 1 -- 172.21.15.76:0/2013855331 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9644024040 con 0x55583c9df370 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 10 client.16989 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 20 client.16989 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583ca5a050 0x55583ca5c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 4 client.16989 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55583c941d70 con 0x55583ca5a050 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.455+0000 7f964a59c640 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583ca5a050 0x55583ca5c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f9631ffb640 10 client.16989 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f964a59c640 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583ca5a050 0x55583ca5c470 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc7ee797ed7150 server_cookie=21d6f302c67f7b2 in_seq=0 out_seq=0 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f9631ffb640 1 -- 172.21.15.76:0/2013855331 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55583c941d70 con 0x55583ca5a050 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f9631ffb640 10 client.16989 handle_command_reply: tid=0 2024-09-19T07:58:00.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 client.16989 shutdown 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 msgr2=0x55583c9d8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9d8780 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9644008bc0 tx=0x7f9644038b00 comp rx=0 tx=0).stop 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 shutdown_connections 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55583ca5a050 0x55583ca5c470 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55583c9df370 0x55583c9d8780 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f9631ffb640 0 client.16989 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55583c9d5b40 0x55583c9e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 --2- 172.21.15.76:0/2013855331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583c9d45d0 0x55583c9e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 >> 172.21.15.76:0/2013855331 conn(0x55583c99d310 msgr2=0x55583c9da7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 shutdown_connections 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.456+0000 7f965320b740 1 -- 172.21.15.76:0/2013855331 wait complete. 2024-09-19T07:58:00.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f965320b740 20 client.16989 trim_cache size 0 max 16384 2024-09-19T07:58:00.463 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:00.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96340a33b0 msgr2=0x7f96340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96340a33b0 0x7f96340a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9644009440 tx=0x7f9644009390 comp rx=0 tx=0).stop 2024-09-19T07:58:00.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 msgr2=0x7f964c197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:00.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 0x7f964c197280 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f963c00d770 tx=0x7f963c00dc30 comp rx=0 tx=0).stop 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 shutdown_connections 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96340a33b0 0x7f96340a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f964c102ef0 0x7f964c197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f964c102570 0x7f964c1977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 --2- 172.21.15.76:0/466449311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f964c100e20 0x7f964c197280 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 >> 172.21.15.76:0/466449311 conn(0x7f964c0fc7d0 msgr2=0x7f964c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 shutdown_connections 2024-09-19T07:58:00.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:00.457+0000 7f9650e32640 1 -- 172.21.15.76:0/466449311 wait complete. 2024-09-19T07:58:00.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:00 smithi152 ceph-mon[35117]: pgmap v208: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:58:02.134 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:58:02.135 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:58:02.391 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:02.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:02 smithi137 ceph-mon[35309]: pgmap v209: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:58:02.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:02 smithi076 ceph-mon[30930]: pgmap v209: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:58:02.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:02 smithi152 ceph-mon[35117]: pgmap v209: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:58:02.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 -- 172.21.15.76:0/2436966569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c100b30 msgr2=0x7f712c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2436966569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c100b30 0x7f712c100f10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7128009900 tx=0x7f712802a470 comp rx=0 tx=0).stop 2024-09-19T07:58:02.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 -- 172.21.15.76:0/2436966569 shutdown_connections 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2436966569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f712c105f40 0x7f712c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2436966569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c101450 0x7f712c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2436966569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c100b30 0x7f712c100f10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 -- 172.21.15.76:0/2436966569 >> 172.21.15.76:0/2436966569 conn(0x7f712c0fc7a0 msgr2=0x7f712c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 -- 172.21.15.76:0/2436966569 shutdown_connections 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.840+0000 7f7133ea8640 1 -- 172.21.15.76:0/2436966569 wait complete. 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 Processor -- start 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 -- start start 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f712c100b30 0x7f712c1a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 0x7f712c1a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c105f40 0x7f712c19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1186a0 con 0x7f712c101450 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f712c118520 con 0x7f712c105f40 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7133ea8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f712c118820 con 0x7f712c100b30 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 0x7f712c1a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 0x7f712c1a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35148/0 (socket says 172.21.15.76:35148) 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7131443640 1 -- 172.21.15.76:0/2750827138 learned_addr learned my addr 172.21.15.76:0/2750827138 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.841+0000 7f7131c44640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f712c100b30 0x7f712c1a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7131443640 1 -- 172.21.15.76:0/2750827138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f712c100b30 msgr2=0x7f712c1a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7131443640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f712c100b30 0x7f712c1a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7131443640 1 -- 172.21.15.76:0/2750827138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c105f40 msgr2=0x7f712c19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7132445640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c105f40 0x7f712c19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7131443640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c105f40 0x7f712c19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7131443640 1 -- 172.21.15.76:0/2750827138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712c19f080 con 0x7f712c101450 2024-09-19T07:58:02.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7132445640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c105f40 0x7f712c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:02.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7131443640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 0x7f712c1a4cd0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c940 tx=0x7f711c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:02.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7122ffd640 1 -- 172.21.15.76:0/2750827138 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c004220 con 0x7f712c101450 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7122ffd640 1 -- 172.21.15.76:0/2750827138 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f711c0043c0 con 0x7f712c101450 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712c19f370 con 0x7f712c101450 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7122ffd640 1 -- 172.21.15.76:0/2750827138 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c004a00 con 0x7f712c101450 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.842+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f712c1ab660 con 0x7f712c101450 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.844+0000 7f7122ffd640 1 -- 172.21.15.76:0/2750827138 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f711c005140 con 0x7f712c101450 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.844+0000 7f7136281740 1 Processor -- start 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 -- start start 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 0x558d32aeef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aef480 0x558d32af9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32afc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558d32a54280 con 0x558d32aeeb60 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d329fbb10 con 0x558d32aef480 2024-09-19T07:58:02.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7136281740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558d32a50240 con 0x558d32af9d40 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7122ffd640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f71180a3430 0x7f71180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 0x558d32aeef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 0x558d32aeef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35156/0 (socket says 172.21.15.76:35156) 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 -- 172.21.15.76:0/3737007793 learned_addr learned my addr 172.21.15.76:0/3737007793 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f71180a3430 0x7f71180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7131c44640 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aef480 0x558d32af9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7122ffd640 1 -- 172.21.15.76:0/2750827138 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f711c0cf950 con 0x7f712c101450 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7131443640 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32afc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 -- 172.21.15.76:0/3737007793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 msgr2=0x558d32afc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32afc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 -- 172.21.15.76:0/3737007793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aef480 msgr2=0x558d32af9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aef480 0x558d32af9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7132445640 1 -- 172.21.15.76:0/3737007793 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d32a081f0 con 0x558d32aeeb60 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.845+0000 7f7131443640 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32afc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7132445640 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 0x558d32aeef40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f71240092f0 tx=0x7f7124011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b34991d27cc33d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7132445640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f71180a3430 0x7f71180a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7124011c50 tx=0x7f7124016000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7117fff640 1 -- 172.21.15.76:0/3737007793 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124022070 con 0x558d32aeeb60 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7117fff640 1 -- 172.21.15.76:0/3737007793 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7124009bc0 con 0x558d32aeeb60 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7117fff640 1 -- 172.21.15.76:0/3737007793 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124005760 con 0x558d32aeeb60 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7136281740 1 -- 172.21.15.76:0/3737007793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 msgr2=0x558d32aeef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7136281740 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 0x558d32aeef40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f71240092f0 tx=0x7f7124011750 comp rx=0 tx=0).stop 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.846+0000 7f7136281740 1 -- 172.21.15.76:0/3737007793 shutdown_connections 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32afc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aef480 0x558d32af9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 --2- 172.21.15.76:0/3737007793 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aeeb60 0x558d32aeef40 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- 172.21.15.76:0/3737007793 >> 172.21.15.76:0/3737007793 conn(0x558d32aeb0f0 msgr2=0x558d32aeb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:02.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- 172.21.15.76:0/3737007793 shutdown_connections 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- 172.21.15.76:0/3737007793 wait complete. 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- start start 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 Processor -- start 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32aeeb60 0x558d32af6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32af7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32af9d40 0x558d32af76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558d32afc910 con 0x558d32aef480 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d32a0ef10 con 0x558d32af9d40 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.847+0000 7f7136281740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558d32afca90 con 0x558d32aeeb60 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7136281740 10 client.0 _ll_register_callbacks cb 0x558d329d7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32af7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32af7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35160/0 (socket says 172.21.15.76:35160) 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 -- 172.21.15.76:0/924003075 learned_addr learned my addr 172.21.15.76:0/924003075 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7132445640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32af9d40 0x558d32af76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131c44640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32aeeb60 0x558d32af6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 -- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32aeeb60 msgr2=0x558d32af6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32aeeb60 0x558d32af6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 -- 172.21.15.76:0/924003075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32af9d40 msgr2=0x558d32af76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32af9d40 0x558d32af76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 -- 172.21.15.76:0/924003075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d327c56a0 con 0x558d32aef480 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131c44640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32aeeb60 0x558d32af6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7131443640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32af7180 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f711c0cd0f0 tx=0x7f711c09b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b39178f35b5e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f71157fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f71157fa640 1 -- 172.21.15.76:0/924003075 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c01d050 con 0x558d32aef480 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f71157fa640 1 -- 172.21.15.76:0/924003075 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f711c0a45b0 con 0x558d32aef480 2024-09-19T07:58:02.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7124009bc0 con 0x558d32aef480 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f71157fa640 1 -- 172.21.15.76:0/924003075 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f711c09ff80 con 0x558d32aef480 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7136281740 10 client.17001 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.848+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558d32b084b0 con 0x558d32aef480 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f71157fa640 1 -- 172.21.15.76:0/924003075 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7124009bc0 con 0x558d32aef480 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f71157fa640 1 -- 172.21.15.76:0/924003075 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f711c0860b0 con 0x558d32aef480 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7136281740 10 client.17001 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7136281740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7136281740 20 client.17001 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7136281740 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b09970 0x558d32b0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7136281740 4 client.17001 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d32a617f0 con 0x558d32b09970 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.849+0000 7f7131c44640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b09970 0x558d32b0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f7131c44640 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b09970 0x558d32b0bda0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10068e557cbb374e server_cookie=beec726b2ee8e69b in_seq=0 out_seq=0 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f71157fa640 10 client.17001 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f71157fa640 1 -- 172.21.15.76:0/924003075 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d32a617f0 con 0x558d32b09970 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f71157fa640 10 client.17001 handle_command_reply: tid=0 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f7136281740 1 client.17001 shutdown 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 msgr2=0x558d32af7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.850+0000 7f7136281740 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32af7180 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f711c0cd0f0 tx=0x7f711c09b7d0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 shutdown_connections 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32af9d40 0x558d32af76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b09970 0x558d32b0bda0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32af7180 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 --2- 172.21.15.76:0/924003075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32aeeb60 0x558d32af6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f71157fa640 0 client.17001 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:02.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 >> 172.21.15.76:0/924003075 conn(0x558d32aeb0f0 msgr2=0x558d32af0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:02.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 shutdown_connections 2024-09-19T07:58:02.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 1 -- 172.21.15.76:0/924003075 wait complete. 2024-09-19T07:58:02.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.851+0000 7f7136281740 20 client.17001 trim_cache size 0 max 16384 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 Processor -- start 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 -- start start 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b11670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32b11bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32af3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1b6a60 con 0x558d32aef480 2024-09-19T07:58:02.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1b4330 con 0x558d32aeeb60 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.868+0000 7f7136281740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1b2180 con 0x558d32af9d40 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32b11bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32b11bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35164/0 (socket says 172.21.15.76:35164) 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 -- 172.21.15.76:0/1944201125 learned_addr learned my addr 172.21.15.76:0/1944201125 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131c44640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b11670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7132445640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32af3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 -- 172.21.15.76:0/1944201125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 msgr2=0x558d32af3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32af3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 -- 172.21.15.76:0/1944201125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 msgr2=0x558d32b11670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b11670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 -- 172.21.15.76:0/1944201125 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d32aeab90 con 0x558d32aef480 2024-09-19T07:58:02.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7132445640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32af3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131c44640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b11670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f7131443640 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32b11bb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f711c00a580 tx=0x7f711c09b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e180812df166bca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f71177fe640 1 -- 172.21.15.76:0/1944201125 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c01d040 con 0x558d32aef480 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f71177fe640 1 -- 172.21.15.76:0/1944201125 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f711c0a4840 con 0x558d32aef480 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.869+0000 7f71177fe640 1 -- 172.21.15.76:0/1944201125 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0a4610 con 0x558d32aef480 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 -- 172.21.15.76:0/1944201125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 msgr2=0x558d32b11bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32b11bb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f711c00a580 tx=0x7f711c09b840 comp rx=0 tx=0).stop 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 -- 172.21.15.76:0/1944201125 shutdown_connections 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32af3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32b11bb0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 --2- 172.21.15.76:0/1944201125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b11670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 -- 172.21.15.76:0/1944201125 >> 172.21.15.76:0/1944201125 conn(0x558d32aeb0f0 msgr2=0x558d32af8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:02.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 -- 172.21.15.76:0/1944201125 shutdown_connections 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 -- 172.21.15.76:0/1944201125 wait complete. 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 -- start start 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.870+0000 7f7136281740 1 Processor -- start 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32afecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32aff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1b27f0 con 0x558d32aef480 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1b3c60 con 0x558d32aeeb60 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f712c1b2ec0 con 0x558d32af9d40 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7136281740 10 client.0 _ll_register_callbacks cb 0x7f711c004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32afecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32afecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:35172/0 (socket says 172.21.15.76:35172) 2024-09-19T07:58:02.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 -- 172.21.15.76:0/4153102685 learned_addr learned my addr 172.21.15.76:0/4153102685 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131c44640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 -- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 msgr2=0x558d32aff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32aff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 -- 172.21.15.76:0/4153102685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 msgr2=0x558d32b022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 -- 172.21.15.76:0/4153102685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d32aff890 con 0x558d32aef480 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131c44640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f7131443640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32afecb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f711c097f50 tx=0x7f711c098490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7b8516e70d47f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.871+0000 7f71157fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f71157fa640 1 -- 172.21.15.76:0/4153102685 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c01d040 con 0x558d32aef480 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f71157fa640 1 -- 172.21.15.76:0/4153102685 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f711c0a45b0 con 0x558d32aef480 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d32a5bd00 con 0x558d32aef480 2024-09-19T07:58:02.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f71157fa640 1 -- 172.21.15.76:0/4153102685 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f711c0ba320 con 0x558d32aef480 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 10 client.17007 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558d32b75490 con 0x558d32aef480 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f71157fa640 1 -- 172.21.15.76:0/4153102685 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x558d32a5bd00 con 0x558d32aef480 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f71157fa640 1 -- 172.21.15.76:0/4153102685 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f711c0a4b90 con 0x558d32aef480 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 10 client.17007 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 20 client.17007 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b75960 0x558d32b77d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 4 client.17007 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558d329d8110 con 0x558d32b75960 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.872+0000 7f7131c44640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b75960 0x558d32b77d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.873+0000 7f71157fa640 10 client.17007 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:02.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.873+0000 7f7131c44640 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b75960 0x558d32b77d50 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8c658a388b4a832 server_cookie=2147b83451fe8077 in_seq=0 out_seq=0 2024-09-19T07:58:02.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f71157fa640 1 -- 172.21.15.76:0/4153102685 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558d329d8110 con 0x558d32b75960 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f71157fa640 10 client.17007 handle_command_reply: tid=0 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 client.17007 shutdown 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 msgr2=0x558d32afecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32afecb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f711c097f50 tx=0x7f711c098490 comp rx=0 tx=0).stop 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 shutdown_connections 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558d32af9d40 0x558d32aff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558d32b75960 0x558d32b77d50 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558d32aef480 0x558d32afecb0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 --2- 172.21.15.76:0/4153102685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d32aeeb60 0x558d32b022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f71157fa640 0 client.17007 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 >> 172.21.15.76:0/4153102685 conn(0x558d32aeb0f0 msgr2=0x558d32af6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:02.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 shutdown_connections 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 1 -- 172.21.15.76:0/4153102685 wait complete. 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.874+0000 7f7136281740 20 client.17007 trim_cache size 0 max 16384 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "5e529bd2-bdd9-46d3-b2e5-74a1b21f66d3", 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:58:02.881 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f71180a3430 msgr2=0x7f71180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f71180a3430 0x7f71180a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7124011c50 tx=0x7f7124016000 comp rx=0 tx=0).stop 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 msgr2=0x7f712c1a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 0x7f712c1a4cd0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c940 tx=0x7f711c00ce00 comp rx=0 tx=0).stop 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 shutdown_connections 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f71180a3430 0x7f71180a58f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f712c105f40 0x7f712c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f712c101450 0x7f712c1a4cd0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 --2- 172.21.15.76:0/2750827138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f712c100b30 0x7f712c1a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:02.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 >> 172.21.15.76:0/2750827138 conn(0x7f712c0fc7a0 msgr2=0x7f712c1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:02.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 shutdown_connections 2024-09-19T07:58:02.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:02.875+0000 7f7133ea8640 1 -- 172.21.15.76:0/2750827138 wait complete. 2024-09-19T07:58:03.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:03 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:58:03.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:03 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:03.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:03 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:58:03.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:03 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:03.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:03 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:58:03.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:03 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:03.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:03 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:58:03.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:03 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:03.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:03 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:58:03.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:03 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:03.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:03 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:58:03.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:03 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:03.610 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:58:03.857 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:04.236 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:04 smithi076 ceph-mon[30930]: pgmap v210: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:58:04.237 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:04 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:58:04.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 -- 172.21.15.76:0/3776484744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 msgr2=0x7fb788106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 --2- 172.21.15.76:0/3776484744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb788106840 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb778009900 tx=0x7fb77802a410 comp rx=0 tx=0).stop 2024-09-19T07:58:04.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 -- 172.21.15.76:0/3776484744 shutdown_connections 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 --2- 172.21.15.76:0/3776484744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb788106f70 0x7fb78810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 --2- 172.21.15.76:0/3776484744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb788106840 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 --2- 172.21.15.76:0/3776484744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788100500 0x7fb7881008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 -- 172.21.15.76:0/3776484744 >> 172.21.15.76:0/3776484744 conn(0x7fb7880fc5c0 msgr2=0x7fb7880fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 -- 172.21.15.76:0/3776484744 shutdown_connections 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.318+0000 7fb78f441640 1 -- 172.21.15.76:0/3776484744 wait complete. 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 Processor -- start 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 -- start start 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb788100500 0x7fb7881a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb7881a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788106f70 0x7fb78819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb788101740 con 0x7fb788100eb0 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881015c0 con 0x7fb788100500 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78f441640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881018c0 con 0x7fb788106f70 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78c9dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb7881a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78c9dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb7881a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50902/0 (socket says 172.21.15.76:50902) 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.319+0000 7fb78c9dc640 1 -- 172.21.15.76:0/3623843680 learned_addr learned my addr 172.21.15.76:0/3623843680 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb788100500 0x7fb7881a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78d9de640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788106f70 0x7fb78819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78c9dc640 1 -- 172.21.15.76:0/3623843680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788106f70 msgr2=0x7fb78819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788106f70 0x7fb78819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78c9dc640 1 -- 172.21.15.76:0/3623843680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb788100500 msgr2=0x7fb7881a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb788100500 0x7fb7881a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78c9dc640 1 -- 172.21.15.76:0/3623843680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78819b570 con 0x7fb788100eb0 2024-09-19T07:58:04.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78d9de640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788106f70 0x7fb78819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb7881a0950 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb778005940 tx=0x7fb7780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb77e7fc640 1 -- 172.21.15.76:0/3623843680 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77803f030 con 0x7fb788100eb0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb77e7fc640 1 -- 172.21.15.76:0/3623843680 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb778003d00 con 0x7fb788100eb0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78819b800 con 0x7fb788100eb0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb77e7fc640 1 -- 172.21.15.76:0/3623843680 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778035070 con 0x7fb788100eb0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.320+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7881a72e0 con 0x7fb788100eb0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb77e7fc640 1 -- 172.21.15.76:0/3623843680 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb778042030 con 0x7fb788100eb0 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 Processor -- start 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 -- start start 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee3d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb77e7fc640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb7740a3430 0x7fb7740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee48140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 0x557d2ee4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557d2eda32e0 con 0x557d2ee48680 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557d2ed4ace0 con 0x557d2ee3d4a0 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.323+0000 7fb79181a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557d2ed9f2a0 con 0x557d2ee3ddc0 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb7740a3430 0x7fb7740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 0x557d2ee4aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 0x557d2ee4aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50914/0 (socket says 172.21.15.76:50914) 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 -- 172.21.15.76:0/2681073246 learned_addr learned my addr 172.21.15.76:0/2681073246 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee3d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb77e7fc640 1 -- 172.21.15.76:0/3623843680 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb7780f0280 con 0x7fb788100eb0 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee48140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 -- 172.21.15.76:0/2681073246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 msgr2=0x557d2ee48140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee48140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 -- 172.21.15.76:0/2681073246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 msgr2=0x557d2ee3d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee3d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 -- 172.21.15.76:0/2681073246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2ed2f440 con 0x557d2ee48680 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb7740a3430 0x7fb7740a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb784005fd0 tx=0x7fb78400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb78d9de640 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 0x557d2ee4aa70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb780013b30 tx=0x7fb78000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697df26ef178958a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb7737fe640 1 -- 172.21.15.76:0/2681073246 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780013310 con 0x557d2ee48680 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb7737fe640 1 -- 172.21.15.76:0/2681073246 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb780003970 con 0x557d2ee48680 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.324+0000 7fb7737fe640 1 -- 172.21.15.76:0/2681073246 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780004570 con 0x557d2ee48680 2024-09-19T07:58:04.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 -- 172.21.15.76:0/2681073246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 msgr2=0x557d2ee4aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 0x557d2ee4aa70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb780013b30 tx=0x7fb78000a660 comp rx=0 tx=0).stop 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 -- 172.21.15.76:0/2681073246 shutdown_connections 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee48680 0x557d2ee4aa70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee48140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 --2- 172.21.15.76:0/2681073246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee3d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 -- 172.21.15.76:0/2681073246 >> 172.21.15.76:0/2681073246 conn(0x557d2ee39a30 msgr2=0x557d2ee39e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 -- 172.21.15.76:0/2681073246 shutdown_connections 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 -- 172.21.15.76:0/2681073246 wait complete. 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.325+0000 7fb79181a740 1 -- start start 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 Processor -- start 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 0x557d2ee48010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee45840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557d2ee4b250 con 0x557d2ee3d4a0 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557d2ed5e050 con 0x557d2ee48680 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557d2ee4b3d0 con 0x557d2ee3ddc0 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb79181a740 10 client.0 _ll_register_callbacks cb 0x557d2ed9e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 0x557d2ee48010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 0x557d2ee48010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50918/0 (socket says 172.21.15.76:50918) 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 -- 172.21.15.76:0/3972613451 learned_addr learned my addr 172.21.15.76:0/3972613451 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 -- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 msgr2=0x557d2ee452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d9de640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee45840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 -- 172.21.15.76:0/3972613451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 msgr2=0x557d2ee45840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee45840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d1dd640 1 -- 172.21.15.76:0/3972613451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2eb143c0 con 0x557d2ee3d4a0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.326+0000 7fb78d9de640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee45840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 0x557d2ee48010 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb7840116f0 tx=0x7fb784004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a4fb314c3dbb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb770ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb770ff9640 1 -- 172.21.15.76:0/3972613451 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78401e8f0 con 0x557d2ee3d4a0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb770ff9640 1 -- 172.21.15.76:0/3972613451 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb78401ea90 con 0x557d2ee3d4a0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb780003970 con 0x557d2ee3d4a0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb770ff9640 1 -- 172.21.15.76:0/3972613451 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb78401ec90 con 0x557d2ee3d4a0 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 10 client.17019 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:04.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557d2ee56ca0 con 0x557d2ee3d4a0 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb770ff9640 1 -- 172.21.15.76:0/3972613451 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb780003970 con 0x557d2ee3d4a0 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb770ff9640 1 -- 172.21.15.76:0/3972613451 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb7840265c0 con 0x557d2ee3d4a0 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 10 client.17019 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 20 client.17019 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2ee58160 0x557d2ee5a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 4 client.17019 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.327+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d2edb0850 con 0x557d2ee58160 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.328+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2ee58160 0x557d2ee5a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.328+0000 7fb770ff9640 10 client.17019 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:04.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.328+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2ee58160 0x557d2ee5a550 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b79585f8968bba server_cookie=8c974c8a8fe95b4a in_seq=0 out_seq=0 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb770ff9640 1 -- 172.21.15.76:0/3972613451 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d2edb0850 con 0x557d2ee58160 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb770ff9640 10 client.17019 handle_command_reply: tid=0 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 client.17019 shutdown 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 msgr2=0x557d2ee48010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 0x557d2ee48010 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb7840116f0 tx=0x7fb784004730 comp rx=0 tx=0).stop 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 shutdown_connections 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee45840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3ddc0 0x557d2ee452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2ee58160 0x557d2ee5a550 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 --2- 172.21.15.76:0/3972613451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3d4a0 0x557d2ee48010 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 >> 172.21.15.76:0/3972613451 conn(0x557d2ee39a30 msgr2=0x557d2ee3f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:04.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb770ff9640 0 client.17019 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 shutdown_connections 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 1 -- 172.21.15.76:0/3972613451 wait complete. 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.329+0000 7fb79181a740 20 client.17019 trim_cache size 0 max 16384 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 Processor -- start 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 -- start start 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee43b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee48680 0x557d2ee407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881b2710 con 0x557d2ee3ddc0 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881affe0 con 0x557d2ee3d4a0 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb79181a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881ade30 con 0x557d2ee48680 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb78c9dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee43b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb78c9dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee43b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50932/0 (socket says 172.21.15.76:50932) 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.346+0000 7fb78c9dc640 1 -- 172.21.15.76:0/1190425934 learned_addr learned my addr 172.21.15.76:0/1190425934 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78d9de640 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee48680 0x557d2ee407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78c9dc640 1 -- 172.21.15.76:0/1190425934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee48680 msgr2=0x557d2ee407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee48680 0x557d2ee407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78c9dc640 1 -- 172.21.15.76:0/1190425934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 msgr2=0x557d2ee544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78c9dc640 1 -- 172.21.15.76:0/1190425934 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2ee44270 con 0x557d2ee3ddc0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee43b90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb7780b8960 tx=0x7fb7780b88d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bc8624c1261ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb772ffd640 1 -- 172.21.15.76:0/1190425934 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778049040 con 0x557d2ee3ddc0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb772ffd640 1 -- 172.21.15.76:0/1190425934 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb7780bcc00 con 0x557d2ee3ddc0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.347+0000 7fb772ffd640 1 -- 172.21.15.76:0/1190425934 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77803b460 con 0x557d2ee3ddc0 2024-09-19T07:58:04.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 -- 172.21.15.76:0/1190425934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 msgr2=0x557d2ee43b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee43b90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb7780b8960 tx=0x7fb7780b88d0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 -- 172.21.15.76:0/1190425934 shutdown_connections 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee48680 0x557d2ee407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee43b90 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 --2- 172.21.15.76:0/1190425934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee3d4a0 0x557d2ee544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 -- 172.21.15.76:0/1190425934 >> 172.21.15.76:0/1190425934 conn(0x557d2ee39a30 msgr2=0x557d2ee40090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 -- 172.21.15.76:0/1190425934 shutdown_connections 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 -- 172.21.15.76:0/1190425934 wait complete. 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 -- start start 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 Processor -- start 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.348+0000 7fb79181a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3d4a0 0x557d2ee509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee50f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee4bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881ae4a0 con 0x557d2ee3ddc0 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881af910 con 0x557d2ee48680 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881aeb70 con 0x557d2ee3d4a0 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 10 client.0 _ll_register_callbacks cb 0x7fb784005c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee50f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee50f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50940/0 (socket says 172.21.15.76:50940) 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 -- 172.21.15.76:0/161734568 learned_addr learned my addr 172.21.15.76:0/161734568 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3d4a0 0x557d2ee509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78d9de640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee4bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 -- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3d4a0 msgr2=0x557d2ee509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3d4a0 0x557d2ee509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 -- 172.21.15.76:0/161734568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 msgr2=0x557d2ee4bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee4bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 -- 172.21.15.76:0/161734568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2ee45bb0 con 0x557d2ee3ddc0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3d4a0 0x557d2ee509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb78c9dc640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee50f30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb7780b8ed0 tx=0x7fb7780095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79438ebe9f94c4d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb770ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb770ff9640 1 -- 172.21.15.76:0/161734568 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780da060 con 0x557d2ee3ddc0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb770ff9640 1 -- 172.21.15.76:0/161734568 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb7780edbf0 con 0x557d2ee3ddc0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7780bcc00 con 0x557d2ee3ddc0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb770ff9640 1 -- 172.21.15.76:0/161734568 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb778049040 con 0x557d2ee3ddc0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 10 client.17025 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.349+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557d2eec27e0 con 0x557d2ee3ddc0 2024-09-19T07:58:04.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb770ff9640 1 -- 172.21.15.76:0/161734568 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb7780bcc00 con 0x557d2ee3ddc0 2024-09-19T07:58:04.374 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:04.374 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:58:04.374 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:58:04.374 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:04.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb770ff9640 1 -- 172.21.15.76:0/161734568 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb77809f030 con 0x557d2ee3ddc0 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb79181a740 10 client.17025 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb79181a740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb79181a740 20 client.17025 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb79181a740 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2eec2f10 0x557d2eec5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb79181a740 4 client.17025 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d2edaad60 con 0x557d2eec2f10 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.350+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2eec2f10 0x557d2eec5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:04.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb770ff9640 10 client.17025 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb78d1dd640 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2eec2f10 0x557d2eec5330 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6413f40125fb0e server_cookie=776c83ef0ce332d4 in_seq=0 out_seq=0 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb770ff9640 1 -- 172.21.15.76:0/161734568 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557d2edaad60 con 0x557d2eec2f10 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb770ff9640 10 client.17025 handle_command_reply: tid=0 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 client.17025 shutdown 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 msgr2=0x557d2ee50f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee50f30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb7780b8ed0 tx=0x7fb7780095d0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 shutdown_connections 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557d2ee48680 0x557d2ee4bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557d2eec2f10 0x557d2eec5330 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557d2ee3ddc0 0x557d2ee50f30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 --2- 172.21.15.76:0/161734568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d2ee3d4a0 0x557d2ee509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb770ff9640 0 client.17025 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:04.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 >> 172.21.15.76:0/161734568 conn(0x557d2ee39a30 msgr2=0x557d2ee38220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 shutdown_connections 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 1 -- 172.21.15.76:0/161734568 wait complete. 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.351+0000 7fb79181a740 20 client.17025 trim_cache size 0 max 16384 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb7740a3430 msgr2=0x7fb7740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb7740a3430 0x7fb7740a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb784005fd0 tx=0x7fb78400b390 comp rx=0 tx=0).stop 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 msgr2=0x7fb7881a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb7881a0950 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb778005940 tx=0x7fb7780042f0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 shutdown_connections 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb7740a3430 0x7fb7740a58f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb788106f70 0x7fb78819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb788100eb0 0x7fb7881a0950 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 --2- 172.21.15.76:0/3623843680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb788100500 0x7fb7881a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:04.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 >> 172.21.15.76:0/3623843680 conn(0x7fb7880fc5c0 msgr2=0x7fb7881051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:04.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 shutdown_connections 2024-09-19T07:58:04.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:04.352+0000 7fb78f441640 1 -- 172.21.15.76:0/3623843680 wait complete. 2024-09-19T07:58:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:04 smithi137 ceph-mon[35309]: pgmap v210: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:58:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:04 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:58:04.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:04 smithi152 ceph-mon[35117]: pgmap v210: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:58:04.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:04 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:58:05.047 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:58:05.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:58:05.295 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:05.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 -- 172.21.15.76:0/1274187850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194102ef0 msgr2=0x7fb19410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:05.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 --2- 172.21.15.76:0/1274187850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194102ef0 0x7fb19410da40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009ca0 tx=0x7fb18c02a950 comp rx=0 tx=0).stop 2024-09-19T07:58:05.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 -- 172.21.15.76:0/1274187850 shutdown_connections 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 --2- 172.21.15.76:0/1274187850 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194102ef0 0x7fb19410da40 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 --2- 172.21.15.76:0/1274187850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102570 0x7fb1941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 --2- 172.21.15.76:0/1274187850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194100e20 0x7fb194101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 -- 172.21.15.76:0/1274187850 >> 172.21.15.76:0/1274187850 conn(0x7fb1940fc7d0 msgr2=0x7fb1940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 -- 172.21.15.76:0/1274187850 shutdown_connections 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.793+0000 7fb199943640 1 -- 172.21.15.76:0/1274187850 wait complete. 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 Processor -- start 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 -- start start 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 0x7fb19410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194102570 0x7fb19410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102ef0 0x7fb19410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:05.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb1941121c0 con 0x7fb194100e20 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb194112040 con 0x7fb194102ef0 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb199943640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb194112340 con 0x7fb194102570 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 0x7fb19410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 0x7fb19410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50964/0 (socket says 172.21.15.76:50964) 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 -- 172.21.15.76:0/387924346 learned_addr learned my addr 172.21.15.76:0/387924346 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb18bfff640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194102570 0x7fb19410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb1937fe640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102ef0 0x7fb19410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 -- 172.21.15.76:0/387924346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194102570 msgr2=0x7fb19410ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194102570 0x7fb19410ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 -- 172.21.15.76:0/387924346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102ef0 msgr2=0x7fb19410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102ef0 0x7fb19410ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 -- 172.21.15.76:0/387924346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1941a6970 con 0x7fb194100e20 2024-09-19T07:58:05.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb18bfff640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194102570 0x7fb19410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb1937fe640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102ef0 0x7fb19410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.794+0000 7fb192ffd640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 0x7fb19410e4d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb18400e9f0 tx=0x7fb18400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.795+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18400cd80 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.795+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb184005520 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.795+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1941a6c60 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.795+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184010690 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.795+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1941a7150 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.796+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb194101200 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.797+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb1840046c0 con 0x7fb194100e20 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.798+0000 7fb198941640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb1800a33b0 0x7fb1800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.798+0000 7fb18bfff640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb1800a33b0 0x7fb1800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:05.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.798+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fb1840d0530 con 0x7fb194100e20 2024-09-19T07:58:05.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.798+0000 7fb18bfff640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb1800a33b0 0x7fb1800a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb17c005e10 tx=0x7fb17c005da0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:05.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:05.801+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb184054210 con 0x7fb194100e20 2024-09-19T07:58:06.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.003+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb19410fa00 con 0x7fb194100e20 2024-09-19T07:58:06.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.003+0000 7fb198941640 1 -- 172.21.15.76:0/387924346 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7fb18409ce50 con 0x7fb194100e20 2024-09-19T07:58:06.004 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:58:06.004 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:58:06.004 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T07:58:06.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb1800a33b0 msgr2=0x7fb1800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb1800a33b0 0x7fb1800a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb17c005e10 tx=0x7fb17c005da0 comp rx=0 tx=0).stop 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 msgr2=0x7fb19410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 0x7fb19410e4d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb18400e9f0 tx=0x7fb18400edf0 comp rx=0 tx=0).stop 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 shutdown_connections 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb1800a33b0 0x7fb1800a5870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb194102ef0 0x7fb19410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb194102570 0x7fb19410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 --2- 172.21.15.76:0/387924346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb194100e20 0x7fb19410e4d0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.005+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 >> 172.21.15.76:0/387924346 conn(0x7fb1940fc7d0 msgr2=0x7fb194105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.006+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 shutdown_connections 2024-09-19T07:58:06.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:06.006+0000 7fb199943640 1 -- 172.21.15.76:0/387924346 wait complete. 2024-09-19T07:58:06.369 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:06 smithi076 ceph-mon[30930]: pgmap v211: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:58:06.369 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:06 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/387924346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:06.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:06 smithi137 ceph-mon[35309]: pgmap v211: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:58:06.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:06 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/387924346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:06.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:06 smithi152 ceph-mon[35117]: pgmap v211: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:58:06.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:06 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/387924346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:06.708 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:58:06.953 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 -- 172.21.15.76:0/2445037554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668102ef0 msgr2=0x7f466810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 --2- 172.21.15.76:0/2445037554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668102ef0 0x7f466810da40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4660009ca0 tx=0x7f466002a950 comp rx=0 tx=0).stop 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 -- 172.21.15.76:0/2445037554 shutdown_connections 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 --2- 172.21.15.76:0/2445037554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668102ef0 0x7f466810da40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 --2- 172.21.15.76:0/2445037554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4668102570 0x7f46681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 --2- 172.21.15.76:0/2445037554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668100e20 0x7f4668101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 -- 172.21.15.76:0/2445037554 >> 172.21.15.76:0/2445037554 conn(0x7f46680fc7d0 msgr2=0x7f46680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 -- 172.21.15.76:0/2445037554 shutdown_connections 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 -- 172.21.15.76:0/2445037554 wait complete. 2024-09-19T07:58:07.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 Processor -- start 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.440+0000 7f466f206640 1 -- start start 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466f206640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 0x7f4668199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466f206640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668102570 0x7f4668199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466f206640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4668102ef0 0x7f46681a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466f206640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4668111130 con 0x7f4668100e20 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466f206640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4668110fb0 con 0x7f4668102570 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466f206640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46681112b0 con 0x7f4668102ef0 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 0x7f4668199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 0x7f4668199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50980/0 (socket says 172.21.15.76:50980) 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 -- 172.21.15.76:0/3226186139 learned_addr learned my addr 172.21.15.76:0/3226186139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f4667fff640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668102570 0x7f4668199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466d7a3640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4668102ef0 0x7f46681a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 -- 172.21.15.76:0/3226186139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4668102ef0 msgr2=0x7f46681a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4668102ef0 0x7f46681a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 -- 172.21.15.76:0/3226186139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668102570 msgr2=0x7f4668199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668102570 0x7f4668199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 -- 172.21.15.76:0/3226186139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46681a49e0 con 0x7f4668100e20 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f4667fff640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668102570 0x7f4668199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f466cfa2640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 0x7f4668199420 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f465c00b4a0 tx=0x7f465c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.441+0000 7f4665ffb640 1 -- 172.21.15.76:0/3226186139 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c014070 con 0x7f4668100e20 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.442+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46681a4bb0 con 0x7f4668100e20 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.442+0000 7f4665ffb640 1 -- 172.21.15.76:0/3226186139 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f465c010b10 con 0x7f4668100e20 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.442+0000 7f4665ffb640 1 -- 172.21.15.76:0/3226186139 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c017d60 con 0x7f4668100e20 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.442+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46681a50f0 con 0x7f4668100e20 2024-09-19T07:58:07.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.444+0000 7f4665ffb640 1 -- 172.21.15.76:0/3226186139 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f465c017070 con 0x7f4668100e20 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.444+0000 7f46715df740 1 Processor -- start 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.444+0000 7f46715df740 1 -- start start 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f46715df740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f46715df740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 0x55faffceea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f4665ffb640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46580a33b0 0x7f46580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f46715df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f46715df740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55faffc542f0 con 0x55faffcee5d0 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f46715df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55faffbfbcf0 con 0x55faffcf9370 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f46715df740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55faffc502b0 con 0x55faffcefb40 2024-09-19T07:58:07.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 0x55faffceea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f4667fff640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46580a33b0 0x7f46580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 0x55faffceea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50984/0 (socket says 172.21.15.76:50984) 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 -- 172.21.15.76:0/240181595 learned_addr learned my addr 172.21.15.76:0/240181595 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466d7a3640 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f4665ffb640 1 -- 172.21.15.76:0/3226186139 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f465c0ceff0 con 0x7f4668100e20 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466d7a3640 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 -- 172.21.15.76:0/240181595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 msgr2=0x55faffcee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 -- 172.21.15.76:0/240181595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 msgr2=0x55faffcfb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 -- 172.21.15.76:0/240181595 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faffbe03a0 con 0x55faffcee5d0 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466d7a3640 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:07.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f4667fff640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46580a33b0 0x7f46580a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f466806aac0 tx=0x7f465400a5c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f466cfa2640 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 0x55faffceea10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f465c09b310 tx=0x7f465c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2de83683195166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.445+0000 7f4652ffd640 1 -- 172.21.15.76:0/240181595 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c01e070 con 0x55faffcee5d0 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f4652ffd640 1 -- 172.21.15.76:0/240181595 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f465c09ba80 con 0x55faffcee5d0 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f4652ffd640 1 -- 172.21.15.76:0/240181595 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c0cc960 con 0x55faffcee5d0 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 -- 172.21.15.76:0/240181595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 msgr2=0x55faffceea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 0x55faffceea10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f465c09b310 tx=0x7f465c0047d0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 -- 172.21.15.76:0/240181595 shutdown_connections 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcee5d0 0x55faffceea10 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 --2- 172.21.15.76:0/240181595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 -- 172.21.15.76:0/240181595 >> 172.21.15.76:0/240181595 conn(0x55faffcb7310 msgr2=0x55faffceac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 -- 172.21.15.76:0/240181595 shutdown_connections 2024-09-19T07:58:07.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.446+0000 7f46715df740 1 -- 172.21.15.76:0/240181595 wait complete. 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 -- start start 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 Processor -- start 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55faffcfc070 con 0x55faffcf9370 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55faffc0f060 con 0x55faffcee5d0 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55faffcfc1f0 con 0x55faffcefb40 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f46715df740 10 client.0 _ll_register_callbacks cb 0x55faff9628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466d7a3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466d7a3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50994/0 (socket says 172.21.15.76:50994) 2024-09-19T07:58:07.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466d7a3640 1 -- 172.21.15.76:0/4217832560 learned_addr learned my addr 172.21.15.76:0/4217832560 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f4667fff640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466d7a3640 1 -- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 msgr2=0x55faffcf6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466d7a3640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.447+0000 7f466d7a3640 1 -- 172.21.15.76:0/4217832560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 msgr2=0x55faffcf8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f466d7a3640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f466d7a3640 1 -- 172.21.15.76:0/4217832560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faff9c53c0 con 0x55faffcf9370 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4667fff640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f466d7a3640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf6810 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f466002ae70 tx=0x7f466002f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c53ebd4a1f18fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4647fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4647fff640 1 -- 172.21.15.76:0/4217832560 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466004c060 con 0x55faffcf9370 2024-09-19T07:58:07.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4647fff640 1 -- 172.21.15.76:0/4217832560 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f4660003970 con 0x55faffcf9370 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f465c09ba80 con 0x55faffcf9370 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4647fff640 1 -- 172.21.15.76:0/4217832560 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4660034040 con 0x55faffcf9370 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 10 client.17043 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55faffd07b90 con 0x55faffcf9370 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4647fff640 1 -- 172.21.15.76:0/4217832560 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f465c09ba80 con 0x55faffcf9370 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f4647fff640 1 -- 172.21.15.76:0/4217832560 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4660004040 con 0x55faffcf9370 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 10 client.17043 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 10 client.17043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 20 client.17043 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd08fa0 0x55faffd0b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 4 client.17043 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.448+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faffc61860 con 0x55faffd08fa0 2024-09-19T07:58:07.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.449+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd08fa0 0x55faffd0b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.449+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd08fa0 0x55faffd0b400 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d373b2d5d3f89d3f server_cookie=1c7fe07e2cd7fef4 in_seq=0 out_seq=0 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.449+0000 7f4647fff640 10 client.17043 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f4647fff640 1 -- 172.21.15.76:0/4217832560 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55faffc61860 con 0x55faffd08fa0 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f4647fff640 10 client.17043 handle_command_reply: tid=0 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 client.17043 shutdown 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 msgr2=0x55faffcf6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf6810 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f466002ae70 tx=0x7f466002f9f0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 shutdown_connections 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd08fa0 0x55faffd0b400 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf6810 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f4647fff640 0 client.17043 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:07.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 --2- 172.21.15.76:0/4217832560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 >> 172.21.15.76:0/4217832560 conn(0x55faffcb7310 msgr2=0x55faffcf0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:07.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 shutdown_connections 2024-09-19T07:58:07.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 1 -- 172.21.15.76:0/4217832560 wait complete. 2024-09-19T07:58:07.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.450+0000 7f46715df740 20 client.17043 trim_cache size 0 max 16384 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.463+0000 7f46715df740 1 Processor -- start 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.463+0000 7f46715df740 1 -- start start 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46715df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46715df740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46715df740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46715df740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f46681b0420 con 0x55faffcf9370 2024-09-19T07:58:07.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46715df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46681adcf0 con 0x55faffcee5d0 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46715df740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46681abb40 con 0x55faffcefb40 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51002/0 (socket says 172.21.15.76:51002) 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 -- 172.21.15.76:0/2521713947 learned_addr learned my addr 172.21.15.76:0/2521713947 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f4667fff640 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466cfa2640 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 -- 172.21.15.76:0/2521713947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 msgr2=0x55faffcf7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 -- 172.21.15.76:0/2521713947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 msgr2=0x55faffcf5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 -- 172.21.15.76:0/2521713947 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faffd0ba80 con 0x55faffcf9370 2024-09-19T07:58:07.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f4667fff640 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:07.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f466d7a3640 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf1180 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f4660051040 tx=0x7f46600093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a6a349dbbbd45e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:07.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.464+0000 7f46527fc640 1 -- 172.21.15.76:0/2521713947 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466004c040 con 0x55faffcf9370 2024-09-19T07:58:07.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46527fc640 1 -- 172.21.15.76:0/2521713947 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f466002feb0 con 0x55faffcf9370 2024-09-19T07:58:07.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46527fc640 1 -- 172.21.15.76:0/2521713947 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660003fb0 con 0x55faffcf9370 2024-09-19T07:58:07.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 -- 172.21.15.76:0/2521713947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 msgr2=0x55faffcf1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf1180 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f4660051040 tx=0x7f46600093e0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 -- 172.21.15.76:0/2521713947 shutdown_connections 2024-09-19T07:58:07.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcf9370 0x55faffcf1180 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcefb40 0x55faffcf7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 --2- 172.21.15.76:0/2521713947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcee5d0 0x55faffcf5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 -- 172.21.15.76:0/2521713947 >> 172.21.15.76:0/2521713947 conn(0x55faffcb7310 msgr2=0x55faffcf78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 -- 172.21.15.76:0/2521713947 shutdown_connections 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.465+0000 7f46715df740 1 -- 172.21.15.76:0/2521713947 wait complete. 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 -- start start 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 Processor -- start 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcee5d0 0x55faffd01d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 0x55faffcfd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f46681ac1b0 con 0x55faffcefb40 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46681ad620 con 0x55faffcf9370 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46681ac880 con 0x55faffcee5d0 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f46715df740 10 client.0 _ll_register_callbacks cb 0x7f4660031d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f4667fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 0x55faffcfd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.466+0000 7f4667fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 0x55faffcfd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51018/0 (socket says 172.21.15.76:51018) 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 -- 172.21.15.76:0/4022262665 learned_addr learned my addr 172.21.15.76:0/4022262665 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f466d7a3640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcee5d0 0x55faffd01d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 -- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcee5d0 msgr2=0x55faffd01d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcee5d0 0x55faffd01d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 -- 172.21.15.76:0/4022262665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 msgr2=0x55faffcfd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 -- 172.21.15.76:0/4022262665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faffd72ca0 con 0x55faffcefb40 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4667fff640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 0x55faffcfd080 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x55faffcf76c0 tx=0x7f46540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678f4efc44da405 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4647fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4647fff640 1 -- 172.21.15.76:0/4022262665 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654004220 con 0x55faffcefb40 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4647fff640 1 -- 172.21.15.76:0/4022262665 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7f46540043c0 con 0x55faffcefb40 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55faffc5bd70 con 0x55faffcefb40 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f4647fff640 1 -- 172.21.15.76:0/4022262665 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f465401e920 con 0x55faffcefb40 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f46715df740 10 client.17049 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:07.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.467+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55faffd73ec0 con 0x55faffcefb40 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f4647fff640 1 -- 172.21.15.76:0/4022262665 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55faffc5bd70 con 0x55faffcefb40 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f4647fff640 1 -- 172.21.15.76:0/4022262665 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f465401f440 con 0x55faffcefb40 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f46715df740 10 client.17049 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f46715df740 10 client.17049 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f46715df740 20 client.17049 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f46715df740 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd74670 0x55faffd76a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f46715df740 4 client.17049 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55faffbd8170 con 0x55faffd74670 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd74670 0x55faffd76a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f4647fff640 10 client.17049 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.468+0000 7f466cfa2640 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd74670 0x55faffd76a90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc20db0951988f1f server_cookie=c38c6d4f628a5ee8 in_seq=0 out_seq=0 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f4647fff640 1 -- 172.21.15.76:0/4022262665 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55faffbd8170 con 0x55faffd74670 2024-09-19T07:58:07.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f4647fff640 10 client.17049 handle_command_reply: tid=0 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 client.17049 shutdown 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 msgr2=0x55faffcfd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 0x55faffcfd080 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x55faffcf76c0 tx=0x7f46540046c0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 shutdown_connections 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55faffd74670 0x55faffd76a90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55faffcf9370 0x55faffcfd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55faffcefb40 0x55faffcfd080 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 --2- 172.21.15.76:0/4022262665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55faffcee5d0 0x55faffd01d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f4647fff640 0 client.17049 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 >> 172.21.15.76:0/4022262665 conn(0x55faffcb7310 msgr2=0x55faffcf8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:07.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 shutdown_connections 2024-09-19T07:58:07.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 1 -- 172.21.15.76:0/4022262665 wait complete. 2024-09-19T07:58:07.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f46715df740 20 client.17049 trim_cache size 0 max 16384 2024-09-19T07:58:07.484 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.469+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46580a33b0 msgr2=0x7f46580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46580a33b0 0x7f46580a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f466806aac0 tx=0x7f465400a5c0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 msgr2=0x7f4668199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 0x7f4668199420 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f465c00b4a0 tx=0x7f465c00b960 comp rx=0 tx=0).stop 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 shutdown_connections 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46580a33b0 0x7f46580a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4668102ef0 0x7f46681a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4668102570 0x7f4668199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 --2- 172.21.15.76:0/3226186139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4668100e20 0x7f4668199420 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 >> 172.21.15.76:0/3226186139 conn(0x7f46680fc7d0 msgr2=0x7f46680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 shutdown_connections 2024-09-19T07:58:07.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:07.470+0000 7f466f206640 1 -- 172.21.15.76:0/3226186139 wait complete. 2024-09-19T07:58:08.153 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:58:08.399 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:08.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:08 smithi137 ceph-mon[35309]: pgmap v212: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T07:58:08.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:08 smithi076 ceph-mon[30930]: pgmap v212: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T07:58:08.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:08 smithi152 ceph-mon[35117]: pgmap v212: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 -- 172.21.15.76:0/4150516939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe568102d30 msgr2=0x7fe568103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- 172.21.15.76:0/4150516939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe568102d30 0x7fe568103110 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe558009930 tx=0x7fe55802a460 comp rx=0 tx=0).stop 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 -- 172.21.15.76:0/4150516939 shutdown_connections 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- 172.21.15.76:0/4150516939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5681082a0 0x7fe56810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- 172.21.15.76:0/4150516939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5681036e0 0x7fe568107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- 172.21.15.76:0/4150516939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe568102d30 0x7fe568103110 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 -- 172.21.15.76:0/4150516939 >> 172.21.15.76:0/4150516939 conn(0x7fe5680fc7d0 msgr2=0x7fe5680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 -- 172.21.15.76:0/4150516939 shutdown_connections 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 -- 172.21.15.76:0/4150516939 wait complete. 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 Processor -- start 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 -- start start 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.894+0000 7fe56e493640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56e493640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681122a0 con 0x7fe5681082a0 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56e493640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe568112120 con 0x7fe5681036e0 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56e493640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe568112420 con 0x7fe568102d30 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51038/0 (socket says 172.21.15.76:51038) 2024-09-19T07:58:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 -- 172.21.15.76:0/3559195442 learned_addr learned my addr 172.21.15.76:0/3559195442 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe567fff640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe55ffff640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 -- 172.21.15.76:0/3559195442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe568102d30 msgr2=0x7fe568100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 -- 172.21.15.76:0/3559195442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5681036e0 msgr2=0x7fe568100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 -- 172.21.15.76:0/3559195442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5681a6cc0 con 0x7fe5681082a0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56ca30640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 0x7fe568101410 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe56000b970 tx=0x7fe56000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe565ffb640 1 -- 172.21.15.76:0/3559195442 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560019070 con 0x7fe5681082a0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe565ffb640 1 -- 172.21.15.76:0/3559195442 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe56000cb40 con 0x7fe5681082a0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe565ffb640 1 -- 172.21.15.76:0/3559195442 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560007700 con 0x7fe5681082a0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5681a6fb0 con 0x7fe5681082a0 2024-09-19T07:58:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.895+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5681a7460 con 0x7fe5681082a0 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 Processor -- start 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe565ffb640 1 -- 172.21.15.76:0/3559195442 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe56001c070 con 0x7fe5681082a0 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 -- start start 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d1b40 0x563f552d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d05d0 0x563f552d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563f552362f0 con 0x563f552db370 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f551ddcf0 con 0x563f552d1b40 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe57086c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f552322b0 con 0x563f552d05d0 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe55ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe55ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51042/0 (socket says 172.21.15.76:51042) 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe55ffff640 1 -- 172.21.15.76:0/2811021593 learned_addr learned my addr 172.21.15.76:0/2811021593 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe567fff640 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d05d0 0x563f552d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.898+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d1b40 0x563f552d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55ffff640 1 -- 172.21.15.76:0/2811021593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d05d0 msgr2=0x563f552d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d05d0 0x563f552d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55ffff640 1 -- 172.21.15.76:0/2811021593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d1b40 msgr2=0x563f552d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d1b40 0x563f552d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55ffff640 1 -- 172.21.15.76:0/2811021593 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f551c23a0 con 0x563f552db370 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe565ffb640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe5540a33b0 0x7fe5540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552dd760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe55000afb0 tx=0x7fe55000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61e0b28e468b162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe567fff640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe5540a33b0 0x7fe5540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55e7fc640 1 -- 172.21.15.76:0/2811021593 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550016e50 con 0x563f552db370 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe565ffb640 1 -- 172.21.15.76:0/3559195442 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe5600cf120 con 0x7fe5681082a0 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55e7fc640 1 -- 172.21.15.76:0/2811021593 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe550018930 con 0x563f552db370 2024-09-19T07:58:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.899+0000 7fe55e7fc640 1 -- 172.21.15.76:0/2811021593 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500178b0 con 0x563f552db370 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 -- 172.21.15.76:0/2811021593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 msgr2=0x563f552dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552dd760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe55000afb0 tx=0x7fe55000a250 comp rx=0 tx=0).stop 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe567fff640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe5540a33b0 0x7fe5540a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe558009900 tx=0x7fe5580058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 -- 172.21.15.76:0/2811021593 shutdown_connections 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552dd760 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d05d0 0x563f552d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 --2- 172.21.15.76:0/2811021593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d1b40 0x563f552d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 -- 172.21.15.76:0/2811021593 >> 172.21.15.76:0/2811021593 conn(0x563f55299310 msgr2=0x563f552ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 -- 172.21.15.76:0/2811021593 shutdown_connections 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 -- 172.21.15.76:0/2811021593 wait complete. 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 -- start start 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.900+0000 7fe57086c740 1 Processor -- start 2024-09-19T07:58:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x563f552de010 con 0x563f552d05d0 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563f551f1060 con 0x563f552db370 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563f552de190 con 0x563f552d1b40 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 10 client.0 _ll_register_callbacks cb 0x563f54f448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552dad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51044/0 (socket says 172.21.15.76:51044) 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 -- 172.21.15.76:0/2500319544 learned_addr learned my addr 172.21.15.76:0/2500319544 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe56ca30640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 -- 172.21.15.76:0/2500319544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 msgr2=0x563f552d7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 -- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 msgr2=0x563f552d85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 -- 172.21.15.76:0/2500319544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f54fa73c0 con 0x563f552d05d0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe567fff640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552dad40 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe5580096c0 tx=0x7fe558009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc71c6f171b488eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe5477fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe5477fe640 1 -- 172.21.15.76:0/2500319544 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55804e070 con 0x563f552d05d0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe5477fe640 1 -- 172.21.15.76:0/2500319544 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe55804a450 con 0x563f552d05d0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe550018930 con 0x563f552d05d0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.901+0000 7fe5477fe640 1 -- 172.21.15.76:0/2500319544 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe55805a050 con 0x563f552d05d0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 10 client.17061 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563f552e9a80 con 0x563f552d05d0 2024-09-19T07:58:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe5477fe640 1 -- 172.21.15.76:0/2500319544 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe550018930 con 0x563f552d05d0 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe5477fe640 1 -- 172.21.15.76:0/2500319544 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe55803d750 con 0x563f552d05d0 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 10 client.17061 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 10 client.17061 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 20 client.17061 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f552eae90 0x563f552ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 4 client.17061 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f55243860 con 0x563f552eae90 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.902+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f552eae90 0x563f552ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe5477fe640 10 client.17061 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe55ffff640 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f552eae90 0x563f552ed2e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da74cd16eab97e38 server_cookie=44a9a33ca7927204 in_seq=0 out_seq=0 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe5477fe640 1 -- 172.21.15.76:0/2500319544 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f55243860 con 0x563f552eae90 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe5477fe640 10 client.17061 handle_command_reply: tid=0 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe57086c740 1 client.17061 shutdown 2024-09-19T07:58:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 msgr2=0x563f552dad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe57086c740 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552dad40 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe5580096c0 tx=0x7fe558009260 comp rx=0 tx=0).stop 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 shutdown_connections 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.903+0000 7fe57086c740 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f552eae90 0x563f552ed2e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe5477fe640 0 client.17061 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 1 --2- 172.21.15.76:0/2500319544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552dad40 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 >> 172.21.15.76:0/2500319544 conn(0x563f55299310 msgr2=0x563f552d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 shutdown_connections 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 1 -- 172.21.15.76:0/2500319544 wait complete. 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.904+0000 7fe57086c740 20 client.17061 trim_cache size 0 max 16384 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.916+0000 7fe57086c740 1 Processor -- start 2024-09-19T07:58:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.916+0000 7fe57086c740 1 -- start start 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.916+0000 7fe57086c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552d9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.916+0000 7fe57086c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.916+0000 7fe57086c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe57086c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681b2690 con 0x563f552d05d0 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe57086c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681aff60 con 0x563f552db370 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe57086c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681addb0 con 0x563f552d1b40 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552d9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552d9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51058/0 (socket says 172.21.15.76:51058) 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 -- 172.21.15.76:0/1991065788 learned_addr learned my addr 172.21.15.76:0/1991065788 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe55ffff640 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 -- 172.21.15.76:0/1991065788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 msgr2=0x563f552d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 -- 172.21.15.76:0/1991065788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 msgr2=0x563f552d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 -- 172.21.15.76:0/1991065788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f552db0b0 con 0x563f552d05d0 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe55ffff640 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe567fff640 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552d9f60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe558000c00 tx=0x7fe558003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5d0b386fa3d8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe55dffb640 1 -- 172.21.15.76:0/1991065788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55804e040 con 0x563f552d05d0 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe55dffb640 1 -- 172.21.15.76:0/1991065788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe558063070 con 0x563f552d05d0 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.917+0000 7fe55dffb640 1 -- 172.21.15.76:0/1991065788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558035040 con 0x563f552d05d0 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 -- 172.21.15.76:0/1991065788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 msgr2=0x563f552d9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552d9f60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe558000c00 tx=0x7fe558003a00 comp rx=0 tx=0).stop 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 -- 172.21.15.76:0/1991065788 shutdown_connections 2024-09-19T07:58:08.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552db370 0x563f552d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 --2- 172.21.15.76:0/1991065788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552d05d0 0x563f552d9f60 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 -- 172.21.15.76:0/1991065788 >> 172.21.15.76:0/1991065788 conn(0x563f55299310 msgr2=0x563f552d9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 -- 172.21.15.76:0/1991065788 shutdown_connections 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 -- 172.21.15.76:0/1991065788 wait complete. 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 -- start start 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.918+0000 7fe57086c740 1 Processor -- start 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d05d0 0x563f552e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681ae420 con 0x563f552db370 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681af890 con 0x563f552d05d0 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681aeaf0 con 0x563f552d1b40 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 10 client.0 _ll_register_callbacks cb 0x7fe558009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552d51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51072/0 (socket says 172.21.15.76:51072) 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 -- 172.21.15.76:0/4121381665 learned_addr learned my addr 172.21.15.76:0/4121381665 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe55ffff640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe567fff640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d05d0 0x563f552e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 -- 172.21.15.76:0/4121381665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 msgr2=0x563f552d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 -- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d05d0 msgr2=0x563f552e3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d05d0 0x563f552e3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 -- 172.21.15.76:0/4121381665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f552d8950 con 0x563f552db370 2024-09-19T07:58:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe567fff640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d05d0 0x563f552e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe56ca30640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552d51a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe56009b590 tx=0x7fe56009b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c518b5f0a1b366 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe5477fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe5477fe640 1 -- 172.21.15.76:0/4121381665 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5600b3070 con 0x563f552db370 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe5477fe640 1 -- 172.21.15.76:0/4121381665 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8614+0+0 (secure 0 0 0) 0x7fe560097c70 con 0x563f552db370 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.919+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe558063070 con 0x563f552db370 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe5477fe640 1 -- 172.21.15.76:0/4121381665 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe560097040 con 0x563f552db370 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 10 client.17067 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563f553558c0 con 0x563f552db370 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe5477fe640 1 -- 172.21.15.76:0/4121381665 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe558063070 con 0x563f552db370 2024-09-19T07:58:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe5477fe640 1 -- 172.21.15.76:0/4121381665 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe5600b42f0 con 0x563f552db370 2024-09-19T07:58:08.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 10 client.17067 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:08.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 10 client.17067 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:08.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 20 client.17067 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:08.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f55355fe0 0x563f553583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:08.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 4 client.17067 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:08.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f5523dd70 con 0x563f55355fe0 2024-09-19T07:58:08.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.920+0000 7fe567fff640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f55355fe0 0x563f553583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:08.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe567fff640 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f55355fe0 0x563f553583d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5609171485718846 server_cookie=df61dd50268da065 in_seq=0 out_seq=0 2024-09-19T07:58:08.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe5477fe640 10 client.17067 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:08.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe5477fe640 1 -- 172.21.15.76:0/4121381665 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f5523dd70 con 0x563f55355fe0 2024-09-19T07:58:08.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe5477fe640 10 client.17067 handle_command_reply: tid=0 2024-09-19T07:58:08.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 client.17067 shutdown 2024-09-19T07:58:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 msgr2=0x563f552d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552d51a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe56009b590 tx=0x7fe56009b020 comp rx=0 tx=0).stop 2024-09-19T07:58:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 shutdown_connections 2024-09-19T07:58:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x563f55355fe0 0x563f553583d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563f552db370 0x563f552d51a0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f552d1b40 0x563f552d4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe5477fe640 0 client.17067 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 --2- 172.21.15.76:0/4121381665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563f552d05d0 0x563f552e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 >> 172.21.15.76:0/4121381665 conn(0x563f55299310 msgr2=0x563f552da070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 shutdown_connections 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 1 -- 172.21.15.76:0/4121381665 wait complete. 2024-09-19T07:58:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.921+0000 7fe57086c740 20 client.17067 trim_cache size 0 max 16384 2024-09-19T07:58:08.946 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe5540a33b0 msgr2=0x7fe5540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe5540a33b0 0x7fe5540a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe558009900 tx=0x7fe5580058d0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 msgr2=0x7fe568101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 0x7fe568101410 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe56000b970 tx=0x7fe56000be30 comp rx=0 tx=0).stop 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 shutdown_connections 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe5540a33b0 0x7fe5540a5870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 --2- 172.21.15.76:0/3559195442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 >> 172.21.15.76:0/3559195442 conn(0x7fe5680fc7d0 msgr2=0x7fe568105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 shutdown_connections 2024-09-19T07:58:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:08.922+0000 7fe56e493640 1 -- 172.21.15.76:0/3559195442 wait complete. 2024-09-19T07:58:09.639 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:58:09.886 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:10.282 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:10 smithi076 ceph-mon[30930]: pgmap v213: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:58:10.283 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:10 smithi076 ceph-mon[30930]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:58:10.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 -- 172.21.15.76:0/476146902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640101de0 msgr2=0x7fa6401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 --2- 172.21.15.76:0/476146902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640101de0 0x7fa6401021c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa630009900 tx=0x7fa63002a410 comp rx=0 tx=0).stop 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 -- 172.21.15.76:0/476146902 shutdown_connections 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 --2- 172.21.15.76:0/476146902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 0x7fa64010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 --2- 172.21.15.76:0/476146902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640102790 0x7fa6401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 --2- 172.21.15.76:0/476146902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640101de0 0x7fa6401021c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 -- 172.21.15.76:0/476146902 >> 172.21.15.76:0/476146902 conn(0x7fa6400fd8c0 msgr2=0x7fa6400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 -- 172.21.15.76:0/476146902 shutdown_connections 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 -- 172.21.15.76:0/476146902 wait complete. 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.364+0000 7fa646879640 1 Processor -- start 2024-09-19T07:58:10.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 -- start start 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640101de0 0x7fa640198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 0x7fa640198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 0x7fa64019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401120f0 con 0x7fa640102790 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa640111f70 con 0x7fa640101de0 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa646879640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa640112270 con 0x7fa640106f10 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 0x7fa640198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 0x7fa640198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51090/0 (socket says 172.21.15.76:51090) 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 -- 172.21.15.76:0/3215704326 learned_addr learned my addr 172.21.15.76:0/3215704326 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63ffff640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640101de0 0x7fa640198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa644e16640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 0x7fa64019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 -- 172.21.15.76:0/3215704326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 msgr2=0x7fa64019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 0x7fa64019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 -- 172.21.15.76:0/3215704326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640101de0 msgr2=0x7fa640198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640101de0 0x7fa640198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63f7fe640 1 -- 172.21.15.76:0/3215704326 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64019d5c0 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa644e16640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 0x7fa64019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.365+0000 7fa63ffff640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640101de0 0x7fa640198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.366+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 0x7fa640198b50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b4a0 tx=0x7fa63400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.366+0000 7fa63d7fa640 1 -- 172.21.15.76:0/3215704326 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634014070 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.366+0000 7fa63d7fa640 1 -- 172.21.15.76:0/3215704326 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa634010b10 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.366+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa64019d8b0 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.366+0000 7fa63d7fa640 1 -- 172.21.15.76:0/3215704326 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634017d60 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.366+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6401a5190 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.368+0000 7fa63d7fa640 1 -- 172.21.15.76:0/3215704326 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa634017070 con 0x7fa640102790 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.368+0000 7fa648c52740 1 Processor -- start 2024-09-19T07:58:10.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 -- start start 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae65b40 0x559bcae64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae645d0 0x559bcae64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 0x559bcae71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559bcadca2f0 con 0x559bcae6f370 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559bcad71cf0 con 0x559bcae65b40 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa648c52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559bcadc62b0 con 0x559bcae645d0 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 0x559bcae71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 0x559bcae71760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51106/0 (socket says 172.21.15.76:51106) 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2737753780 learned_addr learned my addr 172.21.15.76:0/2737753780 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63d7fa640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6280a3430 0x7fa6280a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa644e16640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae65b40 0x559bcae64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63ffff640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae645d0 0x559bcae64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa644e16640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6280a3430 0x7fa6280a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63d7fa640 1 -- 172.21.15.76:0/3215704326 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7fa6340cf070 con 0x7fa640102790 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.369+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2737753780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae645d0 msgr2=0x559bcae64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae645d0 0x559bcae64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2737753780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae65b40 msgr2=0x559bcae64090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae65b40 0x559bcae64090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2737753780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bcad563a0 con 0x559bcae6f370 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa644e16640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae65b40 0x559bcae64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa63ffff640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae645d0 0x559bcae64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 0x559bcae71760 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa634097d80 tx=0x7fa63400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de73d48f134454a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa644e16640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6280a3430 0x7fa6280a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa638013d50 tx=0x7fa63800a370 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:10.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa6267fc640 1 -- 172.21.15.76:0/2737753780 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6340cce60 con 0x559bcae6f370 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa6267fc640 1 -- 172.21.15.76:0/2737753780 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa63409b3b0 con 0x559bcae6f370 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.370+0000 7fa6267fc640 1 -- 172.21.15.76:0/2737753780 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63401e030 con 0x559bcae6f370 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 -- 172.21.15.76:0/2737753780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 msgr2=0x559bcae71760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 0x559bcae71760 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa634097d80 tx=0x7fa63400bf90 comp rx=0 tx=0).stop 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 -- 172.21.15.76:0/2737753780 shutdown_connections 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae6f370 0x559bcae71760 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae645d0 0x559bcae64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 --2- 172.21.15.76:0/2737753780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae65b40 0x559bcae64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 -- 172.21.15.76:0/2737753780 >> 172.21.15.76:0/2737753780 conn(0x559bcae2d310 msgr2=0x559bcae60c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 -- 172.21.15.76:0/2737753780 shutdown_connections 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 -- 172.21.15.76:0/2737753780 wait complete. 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 -- start start 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.371+0000 7fa648c52740 1 Processor -- start 2024-09-19T07:58:10.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcae6ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcae6c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcae6c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559bcae72010 con 0x559bcae65b40 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559bcad85060 con 0x559bcae645d0 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559bcae72190 con 0x559bcae6f370 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 10 client.0 _ll_register_callbacks cb 0x559bcaad88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcae6c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcae6c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51114/0 (socket says 172.21.15.76:51114) 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 -- 172.21.15.76:0/964425477 learned_addr learned my addr 172.21.15.76:0/964425477 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63ffff640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcae6ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 -- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 msgr2=0x559bcae6c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcae6c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 -- 172.21.15.76:0/964425477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 msgr2=0x559bcae6ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcae6ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 -- 172.21.15.76:0/964425477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bcab3b3c0 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63ffff640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcae6ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcae6c020 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa63409b340 tx=0x7fa6340047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b4c926dd33816e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa61f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa61f7fe640 1 -- 172.21.15.76:0/964425477 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6340cce60 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa61f7fe640 1 -- 172.21.15.76:0/964425477 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7fa6340cc900 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.372+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa63409b3b0 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa61f7fe640 1 -- 172.21.15.76:0/964425477 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa63401e070 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 10 client.17079 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559bcae7dab0 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa61f7fe640 1 -- 172.21.15.76:0/964425477 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa63409b3b0 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa61f7fe640 1 -- 172.21.15.76:0/964425477 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa6340972c0 con 0x559bcae65b40 2024-09-19T07:58:10.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 10 client.17079 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 20 client.17079 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcae7ee00 0x559bcae811f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 4 client.17079 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bcadd7860 con 0x559bcae7ee00 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.373+0000 7fa63ffff640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcae7ee00 0x559bcae811f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.374+0000 7fa61f7fe640 10 client.17079 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.374+0000 7fa63ffff640 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcae7ee00 0x559bcae811f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb5ceec1970dcbfe server_cookie=9e462bf7a8cb0b95 in_seq=0 out_seq=0 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.374+0000 7fa61f7fe640 1 -- 172.21.15.76:0/964425477 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bcadd7860 con 0x559bcae7ee00 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.374+0000 7fa61f7fe640 10 client.17079 handle_command_reply: tid=0 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.374+0000 7fa648c52740 1 client.17079 shutdown 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 msgr2=0x559bcae6c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcae6c020 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa63409b340 tx=0x7fa6340047d0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 shutdown_connections 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcae6c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcae7ee00 0x559bcae811f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcae6c020 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 --2- 172.21.15.76:0/964425477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcae6ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 >> 172.21.15.76:0/964425477 conn(0x559bcae2d310 msgr2=0x559bcae66960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa61f7fe640 0 client.17079 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 shutdown_connections 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 1 -- 172.21.15.76:0/964425477 wait complete. 2024-09-19T07:58:10.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.375+0000 7fa648c52740 20 client.17079 trim_cache size 0 max 16384 2024-09-19T07:58:10.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 Processor -- start 2024-09-19T07:58:10.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 -- start start 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 0x559bcae6af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae65b40 0x559bcae6df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae6f370 0x559bcae84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401b05b0 con 0x559bcae645d0 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401ade80 con 0x559bcae6f370 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa648c52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401abcf0 con 0x559bcae65b40 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 0x559bcae6af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 0x559bcae6af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51122/0 (socket says 172.21.15.76:51122) 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 -- 172.21.15.76:0/4230596621 learned_addr learned my addr 172.21.15.76:0/4230596621 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae65b40 0x559bcae6df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 -- 172.21.15.76:0/4230596621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae65b40 msgr2=0x559bcae6df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa644e16640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae6f370 0x559bcae84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae65b40 0x559bcae6df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 -- 172.21.15.76:0/4230596621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae6f370 msgr2=0x559bcae84220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae6f370 0x559bcae84220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 -- 172.21.15.76:0/4230596621 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bcae6f0a0 con 0x559bcae645d0 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae65b40 0x559bcae6df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa644e16640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae6f370 0x559bcae84220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.388+0000 7fa63ffff640 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 0x559bcae6af80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa63002a930 tx=0x7fa630005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1422f05833171964 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa625ffb640 1 -- 172.21.15.76:0/4230596621 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630048070 con 0x559bcae645d0 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa625ffb640 1 -- 172.21.15.76:0/4230596621 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa630005520 con 0x559bcae645d0 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa625ffb640 1 -- 172.21.15.76:0/4230596621 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630035040 con 0x559bcae645d0 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 -- 172.21.15.76:0/4230596621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 msgr2=0x559bcae6af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 0x559bcae6af80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa63002a930 tx=0x7fa630005a70 comp rx=0 tx=0).stop 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 -- 172.21.15.76:0/4230596621 shutdown_connections 2024-09-19T07:58:10.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae6f370 0x559bcae84220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae65b40 0x559bcae6df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 --2- 172.21.15.76:0/4230596621 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae645d0 0x559bcae6af80 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 -- 172.21.15.76:0/4230596621 >> 172.21.15.76:0/4230596621 conn(0x559bcae2d310 msgr2=0x559bcae6d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:10.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 -- 172.21.15.76:0/4230596621 shutdown_connections 2024-09-19T07:58:10.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.389+0000 7fa648c52740 1 -- 172.21.15.76:0/4230596621 wait complete. 2024-09-19T07:58:10.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 -- start start 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 Processor -- start 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcaee16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcaee1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcaeec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401ac340 con 0x559bcae65b40 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401ad7b0 con 0x559bcae645d0 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401aca10 con 0x559bcae6f370 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa648c52740 10 client.0 _ll_register_callbacks cb 0x7fa63800adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:10.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcaee1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcaee1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51128/0 (socket says 172.21.15.76:51128) 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2812021101 learned_addr learned my addr 172.21.15.76:0/2812021101 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa63ffff640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcaee16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.390+0000 7fa644e16640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcaeec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 msgr2=0x559bcaeec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcaeec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2812021101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 msgr2=0x559bcaee16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcaee16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63f7fe640 1 -- 172.21.15.76:0/2812021101 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bcaee2500 con 0x559bcae65b40 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa644e16640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcaeec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63ffff640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcaee16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:10.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa63f7fe640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcaee1c30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa63409b0b0 tx=0x7fa63400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c205f69d25a568 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa61f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa61f7fe640 1 -- 172.21.15.76:0/2812021101 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6340b3060 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa61f7fe640 1 -- 172.21.15.76:0/2812021101 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7fa6340a0c10 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa630005520 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa61f7fe640 1 -- 172.21.15.76:0/2812021101 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa6340cce60 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 10 client.17085 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559bcaeedd20 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa61f7fe640 1 -- 172.21.15.76:0/2812021101 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa630005520 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa61f7fe640 1 -- 172.21.15.76:0/2812021101 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa63409a800 con 0x559bcae65b40 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 10 client.17085 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 20 client.17085 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:10.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcaeee1f0 0x559bcaef05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 4 client.17085 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.391+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bcadd1d70 con 0x559bcaeee1f0 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.392+0000 7fa63ffff640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcaeee1f0 0x559bcaef05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.392+0000 7fa63ffff640 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcaeee1f0 0x559bcaef05e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89efa0d3fe935250 server_cookie=96895f564f813876 in_seq=0 out_seq=0 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.392+0000 7fa61f7fe640 10 client.17085 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.392+0000 7fa61f7fe640 1 -- 172.21.15.76:0/2812021101 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bcadd1d70 con 0x559bcaeee1f0 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.392+0000 7fa61f7fe640 10 client.17085 handle_command_reply: tid=0 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.392+0000 7fa648c52740 1 client.17085 shutdown 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 msgr2=0x559bcaee1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcaee1c30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa63409b0b0 tx=0x7fa63400bf90 comp rx=0 tx=0).stop 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 shutdown_connections 2024-09-19T07:58:10.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559bcae6f370 0x559bcaeec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x559bcaeee1f0 0x559bcaef05e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559bcae65b40 0x559bcaee1c30 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 --2- 172.21.15.76:0/2812021101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559bcae645d0 0x559bcaee16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 >> 172.21.15.76:0/2812021101 conn(0x559bcae2d310 msgr2=0x559bcae6e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa61f7fe640 0 client.17085 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 shutdown_connections 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 1 -- 172.21.15.76:0/2812021101 wait complete. 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa648c52740 20 client.17085 trim_cache size 0 max 16384 2024-09-19T07:58:10.399 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6280a3430 msgr2=0x7fa6280a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6280a3430 0x7fa6280a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa638013d50 tx=0x7fa63800a370 comp rx=0 tx=0).stop 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 msgr2=0x7fa640198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 0x7fa640198b50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b4a0 tx=0x7fa63400b960 comp rx=0 tx=0).stop 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 shutdown_connections 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6280a3430 0x7fa6280a58f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa640106f10 0x7fa64019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa640102790 0x7fa640198b50 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 --2- 172.21.15.76:0/3215704326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa640101de0 0x7fa640198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 >> 172.21.15.76:0/3215704326 conn(0x7fa6400fd8c0 msgr2=0x7fa6400feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.393+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 shutdown_connections 2024-09-19T07:58:10.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:10.394+0000 7fa646879640 1 -- 172.21.15.76:0/3215704326 wait complete. 2024-09-19T07:58:10.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:10 smithi137 ceph-mon[35309]: pgmap v213: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:58:10.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:10 smithi137 ceph-mon[35309]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:58:10.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:10 smithi152 ceph-mon[35117]: pgmap v213: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:58:10.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:10 smithi152 ceph-mon[35117]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:58:12.136 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:58:12.137 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:58:12.394 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:12 smithi076 ceph-mon[30930]: pgmap v215: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:58:12.401 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:12.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:12 smithi137 ceph-mon[35309]: pgmap v215: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:58:12.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:12 smithi152 ceph-mon[35117]: pgmap v215: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:58:12.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 -- 172.21.15.76:0/2933460071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac102d40 msgr2=0x7f15ac103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 --2- 172.21.15.76:0/2933460071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac102d40 0x7f15ac103120 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f159c009900 tx=0x7f159c02a480 comp rx=0 tx=0).stop 2024-09-19T07:58:12.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 -- 172.21.15.76:0/2933460071 shutdown_connections 2024-09-19T07:58:12.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 --2- 172.21.15.76:0/2933460071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15ac10c170 0x7f15ac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 --2- 172.21.15.76:0/2933460071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac103660 0x7f15ac10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 --2- 172.21.15.76:0/2933460071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac102d40 0x7f15ac103120 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 -- 172.21.15.76:0/2933460071 >> 172.21.15.76:0/2933460071 conn(0x7f15ac0fc7a0 msgr2=0x7f15ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 -- 172.21.15.76:0/2933460071 shutdown_connections 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.912+0000 7f15b0b03640 1 -- 172.21.15.76:0/2933460071 wait complete. 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 Processor -- start 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 -- start start 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15ac102d40 0x7f15ac1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 0x7f15ac198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac10c170 0x7f15ac19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1120f0 con 0x7f15ac103660 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac111f70 con 0x7f15ac102d40 2024-09-19T07:58:12.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.913+0000 7f15b0b03640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac112270 con 0x7f15ac10c170 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 0x7f15ac198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 0x7f15ac198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51158/0 (socket says 172.21.15.76:51158) 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 -- 172.21.15.76:0/1632388688 learned_addr learned my addr 172.21.15.76:0/1632388688 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15aa59c640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15ac102d40 0x7f15ac1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac10c170 0x7f15ac19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 -- 172.21.15.76:0/1632388688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac10c170 msgr2=0x7f15ac19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac10c170 0x7f15ac19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 -- 172.21.15.76:0/1632388688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15ac102d40 msgr2=0x7f15ac1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15ac102d40 0x7f15ac1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 -- 172.21.15.76:0/1632388688 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac19d480 con 0x7f15ac103660 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac10c170 0x7f15ac19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 0x7f15ac198a10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c970 tx=0x7f15a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f159b7fe640 1 -- 172.21.15.76:0/1632388688 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0007bb0 con 0x7f15ac103660 2024-09-19T07:58:12.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac19d770 con 0x7f15ac103660 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f159b7fe640 1 -- 172.21.15.76:0/1632388688 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a0007d50 con 0x7f15ac103660 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f159b7fe640 1 -- 172.21.15.76:0/1632388688 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a00188d0 con 0x7f15ac103660 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.914+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac1a5050 con 0x7f15ac103660 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f159b7fe640 1 -- 172.21.15.76:0/1632388688 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f15a0018a70 con 0x7f15ac103660 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 Processor -- start 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 -- start start 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665eb60 0x56229665ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x562296669800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x56229666c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5622965c4280 con 0x562296669d40 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56229656bb10 con 0x56229665f480 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.917+0000 7f15b2edc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5622965c0240 con 0x56229665eb60 2024-09-19T07:58:12.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f159b7fe640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f15940a33b0 0x7f15940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x56229666c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x56229666c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51172/0 (socket says 172.21.15.76:51172) 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x562296669800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 -- 172.21.15.76:0/2714337963 learned_addr learned my addr 172.21.15.76:0/2714337963 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15aad9d640 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665eb60 0x56229665ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f15940a33b0 0x7f15940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f159b7fe640 1 -- 172.21.15.76:0/1632388688 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7f15a00cfe80 con 0x7f15ac103660 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 -- 172.21.15.76:0/2714337963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665eb60 msgr2=0x56229665ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665eb60 0x56229665ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 -- 172.21.15.76:0/2714337963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 msgr2=0x562296669800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x562296669800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 -- 172.21.15.76:0/2714337963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622965781f0 con 0x562296669d40 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15aad9d640 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665eb60 0x56229665ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x56229666c130 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f15a00cd980 tx=0x7f15a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27e40bed3a5d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.918+0000 7f1598ff9640 1 -- 172.21.15.76:0/2714337963 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a00a0460 con 0x562296669d40 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.919+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f15940a33b0 0x7f15940a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f15a400e6b0 tx=0x7f15a4008220 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.919+0000 7f1598ff9640 1 -- 172.21.15.76:0/2714337963 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a00a4d20 con 0x562296669d40 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.919+0000 7f1598ff9640 1 -- 172.21.15.76:0/2714337963 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0098720 con 0x562296669d40 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 -- 172.21.15.76:0/2714337963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 msgr2=0x56229666c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x56229666c130 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f15a00cd980 tx=0x7f15a0000bc0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 -- 172.21.15.76:0/2714337963 shutdown_connections 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x56229666c130 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x562296669800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2714337963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665eb60 0x56229665ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 -- 172.21.15.76:0/2714337963 >> 172.21.15.76:0/2714337963 conn(0x56229665b0f0 msgr2=0x56229665b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 -- 172.21.15.76:0/2714337963 shutdown_connections 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 -- 172.21.15.76:0/2714337963 wait complete. 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 -- start start 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.920+0000 7f15b2edc740 1 Processor -- start 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x5622966671c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562296669d40 0x562296667700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56229666c8b0 con 0x56229665eb60 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56229657ef10 con 0x56229665f480 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56229666ca30 con 0x562296669d40 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15b2edc740 10 client.0 _ll_register_callbacks cb 0x562296547a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51182/0 (socket says 172.21.15.76:51182) 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 -- 172.21.15.76:0/2124162036 learned_addr learned my addr 172.21.15.76:0/2124162036 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x5622966671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aad9d640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562296669d40 0x562296667700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 -- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562296669d40 msgr2=0x562296667700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562296669d40 0x562296667700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 -- 172.21.15.76:0/2124162036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 msgr2=0x5622966671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x5622966671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 -- 172.21.15.76:0/2124162036 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622963356a0 con 0x56229665eb60 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f15aa59c640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666c80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f159c033000 tx=0x7f159c031a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228b5a9dcba770c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f1591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.921+0000 7f1591ffb640 1 -- 172.21.15.76:0/2124162036 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c035040 con 0x56229665eb60 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f1591ffb640 1 -- 172.21.15.76:0/2124162036 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7f159c004380 con 0x56229665eb60 2024-09-19T07:58:12.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a00a4d20 con 0x56229665eb60 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f1591ffb640 1 -- 172.21.15.76:0/2124162036 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f159c005020 con 0x56229665eb60 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 10 client.17097 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562296678510 con 0x56229665eb60 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f1591ffb640 1 -- 172.21.15.76:0/2124162036 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a00a4d20 con 0x56229665eb60 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f1591ffb640 1 -- 172.21.15.76:0/2124162036 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f159c0035f0 con 0x56229665eb60 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 10 client.17097 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 10 client.17097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 20 client.17097 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966799d0 0x56229667be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 4 client.17097 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622965d17f0 con 0x5622966799d0 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.922+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966799d0 0x56229667be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.923+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966799d0 0x56229667be00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0512f4502abc196 server_cookie=36a359c2e22776b6 in_seq=0 out_seq=0 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.923+0000 7f1591ffb640 10 client.17097 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f1591ffb640 1 -- 172.21.15.76:0/2124162036 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622965d17f0 con 0x5622966799d0 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f1591ffb640 10 client.17097 handle_command_reply: tid=0 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 client.17097 shutdown 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 msgr2=0x562296666c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666c80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f159c033000 tx=0x7f159c031a80 comp rx=0 tx=0).stop 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 shutdown_connections 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562296669d40 0x562296667700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665f480 0x5622966671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966799d0 0x56229667be00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2124162036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666c80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 >> 172.21.15.76:0/2124162036 conn(0x56229665b0f0 msgr2=0x562296660dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:12.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f1591ffb640 0 client.17097 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:12.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 shutdown_connections 2024-09-19T07:58:12.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 1 -- 172.21.15.76:0/2124162036 wait complete. 2024-09-19T07:58:12.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.924+0000 7f15b2edc740 20 client.17097 trim_cache size 0 max 16384 2024-09-19T07:58:12.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 Processor -- start 2024-09-19T07:58:12.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 -- start start 2024-09-19T07:58:12.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x562296668ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562296669d40 0x5622966816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1b0470 con 0x56229665eb60 2024-09-19T07:58:12.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1add40 con 0x562296669d40 2024-09-19T07:58:12.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15b2edc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1abbb0 con 0x56229665f480 2024-09-19T07:58:12.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51184/0 (socket says 172.21.15.76:51184) 2024-09-19T07:58:12.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 -- 172.21.15.76:0/2780087718 learned_addr learned my addr 172.21.15.76:0/2780087718 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:12.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aad9d640 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562296669d40 0x5622966816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 -- 172.21.15.76:0/2780087718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 msgr2=0x562296668ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x562296668ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 -- 172.21.15.76:0/2780087718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562296669d40 msgr2=0x5622966816d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562296669d40 0x5622966816d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.941+0000 7f15aa59c640 1 -- 172.21.15.76:0/2780087718 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229665f2b0 con 0x56229665eb60 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.942+0000 7f15aa59c640 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666560 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5511a3349dd6919 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.942+0000 7f1593fff640 1 -- 172.21.15.76:0/2780087718 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c035030 con 0x56229665eb60 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.942+0000 7f1593fff640 1 -- 172.21.15.76:0/2780087718 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f159c0037f0 con 0x56229665eb60 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.942+0000 7f1593fff640 1 -- 172.21.15.76:0/2780087718 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c004a00 con 0x56229665eb60 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- 172.21.15.76:0/2780087718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 msgr2=0x562296666560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666560 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c02a480 comp rx=0 tx=0).stop 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- 172.21.15.76:0/2780087718 shutdown_connections 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562296669d40 0x5622966816d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x562296668ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- 172.21.15.76:0/2780087718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56229665eb60 0x562296666560 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- 172.21.15.76:0/2780087718 >> 172.21.15.76:0/2780087718 conn(0x56229665b0f0 msgr2=0x5622966683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- 172.21.15.76:0/2780087718 shutdown_connections 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- 172.21.15.76:0/2780087718 wait complete. 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- start start 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 Processor -- start 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665eb60 0x5622966dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x5622966dd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x562296670c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1ac200 con 0x562296669d40 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1ad670 con 0x56229665eb60 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.943+0000 7f15b2edc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1ac8d0 con 0x56229665f480 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15b2edc740 10 client.0 _ll_register_callbacks cb 0x7f159c031420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x562296670c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x562296670c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51188/0 (socket says 172.21.15.76:51188) 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 -- 172.21.15.76:0/1337943966 learned_addr learned my addr 172.21.15.76:0/1337943966 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aa59c640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665eb60 0x5622966dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15a9d9b640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x5622966dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 -- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 msgr2=0x5622966dd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x5622966dd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 -- 172.21.15.76:0/1337943966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665eb60 msgr2=0x5622966dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665eb60 0x5622966dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 -- 172.21.15.76:0/1337943966 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622966712b0 con 0x562296669d40 2024-09-19T07:58:12.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15aad9d640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x562296670c70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f15a400acb0 tx=0x7f15a4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f36e9309f33dcd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f1591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f1591ffb640 1 -- 172.21.15.76:0/1337943966 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4014070 con 0x562296669d40 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f159c0037f0 con 0x562296669d40 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.944+0000 7f1591ffb640 1 -- 172.21.15.76:0/1337943966 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7f15a400cdc0 con 0x562296669d40 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f1591ffb640 1 -- 172.21.15.76:0/1337943966 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f15a400ae60 con 0x562296669d40 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 10 client.17103 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5622966725d0 con 0x562296669d40 2024-09-19T07:58:12.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f1591ffb640 1 -- 172.21.15.76:0/1337943966 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f159c0037f0 con 0x562296669d40 2024-09-19T07:58:12.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f1591ffb640 1 -- 172.21.15.76:0/1337943966 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f15a4025070 con 0x562296669d40 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 10 client.17103 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 20 client.17103 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966ed4d0 0x5622966ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 4 client.17103 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622965cbd00 con 0x5622966ed4d0 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.945+0000 7f15aa59c640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966ed4d0 0x5622966ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.946+0000 7f1591ffb640 10 client.17103 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.946+0000 7f15aa59c640 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966ed4d0 0x5622966ef8f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5399e9aded4f77b server_cookie=252bb1c89a9ba6e2 in_seq=0 out_seq=0 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f1591ffb640 1 -- 172.21.15.76:0/1337943966 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622965cbd00 con 0x5622966ed4d0 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f1591ffb640 10 client.17103 handle_command_reply: tid=0 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 client.17103 shutdown 2024-09-19T07:58:12.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 msgr2=0x562296670c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x562296670c70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f15a400acb0 tx=0x7f15a4004b50 comp rx=0 tx=0).stop 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 shutdown_connections 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5622966ed4d0 0x5622966ef8f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562296669d40 0x562296670c70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56229665f480 0x5622966dd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f1591ffb640 0 client.17103 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 --2- 172.21.15.76:0/1337943966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56229665eb60 0x5622966dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.947+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 >> 172.21.15.76:0/1337943966 conn(0x56229665b0f0 msgr2=0x56229665a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 shutdown_connections 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b2edc740 1 -- 172.21.15.76:0/1337943966 wait complete. 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b2edc740 20 client.17103 trim_cache size 0 max 16384 2024-09-19T07:58:12.951 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:12.952 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:58:12.952 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "0098e293-1e48-487e-93c3-a9aad044899f", 2024-09-19T07:58:12.952 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:58:12.952 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:12.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f15940a33b0 msgr2=0x7f15940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b0b03640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f15940a33b0 0x7f15940a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f15a400e6b0 tx=0x7f15a4008220 comp rx=0 tx=0).stop 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 msgr2=0x7f15ac198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.948+0000 7f15b0b03640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 0x7f15ac198a10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c970 tx=0x7f15a000ce30 comp rx=0 tx=0).stop 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 shutdown_connections 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f15940a33b0 0x7f15940a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15ac10c170 0x7f15ac19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f15ac103660 0x7f15ac198a10 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 --2- 172.21.15.76:0/1632388688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15ac102d40 0x7f15ac1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 >> 172.21.15.76:0/1632388688 conn(0x7f15ac0fc7a0 msgr2=0x7f15ac0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 shutdown_connections 2024-09-19T07:58:12.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:12.949+0000 7f15b0b03640 1 -- 172.21.15.76:0/1632388688 wait complete. 2024-09-19T07:58:13.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:13 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:58:13.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:13 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:13.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:13 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:58:13.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:13 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:13.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:13 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:58:13.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:13 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:13.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:13 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:58:13.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:13 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:13.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:13 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:58:13.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:13 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:13.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:13 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:58:13.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:13 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:13.636 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:58:13.883 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:14.361 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:14 smithi076 ceph-mon[30930]: pgmap v216: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:58:14.361 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:14 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:58:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:14 smithi137 ceph-mon[35309]: pgmap v216: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:58:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:14 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:58:14.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1299129619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c1027a0 msgr2=0x7f7f8c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1299129619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c1067f0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009900 tx=0x7f7f7402a410 comp rx=0 tx=0).stop 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1299129619 shutdown_connections 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1299129619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c106f20 0x7f7f8c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1299129619 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c1067f0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1299129619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c101df0 0x7f7f8c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1299129619 >> 172.21.15.76:0/1299129619 conn(0x7f7f8c0fd8b0 msgr2=0x7f7f8c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1299129619 shutdown_connections 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.442+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1299129619 wait complete. 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 Processor -- start 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 -- start start 2024-09-19T07:58:14.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c101df0 0x7f7f8c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 0x7f7f8c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c112060 con 0x7f7f8c106f20 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c111ee0 con 0x7f7f8c101df0 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f91e5d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1121e0 con 0x7f7f8c1027a0 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f8bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 0x7f7f8c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f8bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 0x7f7f8c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45298/0 (socket says 172.21.15.76:45298) 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.443+0000 7f7f8bfff640 1 -- 172.21.15.76:0/1726520657 learned_addr learned my addr 172.21.15.76:0/1726520657 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8affd640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c101df0 0x7f7f8c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8bfff640 1 -- 172.21.15.76:0/1726520657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c1027a0 msgr2=0x7f7f8c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8bfff640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8bfff640 1 -- 172.21.15.76:0/1726520657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c101df0 msgr2=0x7f7f8c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8bfff640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c101df0 0x7f7f8c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8bfff640 1 -- 172.21.15.76:0/1726520657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c19d490 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8affd640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f8bfff640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 0x7f7f8c19cdb0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c970 tx=0x7f7f7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f88ff9640 1 -- 172.21.15.76:0/1726520657 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c007bb0 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f88ff9640 1 -- 172.21.15.76:0/1726520657 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f7c007d50 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c19d780 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f88ff9640 1 -- 172.21.15.76:0/1726520657 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0188a0 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.444+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c1a5060 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.446+0000 7f7f88ff9640 1 -- 172.21.15.76:0/1726520657 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7f7c00f450 con 0x7f7f8c106f20 2024-09-19T07:58:14.478 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 Processor -- start 2024-09-19T07:58:14.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 -- start start 2024-09-19T07:58:14.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 0x5651bb4b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5651bb4162e0 con 0x5651bb4b0380 2024-09-19T07:58:14.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5651bb3bdce0 con 0x5651bb4bfa90 2024-09-19T07:58:14.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f94236740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5651bb4122a0 con 0x5651bb4b0ca0 2024-09-19T07:58:14.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f88ff9640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f780a33b0 0x7f7f780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 0x5651bb4b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 0x5651bb4b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45300/0 (socket says 172.21.15.76:45300) 2024-09-19T07:58:14.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f8affd640 1 -- 172.21.15.76:0/4057261879 learned_addr learned my addr 172.21.15.76:0/4057261879 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:14.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f8bfff640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f780a33b0 0x7f7f780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f8affd640 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.447+0000 7f7f88ff9640 1 -- 172.21.15.76:0/1726520657 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7f7f7c0cfeb0 con 0x7f7f8c106f20 2024-09-19T07:58:14.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8affd640 1 -- 172.21.15.76:0/4057261879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0ca0 msgr2=0x5651bb4bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8affd640 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8affd640 1 -- 172.21.15.76:0/4057261879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 msgr2=0x5651bb4c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8affd640 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4c1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8affd640 1 -- 172.21.15.76:0/4057261879 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651bb3a2440 con 0x5651bb4b0380 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8affd640 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 0x5651bb4b0760 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005ec0 tx=0x7f7f740095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db2cd8f34e04a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f8bfff640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f780a33b0 0x7f7f780a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c09bd80 tx=0x7f7f7c06eeb0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f81ffb640 1 -- 172.21.15.76:0/4057261879 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74035050 con 0x5651bb4b0380 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f81ffb640 1 -- 172.21.15.76:0/4057261879 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f74041070 con 0x5651bb4b0380 2024-09-19T07:58:14.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.448+0000 7f7f81ffb640 1 -- 172.21.15.76:0/4057261879 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740046c0 con 0x5651bb4b0380 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 -- 172.21.15.76:0/4057261879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 msgr2=0x5651bb4b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 0x5651bb4b0760 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005ec0 tx=0x7f7f740095e0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 -- 172.21.15.76:0/4057261879 shutdown_connections 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 --2- 172.21.15.76:0/4057261879 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0380 0x5651bb4b0760 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 -- 172.21.15.76:0/4057261879 >> 172.21.15.76:0/4057261879 conn(0x5651bb4aca30 msgr2=0x5651bb4ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 -- 172.21.15.76:0/4057261879 shutdown_connections 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 -- 172.21.15.76:0/4057261879 wait complete. 2024-09-19T07:58:14.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 -- start start 2024-09-19T07:58:14.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.449+0000 7f7f94236740 1 Processor -- start 2024-09-19T07:58:14.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.484 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 0x5651bb4bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5651bb4c2660 con 0x5651bb4bfa90 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5651bb3d1050 con 0x5651bb4b0ca0 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5651bb4c27e0 con 0x5651bb4b0380 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 10 client.0 _ll_register_callbacks cb 0x5651bb411160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 0x5651bb4bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 0x5651bb4bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45302/0 (socket says 172.21.15.76:45302) 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 -- 172.21.15.76:0/3721474077 learned_addr learned my addr 172.21.15.76:0/3721474077 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:14.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 -- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 msgr2=0x5651bb4bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4bf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 -- 172.21.15.76:0/3721474077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4b0ca0 msgr2=0x5651bb4bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 -- 172.21.15.76:0/3721474077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651bb1873c0 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f8affd640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 0x5651bb4bcbc0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7f74000c00 tx=0x7f7f74005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8177ec6dcaa8b07f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f6affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f6affd640 1 -- 172.21.15.76:0/3721474077 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74035040 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f6affd640 1 -- 172.21.15.76:0/3721474077 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7f7f74004230 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.450+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f74041070 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f6affd640 1 -- 172.21.15.76:0/3721474077 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7f74004430 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 10 client.17115 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5651bb4ce050 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f6affd640 1 -- 172.21.15.76:0/3721474077 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f74041070 con 0x5651bb4bfa90 2024-09-19T07:58:14.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f6affd640 1 -- 172.21.15.76:0/3721474077 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7f74003a20 con 0x5651bb4bfa90 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 10 client.17115 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 20 client.17115 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb4cf3a0 0x5651bb4d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 4 client.17115 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651bb423850 con 0x5651bb4cf3a0 2024-09-19T07:58:14.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.451+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb4cf3a0 0x5651bb4d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.452+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb4cf3a0 0x5651bb4d1790 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe8148cdb9a69ba server_cookie=a09db1c99f9232b0 in_seq=0 out_seq=0 2024-09-19T07:58:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.452+0000 7f7f6affd640 10 client.17115 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.452+0000 7f7f6affd640 1 -- 172.21.15.76:0/3721474077 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651bb423850 con 0x5651bb4cf3a0 2024-09-19T07:58:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.452+0000 7f7f6affd640 10 client.17115 handle_command_reply: tid=0 2024-09-19T07:58:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.452+0000 7f7f94236740 1 client.17115 shutdown 2024-09-19T07:58:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 msgr2=0x5651bb4bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 0x5651bb4bcbc0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7f74000c00 tx=0x7f7f74005420 comp rx=0 tx=0).stop 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 shutdown_connections 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb4cf3a0 0x5651bb4d1790 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4bfa90 0x5651bb4bcbc0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f6affd640 0 client.17115 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4b0ca0 0x5651bb4bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 --2- 172.21.15.76:0/3721474077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 >> 172.21.15.76:0/3721474077 conn(0x5651bb4aca30 msgr2=0x5651bb4b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:14.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 shutdown_connections 2024-09-19T07:58:14.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 1 -- 172.21.15.76:0/3721474077 wait complete. 2024-09-19T07:58:14.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.453+0000 7f7f94236740 20 client.17115 trim_cache size 0 max 16384 2024-09-19T07:58:14.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 Processor -- start 2024-09-19T07:58:14.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 -- start start 2024-09-19T07:58:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4baf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1ae1f0 con 0x5651bb4b0ca0 2024-09-19T07:58:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1abac0 con 0x5651bb4bfa90 2024-09-19T07:58:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.469+0000 7f7f94236740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1a9930 con 0x5651bb4b0380 2024-09-19T07:58:14.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45314/0 (socket says 172.21.15.76:45314) 2024-09-19T07:58:14.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/1461127155 learned_addr learned my addr 172.21.15.76:0/1461127155 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:14.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8affd640 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/1461127155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 msgr2=0x5651bb4baf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4baf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/1461127155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 msgr2=0x5651bb4d4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/1461127155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651bb4bb630 con 0x5651bb4b0ca0 2024-09-19T07:58:14.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8affd640 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4baf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:14.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d47b0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x5651bb4bbf10 tx=0x7f7f84009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d2c1ba1011be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:14.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f817fa640 1 -- 172.21.15.76:0/1461127155 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8401f020 con 0x5651bb4b0ca0 2024-09-19T07:58:14.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f817fa640 1 -- 172.21.15.76:0/1461127155 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f8401ba80 con 0x5651bb4b0ca0 2024-09-19T07:58:14.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.470+0000 7f7f817fa640 1 -- 172.21.15.76:0/1461127155 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84010d50 con 0x5651bb4b0ca0 2024-09-19T07:58:14.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 -- 172.21.15.76:0/1461127155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 msgr2=0x5651bb4d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d47b0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x5651bb4bbf10 tx=0x7f7f84009680 comp rx=0 tx=0).stop 2024-09-19T07:58:14.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 -- 172.21.15.76:0/1461127155 shutdown_connections 2024-09-19T07:58:14.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d47b0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 --2- 172.21.15.76:0/1461127155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4baf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 -- 172.21.15.76:0/1461127155 >> 172.21.15.76:0/1461127155 conn(0x5651bb4aca30 msgr2=0x5651bb4b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:14.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 -- 172.21.15.76:0/1461127155 shutdown_connections 2024-09-19T07:58:14.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 -- 172.21.15.76:0/1461127155 wait complete. 2024-09-19T07:58:14.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 -- start start 2024-09-19T07:58:14.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.471+0000 7f7f94236740 1 Processor -- start 2024-09-19T07:58:14.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1a9f80 con 0x5651bb4b0ca0 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1ab3f0 con 0x5651bb4bfa90 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1aa650 con 0x5651bb4b0380 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f94236740 10 client.0 _ll_register_callbacks cb 0x7f7f74032dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45330/0 (socket says 172.21.15.76:45330) 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/928679311 learned_addr learned my addr 172.21.15.76:0/928679311 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:14.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8affd640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8affd640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 msgr2=0x5651bb4d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/928679311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 msgr2=0x5651bb4d3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:14.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.472+0000 7f7f8b7fe640 1 -- 172.21.15.76:0/928679311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651bb4b0ad0 con 0x5651bb4b0ca0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f8b7fe640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d2ae0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x5651bb4bda70 tx=0x7f7f8401be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ad17e2ad448514 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f6affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f6affd640 1 -- 172.21.15.76:0/928679311 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8401b580 con 0x5651bb4b0ca0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f6affd640 1 -- 172.21.15.76:0/928679311 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7f7f8401b720 con 0x5651bb4b0ca0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8401ba80 con 0x5651bb4b0ca0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f6affd640 1 -- 172.21.15.76:0/928679311 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7f84010670 con 0x5651bb4b0ca0 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 10 client.17121 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:14.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5651bb539d80 con 0x5651bb4b0ca0 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f6affd640 1 -- 172.21.15.76:0/928679311 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f8401ba80 con 0x5651bb4b0ca0 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f6affd640 1 -- 172.21.15.76:0/928679311 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7f8402d020 con 0x5651bb4b0ca0 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 10 client.17121 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 20 client.17121 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb53a470 0x5651bb53c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 4 client.17121 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:58:14.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.473+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5651bb41dd60 con 0x5651bb53a470 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f8affd640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb53a470 0x5651bb53c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f6affd640 10 client.17121 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f8affd640 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb53a470 0x5651bb53c890 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f43e8ea89dff08 server_cookie=7e15d9efa0d898f4 in_seq=0 out_seq=0 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f6affd640 1 -- 172.21.15.76:0/928679311 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5651bb41dd60 con 0x5651bb53a470 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f6affd640 10 client.17121 handle_command_reply: tid=0 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 client.17121 shutdown 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 msgr2=0x5651bb4d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d2ae0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x5651bb4bda70 tx=0x7f7f8401be10 comp rx=0 tx=0).stop 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 shutdown_connections 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5651bb4bfa90 0x5651bb4d3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5651bb53a470 0x5651bb53c890 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5651bb4b0ca0 0x5651bb4d2ae0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 --2- 172.21.15.76:0/928679311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5651bb4b0380 0x5651bb4d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 >> 172.21.15.76:0/928679311 conn(0x5651bb4aca30 msgr2=0x5651bb4b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.474+0000 7f7f6affd640 0 client.17121 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 shutdown_connections 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f94236740 1 -- 172.21.15.76:0/928679311 wait complete. 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f94236740 20 client.17121 trim_cache size 0 max 16384 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:58:14.503 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:14.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f780a33b0 msgr2=0x7f7f780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f780a33b0 0x7f7f780a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c09bd80 tx=0x7f7f7c06eeb0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 msgr2=0x7f7f8c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 0x7f7f8c19cdb0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c970 tx=0x7f7f7c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 shutdown_connections 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7f780a33b0 0x7f7f780a5870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7f8c106f20 0x7f7f8c19cdb0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f8c1027a0 0x7f7f8c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 --2- 172.21.15.76:0/1726520657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c101df0 0x7f7f8c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 >> 172.21.15.76:0/1726520657 conn(0x7f7f8c0fd8b0 msgr2=0x7f7f8c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 shutdown_connections 2024-09-19T07:58:14.505 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:14.475+0000 7f7f91e5d640 1 -- 172.21.15.76:0/1726520657 wait complete. 2024-09-19T07:58:14.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:14 smithi152 ceph-mon[35117]: pgmap v216: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:58:14.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:14 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:58:15.183 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:58:15.183 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:58:15.432 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 -- 172.21.15.76:0/2271401424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 msgr2=0x7fc7c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 --2- 172.21.15.76:0/2271401424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c810da40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009ca0 tx=0x7fc7c002a950 comp rx=0 tx=0).stop 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 -- 172.21.15.76:0/2271401424 shutdown_connections 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 --2- 172.21.15.76:0/2271401424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c810da40 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 --2- 172.21.15.76:0/2271401424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8102570 0x7fc7c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 --2- 172.21.15.76:0/2271401424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7c8100e20 0x7fc7c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 -- 172.21.15.76:0/2271401424 >> 172.21.15.76:0/2271401424 conn(0x7fc7c80fc7d0 msgr2=0x7fc7c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 -- 172.21.15.76:0/2271401424 shutdown_connections 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 -- 172.21.15.76:0/2271401424 wait complete. 2024-09-19T07:58:15.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 Processor -- start 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.938+0000 7fc7d01da640 1 -- start start 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7c8100e20 0x7fc7c81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8102570 0x7fc7c8199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c81a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81110a0 con 0x7fc7c8102ef0 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8110f20 con 0x7fc7c8100e20 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8111220 con 0x7fc7c8102570 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c81a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c81a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45338/0 (socket says 172.21.15.76:45338) 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 -- 172.21.15.76:0/3278219738 learned_addr learned my addr 172.21.15.76:0/3278219738 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7cdf76640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7c8100e20 0x7fc7c81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7cd775640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8102570 0x7fc7c8199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:15.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 -- 172.21.15.76:0/3278219738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8102570 msgr2=0x7fc7c8199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8102570 0x7fc7c8199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 -- 172.21.15.76:0/3278219738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7c8100e20 msgr2=0x7fc7c81993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7c8100e20 0x7fc7c81993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 -- 172.21.15.76:0/3278219738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c81a49b0 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7ce777640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c81a4470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005cc0 tx=0x7fc7c002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0034040 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c81a4b80 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.939+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7c0030940 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.940+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00456e0 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.940+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81a5030 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.941+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c8101200 con 0x7fc7c8102ef0 2024-09-19T07:58:15.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.942+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc7c0037020 con 0x7fc7c8102ef0 2024-09-19T07:58:15.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.943+0000 7fc7baffd640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:15.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.943+0000 7fc7cdf76640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:15.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.943+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8702+0+0 (secure 0 0 0) 0x7fc7c00f1000 con 0x7fc7c8102ef0 2024-09-19T07:58:15.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.943+0000 7fc7cdf76640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00bbe0 tx=0x7fc7bc00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:15.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:15.946+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7c00bdad0 con 0x7fc7c8102ef0 2024-09-19T07:58:16.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.147+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7c81a52c0 con 0x7fc7c8102ef0 2024-09-19T07:58:16.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.148+0000 7fc7baffd640 1 -- 172.21.15.76:0/3278219738 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7fc7c00bd3d0 con 0x7fc7c8102ef0 2024-09-19T07:58:16.148 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:58:16.148 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:58:16.149 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T07:58:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7b40a33b0 msgr2=0x7fc7b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00bbe0 tx=0x7fc7bc00b390 comp rx=0 tx=0).stop 2024-09-19T07:58:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 msgr2=0x7fc7c81a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c81a4470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005cc0 tx=0x7fc7c002f790 comp rx=0 tx=0).stop 2024-09-19T07:58:16.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 shutdown_connections 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc7c8102ef0 0x7fc7c81a4470 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8102570 0x7fc7c8199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 --2- 172.21.15.76:0/3278219738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7c8100e20 0x7fc7c81993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 >> 172.21.15.76:0/3278219738 conn(0x7fc7c80fc7d0 msgr2=0x7fc7c8106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 shutdown_connections 2024-09-19T07:58:16.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:16.151+0000 7fc7d01da640 1 -- 172.21.15.76:0/3278219738 wait complete. 2024-09-19T07:58:16.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:16 smithi137 ceph-mon[35309]: pgmap v217: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:16.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:16 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3278219738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:16.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:16 smithi076 ceph-mon[30930]: pgmap v217: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:16.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:16 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3278219738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:16.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:16 smithi152 ceph-mon[35117]: pgmap v217: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:16.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:16 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3278219738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:16.871 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:58:17.127 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:17.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/455563357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc106a80 msgr2=0x7ff4bc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/455563357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc106a80 0x7ff4bc106e60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009930 tx=0x7ff4b002a420 comp rx=0 tx=0).stop 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/455563357 shutdown_connections 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/455563357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4bc101420 0x7ff4bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/455563357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 0x7ff4bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/455563357 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc106a80 0x7ff4bc106e60 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/455563357 >> 172.21.15.76:0/455563357 conn(0x7ff4bc0fc7a0 msgr2=0x7ff4bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/455563357 shutdown_connections 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.651+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/455563357 wait complete. 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 Processor -- start 2024-09-19T07:58:17.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 -- start start 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 0x7ff4bc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 0x7ff4bc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4bc106a80 0x7ff4bc19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1120c0 con 0x7ff4bc101420 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc111f40 con 0x7ff4bc100a80 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c2dbe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc112240 con 0x7ff4bc106a80 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 0x7ff4bc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 0x7ff4bc198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45350/0 (socket says 172.21.15.76:45350) 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 -- 172.21.15.76:0/1267407754 learned_addr learned my addr 172.21.15.76:0/1267407754 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 0x7ff4bc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 -- 172.21.15.76:0/1267407754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4bc106a80 msgr2=0x7ff4bc19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c135b640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4bc106a80 0x7ff4bc19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4bc106a80 0x7ff4bc19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 -- 172.21.15.76:0/1267407754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 msgr2=0x7ff4bc198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 0x7ff4bc198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 -- 172.21.15.76:0/1267407754 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4bc19d4d0 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 0x7ff4bc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.652+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 0x7ff4bc198a60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d950 tx=0x7ff4a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.653+0000 7ff4b9ffb640 1 -- 172.21.15.76:0/1267407754 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8017070 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.653+0000 7ff4b9ffb640 1 -- 172.21.15.76:0/1267407754 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4a8009c30 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.653+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4bc19d7c0 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.653+0000 7ff4b9ffb640 1 -- 172.21.15.76:0/1267407754 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800f740 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.653+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4bc1a50a0 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.655+0000 7ff4b9ffb640 1 -- 172.21.15.76:0/1267407754 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff4a8010a80 con 0x7ff4bc101420 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.655+0000 7ff4c5197740 1 Processor -- start 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 -- start start 2024-09-19T07:58:17.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4b9ffb640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff4ac0a33b0 0x7ff4ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881ba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564a881132f0 con 0x564a881b8370 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a880bacf0 con 0x564a881ad5d0 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c5197740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564a8810f2b0 con 0x564a881aeb40 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff4ac0a33b0 0x7ff4ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4b9ffb640 1 -- 172.21.15.76:0/1267407754 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ff4a80cfab0 con 0x7ff4bc101420 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881ba760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45354/0 (socket says 172.21.15.76:45354) 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 -- 172.21.15.76:0/4159383484 learned_addr learned my addr 172.21.15.76:0/4159383484 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:17.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 -- 172.21.15.76:0/4159383484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 msgr2=0x564a881ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 -- 172.21.15.76:0/4159383484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 msgr2=0x564a881ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4c135b640 1 -- 172.21.15.76:0/4159383484 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8809f3a0 con 0x564a881b8370 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.656+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.657+0000 7ff4c135b640 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881ba760 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4014ce0 tx=0x7ff4b4011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc86b47a6d4da97b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:17.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.657+0000 7ff4c135b640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff4ac0a33b0 0x7ff4ac0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4011c50 tx=0x7ff4b4013000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.657+0000 7ff4a6ffd640 1 -- 172.21.15.76:0/4159383484 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4022020 con 0x564a881b8370 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.657+0000 7ff4a6ffd640 1 -- 172.21.15.76:0/4159383484 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4b4012c80 con 0x564a881b8370 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.657+0000 7ff4a6ffd640 1 -- 172.21.15.76:0/4159383484 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4004250 con 0x564a881b8370 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- 172.21.15.76:0/4159383484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 msgr2=0x564a881ba760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881ba760 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4014ce0 tx=0x7ff4b4011750 comp rx=0 tx=0).stop 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- 172.21.15.76:0/4159383484 shutdown_connections 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881ba760 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4159383484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- 172.21.15.76:0/4159383484 >> 172.21.15.76:0/4159383484 conn(0x564a88176310 msgr2=0x564a881a9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- 172.21.15.76:0/4159383484 shutdown_connections 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- 172.21.15.76:0/4159383484 wait complete. 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- start start 2024-09-19T07:58:17.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 Processor -- start 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 0x564a881b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881aeb40 0x564a881b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564a881bb010 con 0x564a881ad5d0 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a880ce060 con 0x564a881aeb40 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564a881bb190 con 0x564a881b8370 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.658+0000 7ff4c5197740 10 client.0 _ll_register_callbacks cb 0x564a87e218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 0x564a881b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 0x564a881b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45366/0 (socket says 172.21.15.76:45366) 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 -- 172.21.15.76:0/486276197 learned_addr learned my addr 172.21.15.76:0/486276197 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881aeb40 0x564a881b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 -- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 msgr2=0x564a881b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 -- 172.21.15.76:0/486276197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881aeb40 msgr2=0x564a881b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881aeb40 0x564a881b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 -- 172.21.15.76:0/486276197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a87e843c0 con 0x564a881ad5d0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881aeb40 0x564a881b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 0x564a881b7dd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009930 tx=0x7ff4b0031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef268d53dbb65dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff49bfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff49bfff640 1 -- 172.21.15.76:0/486276197 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0040070 con 0x564a881ad5d0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff49bfff640 1 -- 172.21.15.76:0/486276197 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ff4b0004240 con 0x564a881ad5d0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b4012c80 con 0x564a881ad5d0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff49bfff640 1 -- 172.21.15.76:0/486276197 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff4b0035040 con 0x564a881ad5d0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c5197740 10 client.17139 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.659+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564a881c6b80 con 0x564a881ad5d0 2024-09-19T07:58:17.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff49bfff640 1 -- 172.21.15.76:0/486276197 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4b4012c80 con 0x564a881ad5d0 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff49bfff640 1 -- 172.21.15.76:0/486276197 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff4b0004ac0 con 0x564a881ad5d0 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4c5197740 10 client.17139 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4c5197740 10 client.17139 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4c5197740 20 client.17139 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4c5197740 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a881c8040 0x564a881ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4c5197740 4 client.17139 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a88120860 con 0x564a881c8040 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.660+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a881c8040 0x564a881ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.661+0000 7ff49bfff640 10 client.17139 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.661+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a881c8040 0x564a881ca4b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c90e6e6a80bb533 server_cookie=964b0903d7500cdd in_seq=0 out_seq=0 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff49bfff640 1 -- 172.21.15.76:0/486276197 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a88120860 con 0x564a881c8040 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff49bfff640 10 client.17139 handle_command_reply: tid=0 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 client.17139 shutdown 2024-09-19T07:58:17.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 msgr2=0x564a881b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 0x564a881b7dd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009930 tx=0x7ff4b0031870 comp rx=0 tx=0).stop 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 shutdown_connections 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a881c8040 0x564a881ca4b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881aeb40 0x564a881b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 --2- 172.21.15.76:0/486276197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881ad5d0 0x564a881b7dd0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff49bfff640 0 client.17139 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 >> 172.21.15.76:0/486276197 conn(0x564a88176310 msgr2=0x564a881af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 shutdown_connections 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 1 -- 172.21.15.76:0/486276197 wait complete. 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.662+0000 7ff4c5197740 20 client.17139 trim_cache size 0 max 16384 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 Processor -- start 2024-09-19T07:58:17.707 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 -- start start 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1b0520 con 0x564a881b8370 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1addf0 con 0x564a881ad5d0 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c5197740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1abc60 con 0x564a881aeb40 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45374/0 (socket says 172.21.15.76:45374) 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 -- 172.21.15.76:0/2144798890 learned_addr learned my addr 172.21.15.76:0/2144798890 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 -- 172.21.15.76:0/2144798890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 msgr2=0x564a881cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 -- 172.21.15.76:0/2144798890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 msgr2=0x564a881a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c135b640 1 -- 172.21.15.76:0/2144798890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a881a9320 con 0x564a881b8370 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.675+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c135b640 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881d02c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009990 tx=0x7ff4b4014b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792f4bd8bb7dbc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4a67fc640 1 -- 172.21.15.76:0/2144798890 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4022040 con 0x564a881b8370 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4a67fc640 1 -- 172.21.15.76:0/2144798890 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4b402b030 con 0x564a881b8370 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4a67fc640 1 -- 172.21.15.76:0/2144798890 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4005050 con 0x564a881b8370 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 -- 172.21.15.76:0/2144798890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 msgr2=0x564a881d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881d02c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009990 tx=0x7ff4b4014b90 comp rx=0 tx=0).stop 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 -- 172.21.15.76:0/2144798890 shutdown_connections 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881b8370 0x564a881d02c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881aeb40 0x564a881cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 --2- 172.21.15.76:0/2144798890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 -- 172.21.15.76:0/2144798890 >> 172.21.15.76:0/2144798890 conn(0x564a88176310 msgr2=0x564a881a9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.676+0000 7ff4c5197740 1 -- 172.21.15.76:0/2144798890 shutdown_connections 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 -- 172.21.15.76:0/2144798890 wait complete. 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 -- start start 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 Processor -- start 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 0x564a881bc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1ac2b0 con 0x564a881aeb40 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1ad720 con 0x564a881ad5d0 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1ac980 con 0x564a881b8370 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c5197740 10 client.0 _ll_register_callbacks cb 0x7ff4b0009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:17.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 0x564a881bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 0x564a881bc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45376/0 (socket says 172.21.15.76:45376) 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4bbfff640 1 -- 172.21.15.76:0/4269025261 learned_addr learned my addr 172.21.15.76:0/4269025261 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c135b640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.677+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881bc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4bbfff640 1 -- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 msgr2=0x564a881bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4bbfff640 1 -- 172.21.15.76:0/4269025261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 msgr2=0x564a881bc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881bc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4bbfff640 1 -- 172.21.15.76:0/4269025261 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a882362d0 con 0x564a881aeb40 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c135b640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:17.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4bbfff640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 0x564a881bc820 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff4a809bc90 tx=0x7ff4a80cfcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88e612ad4e475b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff49bfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff49bfff640 1 -- 172.21.15.76:0/4269025261 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8020070 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff49bfff640 1 -- 172.21.15.76:0/4269025261 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ff4a8098370 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b402b030 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff49bfff640 1 -- 172.21.15.76:0/4269025261 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff4a8076230 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 10 client.17145 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564a88237590 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff49bfff640 1 -- 172.21.15.76:0/4269025261 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4b402b030 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff49bfff640 1 -- 172.21.15.76:0/4269025261 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff4a809abc0 con 0x564a881aeb40 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 10 client.17145 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 10 client.17145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:17.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 20 client.17145 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a88237cf0 0x564a8823a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 4 client.17145 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.678+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a8811ad70 con 0x564a88237cf0 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a88237cf0 0x564a8823a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff49bfff640 10 client.17145 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c0b5a640 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a88237cf0 0x564a8823a0e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf1eab1a106f2875 server_cookie=45982259f78f4a00 in_seq=0 out_seq=0 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff49bfff640 1 -- 172.21.15.76:0/4269025261 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a8811ad70 con 0x564a88237cf0 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff49bfff640 10 client.17145 handle_command_reply: tid=0 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 client.17145 shutdown 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 msgr2=0x564a881bc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 0x564a881bc820 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff4a809bc90 tx=0x7ff4a80cfcb0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 shutdown_connections 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x564a88237cf0 0x564a8823a0e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564a881b8370 0x564a881bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff49bfff640 0 client.17145 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564a881aeb40 0x564a881bc820 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 --2- 172.21.15.76:0/4269025261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a881ad5d0 0x564a881bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.679+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 >> 172.21.15.76:0/4269025261 conn(0x564a88176310 msgr2=0x564a881a8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 shutdown_connections 2024-09-19T07:58:17.714 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:17.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c5197740 1 -- 172.21.15.76:0/4269025261 wait complete. 2024-09-19T07:58:17.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c5197740 20 client.17145 trim_cache size 0 max 16384 2024-09-19T07:58:17.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff4ac0a33b0 msgr2=0x7ff4ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff4ac0a33b0 0x7ff4ac0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4011c50 tx=0x7ff4b4013000 comp rx=0 tx=0).stop 2024-09-19T07:58:17.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 msgr2=0x7ff4bc198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 0x7ff4bc198a60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d950 tx=0x7ff4a800de10 comp rx=0 tx=0).stop 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 shutdown_connections 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff4ac0a33b0 0x7ff4ac0a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4bc106a80 0x7ff4bc19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff4bc101420 0x7ff4bc198a60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 --2- 172.21.15.76:0/1267407754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4bc100a80 0x7ff4bc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 >> 172.21.15.76:0/1267407754 conn(0x7ff4bc0fc7a0 msgr2=0x7ff4bc0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 shutdown_connections 2024-09-19T07:58:17.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:17.680+0000 7ff4c2dbe640 1 -- 172.21.15.76:0/1267407754 wait complete. 2024-09-19T07:58:18.311 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:17 smithi076 ceph-mon[30930]: pgmap v218: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:18.311 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:17 smithi076 ceph-mon[30930]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:58:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:17 smithi152 ceph-mon[35117]: pgmap v218: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:17 smithi152 ceph-mon[35117]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:58:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:17 smithi137 ceph-mon[35309]: pgmap v218: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:17 smithi137 ceph-mon[35309]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:58:18.469 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:58:18.717 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:19.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 -- 172.21.15.76:0/3144282188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa380102de0 msgr2=0x7fa3801031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 --2- 172.21.15.76:0/3144282188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa380102de0 0x7fa3801031c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fa370009900 tx=0x7fa37002a480 comp rx=0 tx=0).stop 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 -- 172.21.15.76:0/3144282188 shutdown_connections 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 --2- 172.21.15.76:0/3144282188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa38010c180 0x7fa38010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 --2- 172.21.15.76:0/3144282188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 0x7fa38010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 --2- 172.21.15.76:0/3144282188 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa380102de0 0x7fa3801031c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 -- 172.21.15.76:0/3144282188 >> 172.21.15.76:0/3144282188 conn(0x7fa3800fc7a0 msgr2=0x7fa3800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.182+0000 7fa384a26640 1 -- 172.21.15.76:0/3144282188 shutdown_connections 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.183+0000 7fa384a26640 1 -- 172.21.15.76:0/3144282188 wait complete. 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.183+0000 7fa384a26640 1 Processor -- start 2024-09-19T07:58:19.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.183+0000 7fa384a26640 1 -- start start 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa380102de0 0x7fa380198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 0x7fa380198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 0x7fa38019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa380112090 con 0x7fa38010c180 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa380111f10 con 0x7fa380103700 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa380112210 con 0x7fa380102de0 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 0x7fa38019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 0x7fa38019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45400/0 (socket says 172.21.15.76:45400) 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 -- 172.21.15.76:0/463169784 learned_addr learned my addr 172.21.15.76:0/463169784 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 0x7fa380198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37e59c640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa380102de0 0x7fa380198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 -- 172.21.15.76:0/463169784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa380102de0 msgr2=0x7fa380198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa380102de0 0x7fa380198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 -- 172.21.15.76:0/463169784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 msgr2=0x7fa380198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 0x7fa380198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 -- 172.21.15.76:0/463169784 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38019d4c0 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37e59c640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa380102de0 0x7fa380198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 0x7fa380198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa37ed9d640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 0x7fa38019cde0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fa37800cad0 tx=0x7fa37800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa36f7fe640 1 -- 172.21.15.76:0/463169784 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37800ae20 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38019d7b0 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa36f7fe640 1 -- 172.21.15.76:0/463169784 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa378004b20 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa36f7fe640 1 -- 172.21.15.76:0/463169784 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37800f780 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.184+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3801a5090 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa36f7fe640 1 -- 172.21.15.76:0/463169784 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa378004cd0 con 0x7fa38010c180 2024-09-19T07:58:19.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 Processor -- start 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 -- start start 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x562850358090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850358a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850365760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5628502be2f0 con 0x562850359b40 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562850265cf0 con 0x562850363370 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa386dff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628502ba2b0 con 0x5628503585d0 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x562850358090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa36f7fe640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa3680a33b0 0x7fa3680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x562850358090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45412/0 (socket says 172.21.15.76:45412) 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.187+0000 7fa37dd9b640 1 -- 172.21.15.76:0/76085236 learned_addr learned my addr 172.21.15.76:0/76085236 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:19.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37e59c640 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850358a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37ed9d640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa3680a33b0 0x7fa3680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850365760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 -- 172.21.15.76:0/76085236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 msgr2=0x562850358a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850358a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa36f7fe640 1 -- 172.21.15.76:0/463169784 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fa3780cfe80 con 0x7fa38010c180 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 -- 172.21.15.76:0/76085236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 msgr2=0x562850365760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850365760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 -- 172.21.15.76:0/76085236 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56285024a3a0 con 0x562850359b40 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x562850358090 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fa374014540 tx=0x7fa37400b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7219e2ccba8c338b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa37ed9d640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa3680a33b0 0x7fa3680a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa378061d70 tx=0x7fa3780bc040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa36cff9640 1 -- 172.21.15.76:0/76085236 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374012710 con 0x562850359b40 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa36cff9640 1 -- 172.21.15.76:0/76085236 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa37401a070 con 0x562850359b40 2024-09-19T07:58:19.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.188+0000 7fa36cff9640 1 -- 172.21.15.76:0/76085236 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37400ebe0 con 0x562850359b40 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 -- 172.21.15.76:0/76085236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 msgr2=0x562850358090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x562850358090 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fa374014540 tx=0x7fa37400b530 comp rx=0 tx=0).stop 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 -- 172.21.15.76:0/76085236 shutdown_connections 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850365760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850358a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 --2- 172.21.15.76:0/76085236 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x562850358090 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 -- 172.21.15.76:0/76085236 >> 172.21.15.76:0/76085236 conn(0x562850321310 msgr2=0x562850354c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 -- 172.21.15.76:0/76085236 shutdown_connections 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 -- 172.21.15.76:0/76085236 wait complete. 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 -- start start 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.189+0000 7fa386dff740 1 Processor -- start 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850362df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850359b40 0x5628503600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 0x5628503607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562850366070 con 0x562850363370 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562850279060 con 0x562850359b40 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5628503661f0 con 0x5628503585d0 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 10 client.0 _ll_register_callbacks cb 0x56284ffcc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 0x5628503607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 0x5628503607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45416/0 (socket says 172.21.15.76:45416) 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3711782053 learned_addr learned my addr 172.21.15.76:0/3711782053 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37e59c640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850359b40 0x5628503600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850362df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3711782053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 msgr2=0x562850362df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850362df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850359b40 msgr2=0x5628503600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850359b40 0x5628503600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3711782053 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56285002f3c0 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 0x5628503607e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e760 tx=0x7fa3740046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bb64f6c2d8ad0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa365ffb640 1 -- 172.21.15.76:0/3711782053 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374027070 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa365ffb640 1 -- 172.21.15.76:0/3711782053 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fa374012b50 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.190+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa37401a070 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa365ffb640 1 -- 172.21.15.76:0/3711782053 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa37400b710 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 10 client.17157 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562850371ba0 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa365ffb640 1 -- 172.21.15.76:0/3711782053 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa37401a070 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa365ffb640 1 -- 172.21.15.76:0/3711782053 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa374011ba0 con 0x562850363370 2024-09-19T07:58:19.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 10 client.17157 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 10 client.17157 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 20 client.17157 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562850372f50 0x562850375340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 4 client.17157 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628502cb860 con 0x562850372f50 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.191+0000 7fa37e59c640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562850372f50 0x562850375340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa365ffb640 10 client.17157 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa37e59c640 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562850372f50 0x562850375340 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e534770e1a1a514a server_cookie=cb92810550623bbf in_seq=0 out_seq=0 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa365ffb640 1 -- 172.21.15.76:0/3711782053 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628502cb860 con 0x562850372f50 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa365ffb640 10 client.17157 handle_command_reply: tid=0 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa386dff740 1 client.17157 shutdown 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 msgr2=0x5628503607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.192+0000 7fa386dff740 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 0x5628503607e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e760 tx=0x7fa3740046e0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 shutdown_connections 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562850372f50 0x562850375340 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850363370 0x5628503607e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850359b40 0x5628503600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa365ffb640 0 client.17157 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 --2- 172.21.15.76:0/3711782053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x562850362df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 >> 172.21.15.76:0/3711782053 conn(0x562850321310 msgr2=0x56285035a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 shutdown_connections 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 1 -- 172.21.15.76:0/3711782053 wait complete. 2024-09-19T07:58:19.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.193+0000 7fa386dff740 20 client.17157 trim_cache size 0 max 16384 2024-09-19T07:58:19.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 Processor -- start 2024-09-19T07:58:19.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 -- start start 2024-09-19T07:58:19.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x56285034fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x56285036f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x56285035b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801b05e0 con 0x562850359b40 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801adeb0 con 0x562850363370 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.205+0000 7fa386dff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801abd20 con 0x5628503585d0 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x56285036f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x56285036f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45422/0 (socket says 172.21.15.76:45422) 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 -- 172.21.15.76:0/2409070629 learned_addr learned my addr 172.21.15.76:0/2409070629 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x56285035b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x56285034fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 -- 172.21.15.76:0/2409070629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 msgr2=0x56285034fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x56285034fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 -- 172.21.15.76:0/2409070629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 msgr2=0x56285035b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x56285035b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 -- 172.21.15.76:0/2409070629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56285035ecd0 con 0x562850359b40 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x56285034fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa37e59c640 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x56285036f490 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa370009230 tx=0x7fa370009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d08627eaed4dbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa367fff640 1 -- 172.21.15.76:0/2409070629 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370035040 con 0x562850359b40 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa367fff640 1 -- 172.21.15.76:0/2409070629 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa370048070 con 0x562850359b40 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.206+0000 7fa367fff640 1 -- 172.21.15.76:0/2409070629 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700046c0 con 0x562850359b40 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 -- 172.21.15.76:0/2409070629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 msgr2=0x56285036f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x56285036f490 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa370009230 tx=0x7fa370009660 comp rx=0 tx=0).stop 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 -- 172.21.15.76:0/2409070629 shutdown_connections 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x56285035b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562850359b40 0x56285036f490 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 --2- 172.21.15.76:0/2409070629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5628503585d0 0x56285034fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 -- 172.21.15.76:0/2409070629 >> 172.21.15.76:0/2409070629 conn(0x562850321310 msgr2=0x562850362120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 -- 172.21.15.76:0/2409070629 shutdown_connections 2024-09-19T07:58:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 -- 172.21.15.76:0/2409070629 wait complete. 2024-09-19T07:58:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 -- start start 2024-09-19T07:58:19.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.207+0000 7fa386dff740 1 Processor -- start 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 0x562850376170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562850359b40 0x5628503766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850376bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801ac370 con 0x5628503585d0 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801ad7e0 con 0x562850363370 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801aca40 con 0x562850359b40 2024-09-19T07:58:19.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 10 client.0 _ll_register_callbacks cb 0x7fa37400bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 0x562850376170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 0x562850376170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45426/0 (socket says 172.21.15.76:45426) 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3803824438 learned_addr learned my addr 172.21.15.76:0/3803824438 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3803824438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562850359b40 msgr2=0x5628503766b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37e59c640 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562850359b40 0x5628503766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562850359b40 0x5628503766b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 msgr2=0x562850376bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850376bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 -- 172.21.15.76:0/3803824438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628503dc910 con 0x5628503585d0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa37dd9b640 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 0x562850376170 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e760 tx=0x7fa3740225b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15d9697e920b72f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa365ffb640 1 -- 172.21.15.76:0/3803824438 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374027070 con 0x5628503585d0 2024-09-19T07:58:19.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa365ffb640 1 -- 172.21.15.76:0/3803824438 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fa374022ba0 con 0x5628503585d0 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.208+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa370048070 con 0x5628503585d0 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa365ffb640 1 -- 172.21.15.76:0/3803824438 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa374014300 con 0x5628503585d0 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 10 client.17163 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5628503ddb60 con 0x5628503585d0 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa365ffb640 1 -- 172.21.15.76:0/3803824438 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa370048070 con 0x5628503585d0 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa365ffb640 1 -- 172.21.15.76:0/3803824438 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa37403d030 con 0x5628503585d0 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 10 client.17163 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 10 client.17163 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 20 client.17163 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5628503de250 0x5628503e0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 4 client.17163 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628502c5d70 con 0x5628503de250 2024-09-19T07:58:19.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.209+0000 7fa37e59c640 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5628503de250 0x5628503e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa365ffb640 10 client.17163 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa37e59c640 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5628503de250 0x5628503e0670 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ceccf4d1a8895dac server_cookie=d5da18966ba38ada in_seq=0 out_seq=0 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa365ffb640 1 -- 172.21.15.76:0/3803824438 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628502c5d70 con 0x5628503de250 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa365ffb640 10 client.17163 handle_command_reply: tid=0 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 client.17163 shutdown 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 msgr2=0x562850376170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 0x562850376170 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e760 tx=0x7fa3740225b0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 shutdown_connections 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5628503de250 0x5628503e0670 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562850363370 0x562850376bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa365ffb640 0 client.17163 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562850359b40 0x5628503766b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 --2- 172.21.15.76:0/3803824438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628503585d0 0x562850376170 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 >> 172.21.15.76:0/3803824438 conn(0x562850321310 msgr2=0x56285036e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:19.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 shutdown_connections 2024-09-19T07:58:19.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 1 -- 172.21.15.76:0/3803824438 wait complete. 2024-09-19T07:58:19.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.210+0000 7fa386dff740 20 client.17163 trim_cache size 0 max 16384 2024-09-19T07:58:19.218 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:19.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa3680a33b0 msgr2=0x7fa3680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa3680a33b0 0x7fa3680a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa378061d70 tx=0x7fa3780bc040 comp rx=0 tx=0).stop 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 msgr2=0x7fa38019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 0x7fa38019cde0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fa37800cad0 tx=0x7fa37800cf90 comp rx=0 tx=0).stop 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 shutdown_connections 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa3680a33b0 0x7fa3680a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa38010c180 0x7fa38019cde0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa380103700 0x7fa380198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 --2- 172.21.15.76:0/463169784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa380102de0 0x7fa380198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 >> 172.21.15.76:0/463169784 conn(0x7fa3800fc7a0 msgr2=0x7fa3800fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 shutdown_connections 2024-09-19T07:58:19.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:19.211+0000 7fa384a26640 1 -- 172.21.15.76:0/463169784 wait complete. 2024-09-19T07:58:20.020 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:58:20.267 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:20.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:19 smithi152 ceph-mon[35117]: pgmap v220: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T07:58:20.388 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:19 smithi076 ceph-mon[30930]: pgmap v220: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T07:58:20.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:19 smithi137 ceph-mon[35309]: pgmap v220: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T07:58:20.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 -- 172.21.15.76:0/4183664557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c101420 msgr2=0x7f309c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 --2- 172.21.15.76:0/4183664557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c101420 0x7f309c10d950 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3094009cd0 tx=0x7f309402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 -- 172.21.15.76:0/4183664557 shutdown_connections 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 --2- 172.21.15.76:0/4183664557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c101420 0x7f309c10d950 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 --2- 172.21.15.76:0/4183664557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c100a80 0x7f309c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 --2- 172.21.15.76:0/4183664557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f309c106a80 0x7f309c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 -- 172.21.15.76:0/4183664557 >> 172.21.15.76:0/4183664557 conn(0x7f309c0fc7a0 msgr2=0x7f309c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 -- 172.21.15.76:0/4183664557 shutdown_connections 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.776+0000 7f30a3b47640 1 -- 172.21.15.76:0/4183664557 wait complete. 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 Processor -- start 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 -- start start 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f309c100a80 0x7f309c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c101420 0x7f309c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 0x7f309c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f309c110fa0 con 0x7f309c106a80 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309c110e20 con 0x7f309c101420 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a3b47640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f309c111120 con 0x7f309c100a80 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 0x7f309c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 0x7f309c19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45446/0 (socket says 172.21.15.76:45446) 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 -- 172.21.15.76:0/1032213976 learned_addr learned my addr 172.21.15.76:0/1032213976 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a18e3640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f309c100a80 0x7f309c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a10e2640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c101420 0x7f309c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 -- 172.21.15.76:0/1032213976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f309c100a80 msgr2=0x7f309c197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f309c100a80 0x7f309c197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 -- 172.21.15.76:0/1032213976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c101420 msgr2=0x7f309c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c101420 0x7f309c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a20e4640 1 -- 172.21.15.76:0/1032213976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c19c3d0 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.777+0000 7f30a10e2640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c101420 0x7f309c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.778+0000 7f30a20e4640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 0x7f309c19bcf0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3094006010 tx=0x7f3094003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.778+0000 7f308effd640 1 -- 172.21.15.76:0/1032213976 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094004040 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.778+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c19c660 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.778+0000 7f308effd640 1 -- 172.21.15.76:0/1032213976 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30940046e0 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.778+0000 7f308effd640 1 -- 172.21.15.76:0/1032213976 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094046480 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.778+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c1a3fa0 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.780+0000 7f308effd640 1 -- 172.21.15.76:0/1032213976 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3094030630 con 0x7f309c106a80 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.780+0000 7f30a5f20740 1 Processor -- start 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 -- start start 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 0x562191f07090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f308effd640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f30880a33b0 0x7f30880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f075d0 0x562191f07a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f14580 0x562191f16970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562191e6d2f0 con 0x562191f08b40 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562191e14cf0 con 0x562191f14580 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a5f20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562191e692b0 con 0x562191f075d0 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a18e3640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f30880a33b0 0x7f30880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 0x562191f07090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f308effd640 1 -- 172.21.15.76:0/1032213976 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f309402e030 con 0x7f309c106a80 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 0x562191f07090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45456/0 (socket says 172.21.15.76:45456) 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 -- 172.21.15.76:0/1745607594 learned_addr learned my addr 172.21.15.76:0/1745607594 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a20e4640 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f14580 0x562191f16970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f075d0 0x562191f07a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 -- 172.21.15.76:0/1745607594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f075d0 msgr2=0x562191f07a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f075d0 0x562191f07a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 -- 172.21.15.76:0/1745607594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f14580 msgr2=0x562191f16970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f14580 0x562191f16970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a10e2640 1 -- 172.21.15.76:0/1745607594 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562191df93a0 con 0x562191f08b40 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.781+0000 7f30a18e3640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f30880a33b0 0x7f30880a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3098005fd0 tx=0x7f309800b510 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.782+0000 7f30a10e2640 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 0x562191f07090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f30900127f0 tx=0x7f309000d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa82bbe0300a4fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.782+0000 7f3087fff640 1 -- 172.21.15.76:0/1745607594 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309000aa60 con 0x562191f08b40 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.782+0000 7f3087fff640 1 -- 172.21.15.76:0/1745607594 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3090012e30 con 0x562191f08b40 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.782+0000 7f3087fff640 1 -- 172.21.15.76:0/1745607594 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309000f3c0 con 0x562191f08b40 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 -- 172.21.15.76:0/1745607594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 msgr2=0x562191f07090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 0x562191f07090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f30900127f0 tx=0x7f309000d3c0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 -- 172.21.15.76:0/1745607594 shutdown_connections 2024-09-19T07:58:20.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f14580 0x562191f16970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f075d0 0x562191f07a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 --2- 172.21.15.76:0/1745607594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f08b40 0x562191f07090 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 -- 172.21.15.76:0/1745607594 >> 172.21.15.76:0/1745607594 conn(0x562191ed0310 msgr2=0x562191f03c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 -- 172.21.15.76:0/1745607594 shutdown_connections 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 -- 172.21.15.76:0/1745607594 wait complete. 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 -- start start 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.783+0000 7f30a5f20740 1 Processor -- start 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f13f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f11810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562191f17280 con 0x562191f075d0 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562191e28060 con 0x562191f08b40 2024-09-19T07:58:20.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562191f17400 con 0x562191f14580 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 10 client.0 _ll_register_callbacks cb 0x562191b7b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f13f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f13f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45458/0 (socket says 172.21.15.76:45458) 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 -- 172.21.15.76:0/3155888159 learned_addr learned my addr 172.21.15.76:0/3155888159 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a10e2640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a20e4640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f11810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 -- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 msgr2=0x562191f11810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f11810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 -- 172.21.15.76:0/3155888159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 msgr2=0x562191f11220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f11220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 -- 172.21.15.76:0/3155888159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562191bde3c0 con 0x562191f075d0 2024-09-19T07:58:20.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a18e3640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f13f70 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f309800ffb0 tx=0x7f30980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed6891432297eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30857fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30857fa640 1 -- 172.21.15.76:0/3155888159 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098022070 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3090012e30 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30857fa640 1 -- 172.21.15.76:0/3155888159 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f309801e860 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30857fa640 1 -- 172.21.15.76:0/3155888159 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f309802e050 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.784+0000 7f30a5f20740 10 client.17175 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562191f22dd0 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30857fa640 1 -- 172.21.15.76:0/3155888159 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3090012e30 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30857fa640 1 -- 172.21.15.76:0/3155888159 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3098010c50 con 0x562191f075d0 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 10 client.17175 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 20 client.17175 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:20.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f241e0 0x562191f265f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 4 client.17175 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562191e7a860 con 0x562191f241e0 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.785+0000 7f30a10e2640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f241e0 0x562191f265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30a10e2640 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f241e0 0x562191f265f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fddc254e88be0c5f server_cookie=6a937d82c7ddc4c9 in_seq=0 out_seq=0 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30857fa640 10 client.17175 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30857fa640 1 -- 172.21.15.76:0/3155888159 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562191e7a860 con 0x562191f241e0 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30857fa640 10 client.17175 handle_command_reply: tid=0 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30a5f20740 1 client.17175 shutdown 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 msgr2=0x562191f13f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.786+0000 7f30a5f20740 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f13f70 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f309800ffb0 tx=0x7f30980046c0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 shutdown_connections 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f11810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f241e0 0x562191f265f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 --2- 172.21.15.76:0/3155888159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f13f70 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30857fa640 0 client.17175 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 >> 172.21.15.76:0/3155888159 conn(0x562191ed0310 msgr2=0x562191f09960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 shutdown_connections 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 1 -- 172.21.15.76:0/3155888159 wait complete. 2024-09-19T07:58:20.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.787+0000 7f30a5f20740 20 client.17175 trim_cache size 0 max 16384 2024-09-19T07:58:20.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 Processor -- start 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 -- start start 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f075d0 0x562191f03e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f08b40 0x562191f20520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 0x562191f2bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1ae210 con 0x562191f14580 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1abae0 con 0x562191f075d0 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a5f20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1a9950 con 0x562191f08b40 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 0x562191f2bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 0x562191f2bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45464/0 (socket says 172.21.15.76:45464) 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 -- 172.21.15.76:0/4039474098 learned_addr learned my addr 172.21.15.76:0/4039474098 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a18e3640 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f075d0 0x562191f03e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 -- 172.21.15.76:0/4039474098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f08b40 msgr2=0x562191f20520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f08b40 0x562191f20520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 -- 172.21.15.76:0/4039474098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f075d0 msgr2=0x562191f03e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f075d0 0x562191f03e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 -- 172.21.15.76:0/4039474098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562191f11b80 con 0x562191f14580 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30a20e4640 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 0x562191f2bf10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f30940bd590 tx=0x7f30940305a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51ca461e2681f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.800+0000 7f30877fe640 1 -- 172.21.15.76:0/4039474098 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30940d03d0 con 0x562191f14580 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30877fe640 1 -- 172.21.15.76:0/4039474098 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3094036070 con 0x562191f14580 2024-09-19T07:58:20.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30877fe640 1 -- 172.21.15.76:0/4039474098 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094086790 con 0x562191f14580 2024-09-19T07:58:20.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 -- 172.21.15.76:0/4039474098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 msgr2=0x562191f2bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 0x562191f2bf10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f30940bd590 tx=0x7f30940305a0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 -- 172.21.15.76:0/4039474098 shutdown_connections 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f14580 0x562191f2bf10 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f08b40 0x562191f20520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 --2- 172.21.15.76:0/4039474098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f075d0 0x562191f03e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 -- 172.21.15.76:0/4039474098 >> 172.21.15.76:0/4039474098 conn(0x562191ed0310 msgr2=0x562191f03700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 -- 172.21.15.76:0/4039474098 shutdown_connections 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 -- 172.21.15.76:0/4039474098 wait complete. 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.801+0000 7f30a5f20740 1 -- start start 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 Processor -- start 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f18a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1a9fa0 con 0x562191f075d0 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1ab410 con 0x562191f08b40 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1aa670 con 0x562191f14580 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a5f20740 10 client.0 _ll_register_callbacks cb 0x7f3098015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f1cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f1cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45474/0 (socket says 172.21.15.76:45474) 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 -- 172.21.15.76:0/686024834 learned_addr learned my addr 172.21.15.76:0/686024834 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a10e2640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 -- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 msgr2=0x562191f18a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f18a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 -- 172.21.15.76:0/686024834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 msgr2=0x562191f182e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f182e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a18e3640 1 -- 172.21.15.76:0/686024834 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562191f8dee0 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.802+0000 7f30a10e2640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a18e3640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f1cfb0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f30980267f0 tx=0x7f3098026820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91958f241d7d2d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30857fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30857fa640 1 -- 172.21.15.76:0/686024834 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098036070 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3094036070 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30857fa640 1 -- 172.21.15.76:0/686024834 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f3098005020 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30857fa640 1 -- 172.21.15.76:0/686024834 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3098041050 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 10 client.17181 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562191f8f0c0 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30857fa640 1 -- 172.21.15.76:0/686024834 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3094036070 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30857fa640 1 -- 172.21.15.76:0/686024834 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3098004cc0 con 0x562191f075d0 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 10 client.17181 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:20.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 20 client.17181 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f8f7e0 0x562191f91bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 4 client.17181 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.803+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562191e74d70 con 0x562191f8f7e0 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a10e2640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f8f7e0 0x562191f91bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30857fa640 10 client.17181 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a10e2640 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f8f7e0 0x562191f91bd0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=900c35ed63227e74 server_cookie=19f54ea908299421 in_seq=0 out_seq=0 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30857fa640 1 -- 172.21.15.76:0/686024834 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562191e74d70 con 0x562191f8f7e0 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30857fa640 10 client.17181 handle_command_reply: tid=0 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 client.17181 shutdown 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 msgr2=0x562191f1cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f1cfb0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f30980267f0 tx=0x7f3098026820 comp rx=0 tx=0).stop 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 shutdown_connections 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562191f14580 0x562191f18a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562191f08b40 0x562191f182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x562191f8f7e0 0x562191f91bd0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 --2- 172.21.15.76:0/686024834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562191f075d0 0x562191f1cfb0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30857fa640 0 client.17181 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 >> 172.21.15.76:0/686024834 conn(0x562191ed0310 msgr2=0x562191f09110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 shutdown_connections 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.804+0000 7f30a5f20740 1 -- 172.21.15.76:0/686024834 wait complete. 2024-09-19T07:58:20.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a5f20740 20 client.17181 trim_cache size 0 max 16384 2024-09-19T07:58:20.812 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:20.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f30880a33b0 msgr2=0x7f30880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f30880a33b0 0x7f30880a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3098005fd0 tx=0x7f309800b510 comp rx=0 tx=0).stop 2024-09-19T07:58:20.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 msgr2=0x7f309c19bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:20.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 0x7f309c19bcf0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3094006010 tx=0x7f3094003f10 comp rx=0 tx=0).stop 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 shutdown_connections 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f30880a33b0 0x7f30880a5870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f309c106a80 0x7f309c19bcf0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c101420 0x7f309c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 --2- 172.21.15.76:0/1032213976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f309c100a80 0x7f309c197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 >> 172.21.15.76:0/1032213976 conn(0x7f309c0fc7a0 msgr2=0x7f309c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 shutdown_connections 2024-09-19T07:58:20.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:20.805+0000 7f30a3b47640 1 -- 172.21.15.76:0/1032213976 wait complete. 2024-09-19T07:58:22.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:21 smithi152 ceph-mon[35117]: pgmap v221: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:22.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:21 smithi137 ceph-mon[35309]: pgmap v221: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:21 smithi076 ceph-mon[30930]: pgmap v221: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:22.514 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:58:22.514 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:58:22.776 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 -- 172.21.15.76:0/3177726790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c100e20 msgr2=0x7f5d6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 --2- 172.21.15.76:0/3177726790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c100e20 0x7f5d6c101200 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009900 tx=0x7f5d6802a480 comp rx=0 tx=0).stop 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 -- 172.21.15.76:0/3177726790 shutdown_connections 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 --2- 172.21.15.76:0/3177726790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 0x7f5d6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 --2- 172.21.15.76:0/3177726790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c102570 0x7f5d6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 --2- 172.21.15.76:0/3177726790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c100e20 0x7f5d6c101200 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 -- 172.21.15.76:0/3177726790 >> 172.21.15.76:0/3177726790 conn(0x7f5d6c0fc7d0 msgr2=0x7f5d6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 -- 172.21.15.76:0/3177726790 shutdown_connections 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 -- 172.21.15.76:0/3177726790 wait complete. 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 Processor -- start 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.251+0000 7f5d741bd640 1 -- start start 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c100e20 0x7f5d6c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 0x7f5d6c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 0x7f5d6c1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1110a0 con 0x7f5d6c102570 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c110f20 con 0x7f5d6c102ef0 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c111220 con 0x7f5d6c100e20 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 0x7f5d6c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 0x7f5d6c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45504/0 (socket says 172.21.15.76:45504) 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 -- 172.21.15.76:0/1586824473 learned_addr learned my addr 172.21.15.76:0/1586824473 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71f59640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c100e20 0x7f5d6c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d7275a640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 0x7f5d6c1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 -- 172.21.15.76:0/1586824473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c100e20 msgr2=0x7f5d6c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c100e20 0x7f5d6c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 -- 172.21.15.76:0/1586824473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 msgr2=0x7f5d6c1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 0x7f5d6c1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 -- 172.21.15.76:0/1586824473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c1a4990 con 0x7f5d6c102570 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d7275a640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 0x7f5d6c1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d71758640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 0x7f5d6c199910 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000c970 tx=0x7f5d6000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d5effd640 1 -- 172.21.15.76:0/1586824473 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60007bb0 con 0x7f5d6c102570 2024-09-19T07:58:23.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6c1a4b60 con 0x7f5d6c102570 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d5effd640 1 -- 172.21.15.76:0/1586824473 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d60007d50 con 0x7f5d6c102570 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.252+0000 7f5d5effd640 1 -- 172.21.15.76:0/1586824473 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6000f4b0 con 0x7f5d6c102570 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.253+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6c1a5070 con 0x7f5d6c102570 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 Processor -- start 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d5effd640 1 -- 172.21.15.76:0/1586824473 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5d600046c0 con 0x7f5d6c102570 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 -- start start 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560d645e3280 con 0x560d6468d150 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560d6458ab10 con 0x560d6467da60 2024-09-19T07:58:23.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.255+0000 7f5d76596740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560d645df240 con 0x560d6467e380 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71f59640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45510/0 (socket says 172.21.15.76:45510) 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 -- 172.21.15.76:0/3245572685 learned_addr learned my addr 172.21.15.76:0/3245572685 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d7275a640 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 -- 172.21.15.76:0/3245572685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 msgr2=0x560d6468cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 -- 172.21.15.76:0/3245572685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 msgr2=0x560d6467de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 -- 172.21.15.76:0/3245572685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d645971f0 con 0x560d6468d150 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71f59640 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d5effd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5d580a33b0 0x7f5d580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d7275a640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5d580a33b0 0x7f5d580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d5effd640 1 -- 172.21.15.76:0/1586824473 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f5d600cf7a0 con 0x7f5d6c102570 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d71758640 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468f540 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5d600ccdd0 tx=0x7f5d600d7690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd308b9b279ce1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.256+0000 7f5d57fff640 1 -- 172.21.15.76:0/3245572685 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6001d070 con 0x560d6468d150 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d57fff640 1 -- 172.21.15.76:0/3245572685 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d6009c0f0 con 0x560d6468d150 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d57fff640 1 -- 172.21.15.76:0/3245572685 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6009b530 con 0x560d6468d150 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 -- 172.21.15.76:0/3245572685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 msgr2=0x560d6468f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d7275a640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5d580a33b0 0x7f5d580a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d64007ef0 tx=0x7f5d640076a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468f540 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f5d600ccdd0 tx=0x7f5d600d7690 comp rx=0 tx=0).stop 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 -- 172.21.15.76:0/3245572685 shutdown_connections 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468f540 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 --2- 172.21.15.76:0/3245572685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.257+0000 7f5d76596740 1 -- 172.21.15.76:0/3245572685 >> 172.21.15.76:0/3245572685 conn(0x560d6467a0f0 msgr2=0x560d6467a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 -- 172.21.15.76:0/3245572685 shutdown_connections 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 -- 172.21.15.76:0/3245572685 wait complete. 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 -- start start 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 Processor -- start 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6468a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560d6468fd80 con 0x560d6468d150 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560d6459df10 con 0x560d6467da60 2024-09-19T07:58:23.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560d6468ff00 con 0x560d6467e380 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.258+0000 7f5d76596740 10 client.0 _ll_register_callbacks cb 0x560d64566a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d71758640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d71f59640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6468a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d71758640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.76:51162/0 (socket says 172.21.15.76:51162) 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45512/0 (socket says 172.21.15.76:45512) 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d71758640 1 -- 172.21.15.76:0/2244475921 learned_addr learned my addr 172.21.15.76:0/2244475921 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d71f59640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6468a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.76:55554/0 (socket says 172.21.15.76:55554) 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 -- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 msgr2=0x560d6468a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 -- 172.21.15.76:0/2244475921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 msgr2=0x560d6468a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6468a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 -- 172.21.15.76:0/2244475921 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d643546a0 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d7275a640 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468aab0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f5d64011ca0 tx=0x7f5d64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d611636eca5f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d557fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d557fa640 1 -- 172.21.15.76:0/2244475921 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6401cd30 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d557fa640 1 -- 172.21.15.76:0/2244475921 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f5d64028480 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d6009c0f0 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d557fa640 1 -- 172.21.15.76:0/2244475921 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d64028680 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d76596740 10 client.17193 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.259+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d6469ba20 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d557fa640 1 -- 172.21.15.76:0/2244475921 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d6009c0f0 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d557fa640 1 -- 172.21.15.76:0/2244475921 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5d6402e030 con 0x560d6468d150 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d76596740 10 client.17193 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d76596740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:23.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d76596740 20 client.17193 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d76596740 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d6469cee0 0x560d6469f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d76596740 4 client.17193 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d645f07f0 con 0x560d6469cee0 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.260+0000 7f5d71f59640 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d6469cee0 0x560d6469f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d71f59640 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d6469cee0 0x560d6469f2d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f098c39f3846b1e3 server_cookie=b0914a6b631747e1 in_seq=0 out_seq=0 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d557fa640 10 client.17193 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d557fa640 1 -- 172.21.15.76:0/2244475921 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d645f07f0 con 0x560d6469cee0 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d557fa640 10 client.17193 handle_command_reply: tid=0 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d76596740 1 client.17193 shutdown 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 msgr2=0x560d6468aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.261+0000 7f5d76596740 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468aab0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f5d64011ca0 tx=0x7f5d64004a40 comp rx=0 tx=0).stop 2024-09-19T07:58:23.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 shutdown_connections 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d6469cee0 0x560d6469f2d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d6468aab0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d6468a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d557fa640 0 client.17193 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 --2- 172.21.15.76:0/2244475921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6468a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 >> 172.21.15.76:0/2244475921 conn(0x560d6467a0f0 msgr2=0x560d6467fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 shutdown_connections 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 1 -- 172.21.15.76:0/2244475921 wait complete. 2024-09-19T07:58:23.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.262+0000 7f5d76596740 20 client.17193 trim_cache size 0 max 16384 2024-09-19T07:58:23.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 Processor -- start 2024-09-19T07:58:23.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 -- start start 2024-09-19T07:58:23.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 0x560d646a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6468d150 0x560d646a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1ae230 con 0x560d6467e380 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1abb00 con 0x560d6467da60 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d76596740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1a9970 con 0x560d6468d150 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d71758640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 0x560d646a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d71758640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 0x560d646a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45528/0 (socket says 172.21.15.76:45528) 2024-09-19T07:58:23.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.279+0000 7f5d71758640 1 -- 172.21.15.76:0/1863424038 learned_addr learned my addr 172.21.15.76:0/1863424038 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:23.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71758640 1 -- 172.21.15.76:0/1863424038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6468d150 msgr2=0x560d646a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71758640 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6468d150 0x560d646a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71758640 1 -- 172.21.15.76:0/1863424038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 msgr2=0x560d6467fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71f59640 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71758640 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71758640 1 -- 172.21.15.76:0/1863424038 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d6469f900 con 0x560d6467e380 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d71758640 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 0x560d646a4b30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5d60099ca0 tx=0x7f5d60005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e652f633092854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d577fe640 1 -- 172.21.15.76:0/1863424038 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6001d040 con 0x560d6467e380 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d577fe640 1 -- 172.21.15.76:0/1863424038 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d600d7e90 con 0x560d6467e380 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.280+0000 7f5d577fe640 1 -- 172.21.15.76:0/1863424038 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6009b350 con 0x560d6467e380 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 -- 172.21.15.76:0/1863424038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 msgr2=0x560d646a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 0x560d646a4b30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5d60099ca0 tx=0x7f5d60005740 comp rx=0 tx=0).stop 2024-09-19T07:58:23.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 -- 172.21.15.76:0/1863424038 shutdown_connections 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6468d150 0x560d646a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6467e380 0x560d646a4b30 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 --2- 172.21.15.76:0/1863424038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d6467fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 -- 172.21.15.76:0/1863424038 >> 172.21.15.76:0/1863424038 conn(0x560d6467a0f0 msgr2=0x560d6467f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 -- 172.21.15.76:0/1863424038 shutdown_connections 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 -- 172.21.15.76:0/1863424038 wait complete. 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 -- start start 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.281+0000 7f5d76596740 1 Processor -- start 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d64691120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d64691660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d64691ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1a9fc0 con 0x560d6468d150 2024-09-19T07:58:23.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1ab430 con 0x560d6467da60 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1aa690 con 0x560d6467e380 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d76596740 10 client.0 _ll_register_callbacks cb 0x7f5d64007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d64691ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d64691ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45540/0 (socket says 172.21.15.76:45540) 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 -- 172.21.15.76:0/2855557513 learned_addr learned my addr 172.21.15.76:0/2855557513 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d71f59640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d64691120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d71758640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d64691660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 -- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 msgr2=0x560d64691660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d64691660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 -- 172.21.15.76:0/2855557513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 msgr2=0x560d64691120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d64691120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.282+0000 7f5d7275a640 1 -- 172.21.15.76:0/2855557513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d64706d50 con 0x560d6468d150 2024-09-19T07:58:23.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d7275a640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d64691ba0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5d64016040 tx=0x7f5d6401d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc5f95e9dd938e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:23.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d557fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:23.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d557fa640 1 -- 172.21.15.76:0/2855557513 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6403d060 con 0x560d6468d150 2024-09-19T07:58:23.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d557fa640 1 -- 172.21.15.76:0/2855557513 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f5d6401cd40 con 0x560d6468d150 2024-09-19T07:58:23.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d600d7e90 con 0x560d6468d150 2024-09-19T07:58:23.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d557fa640 1 -- 172.21.15.76:0/2855557513 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d64044050 con 0x560d6468d150 2024-09-19T07:58:23.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 10 client.17199 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d64708050 con 0x560d6468d150 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d557fa640 1 -- 172.21.15.76:0/2855557513 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d600d7e90 con 0x560d6468d150 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d557fa640 1 -- 172.21.15.76:0/2855557513 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5d6402e050 con 0x560d6468d150 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 10 client.17199 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 20 client.17199 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d64708740 0x560d6470ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 4 client.17199 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.283+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560d645ead00 con 0x560d64708740 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.284+0000 7f5d71f59640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d64708740 0x560d6470ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.284+0000 7f5d557fa640 10 client.17199 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:23.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.284+0000 7f5d71f59640 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d64708740 0x560d6470ab60 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=167c3ab511f3f009 server_cookie=d449d878a721a693 in_seq=0 out_seq=0 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d557fa640 1 -- 172.21.15.76:0/2855557513 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560d645ead00 con 0x560d64708740 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d557fa640 10 client.17199 handle_command_reply: tid=0 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 client.17199 shutdown 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 msgr2=0x560d64691ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d64691ba0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5d64016040 tx=0x7f5d6401d6a0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 shutdown_connections 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560d64708740 0x560d6470ab60 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560d6468d150 0x560d64691ba0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d6467e380 0x560d64691660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 --2- 172.21.15.76:0/2855557513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560d6467da60 0x560d64691120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 >> 172.21.15.76:0/2855557513 conn(0x560d6467a0f0 msgr2=0x560d64679270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d557fa640 0 client.17199 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.285+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 shutdown_connections 2024-09-19T07:58:23.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d76596740 1 -- 172.21.15.76:0/2855557513 wait complete. 2024-09-19T07:58:23.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d76596740 20 client.17199 trim_cache size 0 max 16384 2024-09-19T07:58:23.290 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:23.290 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:58:23.290 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "5dd309ed-5517-40a7-8290-0c7a8698405b", 2024-09-19T07:58:23.290 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:58:23.290 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5d580a33b0 msgr2=0x7f5d580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5d580a33b0 0x7f5d580a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d64007ef0 tx=0x7f5d640076a0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 msgr2=0x7f5d6c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 0x7f5d6c199910 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000c970 tx=0x7f5d6000ce30 comp rx=0 tx=0).stop 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 shutdown_connections 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5d580a33b0 0x7f5d580a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d6c102ef0 0x7f5d6c1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5d6c102570 0x7f5d6c199910 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 --2- 172.21.15.76:0/1586824473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c100e20 0x7f5d6c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:23.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 >> 172.21.15.76:0/1586824473 conn(0x7f5d6c0fc7d0 msgr2=0x7f5d6c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:23.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 shutdown_connections 2024-09-19T07:58:23.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:23.286+0000 7f5d741bd640 1 -- 172.21.15.76:0/1586824473 wait complete. 2024-09-19T07:58:24.112 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:58:24.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:23 smithi076 ceph-mon[30930]: pgmap v222: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:24.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:23 smithi152 ceph-mon[35117]: pgmap v222: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:24.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:23 smithi137 ceph-mon[35309]: pgmap v222: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:58:24.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 -- 172.21.15.76:0/1320311403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c100e20 msgr2=0x7f3f4c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 --2- 172.21.15.76:0/1320311403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c100e20 0x7f3f4c101200 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009900 tx=0x7f3f3c02a480 comp rx=0 tx=0).stop 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 -- 172.21.15.76:0/1320311403 shutdown_connections 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 --2- 172.21.15.76:0/1320311403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 --2- 172.21.15.76:0/1320311403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c102570 0x7f3f4c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 --2- 172.21.15.76:0/1320311403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c100e20 0x7f3f4c101200 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 -- 172.21.15.76:0/1320311403 >> 172.21.15.76:0/1320311403 conn(0x7f3f4c0fc7d0 msgr2=0x7f3f4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 -- 172.21.15.76:0/1320311403 shutdown_connections 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.835+0000 7f3f51232640 1 -- 172.21.15.76:0/1320311403 wait complete. 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 Processor -- start 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 -- start start 2024-09-19T07:58:24.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c100e20 0x7f3f4c197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102570 0x7f3f4c197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1110f0 con 0x7f3f4c102ef0 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c110f70 con 0x7f3f4c100e20 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.836+0000 7f3f51232640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c111270 con 0x7f3f4c102570 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47370/0 (socket says 172.21.15.76:47370) 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 -- 172.21.15.76:0/2660135618 learned_addr learned my addr 172.21.15.76:0/2660135618 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c100e20 0x7f3f4c197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102570 0x7f3f4c197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 -- 172.21.15.76:0/2660135618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102570 msgr2=0x7f3f4c197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102570 0x7f3f4c197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 -- 172.21.15.76:0/2660135618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c100e20 msgr2=0x7f3f4c197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c100e20 0x7f3f4c197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 -- 172.21.15.76:0/2660135618 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c19c400 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102570 0x7f3f4c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c100e20 0x7f3f4c197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f4b59e640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c19bd20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cce0 tx=0x7f3f4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f33fff640 1 -- 172.21.15.76:0/2660135618 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400f450 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c19c6f0 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f33fff640 1 -- 172.21.15.76:0/2660135618 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f4400faf0 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1a3fd0 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.837+0000 7f3f33fff640 1 -- 172.21.15.76:0/2660135618 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44018c60 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f33fff640 1 -- 172.21.15.76:0/2660135618 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3f440213f0 con 0x7f3f4c102ef0 2024-09-19T07:58:24.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 Processor -- start 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 -- start start 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bba9aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c1bb9fe2e0 con 0x55c1bba9afd0 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c1bb9a5ce0 con 0x55c1bbaa5890 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f5360b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c1bb9fa2a0 con 0x55c1bba9a6b0 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f4ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f4ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47376/0 (socket says 172.21.15.76:47376) 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f4ad9d640 1 -- 172.21.15.76:0/1422130249 learned_addr learned my addr 172.21.15.76:0/1422130249 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.840+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bba9aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f33fff640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3f340a33b0 0x7f3f340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4ad9d640 1 -- 172.21.15.76:0/1422130249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 msgr2=0x55c1bba9aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4b59e640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3f340a33b0 0x7f3f340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bba9aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4ad9d640 1 -- 172.21.15.76:0/1422130249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa5890 msgr2=0x55c1bbaa7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4ad9d640 1 -- 172.21.15.76:0/1422130249 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1bb98a440 con 0x55c1bba9afd0 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f33fff640 1 -- 172.21.15.76:0/2660135618 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f3f440d02e0 con 0x7f3f4c102ef0 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa5350 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009900 tx=0x7f3f3c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f7419e000e8282 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:24.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f4b59e640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3f340a33b0 0x7f3f340a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3f440cda50 tx=0x7f3f44013e90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f317fa640 1 -- 172.21.15.76:0/1422130249 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c03f070 con 0x55c1bba9afd0 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f317fa640 1 -- 172.21.15.76:0/1422130249 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f3c005520 con 0x55c1bba9afd0 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.841+0000 7f3f317fa640 1 -- 172.21.15.76:0/1422130249 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c035070 con 0x55c1bba9afd0 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 -- 172.21.15.76:0/1422130249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 msgr2=0x55c1bbaa5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa5350 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009900 tx=0x7f3f3c004170 comp rx=0 tx=0).stop 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 -- 172.21.15.76:0/1422130249 shutdown_connections 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa5350 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1422130249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bba9aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 -- 172.21.15.76:0/1422130249 >> 172.21.15.76:0/1422130249 conn(0x55c1bba96c40 msgr2=0x55c1bba97020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 -- 172.21.15.76:0/1422130249 shutdown_connections 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 -- 172.21.15.76:0/1422130249 wait complete. 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 -- start start 2024-09-19T07:58:24.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.842+0000 7f3f5360b740 1 Processor -- start 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55c1bbaa8460 con 0x55c1bbaa5890 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c1bb9b9050 con 0x55c1bba9a6b0 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c1bbaa85e0 con 0x55c1bba9afd0 2024-09-19T07:58:24.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 10 client.0 _ll_register_callbacks cb 0x55c1bb9f9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47392/0 (socket says 172.21.15.76:47392) 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1047407632 learned_addr learned my addr 172.21.15.76:0/1047407632 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9afd0 msgr2=0x55c1bbaa2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1047407632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bba9a6b0 msgr2=0x55c1bbaa5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1047407632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1bb76f3c0 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa2960 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3f40011fb0 tx=0x7f3f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3f2cfdfc4bbc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f2eff5640 1 -- 172.21.15.76:0/1047407632 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40010430 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f2eff5640 1 -- 172.21.15.76:0/1047407632 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f3f400105d0 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.843+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f3c005520 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f2eff5640 1 -- 172.21.15.76:0/1047407632 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3f40004020 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 10 client.17211 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c1bbab3d40 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f2eff5640 1 -- 172.21.15.76:0/1047407632 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f3c005520 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f2eff5640 1 -- 172.21.15.76:0/1047407632 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3f400035f0 con 0x55c1bbaa5890 2024-09-19T07:58:24.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 10 client.17211 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 10 client.17211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 20 client.17211 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bbab5200 0x55c1bbab75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 4 client.17211 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1bba0b850 con 0x55c1bbab5200 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.844+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bbab5200 0x55c1bbab75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.845+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bbab5200 0x55c1bbab75f0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8484b38c36ea6d server_cookie=22b56ff4e0be696 in_seq=0 out_seq=0 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.845+0000 7f3f2eff5640 10 client.17211 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.845+0000 7f3f2eff5640 1 -- 172.21.15.76:0/1047407632 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1bba0b850 con 0x55c1bbab5200 2024-09-19T07:58:24.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.845+0000 7f3f2eff5640 10 client.17211 handle_command_reply: tid=0 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.845+0000 7f3f5360b740 1 client.17211 shutdown 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 msgr2=0x55c1bbaa2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa2960 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3f40011fb0 tx=0x7f3f400046c0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 shutdown_connections 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bbab5200 0x55c1bbab75f0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bbaa5890 0x55c1bbaa2960 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9afd0 0x55c1bbaa2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f2eff5640 0 client.17211 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:24.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1047407632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 >> 172.21.15.76:0/1047407632 conn(0x55c1bba96c40 msgr2=0x55c1bba93b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 shutdown_connections 2024-09-19T07:58:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 1 -- 172.21.15.76:0/1047407632 wait complete. 2024-09-19T07:58:24.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.846+0000 7f3f5360b740 20 client.17211 trim_cache size 0 max 16384 2024-09-19T07:58:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 Processor -- start 2024-09-19T07:58:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 -- start start 2024-09-19T07:58:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbab16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba96c40 0x55c1bbabcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 0x55c1bbabd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1ae130 con 0x55c1bba9a6b0 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1aba00 con 0x55c1bbaa2ac0 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f5360b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1a9870 con 0x55c1bba96c40 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 0x55c1bbabd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 0x55c1bbabd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47404/0 (socket says 172.21.15.76:47404) 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1579873988 learned_addr learned my addr 172.21.15.76:0/1579873988 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbab16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba96c40 0x55c1bbabcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1579873988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba96c40 msgr2=0x55c1bbabcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba96c40 0x55c1bbabcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1579873988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 msgr2=0x55c1bbab16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbab16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.863+0000 7f3f4a59c640 1 -- 172.21.15.76:0/1579873988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1bbab7960 con 0x55c1bba9a6b0 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 0x55c1bbabd310 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x55c1bbaa2390 tx=0x7f3f4000b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21a11e132b30819 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f30ff9640 1 -- 172.21.15.76:0/1579873988 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4000b770 con 0x55c1bba9a6b0 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f30ff9640 1 -- 172.21.15.76:0/1579873988 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f40005530 con 0x55c1bba9a6b0 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f30ff9640 1 -- 172.21.15.76:0/1579873988 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400041c0 con 0x55c1bba9a6b0 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 -- 172.21.15.76:0/1579873988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 msgr2=0x55c1bbabd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 0x55c1bbabd310 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x55c1bbaa2390 tx=0x7f3f4000b640 comp rx=0 tx=0).stop 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 -- 172.21.15.76:0/1579873988 shutdown_connections 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba9a6b0 0x55c1bbabd310 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba96c40 0x55c1bbabcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 --2- 172.21.15.76:0/1579873988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbab16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 -- 172.21.15.76:0/1579873988 >> 172.21.15.76:0/1579873988 conn(0x55c1bba9de10 msgr2=0x55c1bbaa0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 -- 172.21.15.76:0/1579873988 shutdown_connections 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.864+0000 7f3f5360b740 1 -- 172.21.15.76:0/1579873988 wait complete. 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 -- start start 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 Processor -- start 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 0x55c1bbaae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbaa9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1a9ec0 con 0x55c1bba96c40 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1ab330 con 0x55c1bbaa2ac0 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1aa590 con 0x55c1bba9a6b0 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f5360b740 10 client.0 _ll_register_callbacks cb 0x7f3f4000bb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 0x55c1bbaae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f4a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 0x55c1bbaae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47414/0 (socket says 172.21.15.76:47414) 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f4a59c640 1 -- 172.21.15.76:0/899008629 learned_addr learned my addr 172.21.15.76:0/899008629 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.865+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4a59c640 1 -- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 msgr2=0x55c1bbaa9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4a59c640 1 -- 172.21.15.76:0/899008629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 msgr2=0x55c1bbaa9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbaa9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4a59c640 1 -- 172.21.15.76:0/899008629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1bbb1eda0 con 0x55c1bba96c40 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f4a59c640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 0x55c1bbaae0e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000ec10 tx=0x7f3f40011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d758548475596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f2eff5640 1 -- 172.21.15.76:0/899008629 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400041c0 con 0x55c1bba96c40 2024-09-19T07:58:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f2eff5640 1 -- 172.21.15.76:0/899008629 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f3f40004360 con 0x55c1bba96c40 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f40005530 con 0x55c1bba96c40 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f2eff5640 1 -- 172.21.15.76:0/899008629 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3f4001f430 con 0x55c1bba96c40 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f5360b740 10 client.17217 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c1bbb1ff10 con 0x55c1bba96c40 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f2eff5640 1 -- 172.21.15.76:0/899008629 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f40005530 con 0x55c1bba96c40 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.866+0000 7f3f2eff5640 1 -- 172.21.15.76:0/899008629 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3f4003f030 con 0x55c1bba96c40 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 10 client.17217 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 20 client.17217 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bba9afd0 0x55c1bbb22590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 4 client.17217 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c1bba05d60 con 0x55c1bba9afd0 2024-09-19T07:58:24.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bba9afd0 0x55c1bbb22590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f2eff5640 10 client.17217 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f4ad9d640 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bba9afd0 0x55c1bbb22590 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e05c6810240baeb server_cookie=777886b3b5c6ced3 in_seq=0 out_seq=0 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f2eff5640 1 -- 172.21.15.76:0/899008629 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c1bba05d60 con 0x55c1bba9afd0 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f2eff5640 10 client.17217 handle_command_reply: tid=0 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.867+0000 7f3f5360b740 1 client.17217 shutdown 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 msgr2=0x55c1bbaae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 0x55c1bbaae0e0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000ec10 tx=0x7f3f40011ca0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 shutdown_connections 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c1bbaa2ac0 0x55c1bbaa9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1bba9a6b0 0x55c1bbaa9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55c1bba9afd0 0x55c1bbb22590 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 --2- 172.21.15.76:0/899008629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c1bba96c40 0x55c1bbaae0e0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f2eff5640 0 client.17217 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:24.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 >> 172.21.15.76:0/899008629 conn(0x55c1bba9de10 msgr2=0x55c1bba93b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:24.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 shutdown_connections 2024-09-19T07:58:24.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 1 -- 172.21.15.76:0/899008629 wait complete. 2024-09-19T07:58:24.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f5360b740 20 client.17217 trim_cache size 0 max 16384 2024-09-19T07:58:24.885 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:24.885 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:58:24.886 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:58:24.886 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:24.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3f340a33b0 msgr2=0x7f3f340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3f340a33b0 0x7f3f340a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3f440cda50 tx=0x7f3f44013e90 comp rx=0 tx=0).stop 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 msgr2=0x7f3f4c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c19bd20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cce0 tx=0x7f3f4400a620 comp rx=0 tx=0).stop 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 shutdown_connections 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f3f340a33b0 0x7f3f340a5870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3f4c102ef0 0x7f3f4c19bd20 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f4c102570 0x7f3f4c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 --2- 172.21.15.76:0/2660135618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f4c100e20 0x7f3f4c197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 >> 172.21.15.76:0/2660135618 conn(0x7f3f4c0fc7d0 msgr2=0x7f3f4c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.868+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 shutdown_connections 2024-09-19T07:58:24.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:24.869+0000 7f3f51232640 1 -- 172.21.15.76:0/2660135618 wait complete. 2024-09-19T07:58:25.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:25 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:58:25.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:25 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:25.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:25 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:58:25.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:25 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:25.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:25 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:58:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:25 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:58:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:25 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:25 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:58:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:25 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:25 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:58:25.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:25 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:58:25.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:25 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:25.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:25 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:58:25.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:25 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:25.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:25 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:58:25.698 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:58:25.699 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:58:25.949 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:26.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:26 smithi152 ceph-mon[35117]: pgmap v223: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:58:26.340 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:26 smithi076 ceph-mon[30930]: pgmap v223: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:58:26.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:26 smithi137 ceph-mon[35309]: pgmap v223: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 -- 172.21.15.76:0/3432665767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3910106f50 msgr2=0x7f391010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3432665767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3910106f50 0x7f391010eaf0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3908009cd0 tx=0x7f390802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 -- 172.21.15.76:0/3432665767 shutdown_connections 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3432665767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3910106f50 0x7f391010eaf0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3432665767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 0x7f3910106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3432665767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39101002f0 0x7f39101006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 -- 172.21.15.76:0/3432665767 >> 172.21.15.76:0/3432665767 conn(0x7f3910077210 msgr2=0x7f39100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 -- 172.21.15.76:0/3432665767 shutdown_connections 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.420+0000 7f3915ab3640 1 -- 172.21.15.76:0/3432665767 wait complete. 2024-09-19T07:58:26.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 Processor -- start 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 -- start start 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 0x7f3910101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 0x7f39101017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3910106f50 0x7f3910101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f39101120c0 con 0x7f39101002f0 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3910111f40 con 0x7f3910106f50 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3915ab3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112240 con 0x7f3910100ca0 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 0x7f3910101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 0x7f3910101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47428/0 (socket says 172.21.15.76:47428) 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 -- 172.21.15.76:0/3389546277 learned_addr learned my addr 172.21.15.76:0/3389546277 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390ffff640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3910106f50 0x7f3910101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3907fff640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 0x7f39101017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 -- 172.21.15.76:0/3389546277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 msgr2=0x7f39101017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 0x7f39101017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 -- 172.21.15.76:0/3389546277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3910106f50 msgr2=0x7f3910101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3910106f50 0x7f3910101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f390f7fe640 1 -- 172.21.15.76:0/3389546277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39101a6a80 con 0x7f39101002f0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.421+0000 7f3907fff640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 0x7f39101017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.422+0000 7f390f7fe640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 0x7f3910101270 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f390000d950 tx=0x7f390000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.422+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900017070 con 0x7f39101002f0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.422+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3900009c30 con 0x7f39101002f0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.422+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39101a6d70 con 0x7f39101002f0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.422+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390000f740 con 0x7f39101002f0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.422+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101a7250 con 0x7f39101002f0 2024-09-19T07:58:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.423+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39101006d0 con 0x7f39101002f0 2024-09-19T07:58:26.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.424+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3900010a80 con 0x7f39101002f0 2024-09-19T07:58:26.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.425+0000 7f390d7fa640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38f00a33b0 0x7f38f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:26.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.425+0000 7f3907fff640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38f00a33b0 0x7f38f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:26.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.425+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f39000cfe20 con 0x7f39101002f0 2024-09-19T07:58:26.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.425+0000 7f3907fff640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38f00a33b0 0x7f38f00a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f38f8005fd0 tx=0x7f38f8005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:26.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.429+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3900009de0 con 0x7f39101002f0 2024-09-19T07:58:26.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.641+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3910109b90 con 0x7f39101002f0 2024-09-19T07:58:26.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.642+0000 7f390d7fa640 1 -- 172.21.15.76:0/3389546277 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f390009c770 con 0x7f39101002f0 2024-09-19T07:58:26.642 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:58:26.643 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:58:26.643 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T07:58:26.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38f00a33b0 msgr2=0x7f38f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38f00a33b0 0x7f38f00a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f38f8005fd0 tx=0x7f38f8005850 comp rx=0 tx=0).stop 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 msgr2=0x7f3910101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 0x7f3910101270 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f390000d950 tx=0x7f390000de10 comp rx=0 tx=0).stop 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 shutdown_connections 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f38f00a33b0 0x7f38f00a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3910106f50 0x7f3910101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3910100ca0 0x7f39101017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 --2- 172.21.15.76:0/3389546277 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f39101002f0 0x7f3910101270 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.645+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 >> 172.21.15.76:0/3389546277 conn(0x7f3910077210 msgr2=0x7f3910105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.646+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 shutdown_connections 2024-09-19T07:58:26.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:26.646+0000 7f3915ab3640 1 -- 172.21.15.76:0/3389546277 wait complete. 2024-09-19T07:58:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:27 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:58:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:27 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:58:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:27 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:58:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:27 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:58:27.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:27 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3389546277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:27.363 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:27 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:58:27.363 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:27 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:58:27.363 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:27 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:58:27.363 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:27 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:58:27.364 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:27 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3389546277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:27.392 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:58:27.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:27 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:58:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:27 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:58:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:27 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:58:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:27 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:58:27.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:27 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3389546277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:27.641 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 -- 172.21.15.76:0/2081891334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918106a80 msgr2=0x7fc918106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 --2- 172.21.15.76:0/2081891334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918106a80 0x7fc918106e60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc910009930 tx=0x7fc91002a420 comp rx=0 tx=0).stop 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 -- 172.21.15.76:0/2081891334 shutdown_connections 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 --2- 172.21.15.76:0/2081891334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918101420 0x7fc91810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 --2- 172.21.15.76:0/2081891334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918100a80 0x7fc918100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 --2- 172.21.15.76:0/2081891334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918106a80 0x7fc918106e60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 -- 172.21.15.76:0/2081891334 >> 172.21.15.76:0/2081891334 conn(0x7fc9180fc7a0 msgr2=0x7fc9180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:28.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 -- 172.21.15.76:0/2081891334 shutdown_connections 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.091+0000 7fc91f71a640 1 -- 172.21.15.76:0/2081891334 wait complete. 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 Processor -- start 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 -- start start 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918100a80 0x7fc9181985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 0x7fc918198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918106a80 0x7fc91819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc918110fa0 con 0x7fc918101420 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc918110e20 con 0x7fc918100a80 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91f71a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc918111120 con 0x7fc918106a80 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 0x7fc918198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 0x7fc918198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47454/0 (socket says 172.21.15.76:47454) 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 -- 172.21.15.76:0/4107879119 learned_addr learned my addr 172.21.15.76:0/4107879119 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:28.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918100a80 0x7fc9181985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918106a80 0x7fc91819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 -- 172.21.15.76:0/4107879119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918106a80 msgr2=0x7fc91819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918106a80 0x7fc91819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 -- 172.21.15.76:0/4107879119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918100a80 msgr2=0x7fc9181985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918100a80 0x7fc9181985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91ccb5640 1 -- 172.21.15.76:0/4107879119 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91819d550 con 0x7fc918101420 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918100a80 0x7fc9181985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.092+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918106a80 0x7fc91819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.093+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 0x7fc918198ae0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00ea80 tx=0x7fc90c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.093+0000 7fc9167fc640 1 -- 172.21.15.76:0/4107879119 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00ce40 con 0x7fc918101420 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.093+0000 7fc9167fc640 1 -- 172.21.15.76:0/4107879119 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc90c004b20 con 0x7fc918101420 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.093+0000 7fc9167fc640 1 -- 172.21.15.76:0/4107879119 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011830 con 0x7fc918101420 2024-09-19T07:58:28.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.093+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91819d840 con 0x7fc918101420 2024-09-19T07:58:28.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.093+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9181a5120 con 0x7fc918101420 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.095+0000 7fc9167fc640 1 -- 172.21.15.76:0/4107879119 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc90c0119d0 con 0x7fc918101420 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.095+0000 7fc921af3740 1 Processor -- start 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 -- start start 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6ceaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cfbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5638d6c502f0 con 0x5638d6cea5d0 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5638d6bf7cf0 con 0x5638d6cebb40 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc921af3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5638d6c4c2b0 con 0x5638d6cf9780 2024-09-19T07:58:28.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc9167fc640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc9000a33b0 0x7fc9000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6ceaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6ceaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47466/0 (socket says 172.21.15.76:47466) 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 -- 172.21.15.76:0/3067442769 learned_addr learned my addr 172.21.15.76:0/3067442769 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc9000a33b0 0x7fc9000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc9167fc640 1 -- 172.21.15.76:0/4107879119 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fc90c0d04c0 con 0x7fc918101420 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cfbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 -- 172.21.15.76:0/3067442769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 msgr2=0x5638d6cfbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cfbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 -- 172.21.15.76:0/3067442769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 msgr2=0x5638d6cea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.096+0000 7fc91d4b6640 1 -- 172.21.15.76:0/3067442769 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d6bdc3a0 con 0x5638d6cea5d0 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.097+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc9000a33b0 0x7fc9000a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc908005d50 tx=0x7fc90800ba00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:28.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.097+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6ceaa10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc910009930 tx=0x7fc910032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51614d66d0bd6ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.097+0000 7fc8ff7fe640 1 -- 172.21.15.76:0/3067442769 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91003f070 con 0x5638d6cea5d0 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.097+0000 7fc8ff7fe640 1 -- 172.21.15.76:0/3067442769 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc910031840 con 0x5638d6cea5d0 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.097+0000 7fc8ff7fe640 1 -- 172.21.15.76:0/3067442769 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910035070 con 0x5638d6cea5d0 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- 172.21.15.76:0/3067442769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 msgr2=0x5638d6ceaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6ceaa10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc910009930 tx=0x7fc910032d30 comp rx=0 tx=0).stop 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- 172.21.15.76:0/3067442769 shutdown_connections 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cfbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6ceaa10 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- 172.21.15.76:0/3067442769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- 172.21.15.76:0/3067442769 >> 172.21.15.76:0/3067442769 conn(0x5638d6cb3310 msgr2=0x5638d6ce6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- 172.21.15.76:0/3067442769 shutdown_connections 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- 172.21.15.76:0/3067442769 wait complete. 2024-09-19T07:58:28.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- start start 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 Processor -- start 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6cf9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cf6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cf69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5638d6cfc420 con 0x5638d6cea5d0 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5638d6c0b060 con 0x5638d6cebb40 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.098+0000 7fc921af3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5638d6cfc5a0 con 0x5638d6cf9780 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc921af3740 10 client.0 _ll_register_callbacks cb 0x5638d695e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6cf9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6cf9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47474/0 (socket says 172.21.15.76:47474) 2024-09-19T07:58:28.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 -- 172.21.15.76:0/968493763 learned_addr learned my addr 172.21.15.76:0/968493763 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cf6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cf69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 -- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 msgr2=0x5638d6cf69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cf69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 -- 172.21.15.76:0/968493763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 msgr2=0x5638d6cf6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cf6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 -- 172.21.15.76:0/968493763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d69c13c0 con 0x5638d6cea5d0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6cf9150 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc91002a940 tx=0x7fc9100058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66f7d9aa9831612 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc8fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc8fcff9640 1 -- 172.21.15.76:0/968493763 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91004a020 con 0x5638d6cea5d0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc8fcff9640 1 -- 172.21.15.76:0/968493763 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fc9100035f0 con 0x5638d6cea5d0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc910031840 con 0x5638d6cea5d0 2024-09-19T07:58:28.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc8fcff9640 1 -- 172.21.15.76:0/968493763 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc910055050 con 0x5638d6cea5d0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc921af3740 10 client.17235 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.099+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5638d6d07e90 con 0x5638d6cea5d0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc8fcff9640 1 -- 172.21.15.76:0/968493763 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc910031840 con 0x5638d6cea5d0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc8fcff9640 1 -- 172.21.15.76:0/968493763 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc9100048d0 con 0x5638d6cea5d0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc921af3740 10 client.17235 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc921af3740 10 client.17235 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc921af3740 20 client.17235 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc921af3740 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d091e0 0x5638d6d0b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc921af3740 4 client.17235 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d6c5d860 con 0x5638d6d091e0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.100+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d091e0 0x5638d6d0b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d091e0 0x5638d6d0b5d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2a8373698e38d4a server_cookie=408110fa31001f07 in_seq=0 out_seq=0 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc8fcff9640 10 client.17235 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:28.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc8fcff9640 1 -- 172.21.15.76:0/968493763 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638d6c5d860 con 0x5638d6d091e0 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc8fcff9640 10 client.17235 handle_command_reply: tid=0 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc921af3740 1 client.17235 shutdown 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 msgr2=0x5638d6cf9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc921af3740 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6cf9150 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc91002a940 tx=0x7fc9100058b0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 shutdown_connections 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.101+0000 7fc921af3740 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d091e0 0x5638d6d0b5d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cf9780 0x5638d6cf69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6cf6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 1 --2- 172.21.15.76:0/968493763 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cea5d0 0x5638d6cf9150 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 >> 172.21.15.76:0/968493763 conn(0x5638d6cb3310 msgr2=0x5638d6cec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc8fcff9640 0 client.17235 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 shutdown_connections 2024-09-19T07:58:28.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 1 -- 172.21.15.76:0/968493763 wait complete. 2024-09-19T07:58:28.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.102+0000 7fc921af3740 20 client.17235 trim_cache size 0 max 16384 2024-09-19T07:58:28.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.114+0000 7fc921af3740 1 Processor -- start 2024-09-19T07:58:28.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.114+0000 7fc921af3740 1 -- start start 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc921af3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cea5d0 0x5638d6d056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc921af3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cebb40 0x5638d6cf52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc921af3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6d10b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc921af3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181ae220 con 0x5638d6cf9780 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc921af3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181abaf0 con 0x5638d6cea5d0 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc921af3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181a9960 con 0x5638d6cebb40 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6d10b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6d10b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47486/0 (socket says 172.21.15.76:47486) 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 -- 172.21.15.76:0/3272414204 learned_addr learned my addr 172.21.15.76:0/3272414204 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cea5d0 0x5638d6d056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 -- 172.21.15.76:0/3272414204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cebb40 msgr2=0x5638d6cf52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cebb40 0x5638d6cf52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 -- 172.21.15.76:0/3272414204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cea5d0 msgr2=0x5638d6d056c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cea5d0 0x5638d6d056c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 -- 172.21.15.76:0/3272414204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d6ce7960 con 0x5638d6cf9780 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6d10b70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc90800be40 tx=0x7fc908004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80574dba4604f4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc8feffd640 1 -- 172.21.15.76:0/3272414204 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908024070 con 0x5638d6cf9780 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc8feffd640 1 -- 172.21.15.76:0/3272414204 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9080132b0 con 0x5638d6cf9780 2024-09-19T07:58:28.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.115+0000 7fc8feffd640 1 -- 172.21.15.76:0/3272414204 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908003a80 con 0x5638d6cf9780 2024-09-19T07:58:28.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 -- 172.21.15.76:0/3272414204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 msgr2=0x5638d6d10b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6d10b70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc90800be40 tx=0x7fc908004730 comp rx=0 tx=0).stop 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 -- 172.21.15.76:0/3272414204 shutdown_connections 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6d10b70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cebb40 0x5638d6cf52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 --2- 172.21.15.76:0/3272414204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cea5d0 0x5638d6d056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 -- 172.21.15.76:0/3272414204 >> 172.21.15.76:0/3272414204 conn(0x5638d6cb3310 msgr2=0x5638d6cf4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 -- 172.21.15.76:0/3272414204 shutdown_connections 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 -- 172.21.15.76:0/3272414204 wait complete. 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.116+0000 7fc921af3740 1 -- start start 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 Processor -- start 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cea5d0 0x5638d6d01be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6d02120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6cf3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181a9fb0 con 0x5638d6cf9780 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181ab420 con 0x5638d6cebb40 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181aa680 con 0x5638d6cea5d0 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc921af3740 10 client.0 _ll_register_callbacks cb 0x7fc90800bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6cf3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6cf3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47494/0 (socket says 172.21.15.76:47494) 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 -- 172.21.15.76:0/1936513417 learned_addr learned my addr 172.21.15.76:0/1936513417 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cea5d0 0x5638d6d01be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6d02120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 -- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cea5d0 msgr2=0x5638d6d01be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cea5d0 0x5638d6d01be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 -- 172.21.15.76:0/1936513417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 msgr2=0x5638d6d02120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:28.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6d02120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91dcb7640 1 -- 172.21.15.76:0/1936513417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d6cf3870 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.117+0000 7fc91ccb5640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6d02120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc91dcb7640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6cf3040 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc908011810 tx=0x7fc908020660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fe99ef8661d91e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc8fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc8fcff9640 1 -- 172.21.15.76:0/1936513417 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908024040 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc8fcff9640 1 -- 172.21.15.76:0/1936513417 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fc908020a60 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9080132b0 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc8fcff9640 1 -- 172.21.15.76:0/1936513417 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc908020c80 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 10 client.17241 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5638d6d73830 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc8fcff9640 1 -- 172.21.15.76:0/1936513417 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9080132b0 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc8fcff9640 1 -- 172.21.15.76:0/1936513417 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc90803a030 con 0x5638d6cf9780 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 10 client.17241 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:28.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 10 client.17241 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 20 client.17241 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d73ed0 0x5638d6d762f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 4 client.17241 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.118+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5638d6c57d70 con 0x5638d6d73ed0 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d73ed0 0x5638d6d762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc8fcff9640 10 client.17241 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc91d4b6640 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d73ed0 0x5638d6d762f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6f7ebb0414941fc server_cookie=f9b211f2ccac5b81 in_seq=0 out_seq=0 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc8fcff9640 1 -- 172.21.15.76:0/1936513417 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638d6c57d70 con 0x5638d6d73ed0 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc8fcff9640 10 client.17241 handle_command_reply: tid=0 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc921af3740 1 client.17241 shutdown 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 msgr2=0x5638d6cf3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc921af3740 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6cf3040 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc908011810 tx=0x7fc908020660 comp rx=0 tx=0).stop 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 shutdown_connections 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.119+0000 7fc921af3740 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5638d6d73ed0 0x5638d6d762f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638d6cf9780 0x5638d6cf3040 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d6cebb40 0x5638d6d02120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 1 --2- 172.21.15.76:0/1936513417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5638d6cea5d0 0x5638d6d01be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 >> 172.21.15.76:0/1936513417 conn(0x5638d6cb3310 msgr2=0x5638d6cf53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc8fcff9640 0 client.17241 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 shutdown_connections 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 1 -- 172.21.15.76:0/1936513417 wait complete. 2024-09-19T07:58:28.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc921af3740 20 client.17241 trim_cache size 0 max 16384 2024-09-19T07:58:28.126 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:28.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc9000a33b0 msgr2=0x7fc9000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc9000a33b0 0x7fc9000a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc908005d50 tx=0x7fc90800ba00 comp rx=0 tx=0).stop 2024-09-19T07:58:28.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 msgr2=0x7fc918198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:28.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 0x7fc918198ae0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00ea80 tx=0x7fc90c00ef40 comp rx=0 tx=0).stop 2024-09-19T07:58:28.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 shutdown_connections 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc9000a33b0 0x7fc9000a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc918106a80 0x7fc91819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc918101420 0x7fc918198ae0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 --2- 172.21.15.76:0/4107879119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc918100a80 0x7fc9181985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.120+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 >> 172.21.15.76:0/4107879119 conn(0x7fc9180fc7a0 msgr2=0x7fc91806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.121+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 shutdown_connections 2024-09-19T07:58:28.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:28.121+0000 7fc91f71a640 1 -- 172.21.15.76:0/4107879119 wait complete. 2024-09-19T07:58:28.839 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:58:28.862 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:28 smithi076 ceph-mon[30930]: pgmap v224: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:58:28.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:28 smithi137 ceph-mon[35309]: pgmap v224: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:58:29.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:28 smithi152 ceph-mon[35117]: pgmap v224: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:58:29.086 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:29.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 -- 172.21.15.76:0/1871651041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c100e20 msgr2=0x7f1f7c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 --2- 172.21.15.76:0/1871651041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c100e20 0x7f1f7c101200 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009900 tx=0x7f1f6c02a480 comp rx=0 tx=0).stop 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 -- 172.21.15.76:0/1871651041 shutdown_connections 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 --2- 172.21.15.76:0/1871651041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 0x7f1f7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 --2- 172.21.15.76:0/1871651041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f7c102570 0x7f1f7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 --2- 172.21.15.76:0/1871651041 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c100e20 0x7f1f7c101200 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 -- 172.21.15.76:0/1871651041 >> 172.21.15.76:0/1871651041 conn(0x7f1f7c0fc7d0 msgr2=0x7f1f7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 -- 172.21.15.76:0/1871651041 shutdown_connections 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 -- 172.21.15.76:0/1871651041 wait complete. 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 Processor -- start 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.580+0000 7f1f818c6640 1 -- start start 2024-09-19T07:58:29.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f818c6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f7c100e20 0x7f1f7c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f818c6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 0x7f1f7c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f818c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 0x7f1f7c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f818c6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1110e0 con 0x7f1f7c102570 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f818c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c110f60 con 0x7f1f7c102ef0 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f818c6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c111260 con 0x7f1f7c100e20 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 0x7f1f7c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 0x7f1f7c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47516/0 (socket says 172.21.15.76:47516) 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 -- 172.21.15.76:0/104378780 learned_addr learned my addr 172.21.15.76:0/104378780 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 0x7f1f7c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f7affd640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f7c100e20 0x7f1f7c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 -- 172.21.15.76:0/104378780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f7c100e20 msgr2=0x7f1f7c197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f7c100e20 0x7f1f7c197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 -- 172.21.15.76:0/104378780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 msgr2=0x7f1f7c19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 0x7f1f7c19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 -- 172.21.15.76:0/104378780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c19c4f0 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 0x7f1f7c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f727fc640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 0x7f1f7c197a80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400b4a0 tx=0x7f1f6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.581+0000 7f1f808c4640 1 -- 172.21.15.76:0/104378780 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64014070 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.582+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c19c7e0 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.582+0000 7f1f808c4640 1 -- 172.21.15.76:0/104378780 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f64010b10 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.582+0000 7f1f808c4640 1 -- 172.21.15.76:0/104378780 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64017d60 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.582+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c1a40c0 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.584+0000 7f1f808c4640 1 -- 172.21.15.76:0/104378780 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1f64017070 con 0x7f1f7c102570 2024-09-19T07:58:29.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.584+0000 7f1f83c9f740 1 Processor -- start 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.584+0000 7f1f83c9f740 1 -- start start 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.584+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b4157090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.584+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.584+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b4166970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b4157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b4157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47532/0 (socket says 172.21.15.76:47532) 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 -- 172.21.15.76:0/410257792 learned_addr learned my addr 172.21.15.76:0/410257792 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5583b40bd2f0 con 0x5583b4158b40 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583b4064cf0 con 0x5583b41575d0 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583b40b92b0 con 0x5583b4164580 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f727fc640 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b4166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7affd640 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 -- 172.21.15.76:0/410257792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 msgr2=0x5583b4166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b4166970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 -- 172.21.15.76:0/410257792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 msgr2=0x5583b4157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 -- 172.21.15.76:0/410257792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b40493a0 con 0x5583b4158b40 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.585+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b4157090 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009fb0 tx=0x7f1f74010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b756adb05a058b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f71ffb640 1 -- 172.21.15.76:0/410257792 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74016070 con 0x5583b4158b40 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f71ffb640 1 -- 172.21.15.76:0/410257792 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f74012c10 con 0x5583b4158b40 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f71ffb640 1 -- 172.21.15.76:0/410257792 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74011cd0 con 0x5583b4158b40 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f808c4640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f680a33b0 0x7f1f680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f7affd640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f680a33b0 0x7f1f680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f808c4640 1 -- 172.21.15.76:0/104378780 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f1f640cf160 con 0x7f1f7c102570 2024-09-19T07:58:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 msgr2=0x5583b4157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.586+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b4157090 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009fb0 tx=0x7f1f74010800 comp rx=0 tx=0).stop 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f7affd640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f680a33b0 0x7f1f680a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5583b4154ac0 tx=0x7f1f6c0058b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 shutdown_connections 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b4166970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/410257792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b4157090 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 >> 172.21.15.76:0/410257792 conn(0x5583b4120310 msgr2=0x5583b4153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 shutdown_connections 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- 172.21.15.76:0/410257792 wait complete. 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- start start 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 Processor -- start 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b4163f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4158b40 0x5583b4161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4164580 0x5583b41618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5583b4167280 con 0x5583b41575d0 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583b4078060 con 0x5583b4164580 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.587+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583b4167400 con 0x5583b4158b40 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f83c9f740 10 client.0 _ll_register_callbacks cb 0x5583b3dcb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b4163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b4163f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47546/0 (socket says 172.21.15.76:47546) 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 -- 172.21.15.76:0/3017476240 learned_addr learned my addr 172.21.15.76:0/3017476240 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4164580 0x5583b41618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4158b40 0x5583b4161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 -- 172.21.15.76:0/3017476240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4158b40 msgr2=0x5583b4161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4158b40 0x5583b4161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 -- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4164580 msgr2=0x5583b41618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4164580 0x5583b41618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 -- 172.21.15.76:0/3017476240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b3e2e3c0 con 0x5583b41575d0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4164580 0x5583b41618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4158b40 0x5583b4161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f7affd640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b4163f40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c033000 tx=0x7f1f6c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75805373a1cdfaa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f5affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f5affd640 1 -- 172.21.15.76:0/3017476240 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c04d070 con 0x5583b41575d0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f5affd640 1 -- 172.21.15.76:0/3017476240 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f1f6c0046c0 con 0x5583b41575d0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f74012c10 con 0x5583b41575d0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.588+0000 7f1f5affd640 1 -- 172.21.15.76:0/3017476240 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1f6c059050 con 0x5583b41575d0 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 10 client.17253 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5583b4172d20 con 0x5583b41575d0 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f5affd640 1 -- 172.21.15.76:0/3017476240 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f74012c10 con 0x5583b41575d0 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f5affd640 1 -- 172.21.15.76:0/3017476240 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1f6c003c70 con 0x5583b41575d0 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 10 client.17253 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 10 client.17253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 20 client.17253 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b4174180 0x5583b41765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 4 client.17253 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583b40ca860 con 0x5583b4174180 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.589+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b4174180 0x5583b41765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b4174180 0x5583b41765b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d44e195755a7e74 server_cookie=972646d747532761 in_seq=0 out_seq=0 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f5affd640 10 client.17253 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f5affd640 1 -- 172.21.15.76:0/3017476240 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583b40ca860 con 0x5583b4174180 2024-09-19T07:58:29.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f5affd640 10 client.17253 handle_command_reply: tid=0 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f83c9f740 1 client.17253 shutdown 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 msgr2=0x5583b4163f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.590+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b4163f40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c033000 tx=0x7f1f6c009260 comp rx=0 tx=0).stop 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 shutdown_connections 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b4174180 0x5583b41765b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4164580 0x5583b41618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4158b40 0x5583b4161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3017476240 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b4163f40 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 >> 172.21.15.76:0/3017476240 conn(0x5583b4120310 msgr2=0x5583b4159960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f5affd640 0 client.17253 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 shutdown_connections 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3017476240 wait complete. 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.591+0000 7f1f83c9f740 20 client.17253 trim_cache size 0 max 16384 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.603+0000 7f1f83c9f740 1 Processor -- start 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 -- start start 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4170520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b417be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b417c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1ae1a0 con 0x5583b4158b40 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1aba70 con 0x5583b41575d0 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1a98e0 con 0x5583b4164580 2024-09-19T07:58:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b417be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b417be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47562/0 (socket says 172.21.15.76:47562) 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 -- 172.21.15.76:0/969314543 learned_addr learned my addr 172.21.15.76:0/969314543 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f7affd640 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4170520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b417c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 -- 172.21.15.76:0/969314543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 msgr2=0x5583b417c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b417c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 -- 172.21.15.76:0/969314543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 msgr2=0x5583b4170520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4170520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 -- 172.21.15.76:0/969314543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b4153ed0 con 0x5583b4158b40 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b417c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:29.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.604+0000 7f1f727fc640 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b417be80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1f640cc990 tx=0x7f1f640d2cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae9756a9e94d0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.606+0000 7f1f717fa640 1 -- 172.21.15.76:0/969314543 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6401e040 con 0x5583b4158b40 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.606+0000 7f1f717fa640 1 -- 172.21.15.76:0/969314543 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f6409bbc0 con 0x5583b4158b40 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.606+0000 7f1f717fa640 1 -- 172.21.15.76:0/969314543 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f640a4130 con 0x5583b4158b40 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 -- 172.21.15.76:0/969314543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 msgr2=0x5583b417be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b417be80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1f640cc990 tx=0x7f1f640d2cb0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 -- 172.21.15.76:0/969314543 shutdown_connections 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b417c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b4158b40 0x5583b417be80 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/969314543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b41575d0 0x5583b4170520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 -- 172.21.15.76:0/969314543 >> 172.21.15.76:0/969314543 conn(0x5583b4120310 msgr2=0x5583b4160330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 -- 172.21.15.76:0/969314543 shutdown_connections 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 -- 172.21.15.76:0/969314543 wait complete. 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.607+0000 7f1f83c9f740 1 -- start start 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 Processor -- start 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4158b40 0x5583b415b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b416b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1a9f30 con 0x5583b41575d0 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1ab3a0 con 0x5583b4158b40 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1aa600 con 0x5583b4164580 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f83c9f740 10 client.0 _ll_register_callbacks cb 0x7f1f6c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:29.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47576/0 (socket says 172.21.15.76:47576) 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 -- 172.21.15.76:0/3804049301 learned_addr learned my addr 172.21.15.76:0/3804049301 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b416b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4158b40 0x5583b415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 -- 172.21.15.76:0/3804049301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 msgr2=0x5583b416b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b416b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 -- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4158b40 msgr2=0x5583b415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4158b40 0x5583b415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7affd640 1 -- 172.21.15.76:0/3804049301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b416bd30 con 0x5583b41575d0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f7b7fe640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b416b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.608+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4158b40 0x5583b415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f7affd640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b415acd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c049690 tx=0x7f1f6c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503a3835fb993a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f5affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f5affd640 1 -- 172.21.15.76:0/3804049301 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c061070 con 0x5583b41575d0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f5affd640 1 -- 172.21.15.76:0/3804049301 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f1f6c004ad0 con 0x5583b41575d0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f6409bbc0 con 0x5583b41575d0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f5affd640 1 -- 172.21.15.76:0/3804049301 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1f6c04d040 con 0x5583b41575d0 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 10 client.17259 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:29.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5583b416d010 con 0x5583b41575d0 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f5affd640 1 -- 172.21.15.76:0/3804049301 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f6409bbc0 con 0x5583b41575d0 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f5affd640 1 -- 172.21.15.76:0/3804049301 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1f6c06b030 con 0x5583b41575d0 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 10 client.17259 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 10 client.17259 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 20 client.17259 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b41e14d0 0x5583b41e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 4 client.17259 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.609+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583b40c4d70 con 0x5583b41e14d0 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b41e14d0 0x5583b41e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f727fc640 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b41e14d0 0x5583b41e38f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f6d239586c20ac65 server_cookie=6a8893312ece54af in_seq=0 out_seq=0 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f5affd640 10 client.17259 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f5affd640 1 -- 172.21.15.76:0/3804049301 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583b40c4d70 con 0x5583b41e14d0 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f5affd640 10 client.17259 handle_command_reply: tid=0 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 client.17259 shutdown 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 msgr2=0x5583b415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b415acd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c049690 tx=0x7f1f6c0042c0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.633 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 shutdown_connections 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5583b41e14d0 0x5583b41e38f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583b4164580 0x5583b416b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5583b4158b40 0x5583b415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f5affd640 0 client.17259 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 --2- 172.21.15.76:0/3804049301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583b41575d0 0x5583b415acd0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 >> 172.21.15.76:0/3804049301 conn(0x5583b4120310 msgr2=0x5583b4152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.610+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 shutdown_connections 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f83c9f740 1 -- 172.21.15.76:0/3804049301 wait complete. 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f83c9f740 20 client.17259 trim_cache size 0 max 16384 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f680a33b0 msgr2=0x7f1f680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f680a33b0 0x7f1f680a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5583b4154ac0 tx=0x7f1f6c0058b0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 msgr2=0x7f1f7c197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 0x7f1f7c197a80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400b4a0 tx=0x7f1f6400b960 comp rx=0 tx=0).stop 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 shutdown_connections 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1f680a33b0 0x7f1f680a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f7c102ef0 0x7f1f7c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1f7c102570 0x7f1f7c197a80 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 --2- 172.21.15.76:0/104378780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f7c100e20 0x7f1f7c197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 >> 172.21.15.76:0/104378780 conn(0x7f1f7c0fc7d0 msgr2=0x7f1f7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 shutdown_connections 2024-09-19T07:58:29.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:29.611+0000 7f1f818c6640 1 -- 172.21.15.76:0/104378780 wait complete. 2024-09-19T07:58:30.450 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:58:30.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:30 smithi076 ceph-mon[30930]: pgmap v225: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:58:30.738 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:30.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:30 smithi137 ceph-mon[35309]: pgmap v225: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:58:31.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:30 smithi152 ceph-mon[35117]: pgmap v225: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:58:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 -- 172.21.15.76:0/3688687652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0106f10 msgr2=0x7f91a010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 --2- 172.21.15.76:0/3688687652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0106f10 0x7f91a010ea90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f9198009ca0 tx=0x7f919802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 -- 172.21.15.76:0/3688687652 shutdown_connections 2024-09-19T07:58:31.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 --2- 172.21.15.76:0/3688687652 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0106f10 0x7f91a010ea90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 --2- 172.21.15.76:0/3688687652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0102790 0x7f91a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 --2- 172.21.15.76:0/3688687652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0101de0 0x7f91a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 -- 172.21.15.76:0/3688687652 >> 172.21.15.76:0/3688687652 conn(0x7f91a00fd8c0 msgr2=0x7f91a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 -- 172.21.15.76:0/3688687652 shutdown_connections 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.258+0000 7f91a85bc640 1 -- 172.21.15.76:0/3688687652 wait complete. 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 Processor -- start 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 -- start start 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 0x7f91a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0102790 0x7f91a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0106f10 0x7f91a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01120d0 con 0x7f91a0101de0 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0111f50 con 0x7f91a0106f10 2024-09-19T07:58:31.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a85bc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0112250 con 0x7f91a0102790 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 0x7f91a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 0x7f91a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47586/0 (socket says 172.21.15.76:47586) 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 -- 172.21.15.76:0/928187037 learned_addr learned my addr 172.21.15.76:0/928187037 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a5b57640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0102790 0x7f91a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 -- 172.21.15.76:0/928187037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0102790 msgr2=0x7f91a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0102790 0x7f91a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 -- 172.21.15.76:0/928187037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0106f10 msgr2=0x7f91a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6b59640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0106f10 0x7f91a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0106f10 0x7f91a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 -- 172.21.15.76:0/928187037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a01a69d0 con 0x7f91a0101de0 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a5b57640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0102790 0x7f91a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:31.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6b59640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0106f10 0x7f91a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.259+0000 7f91a6358640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 0x7f91a00744f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f919c00b4a0 tx=0x7f919c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.260+0000 7f91937fe640 1 -- 172.21.15.76:0/928187037 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c014070 con 0x7f91a0101de0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.260+0000 7f91937fe640 1 -- 172.21.15.76:0/928187037 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f919c010b10 con 0x7f91a0101de0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.260+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a01a6cc0 con 0x7f91a0101de0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.260+0000 7f91937fe640 1 -- 172.21.15.76:0/928187037 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c017d60 con 0x7f91a0101de0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.260+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a01a71b0 con 0x7f91a0101de0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.262+0000 7f91937fe640 1 -- 172.21.15.76:0/928187037 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f919c017070 con 0x7f91a0101de0 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.262+0000 7f91aa995740 1 Processor -- start 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.262+0000 7f91aa995740 1 -- start start 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.262+0000 7f91aa995740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6cab40 0x5587fb6c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.262+0000 7f91aa995740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 0x5587fb6c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.262+0000 7f91aa995740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91aa995740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5587fb62f2f0 con 0x5587fb6c95d0 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91aa995740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5587fb5d6cf0 con 0x5587fb6d4370 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91aa995740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587fb62b2b0 con 0x5587fb6cab40 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 0x5587fb6c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 0x5587fb6c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47594/0 (socket says 172.21.15.76:47594) 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 -- 172.21.15.76:0/4150261690 learned_addr learned my addr 172.21.15.76:0/4150261690 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6b59640 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6cab40 0x5587fb6c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a5b57640 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91937fe640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f918c0a3430 0x7f918c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91937fe640 1 -- 172.21.15.76:0/928187037 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f919c0cf090 con 0x7f91a0101de0 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6b59640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f918c0a3430 0x7f918c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 -- 172.21.15.76:0/4150261690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6cab40 msgr2=0x5587fb6c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6cab40 0x5587fb6c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 -- 172.21.15.76:0/4150261690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 msgr2=0x5587fb6d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 -- 172.21.15.76:0/4150261690 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587fb5bb3a0 con 0x5587fb6c95d0 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f91a6358640 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 0x5587fb6c9a10 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f919c0cc7d0 tx=0x7f919c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd334afc9056539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.263+0000 7f9190ff9640 1 -- 172.21.15.76:0/4150261690 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c01e070 con 0x5587fb6c95d0 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f9190ff9640 1 -- 172.21.15.76:0/4150261690 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f919c09baf0 con 0x5587fb6c95d0 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f9190ff9640 1 -- 172.21.15.76:0/4150261690 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c0a4060 con 0x5587fb6c95d0 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 -- 172.21.15.76:0/4150261690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 msgr2=0x5587fb6c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91a6b59640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f918c0a3430 0x7f918c0a58f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9198009430 tx=0x7f919802a8c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 0x5587fb6c9a10 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f919c0cc7d0 tx=0x7f919c0047d0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 -- 172.21.15.76:0/4150261690 shutdown_connections 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6c95d0 0x5587fb6c9a10 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 --2- 172.21.15.76:0/4150261690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6cab40 0x5587fb6c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 -- 172.21.15.76:0/4150261690 >> 172.21.15.76:0/4150261690 conn(0x5587fb692310 msgr2=0x5587fb6c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 -- 172.21.15.76:0/4150261690 shutdown_connections 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.264+0000 7f91aa995740 1 -- 172.21.15.76:0/4150261690 wait complete. 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 -- start start 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 Processor -- start 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5587fb6d7010 con 0x5587fb6cab40 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5587fb5ea060 con 0x5587fb6c95d0 2024-09-19T07:58:31.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587fb6d7190 con 0x5587fb6d4370 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91aa995740 10 client.0 _ll_register_callbacks cb 0x5587fb33d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47604/0 (socket says 172.21.15.76:47604) 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 -- 172.21.15.76:0/283625218 learned_addr learned my addr 172.21.15.76:0/283625218 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a6358640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a6b59640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 -- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 msgr2=0x5587fb6d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 -- 172.21.15.76:0/283625218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 msgr2=0x5587fb6d3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6d3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a5b57640 1 -- 172.21.15.76:0/283625218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587fb3a03c0 con 0x5587fb6cab40 2024-09-19T07:58:31.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a6358640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.265+0000 7f91a6b59640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91a5b57640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d1040 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f919400bf70 tx=0x7f91940128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6610d5969e2b71f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f9189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f9189ffb640 1 -- 172.21.15.76:0/283625218 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91940035f0 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f9189ffb640 1 -- 172.21.15.76:0/283625218 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f9194003790 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f919c09baf0 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f9189ffb640 1 -- 172.21.15.76:0/283625218 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9194003990 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 10 client.17271 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5587fb6e2b70 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f9189ffb640 1 -- 172.21.15.76:0/283625218 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f919c09baf0 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f9189ffb640 1 -- 172.21.15.76:0/283625218 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9194019070 con 0x5587fb6cab40 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 10 client.17271 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:31.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 20 client.17271 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb6e40d0 0x5587fb6e6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 4 client.17271 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.266+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587fb63c860 con 0x5587fb6e40d0 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.267+0000 7f91a6358640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb6e40d0 0x5587fb6e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.267+0000 7f9189ffb640 10 client.17271 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.267+0000 7f91a6358640 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb6e40d0 0x5587fb6e6510 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b369ea170f83567 server_cookie=9668235c4434f410 in_seq=0 out_seq=0 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f9189ffb640 1 -- 172.21.15.76:0/283625218 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587fb63c860 con 0x5587fb6e40d0 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f9189ffb640 10 client.17271 handle_command_reply: tid=0 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 client.17271 shutdown 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 msgr2=0x5587fb6d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d1040 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f919400bf70 tx=0x7f91940128e0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 shutdown_connections 2024-09-19T07:58:31.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb6e40d0 0x5587fb6e6510 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d1040 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 --2- 172.21.15.76:0/283625218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f9189ffb640 0 client.17271 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 >> 172.21.15.76:0/283625218 conn(0x5587fb692310 msgr2=0x5587fb6cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 shutdown_connections 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 1 -- 172.21.15.76:0/283625218 wait complete. 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.268+0000 7f91aa995740 20 client.17271 trim_cache size 0 max 16384 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.280+0000 7f91aa995740 1 Processor -- start 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 -- start start 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01b27d0 con 0x5587fb6cab40 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01b00a0 con 0x5587fb6c95d0 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91aa995740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01adf10 con 0x5587fb6d4370 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47606/0 (socket says 172.21.15.76:47606) 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 -- 172.21.15.76:0/873290021 learned_addr learned my addr 172.21.15.76:0/873290021 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a6358640 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 -- 172.21.15.76:0/873290021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 msgr2=0x5587fb6ebde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 -- 172.21.15.76:0/873290021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 msgr2=0x5587fb6e02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6e02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 -- 172.21.15.76:0/873290021 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587fb6cf590 con 0x5587fb6cab40 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a6358640 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6e02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f91a5b57640 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d0020 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9194010ea0 tx=0x7f919400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fa4f7adb096160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f918bfff640 1 -- 172.21.15.76:0/873290021 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91940037f0 con 0x5587fb6cab40 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f918bfff640 1 -- 172.21.15.76:0/873290021 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9194004480 con 0x5587fb6cab40 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.281+0000 7f918bfff640 1 -- 172.21.15.76:0/873290021 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91940052a0 con 0x5587fb6cab40 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 -- 172.21.15.76:0/873290021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 msgr2=0x5587fb6d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d0020 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9194010ea0 tx=0x7f919400b840 comp rx=0 tx=0).stop 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 -- 172.21.15.76:0/873290021 shutdown_connections 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6d4370 0x5587fb6ebde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6d0020 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 --2- 172.21.15.76:0/873290021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6c95d0 0x5587fb6e02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 -- 172.21.15.76:0/873290021 >> 172.21.15.76:0/873290021 conn(0x5587fb692310 msgr2=0x5587fb6cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 -- 172.21.15.76:0/873290021 shutdown_connections 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 -- 172.21.15.76:0/873290021 wait complete. 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 -- start start 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.282+0000 7f91aa995740 1 Processor -- start 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6c95d0 0x5587fb6dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01ae560 con 0x5587fb6cab40 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01af9d0 con 0x5587fb6d4370 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01aec30 con 0x5587fb6c95d0 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 10 client.0 _ll_register_callbacks cb 0x7f919400b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:31.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47608/0 (socket says 172.21.15.76:47608) 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 -- 172.21.15.76:0/2381425846 learned_addr learned my addr 172.21.15.76:0/2381425846 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a6b59640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a6358640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6c95d0 0x5587fb6dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 -- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6c95d0 msgr2=0x5587fb6dccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6c95d0 0x5587fb6dccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 -- 172.21.15.76:0/2381425846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 msgr2=0x5587fb6ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 -- 172.21.15.76:0/2381425846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587fb6ced20 con 0x5587fb6cab40 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91a5b57640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6cdee0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f919400b6a0 tx=0x7f919401bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c68655442359c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f9189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f9189ffb640 1 -- 172.21.15.76:0/2381425846 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919401b510 con 0x5587fb6cab40 2024-09-19T07:58:31.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f9189ffb640 1 -- 172.21.15.76:0/2381425846 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f919401b6b0 con 0x5587fb6cab40 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.283+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9194004480 con 0x5587fb6cab40 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f9189ffb640 1 -- 172.21.15.76:0/2381425846 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9194005040 con 0x5587fb6cab40 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 10 client.17277 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5587fb74ee50 con 0x5587fb6cab40 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f9189ffb640 1 -- 172.21.15.76:0/2381425846 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9194004480 con 0x5587fb6cab40 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f9189ffb640 1 -- 172.21.15.76:0/2381425846 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9194019040 con 0x5587fb6cab40 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 10 client.17277 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 10 client.17277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 20 client.17277 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb74f520 0x5587fb751910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 4 client.17277 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:31.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5587fb636d70 con 0x5587fb74f520 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.284+0000 7f91a6358640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb74f520 0x5587fb751910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91a6358640 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb74f520 0x5587fb751910 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a67425fb90c0a2 server_cookie=71506ae2e7f2cb18 in_seq=0 out_seq=0 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f9189ffb640 10 client.17277 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f9189ffb640 1 -- 172.21.15.76:0/2381425846 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5587fb636d70 con 0x5587fb74f520 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f9189ffb640 10 client.17277 handle_command_reply: tid=0 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 client.17277 shutdown 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 msgr2=0x5587fb6cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6cdee0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f919400b6a0 tx=0x7f919401bca0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 shutdown_connections 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5587fb6d4370 0x5587fb6ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5587fb74f520 0x5587fb751910 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5587fb6cab40 0x5587fb6cdee0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f9189ffb640 0 client.17277 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:31.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 --2- 172.21.15.76:0/2381425846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587fb6c95d0 0x5587fb6dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 >> 172.21.15.76:0/2381425846 conn(0x5587fb692310 msgr2=0x5587fb6d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:31.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 shutdown_connections 2024-09-19T07:58:31.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 1 -- 172.21.15.76:0/2381425846 wait complete. 2024-09-19T07:58:31.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.285+0000 7f91aa995740 20 client.17277 trim_cache size 0 max 16384 2024-09-19T07:58:31.303 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f918c0a3430 msgr2=0x7f918c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f918c0a3430 0x7f918c0a58f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9198009430 tx=0x7f919802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 msgr2=0x7f91a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 0x7f91a00744f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f919c00b4a0 tx=0x7f919c00b960 comp rx=0 tx=0).stop 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 shutdown_connections 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f918c0a3430 0x7f918c0a58f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91a0106f10 0x7f91a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a0102790 0x7f91a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 --2- 172.21.15.76:0/928187037 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f91a0101de0 0x7f91a00744f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:31.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 >> 172.21.15.76:0/928187037 conn(0x7f91a00fd8c0 msgr2=0x7f91a00febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:31.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 shutdown_connections 2024-09-19T07:58:31.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:31.286+0000 7f91a85bc640 1 -- 172.21.15.76:0/928187037 wait complete. 2024-09-19T07:58:32.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:32 smithi137 ceph-mon[35309]: pgmap v226: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:32.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:32 smithi076 ceph-mon[30930]: pgmap v226: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:32.963 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:58:32.963 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:58:33.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:32 smithi152 ceph-mon[35117]: pgmap v226: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:33.219 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 -- 172.21.15.76:0/619170594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0102790 msgr2=0x7f97f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 --2- 172.21.15.76:0/619170594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0102790 0x7f97f01067e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009900 tx=0x7f97e002a410 comp rx=0 tx=0).stop 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 -- 172.21.15.76:0/619170594 shutdown_connections 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 --2- 172.21.15.76:0/619170594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0106f10 0x7f97f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 --2- 172.21.15.76:0/619170594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0102790 0x7f97f01067e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 --2- 172.21.15.76:0/619170594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f0101de0 0x7f97f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 -- 172.21.15.76:0/619170594 >> 172.21.15.76:0/619170594 conn(0x7f97f00fd8c0 msgr2=0x7f97f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:33.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 -- 172.21.15.76:0/619170594 shutdown_connections 2024-09-19T07:58:33.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.680+0000 7f97f860e640 1 -- 172.21.15.76:0/619170594 wait complete. 2024-09-19T07:58:33.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 Processor -- start 2024-09-19T07:58:33.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 -- start start 2024-09-19T07:58:33.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0101de0 0x7f97f01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f0102790 0x7f97f0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 0x7f97f019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01120d0 con 0x7f97f0106f10 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0111f50 con 0x7f97f0102790 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f860e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0112250 con 0x7f97f0101de0 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f6bab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 0x7f97f019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f6bab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 0x7f97f019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43294/0 (socket says 172.21.15.76:43294) 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f6bab640 1 -- 172.21.15.76:0/2947662284 learned_addr learned my addr 172.21.15.76:0/2947662284 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f0102790 0x7f97f0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f63aa640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0101de0 0x7f97f01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.681+0000 7f97f6bab640 1 -- 172.21.15.76:0/2947662284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0101de0 msgr2=0x7f97f01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f6bab640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0101de0 0x7f97f01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f6bab640 1 -- 172.21.15.76:0/2947662284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f0102790 msgr2=0x7f97f0198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f6bab640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f0102790 0x7f97f0198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f6bab640 1 -- 172.21.15.76:0/2947662284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f019d470 con 0x7f97f0106f10 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f63aa640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0101de0 0x7f97f01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f6bab640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 0x7f97f019cd90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f97e800b970 tx=0x7f97e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97e77fe640 1 -- 172.21.15.76:0/2947662284 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8019070 con 0x7f97f0106f10 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f019d760 con 0x7f97f0106f10 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97e77fe640 1 -- 172.21.15.76:0/2947662284 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97e800cb40 con 0x7f97f0106f10 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97e77fe640 1 -- 172.21.15.76:0/2947662284 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80076e0 con 0x7f97f0106f10 2024-09-19T07:58:33.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.682+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f01a5040 con 0x7f97f0106f10 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.684+0000 7f97e77fe640 1 -- 172.21.15.76:0/2947662284 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f97e801c070 con 0x7f97f0106f10 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.684+0000 7f97fa9e7740 1 Processor -- start 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 -- start start 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97e77fe640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f97dc0a33b0 0x7f97dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6350f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c635b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c635e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5621c62b6280 con 0x5621c6351480 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5621c625db10 con 0x5621c635bd40 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5621c62b2240 con 0x5621c6350b60 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f97dc0a33b0 0x7f97dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97e77fe640 1 -- 172.21.15.76:0/2947662284 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f97e80cf1a0 con 0x7f97f0106f10 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97f5ba9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c635b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97f63aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6350f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97f5ba9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c635b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43304/0 (socket says 172.21.15.76:43304) 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3532916924 learned_addr learned my addr 172.21.15.76:0/3532916924 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.685+0000 7f97f6bab640 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c635e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f97dc0a33b0 0x7f97dc0a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97e002a930 tx=0x7f97e0031970 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3532916924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 msgr2=0x5621c6350f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6350f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3532916924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 msgr2=0x5621c635e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c635e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3532916924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621c626a1f0 con 0x5621c6351480 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c635b800 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f97e0033000 tx=0x7f97e0047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef1de5856b55651 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:33.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97e4ff9640 1 -- 172.21.15.76:0/3532916924 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0035050 con 0x5621c6351480 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97e4ff9640 1 -- 172.21.15.76:0/3532916924 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97e004e070 con 0x5621c6351480 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.686+0000 7f97e4ff9640 1 -- 172.21.15.76:0/3532916924 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e003daa0 con 0x5621c6351480 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3532916924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 msgr2=0x5621c635b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c635b800 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f97e0033000 tx=0x7f97e0047000 comp rx=0 tx=0).stop 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3532916924 shutdown_connections 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c635e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c635b800 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3532916924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6350f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3532916924 >> 172.21.15.76:0/3532916924 conn(0x5621c634d0f0 msgr2=0x5621c634d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3532916924 shutdown_connections 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3532916924 wait complete. 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- start start 2024-09-19T07:58:33.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 Processor -- start 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6358bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6359100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6359640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5621c635e910 con 0x5621c635bd40 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5621c6270f10 con 0x5621c6351480 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.687+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5621c635ea90 con 0x5621c6350b60 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97fa9e7740 10 client.0 _ll_register_callbacks cb 0x5621c6239a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6359640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6359640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43308/0 (socket says 172.21.15.76:43308) 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 -- 172.21.15.76:0/817095519 learned_addr learned my addr 172.21.15.76:0/817095519 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:33.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6359100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f63aa640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6358bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 -- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 msgr2=0x5621c6358bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6358bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 -- 172.21.15.76:0/817095519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 msgr2=0x5621c6359100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6359100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 -- 172.21.15.76:0/817095519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621c60276a0 con 0x5621c635bd40 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97f6bab640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6359640 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f97e80099d0 tx=0x7f97e809aff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6226a424a52bccf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97d9ffb640 1 -- 172.21.15.76:0/817095519 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e809f950 con 0x5621c635bd40 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97d9ffb640 1 -- 172.21.15.76:0/817095519 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f97e80998a0 con 0x5621c635bd40 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e004e070 con 0x5621c635bd40 2024-09-19T07:58:33.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97d9ffb640 1 -- 172.21.15.76:0/817095519 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f97e80a4210 con 0x5621c635bd40 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97fa9e7740 10 client.17289 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.688+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5621c636a520 con 0x5621c635bd40 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97d9ffb640 1 -- 172.21.15.76:0/817095519 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97e807b020 con 0x5621c635bd40 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97d9ffb640 1 -- 172.21.15.76:0/817095519 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f97e800e8d0 con 0x5621c635bd40 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97fa9e7740 10 client.17289 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97fa9e7740 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97fa9e7740 20 client.17289 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c636b980 0x5621c636ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97fa9e7740 4 client.17289 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621c62c37f0 con 0x5621c636b980 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.689+0000 7f97f63aa640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c636b980 0x5621c636ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97f63aa640 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c636b980 0x5621c636ddb0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e0b07c6544768b server_cookie=e4aa38ac34382268 in_seq=0 out_seq=0 2024-09-19T07:58:33.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97d9ffb640 10 client.17289 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:33.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97d9ffb640 1 -- 172.21.15.76:0/817095519 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621c62c37f0 con 0x5621c636b980 2024-09-19T07:58:33.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97d9ffb640 10 client.17289 handle_command_reply: tid=0 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97fa9e7740 1 client.17289 shutdown 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 msgr2=0x5621c6359640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.690+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6359640 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f97e80099d0 tx=0x7f97e809aff0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 shutdown_connections 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c636b980 0x5621c636ddb0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6359640 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6359100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97d9ffb640 0 client.17289 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/817095519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6358bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 >> 172.21.15.76:0/817095519 conn(0x5621c634d0f0 msgr2=0x5621c634c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 shutdown_connections 2024-09-19T07:58:33.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 1 -- 172.21.15.76:0/817095519 wait complete. 2024-09-19T07:58:33.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.691+0000 7f97fa9e7740 20 client.17289 trim_cache size 0 max 16384 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 Processor -- start 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 -- start start 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c63535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6373680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6373bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01b0450 con 0x5621c635bd40 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01add20 con 0x5621c6351480 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01abb90 con 0x5621c6350b60 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6373bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6373bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43310/0 (socket says 172.21.15.76:43310) 2024-09-19T07:58:33.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 -- 172.21.15.76:0/830866256 learned_addr learned my addr 172.21.15.76:0/830866256 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f63aa640 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c63535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6373680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 -- 172.21.15.76:0/830866256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 msgr2=0x5621c63535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c63535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 -- 172.21.15.76:0/830866256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 msgr2=0x5621c6373680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6373680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 -- 172.21.15.76:0/830866256 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621c635b490 con 0x5621c635bd40 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.708+0000 7f97f6bab640 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6373bc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f97e80a3ce0 tx=0x7f97e8014db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86129ed248dc389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97dbfff640 1 -- 172.21.15.76:0/830866256 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e809f950 con 0x5621c635bd40 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97dbfff640 1 -- 172.21.15.76:0/830866256 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97e807b070 con 0x5621c635bd40 2024-09-19T07:58:33.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97dbfff640 1 -- 172.21.15.76:0/830866256 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8097840 con 0x5621c635bd40 2024-09-19T07:58:33.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 -- 172.21.15.76:0/830866256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 msgr2=0x5621c6373bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6373bc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f97e80a3ce0 tx=0x7f97e8014db0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 -- 172.21.15.76:0/830866256 shutdown_connections 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c635bd40 0x5621c6373bc0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c6351480 0x5621c6373680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/830866256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c63535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 -- 172.21.15.76:0/830866256 >> 172.21.15.76:0/830866256 conn(0x5621c634d0f0 msgr2=0x5621c635ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 -- 172.21.15.76:0/830866256 shutdown_connections 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.709+0000 7f97fa9e7740 1 -- 172.21.15.76:0/830866256 wait complete. 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 -- start start 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 Processor -- start 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6363ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c6364400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c6360cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01ac1e0 con 0x5621c6351480 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01ad650 con 0x5621c635bd40 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01ac8b0 con 0x5621c6350b60 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97fa9e7740 10 client.0 _ll_register_callbacks cb 0x7f97e809b370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c6364400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c6364400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43318/0 (socket says 172.21.15.76:43318) 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3338586144 learned_addr learned my addr 172.21.15.76:0/3338586144 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f63aa640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6363ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f6bab640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c6360cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 msgr2=0x5621c6363ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6363ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3338586144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 msgr2=0x5621c6360cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:33.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c6360cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.710+0000 7f97f5ba9640 1 -- 172.21.15.76:0/3338586144 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621c6361350 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97f5ba9640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c6364400 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f97e0004340 tx=0x7f97e003d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15a9d56a2b88835 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97d9ffb640 1 -- 172.21.15.76:0/3338586144 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e005d670 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97d9ffb640 1 -- 172.21.15.76:0/3338586144 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f97e005d810 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e807b070 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97d9ffb640 1 -- 172.21.15.76:0/3338586144 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f97e005da10 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 10 client.17295 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5621c63d7020 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97d9ffb640 1 -- 172.21.15.76:0/3338586144 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97e807b070 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97d9ffb640 1 -- 172.21.15.76:0/3338586144 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f97e0063030 con 0x5621c6351480 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 10 client.17295 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:33.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 20 client.17295 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c63d72f0 0x5621c63d96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 4 client.17295 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.711+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5621c62bdd00 con 0x5621c63d72f0 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.712+0000 7f97f63aa640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c63d72f0 0x5621c63d96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.712+0000 7f97f63aa640 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c63d72f0 0x5621c63d96e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bca5158301c3ba7 server_cookie=f60b9b1a0fbcf208 in_seq=0 out_seq=0 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.712+0000 7f97d9ffb640 10 client.17295 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97d9ffb640 1 -- 172.21.15.76:0/3338586144 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5621c62bdd00 con 0x5621c63d72f0 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97d9ffb640 10 client.17295 handle_command_reply: tid=0 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 client.17295 shutdown 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 msgr2=0x5621c6364400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c6364400 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f97e0004340 tx=0x7f97e003d5e0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 shutdown_connections 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621c635bd40 0x5621c6360cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5621c63d72f0 0x5621c63d96e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621c6351480 0x5621c6364400 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 --2- 172.21.15.76:0/3338586144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621c6350b60 0x5621c6363ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 >> 172.21.15.76:0/3338586144 conn(0x5621c634d0f0 msgr2=0x5621c6358b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97d9ffb640 0 client.17295 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 shutdown_connections 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 1 -- 172.21.15.76:0/3338586144 wait complete. 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.713+0000 7f97fa9e7740 20 client.17295 trim_cache size 0 max 16384 2024-09-19T07:58:33.719 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:33.720 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:58:33.720 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "a85f128d-156f-41a3-9fe1-3bc73efaf3ba", 2024-09-19T07:58:33.720 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:58:33.720 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:33.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f97dc0a33b0 msgr2=0x7f97dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f97dc0a33b0 0x7f97dc0a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97e002a930 tx=0x7f97e0031970 comp rx=0 tx=0).stop 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 msgr2=0x7f97f019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 0x7f97f019cd90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f97e800b970 tx=0x7f97e800be30 comp rx=0 tx=0).stop 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 shutdown_connections 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f97dc0a33b0 0x7f97dc0a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f97f0106f10 0x7f97f019cd90 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97f0102790 0x7f97f0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 --2- 172.21.15.76:0/2947662284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97f0101de0 0x7f97f01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 >> 172.21.15.76:0/2947662284 conn(0x7f97f00fd8c0 msgr2=0x7f97f00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 shutdown_connections 2024-09-19T07:58:33.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:33.714+0000 7f97f860e640 1 -- 172.21.15.76:0/2947662284 wait complete. 2024-09-19T07:58:34.550 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:58:34.798 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:34 smithi137 ceph-mon[35309]: pgmap v227: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:34 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:58:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:34 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:34 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:58:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:34 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:34.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:34 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:58:34.919 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:34 smithi076 ceph-mon[30930]: pgmap v227: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:34.919 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:34 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:58:34.919 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:34 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:34.919 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:34 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:58:34.919 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:34 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:34.919 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:34 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:58:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:34 smithi152 ceph-mon[35117]: pgmap v227: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:34 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:58:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:34 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:34 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:58:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:34 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:35.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:34 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 -- 172.21.15.76:0/2759053278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c102790 msgr2=0x7f2c3c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 --2- 172.21.15.76:0/2759053278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c102790 0x7f2c3c1067e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009900 tx=0x7f2c3002a410 comp rx=0 tx=0).stop 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 -- 172.21.15.76:0/2759053278 shutdown_connections 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 --2- 172.21.15.76:0/2759053278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c106f10 0x7f2c3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 --2- 172.21.15.76:0/2759053278 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c102790 0x7f2c3c1067e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 --2- 172.21.15.76:0/2759053278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c101de0 0x7f2c3c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 -- 172.21.15.76:0/2759053278 >> 172.21.15.76:0/2759053278 conn(0x7f2c3c0fd8c0 msgr2=0x7f2c3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 -- 172.21.15.76:0/2759053278 shutdown_connections 2024-09-19T07:58:35.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.273+0000 7f2c42565640 1 -- 172.21.15.76:0/2759053278 wait complete. 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 Processor -- start 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 -- start start 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101de0 0x7f2c3c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c102790 0x7f2c3c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 0x7f2c3c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1120f0 con 0x7f2c3c106f10 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c111f70 con 0x7f2c3c102790 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c42565640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c112270 con 0x7f2c3c101de0 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c40b02640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 0x7f2c3c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c40b02640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 0x7f2c3c19cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43336/0 (socket says 172.21.15.76:43336) 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c40b02640 1 -- 172.21.15.76:0/3265032771 learned_addr learned my addr 172.21.15.76:0/3265032771 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:35.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.274+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101de0 0x7f2c3c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c102790 0x7f2c3c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c40b02640 1 -- 172.21.15.76:0/3265032771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101de0 msgr2=0x7f2c3c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c40b02640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101de0 0x7f2c3c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c40b02640 1 -- 172.21.15.76:0/3265032771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c102790 msgr2=0x7f2c3c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c40b02640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c102790 0x7f2c3c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c40b02640 1 -- 172.21.15.76:0/3265032771 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c19d600 con 0x7f2c3c106f10 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101de0 0x7f2c3c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c102790 0x7f2c3c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c40b02640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 0x7f2c3c19cf20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400eaa0 tx=0x7f2c3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c397fa640 1 -- 172.21.15.76:0/3265032771 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400cdb0 con 0x7f2c3c106f10 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c19d8f0 con 0x7f2c3c106f10 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c397fa640 1 -- 172.21.15.76:0/3265032771 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c34004b20 con 0x7f2c3c106f10 2024-09-19T07:58:35.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c397fa640 1 -- 172.21.15.76:0/3265032771 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011760 con 0x7f2c3c106f10 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.275+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c1a51d0 con 0x7f2c3c106f10 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.277+0000 7f2c397fa640 1 -- 172.21.15.76:0/3265032771 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2c34011900 con 0x7f2c3c106f10 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.277+0000 7f2c4493e740 1 Processor -- start 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 -- start start 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c6c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c77140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c79a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55fda0bd22e0 con 0x55fda0c77680 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fda0b79ce0 con 0x55fda0c6c4a0 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c4493e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fda0bce2a0 con 0x55fda0c6cdc0 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c79a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c79a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43346/0 (socket says 172.21.15.76:43346) 2024-09-19T07:58:35.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/2718450142 learned_addr learned my addr 172.21.15.76:0/2718450142 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c6c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c397fa640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2c240a33b0 0x7f2c240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c77140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c40b02640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2c240a33b0 0x7f2c240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/2718450142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 msgr2=0x55fda0c77140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c77140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/2718450142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 msgr2=0x55fda0c6c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c6c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/2718450142 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda0b5e440 con 0x55fda0c77680 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c77140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.278+0000 7f2c397fa640 1 -- 172.21.15.76:0/3265032771 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f2c340d0110 con 0x7f2c3c106f10 2024-09-19T07:58:35.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c79a70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005ec0 tx=0x7f2c30000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3b3243ffd80f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c227fc640 1 -- 172.21.15.76:0/2718450142 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30035040 con 0x55fda0c77680 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c227fc640 1 -- 172.21.15.76:0/2718450142 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c300035f0 con 0x55fda0c77680 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c227fc640 1 -- 172.21.15.76:0/2718450142 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3003e660 con 0x55fda0c77680 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c4493e740 1 -- 172.21.15.76:0/2718450142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 msgr2=0x55fda0c79a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c40b02640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2c240a33b0 0x7f2c240a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c3409c000 tx=0x7f2c34000f40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.279+0000 7f2c4493e740 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c79a70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005ec0 tx=0x7f2c30000bc0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- 172.21.15.76:0/2718450142 shutdown_connections 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c79a70 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c77140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 --2- 172.21.15.76:0/2718450142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- 172.21.15.76:0/2718450142 >> 172.21.15.76:0/2718450142 conn(0x55fda0c68a30 msgr2=0x55fda0c68e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- 172.21.15.76:0/2718450142 shutdown_connections 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- 172.21.15.76:0/2718450142 wait complete. 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- start start 2024-09-19T07:58:35.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 Processor -- start 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c76f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c74230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c74770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55fda0c7a250 con 0x55fda0c77680 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fda0b8d050 con 0x55fda0c6c4a0 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fda0c7a3d0 con 0x55fda0c6cdc0 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.280+0000 7f2c4493e740 10 client.0 _ll_register_callbacks cb 0x55fda0bcd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c74770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c74770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43356/0 (socket says 172.21.15.76:43356) 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/178163829 learned_addr learned my addr 172.21.15.76:0/178163829 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c74230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c76f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 msgr2=0x55fda0c74230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c74230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/178163829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 msgr2=0x55fda0c76f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c76f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/178163829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda09433c0 con 0x55fda0c77680 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c74230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c74770 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2c300096c0 tx=0x7f2c30009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a06a8f86e666ade server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/178163829 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30053060 con 0x55fda0c77680 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/178163829 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f2c30004180 con 0x55fda0c77680 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c300035f0 con 0x55fda0c77680 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/178163829 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2c30035070 con 0x55fda0c77680 2024-09-19T07:58:35.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c4493e740 10 client.17307 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fda0c85bc0 con 0x55fda0c77680 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.281+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/178163829 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c300035f0 con 0x55fda0c77680 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/178163829 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2c3003a040 con 0x55fda0c77680 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c4493e740 10 client.17307 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c4493e740 10 client.17307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c4493e740 20 client.17307 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c4493e740 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0c86f10 0x55fda0c89300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c4493e740 4 client.17307 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fda0bdf850 con 0x55fda0c86f10 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.282+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0c86f10 0x55fda0c89300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c1b7fe640 10 client.17307 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0c86f10 0x55fda0c89300 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672d5e330a5305d2 server_cookie=97dece4ae9fb2f0 in_seq=0 out_seq=0 2024-09-19T07:58:35.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/178163829 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fda0bdf850 con 0x55fda0c86f10 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c1b7fe640 10 client.17307 handle_command_reply: tid=0 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c4493e740 1 client.17307 shutdown 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 msgr2=0x55fda0c74770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.283+0000 7f2c4493e740 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c74770 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2c300096c0 tx=0x7f2c30009880 comp rx=0 tx=0).stop 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 shutdown_connections 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0c86f10 0x55fda0c89300 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c74770 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6cdc0 0x55fda0c74230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 --2- 172.21.15.76:0/178163829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c76f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c1b7fe640 0 client.17307 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 >> 172.21.15.76:0/178163829 conn(0x55fda0c68a30 msgr2=0x55fda0c6e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 shutdown_connections 2024-09-19T07:58:35.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 1 -- 172.21.15.76:0/178163829 wait complete. 2024-09-19T07:58:35.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.284+0000 7f2c4493e740 20 client.17307 trim_cache size 0 max 16384 2024-09-19T07:58:35.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.300+0000 7f2c4493e740 1 Processor -- start 2024-09-19T07:58:35.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 -- start start 2024-09-19T07:58:35.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 0x55fda0c719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c77680 0x55fda0c729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1b0570 con 0x55fda0c6cdc0 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1ade40 con 0x55fda0c6c4a0 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c4493e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1abcb0 con 0x55fda0c77680 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 0x55fda0c719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 0x55fda0c719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43368/0 (socket says 172.21.15.76:43368) 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 -- 172.21.15.76:0/1452430466 learned_addr learned my addr 172.21.15.76:0/1452430466 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 -- 172.21.15.76:0/1452430466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c77680 msgr2=0x55fda0c729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c77680 0x55fda0c729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 -- 172.21.15.76:0/1452430466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 msgr2=0x55fda0c714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 -- 172.21.15.76:0/1452430466 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fda0c79db0 con 0x55fda0c6cdc0 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 0x55fda0c719f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x55fda0c73ac0 tx=0x7f2c2c016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23839be19cd01b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.301+0000 7f2c21ffb640 1 -- 172.21.15.76:0/1452430466 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00bcc0 con 0x55fda0c6cdc0 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c21ffb640 1 -- 172.21.15.76:0/1452430466 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c2c024930 con 0x55fda0c6cdc0 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c21ffb640 1 -- 172.21.15.76:0/1452430466 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c014880 con 0x55fda0c6cdc0 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 -- 172.21.15.76:0/1452430466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 msgr2=0x55fda0c719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 0x55fda0c719f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x55fda0c73ac0 tx=0x7f2c2c016800 comp rx=0 tx=0).stop 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 -- 172.21.15.76:0/1452430466 shutdown_connections 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c77680 0x55fda0c729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c6cdc0 0x55fda0c719f0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1452430466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6c4a0 0x55fda0c714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 -- 172.21.15.76:0/1452430466 >> 172.21.15.76:0/1452430466 conn(0x55fda0c68a30 msgr2=0x55fda0c762b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:35.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 -- 172.21.15.76:0/1452430466 shutdown_connections 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.302+0000 7f2c4493e740 1 -- 172.21.15.76:0/1452430466 wait complete. 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 -- start start 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 Processor -- start 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6c4a0 0x55fda0c8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6cdc0 0x55fda0c89e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c8a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1ac300 con 0x55fda0c77680 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1ad770 con 0x55fda0c6cdc0 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c1ac9d0 con 0x55fda0c6c4a0 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c4493e740 10 client.0 _ll_register_callbacks cb 0x7f2c30032ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c8a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c8a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43378/0 (socket says 172.21.15.76:43378) 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/1237846528 learned_addr learned my addr 172.21.15.76:0/1237846528 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:35.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6c4a0 msgr2=0x55fda0c8cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6c4a0 0x55fda0c8cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/1237846528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6cdc0 msgr2=0x55fda0c89e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6cdc0 0x55fda0c89e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.303+0000 7f2c3b7fe640 1 -- 172.21.15.76:0/1237846528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fda0c8ab90 con 0x55fda0c77680 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c3b7fe640 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c8a360 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2c300057c0 tx=0x7f2c30032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bc5168241973bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/1237846528 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30063060 con 0x55fda0c77680 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/1237846528 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f2c30003ea0 con 0x55fda0c77680 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c2c024930 con 0x55fda0c77680 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/1237846528 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2c3006a050 con 0x55fda0c77680 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 10 client.17313 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fda0cf18c0 con 0x55fda0c77680 2024-09-19T07:58:35.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/1237846528 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c2c024930 con 0x55fda0c77680 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/1237846528 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2c3003a050 con 0x55fda0c77680 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 10 client.17313 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 10 client.17313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 20 client.17313 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0cf2070 0x55fda0cf44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 4 client.17313 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.304+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fda0bd9d60 con 0x55fda0cf2070 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0cf2070 0x55fda0cf44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c3bfff640 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0cf2070 0x55fda0cf44d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708a489dcb23935b server_cookie=65c6ba9f9cf3413f in_seq=0 out_seq=0 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c1b7fe640 10 client.17313 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c1b7fe640 1 -- 172.21.15.76:0/1237846528 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fda0bd9d60 con 0x55fda0cf2070 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c1b7fe640 10 client.17313 handle_command_reply: tid=0 2024-09-19T07:58:35.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 client.17313 shutdown 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 msgr2=0x55fda0c8a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c8a360 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2c300057c0 tx=0x7f2c30032e10 comp rx=0 tx=0).stop 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 shutdown_connections 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55fda0cf2070 0x55fda0cf44d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fda0c77680 0x55fda0c8a360 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.305+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fda0c6cdc0 0x55fda0c89e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c4493e740 1 --2- 172.21.15.76:0/1237846528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fda0c6c4a0 0x55fda0c8cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 >> 172.21.15.76:0/1237846528 conn(0x55fda0c68a30 msgr2=0x55fda0c67350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c1b7fe640 0 client.17313 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 shutdown_connections 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c4493e740 1 -- 172.21.15.76:0/1237846528 wait complete. 2024-09-19T07:58:35.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c4493e740 20 client.17313 trim_cache size 0 max 16384 2024-09-19T07:58:35.314 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:35.314 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:58:35.314 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:58:35.314 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2c240a33b0 msgr2=0x7f2c240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2c240a33b0 0x7f2c240a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c3409c000 tx=0x7f2c34000f40 comp rx=0 tx=0).stop 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 msgr2=0x7f2c3c19cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 0x7f2c3c19cf20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400eaa0 tx=0x7f2c3400ef60 comp rx=0 tx=0).stop 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 shutdown_connections 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2c240a33b0 0x7f2c240a5870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2c3c106f10 0x7f2c3c19cf20 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c3c102790 0x7f2c3c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 --2- 172.21.15.76:0/3265032771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c3c101de0 0x7f2c3c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:35.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 >> 172.21.15.76:0/3265032771 conn(0x7f2c3c0fd8c0 msgr2=0x7f2c3c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:35.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 shutdown_connections 2024-09-19T07:58:35.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:35.306+0000 7f2c42565640 1 -- 172.21.15.76:0/3265032771 wait complete. 2024-09-19T07:58:35.965 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:58:35.965 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:58:36.216 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 -- 172.21.15.76:0/873323298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec100e20 msgr2=0x7f77ec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 --2- 172.21.15.76:0/873323298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec100e20 0x7f77ec101200 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009900 tx=0x7f77e802a480 comp rx=0 tx=0).stop 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 -- 172.21.15.76:0/873323298 shutdown_connections 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 --2- 172.21.15.76:0/873323298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 0x7f77ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 --2- 172.21.15.76:0/873323298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ec102570 0x7f77ec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 --2- 172.21.15.76:0/873323298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec100e20 0x7f77ec101200 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 -- 172.21.15.76:0/873323298 >> 172.21.15.76:0/873323298 conn(0x7f77ec0fc7d0 msgr2=0x7f77ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 -- 172.21.15.76:0/873323298 shutdown_connections 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.666+0000 7f77f30c4640 1 -- 172.21.15.76:0/873323298 wait complete. 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 Processor -- start 2024-09-19T07:58:36.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 -- start start 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ec100e20 0x7f77ec0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 0x7f77ec0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 0x7f77ec0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec111130 con 0x7f77ec102570 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec110fb0 con 0x7f77ec102ef0 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f30c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1112b0 con 0x7f77ec100e20 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 0x7f77ec0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 0x7f77ec0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43392/0 (socket says 172.21.15.76:43392) 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 -- 172.21.15.76:0/976049303 learned_addr learned my addr 172.21.15.76:0/976049303 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f1661640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 0x7f77ec0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f0e60640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ec100e20 0x7f77ec0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:36.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 -- 172.21.15.76:0/976049303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ec100e20 msgr2=0x7f77ec0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ec100e20 0x7f77ec0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 -- 172.21.15.76:0/976049303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 msgr2=0x7f77ec0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 0x7f77ec0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77e3fff640 1 -- 172.21.15.76:0/976049303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec1a6b20 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.667+0000 7f77f1661640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 0x7f77ec0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.668+0000 7f77e3fff640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 0x7f77ec0fd1c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00b4a0 tx=0x7f77dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.668+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc014070 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.668+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77dc010b10 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.668+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec1a6e10 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.668+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc017d60 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.668+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec1a7270 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.669+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec101200 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.670+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f77dc017070 con 0x7f77ec102570 2024-09-19T07:58:36.689 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.670+0000 7f77e1ffb640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77d40a33b0 0x7f77d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.671+0000 7f77f0e60640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77d40a33b0 0x7f77d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.671+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f77dc0cf0f0 con 0x7f77ec102570 2024-09-19T07:58:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.671+0000 7f77f0e60640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77d40a33b0 0x7f77d40a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77e8000c00 tx=0x7f77e8005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:36.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.675+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77dc09bb50 con 0x7f77ec102570 2024-09-19T07:58:36.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.875+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77ec10a0a0 con 0x7f77ec102570 2024-09-19T07:58:36.876 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:36 smithi076 ceph-mon[30930]: pgmap v228: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T07:58:36.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.876+0000 7f77e1ffb640 1 -- 172.21.15.76:0/976049303 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f77dc09b450 con 0x7f77ec102570 2024-09-19T07:58:36.877 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:58:36.878 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:58:36.878 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77d40a33b0 msgr2=0x7f77d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77d40a33b0 0x7f77d40a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77e8000c00 tx=0x7f77e8005a20 comp rx=0 tx=0).stop 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 msgr2=0x7f77ec0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 0x7f77ec0fd1c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00b4a0 tx=0x7f77dc00b960 comp rx=0 tx=0).stop 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 shutdown_connections 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f77d40a33b0 0x7f77d40a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77ec102ef0 0x7f77ec0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77ec102570 0x7f77ec0fd1c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.878+0000 7f77f30c4640 1 --2- 172.21.15.76:0/976049303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77ec100e20 0x7f77ec0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:36.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.879+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 >> 172.21.15.76:0/976049303 conn(0x7f77ec0fc7d0 msgr2=0x7f77ec06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:36.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.879+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 shutdown_connections 2024-09-19T07:58:36.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:36.879+0000 7f77f30c4640 1 -- 172.21.15.76:0/976049303 wait complete. 2024-09-19T07:58:36.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:36 smithi137 ceph-mon[35309]: pgmap v228: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T07:58:37.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:36 smithi152 ceph-mon[35117]: pgmap v228: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T07:58:37.665 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:58:37.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:37 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/976049303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:37.913 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:37.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:37 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/976049303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:38.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:37 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/976049303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:58:38.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 -- 172.21.15.76:0/4177910622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860106a80 msgr2=0x7f8860106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 --2- 172.21.15.76:0/4177910622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860106a80 0x7f8860106e60 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f8854009930 tx=0x7f885402a420 comp rx=0 tx=0).stop 2024-09-19T07:58:38.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 -- 172.21.15.76:0/4177910622 shutdown_connections 2024-09-19T07:58:38.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 --2- 172.21.15.76:0/4177910622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860101420 0x7f886010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 --2- 172.21.15.76:0/4177910622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 0x7f8860100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 --2- 172.21.15.76:0/4177910622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860106a80 0x7f8860106e60 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 -- 172.21.15.76:0/4177910622 >> 172.21.15.76:0/4177910622 conn(0x7f88600fc7a0 msgr2=0x7f88600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 -- 172.21.15.76:0/4177910622 shutdown_connections 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.397+0000 7f8866f87640 1 -- 172.21.15.76:0/4177910622 wait complete. 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 Processor -- start 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 -- start start 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 0x7f8860198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 0x7f8860198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860106a80 0x7f886019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8860110fe0 con 0x7f8860101420 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8860110e60 con 0x7f8860106a80 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8866f87640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8860111160 con 0x7f8860100a80 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 0x7f8860198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 0x7f8860198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43414/0 (socket says 172.21.15.76:43414) 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 -- 172.21.15.76:0/3470205567 learned_addr learned my addr 172.21.15.76:0/3470205567 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8865524640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860106a80 0x7f886019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8864d23640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 0x7f8860198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 -- 172.21.15.76:0/3470205567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 msgr2=0x7f8860198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 0x7f8860198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 -- 172.21.15.76:0/3470205567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860106a80 msgr2=0x7f886019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860106a80 0x7f886019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f885ffff640 1 -- 172.21.15.76:0/3470205567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886019d530 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8865524640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860106a80 0x7f886019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.398+0000 7f8864d23640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 0x7f8860198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.399+0000 7f885ffff640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 0x7f8860198ac0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c890 tx=0x7f884c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.399+0000 7f885dffb640 1 -- 172.21.15.76:0/3470205567 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c004220 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.399+0000 7f885dffb640 1 -- 172.21.15.76:0/3470205567 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f884c0043c0 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.399+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886019d820 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.399+0000 7f885dffb640 1 -- 172.21.15.76:0/3470205567 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c004ba0 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.399+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88601a5100 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.401+0000 7f885dffb640 1 -- 172.21.15.76:0/3470205567 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f884c004d40 con 0x7f8860101420 2024-09-19T07:58:38.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 Processor -- start 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 -- start start 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f885dffb640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88500a33b0 0x7f88500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8865524640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88500a33b0 0x7f88500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5627702372f0 con 0x5627702d2b40 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627701decf0 con 0x5627702d15d0 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8869360740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5627702332b0 con 0x5627702dc370 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f885dffb640 1 -- 172.21.15.76:0/3470205567 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f884c0cff50 con 0x7f8860101420 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43430/0 (socket says 172.21.15.76:43430) 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 -- 172.21.15.76:0/4039351585 learned_addr learned my addr 172.21.15.76:0/4039351585 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 -- 172.21.15.76:0/4039351585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 msgr2=0x5627702de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8865524640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f885ffff640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 -- 172.21.15.76:0/4039351585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 msgr2=0x5627702d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.402+0000 7f8864d23640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f8864d23640 1 -- 172.21.15.76:0/4039351585 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627701c33a0 con 0x5627702d2b40 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f8865524640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f885ffff640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f8865524640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88500a33b0 0x7f88500a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8858007ea0 tx=0x7f885800c690 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f8864d23640 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d1090 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8854000c00 tx=0x7f8854032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c45f1dbf6fce2d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f884affd640 1 -- 172.21.15.76:0/4039351585 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885403f070 con 0x5627702d2b40 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f884affd640 1 -- 172.21.15.76:0/4039351585 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8854031840 con 0x5627702d2b40 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.403+0000 7f884affd640 1 -- 172.21.15.76:0/4039351585 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854035070 con 0x5627702d2b40 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 -- 172.21.15.76:0/4039351585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 msgr2=0x5627702d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d1090 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8854000c00 tx=0x7f8854032d30 comp rx=0 tx=0).stop 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 -- 172.21.15.76:0/4039351585 shutdown_connections 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 --2- 172.21.15.76:0/4039351585 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d1090 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 -- 172.21.15.76:0/4039351585 >> 172.21.15.76:0/4039351585 conn(0x56277029a310 msgr2=0x5627702cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 -- 172.21.15.76:0/4039351585 shutdown_connections 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 -- 172.21.15.76:0/4039351585 wait complete. 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 -- start start 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.404+0000 7f8869360740 1 Processor -- start 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d2b40 0x5627702d8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 0x5627702d94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5627702df010 con 0x5627702dc370 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627701f2060 con 0x5627702d2b40 2024-09-19T07:58:38.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5627702df190 con 0x5627702d15d0 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 10 client.0 _ll_register_callbacks cb 0x56276ff458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 0x5627702d94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 0x5627702d94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43446/0 (socket says 172.21.15.76:43446) 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 -- 172.21.15.76:0/1092775653 learned_addr learned my addr 172.21.15.76:0/1092775653 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8864d23640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f885ffff640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d2b40 0x5627702d8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 -- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 msgr2=0x5627702dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 -- 172.21.15.76:0/1092775653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d2b40 msgr2=0x5627702d8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d2b40 0x5627702d8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 -- 172.21.15.76:0/1092775653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276ffa83c0 con 0x5627702dc370 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8865524640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 0x5627702d94d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f885800fe90 tx=0x7f8858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3524d6fbb6a9d2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f883ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f883ffff640 1 -- 172.21.15.76:0/1092775653 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858019050 con 0x5627702dc370 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f883ffff640 1 -- 172.21.15.76:0/1092775653 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f88580107d0 con 0x5627702dc370 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8854031840 con 0x5627702dc370 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f883ffff640 1 -- 172.21.15.76:0/1092775653 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f885802c050 con 0x5627702dc370 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 10 client.17331 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.405+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5627702ea9f0 con 0x5627702dc370 2024-09-19T07:58:38.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f883ffff640 1 -- 172.21.15.76:0/1092775653 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8854031840 con 0x5627702dc370 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f883ffff640 1 -- 172.21.15.76:0/1092775653 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f885801eb30 con 0x5627702dc370 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8869360740 10 client.17331 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8869360740 10 client.17331 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8869360740 20 client.17331 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8869360740 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627702ebe00 0x5627702ee250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8869360740 4 client.17331 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562770244860 con 0x5627702ebe00 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.406+0000 7f8864d23640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627702ebe00 0x5627702ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f8864d23640 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627702ebe00 0x5627702ee250 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e043f53f9a40360 server_cookie=51538ce1c33fb959 in_seq=0 out_seq=0 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f883ffff640 10 client.17331 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f883ffff640 1 -- 172.21.15.76:0/1092775653 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562770244860 con 0x5627702ebe00 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f883ffff640 10 client.17331 handle_command_reply: tid=0 2024-09-19T07:58:38.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f8869360740 1 client.17331 shutdown 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 msgr2=0x5627702d94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.407+0000 7f8869360740 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 0x5627702d94d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f885800fe90 tx=0x7f8858004a40 comp rx=0 tx=0).stop 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 shutdown_connections 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627702ebe00 0x5627702ee250 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702dc370 0x5627702d94d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d2b40 0x5627702d8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f883ffff640 0 client.17331 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 --2- 172.21.15.76:0/1092775653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 >> 172.21.15.76:0/1092775653 conn(0x56277029a310 msgr2=0x5627702d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:38.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 shutdown_connections 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 1 -- 172.21.15.76:0/1092775653 wait complete. 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.408+0000 7f8869360740 20 client.17331 trim_cache size 0 max 16384 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.420+0000 7f8869360740 1 Processor -- start 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.420+0000 7f8869360740 1 -- start start 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8869360740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702daee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8869360740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8869360740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8869360740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88601b0570 con 0x5627702d2b40 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8869360740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88601ade40 con 0x5627702d15d0 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8869360740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88601abcb0 con 0x5627702dc370 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43452/0 (socket says 172.21.15.76:43452) 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 -- 172.21.15.76:0/129480994 learned_addr learned my addr 172.21.15.76:0/129480994 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8864d23640 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 -- 172.21.15.76:0/129480994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 msgr2=0x5627702d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 -- 172.21.15.76:0/129480994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 msgr2=0x5627702daee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702daee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 -- 172.21.15.76:0/129480994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627702ce960 con 0x5627702d2b40 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f8864d23640 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f885ffff640 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d4120 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f884c0985a0 tx=0x7f884c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cd42b24477a685 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f884a7fc640 1 -- 172.21.15.76:0/129480994 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0b5070 con 0x5627702d2b40 2024-09-19T07:58:38.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f884a7fc640 1 -- 172.21.15.76:0/129480994 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f884c0a04f0 con 0x5627702d2b40 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.421+0000 7f884a7fc640 1 -- 172.21.15.76:0/129480994 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c01d040 con 0x5627702d2b40 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 -- 172.21.15.76:0/129480994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 msgr2=0x5627702d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d4120 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f884c0985a0 tx=0x7f884c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 -- 172.21.15.76:0/129480994 shutdown_connections 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702dc370 0x5627702d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702d4120 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 --2- 172.21.15.76:0/129480994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702d15d0 0x5627702daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 -- 172.21.15.76:0/129480994 >> 172.21.15.76:0/129480994 conn(0x56277029a310 msgr2=0x5627702da7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 -- 172.21.15.76:0/129480994 shutdown_connections 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 -- 172.21.15.76:0/129480994 wait complete. 2024-09-19T07:58:38.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 -- start start 2024-09-19T07:58:38.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.422+0000 7f8869360740 1 Processor -- start 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702e0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702e0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702dc370 0x5627702e0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88601ac300 con 0x5627702d2b40 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88601ad770 con 0x5627702dc370 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88601ac9d0 con 0x5627702d15d0 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 10 client.0 _ll_register_callbacks cb 0x7f885800ce40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702e0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43460/0 (socket says 172.21.15.76:43460) 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 -- 172.21.15.76:0/3117866918 learned_addr learned my addr 172.21.15.76:0/3117866918 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:38.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8865524640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702dc370 0x5627702e0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8864d23640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 -- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 msgr2=0x5627702e0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702e0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 -- 172.21.15.76:0/3117866918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702dc370 msgr2=0x5627702e0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702dc370 0x5627702e0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 -- 172.21.15.76:0/3117866918 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562770355bf0 con 0x5627702d2b40 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f885ffff640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702e0750 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f884c09c0d0 tx=0x7f884c0a4e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b991c393bb3a1052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f883ffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f883ffff640 1 -- 172.21.15.76:0/3117866918 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c01d070 con 0x5627702d2b40 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f883ffff640 1 -- 172.21.15.76:0/3117866918 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7f884c0987b0 con 0x5627702d2b40 2024-09-19T07:58:38.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.423+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f884c0a04f0 con 0x5627702d2b40 2024-09-19T07:58:38.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f883ffff640 1 -- 172.21.15.76:0/3117866918 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f884c0b5040 con 0x5627702d2b40 2024-09-19T07:58:38.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 10 client.17337 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:38.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562770356e50 con 0x5627702d2b40 2024-09-19T07:58:38.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f883ffff640 1 -- 172.21.15.76:0/3117866918 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f884c0a04f0 con 0x5627702d2b40 2024-09-19T07:58:38.450 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:38.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f883ffff640 1 -- 172.21.15.76:0/3117866918 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f884c09b000 con 0x5627702d2b40 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 10 client.17337 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 10 client.17337 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 20 client.17337 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627703575a0 0x5627703599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 4 client.17337 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56277023ed70 con 0x5627703575a0 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.424+0000 7f8864d23640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627703575a0 0x5627703599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8864d23640 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627703575a0 0x5627703599c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e61e5c6f8e1784e9 server_cookie=46eafa32bdf57970 in_seq=0 out_seq=0 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f883ffff640 10 client.17337 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f883ffff640 1 -- 172.21.15.76:0/3117866918 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56277023ed70 con 0x5627703575a0 2024-09-19T07:58:38.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f883ffff640 10 client.17337 handle_command_reply: tid=0 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 client.17337 shutdown 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 msgr2=0x5627702e0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702e0750 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f884c09c0d0 tx=0x7f884c0a4e30 comp rx=0 tx=0).stop 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 shutdown_connections 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5627703575a0 0x5627703599c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627702dc370 0x5627702e0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5627702d2b40 0x5627702e0750 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f883ffff640 0 client.17337 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 --2- 172.21.15.76:0/3117866918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5627702d15d0 0x5627702e0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 >> 172.21.15.76:0/3117866918 conn(0x56277029a310 msgr2=0x5627702daff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 shutdown_connections 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 1 -- 172.21.15.76:0/3117866918 wait complete. 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.425+0000 7f8869360740 20 client.17337 trim_cache size 0 max 16384 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88500a33b0 msgr2=0x7f88500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88500a33b0 0x7f88500a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8858007ea0 tx=0x7f885800c690 comp rx=0 tx=0).stop 2024-09-19T07:58:38.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 msgr2=0x7f8860198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 0x7f8860198ac0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c890 tx=0x7f884c00cd50 comp rx=0 tx=0).stop 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 shutdown_connections 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f88500a33b0 0x7f88500a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860106a80 0x7f886019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8860101420 0x7f8860198ac0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 --2- 172.21.15.76:0/3470205567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8860100a80 0x7f8860198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 >> 172.21.15.76:0/3470205567 conn(0x7f88600fc7a0 msgr2=0x7f8860104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 shutdown_connections 2024-09-19T07:58:38.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:38.426+0000 7f8866f87640 1 -- 172.21.15.76:0/3470205567 wait complete. 2024-09-19T07:58:38.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:38 smithi137 ceph-mon[35309]: pgmap v229: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:38.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:38 smithi076 ceph-mon[30930]: pgmap v229: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:39.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:38 smithi152 ceph-mon[35117]: pgmap v229: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:39.209 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:58:39.454 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:39.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 -- 172.21.15.76:0/3096515776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad8101290 msgr2=0x7fdad8107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 --2- 172.21.15.76:0/3096515776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad8101290 0x7fdad8107a50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009930 tx=0x7fdac802a420 comp rx=0 tx=0).stop 2024-09-19T07:58:39.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 -- 172.21.15.76:0/3096515776 shutdown_connections 2024-09-19T07:58:39.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 --2- 172.21.15.76:0/3096515776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad8108160 0x7fdad810eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 --2- 172.21.15.76:0/3096515776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad8101290 0x7fdad8107a50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 --2- 172.21.15.76:0/3096515776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdad81008e0 0x7fdad8100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 -- 172.21.15.76:0/3096515776 >> 172.21.15.76:0/3096515776 conn(0x7fdad8077210 msgr2=0x7fdad8077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:39.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 -- 172.21.15.76:0/3096515776 shutdown_connections 2024-09-19T07:58:39.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.924+0000 7fdade084640 1 -- 172.21.15.76:0/3096515776 wait complete. 2024-09-19T07:58:39.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 Processor -- start 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 -- start start 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 0x7fdad8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad8101290 0x7fdad8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdad8108160 0x7fdad819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8112180 con 0x7fdad81008e0 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8112000 con 0x7fdad8101290 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdade084640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8112300 con 0x7fdad8108160 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdad77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 0x7fdad8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdad77fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 0x7fdad8198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43484/0 (socket says 172.21.15.76:43484) 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdad77fe640 1 -- 172.21.15.76:0/584982071 learned_addr learned my addr 172.21.15.76:0/584982071 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdad7fff640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdad8108160 0x7fdad819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad8101290 0x7fdad8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.925+0000 7fdad77fe640 1 -- 172.21.15.76:0/584982071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdad8108160 msgr2=0x7fdad819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad77fe640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdad8108160 0x7fdad819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad77fe640 1 -- 172.21.15.76:0/584982071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad8101290 msgr2=0x7fdad8198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad77fe640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad8101290 0x7fdad8198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad77fe640 1 -- 172.21.15.76:0/584982071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad819d5d0 con 0x7fdad81008e0 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad77fe640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 0x7fdad8198620 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b4a0 tx=0x7fdac000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad4ff9640 1 -- 172.21.15.76:0/584982071 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0014070 con 0x7fdad81008e0 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad4ff9640 1 -- 172.21.15.76:0/584982071 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdac0010b10 con 0x7fdad81008e0 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad819d8c0 con 0x7fdad81008e0 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdad4ff9640 1 -- 172.21.15.76:0/584982071 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0017d60 con 0x7fdad81008e0 2024-09-19T07:58:39.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.926+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad81a51a0 con 0x7fdad81008e0 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdad4ff9640 1 -- 172.21.15.76:0/584982071 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fdac0017070 con 0x7fdad81008e0 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 Processor -- start 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 -- start start 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 0x564cd8411090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd8411a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd841e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564cd83772f0 con 0x564cd8412b40 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564cd831ecf0 con 0x564cd841c370 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.929+0000 7fdae045d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564cd83732b0 con 0x564cd84115d0 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 0x564cd8411090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 0x564cd8411090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43486/0 (socket says 172.21.15.76:43486) 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 -- 172.21.15.76:0/1198606547 learned_addr learned my addr 172.21.15.76:0/1198606547 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd8411a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd841e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 -- 172.21.15.76:0/1198606547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 msgr2=0x564cd8411a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd8411a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 -- 172.21.15.76:0/1198606547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 msgr2=0x564cd841e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd841e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 -- 172.21.15.76:0/1198606547 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd83033a0 con 0x564cd8412b40 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad4ff9640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdac40a33b0 0x7fdac40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad7fff640 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 0x564cd8411090 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009ee0 tx=0x7fdad0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c1523ba0f7e958 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad77fe640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdac40a33b0 0x7fdac40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdacdffb640 1 -- 172.21.15.76:0/1198606547 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0016070 con 0x564cd8412b40 2024-09-19T07:58:39.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdacdffb640 1 -- 172.21.15.76:0/1198606547 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdad0004d20 con 0x564cd8412b40 2024-09-19T07:58:39.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdacdffb640 1 -- 172.21.15.76:0/1198606547 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0012870 con 0x564cd8412b40 2024-09-19T07:58:39.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.930+0000 7fdad4ff9640 1 -- 172.21.15.76:0/584982071 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fdac00cf0f0 con 0x7fdad81008e0 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdad77fe640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdac40a33b0 0x7fdac40a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdac00cc970 tx=0x7fdac0097040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 -- 172.21.15.76:0/1198606547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 msgr2=0x564cd8411090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 0x564cd8411090 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009ee0 tx=0x7fdad0010740 comp rx=0 tx=0).stop 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 -- 172.21.15.76:0/1198606547 shutdown_connections 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd841e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd8411a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 --2- 172.21.15.76:0/1198606547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd8412b40 0x564cd8411090 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 -- 172.21.15.76:0/1198606547 >> 172.21.15.76:0/1198606547 conn(0x564cd83da310 msgr2=0x564cd840dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 -- 172.21.15.76:0/1198606547 shutdown_connections 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.931+0000 7fdae045d740 1 -- 172.21.15.76:0/1198606547 wait complete. 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 -- start start 2024-09-19T07:58:39.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 Processor -- start 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8418ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8419600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564cd841f070 con 0x564cd841c370 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564cd8332060 con 0x564cd8412b40 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564cd841f1f0 con 0x564cd84115d0 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdae045d740 10 client.0 _ll_register_callbacks cb 0x564cd80858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8419600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8419600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43488/0 (socket says 172.21.15.76:43488) 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdad6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8418ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.932+0000 7fdad7fff640 1 -- 172.21.15.76:0/3420352920 learned_addr learned my addr 172.21.15.76:0/3420352920 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 -- 172.21.15.76:0/3420352920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 msgr2=0x564cd841bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 -- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 msgr2=0x564cd8418ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8418ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 -- 172.21.15.76:0/3420352920 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cd80e83c0 con 0x564cd841c370 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8418ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdad7fff640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8419600 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdad0005a60 tx=0x7fdad0012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeb88a76f03e63e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdab6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:39.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdab6ffd640 1 -- 172.21.15.76:0/3420352920 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad001e070 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdab6ffd640 1 -- 172.21.15.76:0/3420352920 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fdad0012800 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad0004d20 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdab6ffd640 1 -- 172.21.15.76:0/3420352920 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdad0030050 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdae045d740 10 client.17349 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.933+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564cd842aae0 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdab6ffd640 1 -- 172.21.15.76:0/3420352920 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdad0004d20 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdab6ffd640 1 -- 172.21.15.76:0/3420352920 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdad000f040 con 0x564cd841c370 2024-09-19T07:58:39.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdae045d740 10 client.17349 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdae045d740 10 client.17349 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdae045d740 20 client.17349 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdae045d740 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd842be30 0x564cd842e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdae045d740 4 client.17349 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cd8384860 con 0x564cd842be30 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.934+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd842be30 0x564cd842e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd842be30 0x564cd842e220 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0f0200925d133ff server_cookie=6afb2e29f53c8c1f in_seq=0 out_seq=0 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdab6ffd640 10 client.17349 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdab6ffd640 1 -- 172.21.15.76:0/3420352920 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564cd8384860 con 0x564cd842be30 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdab6ffd640 10 client.17349 handle_command_reply: tid=0 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 client.17349 shutdown 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 msgr2=0x564cd8419600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8419600 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdad0005a60 tx=0x7fdad0012450 comp rx=0 tx=0).stop 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 shutdown_connections 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd842be30 0x564cd842e220 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8419600 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8418ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdab6ffd640 0 client.17349 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.935+0000 7fdae045d740 1 --2- 172.21.15.76:0/3420352920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.936+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 >> 172.21.15.76:0/3420352920 conn(0x564cd83da310 msgr2=0x564cd8413960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.936+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 shutdown_connections 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.936+0000 7fdae045d740 1 -- 172.21.15.76:0/3420352920 wait complete. 2024-09-19T07:58:39.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.936+0000 7fdae045d740 20 client.17349 trim_cache size 0 max 16384 2024-09-19T07:58:39.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 Processor -- start 2024-09-19T07:58:39.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 -- start start 2024-09-19T07:58:39.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8428310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8424860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81b0660 con 0x564cd841c370 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81adf30 con 0x564cd8412b40 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.948+0000 7fdae045d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81abda0 con 0x564cd84115d0 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8424860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8424860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43496/0 (socket says 172.21.15.76:43496) 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 -- 172.21.15.76:0/2346083226 learned_addr learned my addr 172.21.15.76:0/2346083226 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8428310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 -- 172.21.15.76:0/2346083226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 msgr2=0x564cd841b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 -- 172.21.15.76:0/2346083226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 msgr2=0x564cd8428310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8428310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 -- 172.21.15.76:0/2346083226 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd8412780 con 0x564cd841c370 2024-09-19T07:58:39.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8428310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:39.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdad7fff640 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8424860 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdad0005950 tx=0x7fdad0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bb12e962c40da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:39.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdacd7fa640 1 -- 172.21.15.76:0/2346083226 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad001e070 con 0x564cd841c370 2024-09-19T07:58:39.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdacd7fa640 1 -- 172.21.15.76:0/2346083226 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdad0005bd0 con 0x564cd841c370 2024-09-19T07:58:39.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.949+0000 7fdacd7fa640 1 -- 172.21.15.76:0/2346083226 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0016040 con 0x564cd841c370 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 -- 172.21.15.76:0/2346083226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 msgr2=0x564cd8424860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8424860 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdad0005950 tx=0x7fdad0009c30 comp rx=0 tx=0).stop 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 -- 172.21.15.76:0/2346083226 shutdown_connections 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd841c370 0x564cd8424860 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd8412b40 0x564cd8428310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 --2- 172.21.15.76:0/2346083226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd84115d0 0x564cd841b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 -- 172.21.15.76:0/2346083226 >> 172.21.15.76:0/2346083226 conn(0x564cd83da310 msgr2=0x564cd840cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:39.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 -- 172.21.15.76:0/2346083226 shutdown_connections 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 -- 172.21.15.76:0/2346083226 wait complete. 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 -- start start 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.950+0000 7fdae045d740 1 Processor -- start 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 0x564cd8416c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd8412b40 0x564cd84333d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd84339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81ac3f0 con 0x564cd84115d0 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81ad860 con 0x564cd841c370 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81acac0 con 0x564cd8412b40 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 10 client.0 _ll_register_callbacks cb 0x7fdac8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 0x564cd8416c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 0x564cd8416c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43504/0 (socket says 172.21.15.76:43504) 2024-09-19T07:58:39.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 -- 172.21.15.76:0/417922328 learned_addr learned my addr 172.21.15.76:0/417922328 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 -- 172.21.15.76:0/417922328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd8412b40 msgr2=0x564cd84333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd8412b40 0x564cd84333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 -- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 msgr2=0x564cd84339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd84339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 -- 172.21.15.76:0/417922328 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cd84341e0 con 0x564cd84115d0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdad7fff640 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 0x564cd8416c30 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdad00092f0 tx=0x7fdad00097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad24f8cb7802cc1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdab6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdab6ffd640 1 -- 172.21.15.76:0/417922328 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0016030 con 0x564cd84115d0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdab6ffd640 1 -- 172.21.15.76:0/417922328 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fdad001a9d0 con 0x564cd84115d0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad0005bd0 con 0x564cd84115d0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdab6ffd640 1 -- 172.21.15.76:0/417922328 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdad001e070 con 0x564cd84115d0 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.951+0000 7fdae045d740 10 client.17355 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:39.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564cd849a920 con 0x564cd84115d0 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdab6ffd640 1 -- 172.21.15.76:0/417922328 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdad0005bd0 con 0x564cd84115d0 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdab6ffd640 1 -- 172.21.15.76:0/417922328 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdad0035780 con 0x564cd84115d0 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 10 client.17355 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 10 client.17355 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 20 client.17355 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd849af60 0x564cd849d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 4 client.17355 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564cd837ed70 con 0x564cd849af60 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.952+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd849af60 0x564cd849d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdad6ffd640 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd849af60 0x564cd849d380 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cdf87be3b151e6e server_cookie=74956fea2b78d778 in_seq=0 out_seq=0 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdab6ffd640 10 client.17355 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:39.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdab6ffd640 1 -- 172.21.15.76:0/417922328 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564cd837ed70 con 0x564cd849af60 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdab6ffd640 10 client.17355 handle_command_reply: tid=0 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 client.17355 shutdown 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 msgr2=0x564cd8416c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 0x564cd8416c30 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdad00092f0 tx=0x7fdad00097d0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 shutdown_connections 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564cd849af60 0x564cd849d380 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564cd841c370 0x564cd84339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564cd8412b40 0x564cd84333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 --2- 172.21.15.76:0/417922328 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cd84115d0 0x564cd8416c30 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 >> 172.21.15.76:0/417922328 conn(0x564cd83da310 msgr2=0x564cd8417790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdab6ffd640 0 client.17355 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 shutdown_connections 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 1 -- 172.21.15.76:0/417922328 wait complete. 2024-09-19T07:58:39.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.953+0000 7fdae045d740 20 client.17355 trim_cache size 0 max 16384 2024-09-19T07:58:39.959 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdac40a33b0 msgr2=0x7fdac40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdac40a33b0 0x7fdac40a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdac00cc970 tx=0x7fdac0097040 comp rx=0 tx=0).stop 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 msgr2=0x7fdad8198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 0x7fdad8198620 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b4a0 tx=0x7fdac000b960 comp rx=0 tx=0).stop 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 shutdown_connections 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdac40a33b0 0x7fdac40a5870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdad8108160 0x7fdad819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad8101290 0x7fdad8198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 --2- 172.21.15.76:0/584982071 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdad81008e0 0x7fdad8198620 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 >> 172.21.15.76:0/584982071 conn(0x7fdad8077210 msgr2=0x7fdad80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:39.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 shutdown_connections 2024-09-19T07:58:39.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:39.954+0000 7fdade084640 1 -- 172.21.15.76:0/584982071 wait complete. 2024-09-19T07:58:40.787 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:58:40.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:40 smithi137 ceph-mon[35309]: pgmap v230: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:58:40.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:40 smithi076 ceph-mon[30930]: pgmap v230: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:58:41.035 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:41.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:40 smithi152 ceph-mon[35117]: pgmap v230: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 -- 172.21.15.76:0/3959675954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 msgr2=0x7ffab010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 --2- 172.21.15.76:0/3959675954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab010e610 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009900 tx=0x7ffaa802a480 comp rx=0 tx=0).stop 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 -- 172.21.15.76:0/3959675954 shutdown_connections 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 --2- 172.21.15.76:0/3959675954 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab010e610 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 --2- 172.21.15.76:0/3959675954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 0x7ffab010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 --2- 172.21.15.76:0/3959675954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 0x7ffab0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 -- 172.21.15.76:0/3959675954 >> 172.21.15.76:0/3959675954 conn(0x7ffab00fc7a0 msgr2=0x7ffab00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 -- 172.21.15.76:0/3959675954 shutdown_connections 2024-09-19T07:58:41.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.511+0000 7ffab56f9640 1 -- 172.21.15.76:0/3959675954 wait complete. 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 Processor -- start 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 -- start start 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 0x7ffab0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 0x7ffab0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0112070 con 0x7ffab010c170 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0111ef0 con 0x7ffab0103660 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.512+0000 7ffab56f9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01121f0 con 0x7ffab0102d40 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43524/0 (socket says 172.21.15.76:43524) 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/1548031449 learned_addr learned my addr 172.21.15.76:0/1548031449 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:41.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 0x7ffab0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 0x7ffab0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/1548031449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 msgr2=0x7ffab0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 0x7ffab0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/1548031449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 msgr2=0x7ffab0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 0x7ffab0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/1548031449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab019d3e0 con 0x7ffab010c170 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 0x7ffab0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 0x7ffab0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab019cd00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005ab0 tx=0x7ffaa80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaa7fff640 1 -- 172.21.15.76:0/1548031449 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa803f030 con 0x7ffab010c170 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab019d670 con 0x7ffab010c170 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaa7fff640 1 -- 172.21.15.76:0/1548031449 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffaa8003d00 con 0x7ffab010c170 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffaa7fff640 1 -- 172.21.15.76:0/1548031449 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8035070 con 0x7ffab010c170 2024-09-19T07:58:41.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.513+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab01a4fb0 con 0x7ffab010c170 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.515+0000 7ffaa7fff640 1 -- 172.21.15.76:0/1548031449 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ffaa8042030 con 0x7ffab010c170 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 Processor -- start 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 -- start start 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaa7fff640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ffa9c0a33b0 0x7ffa9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaa7fff640 1 -- 172.21.15.76:0/1548031449 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ffaa80f0290 con 0x7ffab010c170 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ffa9c0a33b0 0x7ffa9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 0x564efa7ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564efa7112f0 con 0x564efa7acb40 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564efa6b8cf0 con 0x564efa7b6370 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564efa70d2b0 con 0x564efa7ab5d0 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 0x564efa7ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 0x564efa7ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43536/0 (socket says 172.21.15.76:43536) 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1819695849 learned_addr learned my addr 172.21.15.76:0/1819695849 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.516+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1819695849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 msgr2=0x564efa7aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1819695849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 msgr2=0x564efa7b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ffa9c0a33b0 0x7ffa9c0a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa98005fd0 tx=0x7ffa98013900 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:41.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1819695849 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564efa69d3a0 con 0x564efa7acb40 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 0x564efa7ab090 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0008f10 tx=0x7ffaa000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc2cc55e8e1d249 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaa57fa640 1 -- 172.21.15.76:0/1819695849 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000f830 con 0x564efa7acb40 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaa57fa640 1 -- 172.21.15.76:0/1819695849 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffaa0018480 con 0x564efa7acb40 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.517+0000 7ffaa57fa640 1 -- 172.21.15.76:0/1819695849 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000e5f0 con 0x564efa7acb40 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1819695849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 msgr2=0x564efa7ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 0x564efa7ab090 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0008f10 tx=0x7ffaa000d710 comp rx=0 tx=0).stop 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1819695849 shutdown_connections 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1819695849 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7acb40 0x564efa7ab090 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1819695849 >> 172.21.15.76:0/1819695849 conn(0x564efa774310 msgr2=0x564efa7a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1819695849 shutdown_connections 2024-09-19T07:58:41.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1819695849 wait complete. 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 -- start start 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.518+0000 7ffab7ad2740 1 Processor -- start 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7acb40 0x564efa7b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564efa7b9070 con 0x564efa7b6370 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564efa6cc060 con 0x564efa7acb40 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564efa7b91f0 con 0x564efa7ab5d0 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 10 client.0 _ll_register_callbacks cb 0x564efa41f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43542/0 (socket says 172.21.15.76:43542) 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/295556586 learned_addr learned my addr 172.21.15.76:0/295556586 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7acb40 0x564efa7b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 msgr2=0x564efa7b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/295556586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7acb40 msgr2=0x564efa7b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7acb40 0x564efa7b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/295556586 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564efa4823c0 con 0x564efa7b6370 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7b3570 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005820 tx=0x7ffaa80bc020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88f94cd52a9fd00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffa967fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffa967fc640 1 -- 172.21.15.76:0/295556586 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8049040 con 0x564efa7b6370 2024-09-19T07:58:41.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffa967fc640 1 -- 172.21.15.76:0/295556586 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ffaa80b8b50 con 0x564efa7b6370 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa0018480 con 0x564efa7b6370 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffa967fc640 1 -- 172.21.15.76:0/295556586 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffaa80bc4e0 con 0x564efa7b6370 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 10 client.17367 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.519+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564efa7c4ac0 con 0x564efa7b6370 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffa967fc640 1 -- 172.21.15.76:0/295556586 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffaa0018480 con 0x564efa7b6370 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffa967fc640 1 -- 172.21.15.76:0/295556586 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ffaa80c4cc0 con 0x564efa7b6370 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffab7ad2740 10 client.17367 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffab7ad2740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffab7ad2740 20 client.17367 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa7c5f20 0x564efa7c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffab7ad2740 4 client.17367 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564efa71e860 con 0x564efa7c5f20 2024-09-19T07:58:41.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa7c5f20 0x564efa7c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa7c5f20 0x564efa7c8350 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5c351f6dd9358b server_cookie=18e22da2eebe443 in_seq=0 out_seq=0 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.520+0000 7ffa967fc640 10 client.17367 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffa967fc640 1 -- 172.21.15.76:0/295556586 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564efa71e860 con 0x564efa7c5f20 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffa967fc640 10 client.17367 handle_command_reply: tid=0 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 client.17367 shutdown 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 msgr2=0x564efa7b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7b3570 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005820 tx=0x7ffaa80bc020 comp rx=0 tx=0).stop 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 shutdown_connections 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa7c5f20 0x564efa7c8350 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7b3570 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7acb40 0x564efa7b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffa967fc640 0 client.17367 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:41.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/295556586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7ab5d0 0x564efa7b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 >> 172.21.15.76:0/295556586 conn(0x564efa774310 msgr2=0x564efa7ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:41.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 shutdown_connections 2024-09-19T07:58:41.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.521+0000 7ffab7ad2740 1 -- 172.21.15.76:0/295556586 wait complete. 2024-09-19T07:58:41.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.522+0000 7ffab7ad2740 20 client.17367 trim_cache size 0 max 16384 2024-09-19T07:58:41.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.534+0000 7ffab7ad2740 1 Processor -- start 2024-09-19T07:58:41.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.534+0000 7ffab7ad2740 1 -- start start 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7ab5d0 0x564efa7c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01b0420 con 0x564efa7b6370 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01adcf0 con 0x564efa7ab5d0 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01abb60 con 0x564efa7acb40 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43550/0 (socket says 172.21.15.76:43550) 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/3893215069 learned_addr learned my addr 172.21.15.76:0/3893215069 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7ab5d0 0x564efa7c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/3893215069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 msgr2=0x564efa7ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/3893215069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7ab5d0 msgr2=0x564efa7c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7ab5d0 0x564efa7c2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 -- 172.21.15.76:0/3893215069 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564efa7b5940 con 0x564efa7b6370 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.535+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7ae660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80edf50 tx=0x7ffaa80bc150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdd2707d8e91dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffaa4ff9640 1 -- 172.21.15.76:0/3893215069 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8049030 con 0x564efa7b6370 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffaa4ff9640 1 -- 172.21.15.76:0/3893215069 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffaa803bc70 con 0x564efa7b6370 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffaa4ff9640 1 -- 172.21.15.76:0/3893215069 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80b8b50 con 0x564efa7b6370 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 -- 172.21.15.76:0/3893215069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 msgr2=0x564efa7ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7ae660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80edf50 tx=0x7ffaa80bc150 comp rx=0 tx=0).stop 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 -- 172.21.15.76:0/3893215069 shutdown_connections 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7b6370 0x564efa7ae660 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/3893215069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7ab5d0 0x564efa7c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 -- 172.21.15.76:0/3893215069 >> 172.21.15.76:0/3893215069 conn(0x564efa774310 msgr2=0x564efa7b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 -- 172.21.15.76:0/3893215069 shutdown_connections 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.536+0000 7ffab7ad2740 1 -- 172.21.15.76:0/3893215069 wait complete. 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 -- start start 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 Processor -- start 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 0x564efa7beb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01ac1b0 con 0x564efa7ab5d0 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01ad620 con 0x564efa7b6370 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01ac880 con 0x564efa7acb40 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffab7ad2740 10 client.0 _ll_register_callbacks cb 0x7ffaa80044e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 0x564efa7beb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 0x564efa7beb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:43556/0 (socket says 172.21.15.76:43556) 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1114629177 learned_addr learned my addr 172.21.15.76:0/1114629177 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 msgr2=0x564efa7b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1114629177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 msgr2=0x564efa7ba3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7ba3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaeffd640 1 -- 172.21.15.76:0/1114629177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564efa7babf0 con 0x564efa7ab5d0 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.537+0000 7ffaaf7fe640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7ba3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffaaeffd640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 0x564efa7beb30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000dc10 tx=0x7ffaa0008b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec342afef920a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffa967fc640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffa967fc640 1 -- 172.21.15.76:0/1114629177 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0004e10 con 0x564efa7ab5d0 2024-09-19T07:58:41.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffa967fc640 1 -- 172.21.15.76:0/1114629177 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ffaa0018480 con 0x564efa7ab5d0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564efa718d70 con 0x564efa7ab5d0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffa967fc640 1 -- 172.21.15.76:0/1114629177 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffaa0033050 con 0x564efa7ab5d0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 10 client.17373 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564efa830b50 con 0x564efa7ab5d0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffa967fc640 1 -- 172.21.15.76:0/1114629177 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x564efa718d70 con 0x564efa7ab5d0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffa967fc640 1 -- 172.21.15.76:0/1114629177 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ffaa000fc90 con 0x564efa7ab5d0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 10 client.17373 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 10 client.17373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 20 client.17373 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa830ff0 0x564efa8333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 4 client.17373 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.538+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564efa695170 con 0x564efa830ff0 2024-09-19T07:58:41.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.539+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa830ff0 0x564efa8333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.539+0000 7ffa967fc640 10 client.17373 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.539+0000 7ffaae7fc640 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa830ff0 0x564efa8333e0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61abb7c01aac09ee server_cookie=5bbe819a8164eadd in_seq=0 out_seq=0 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.539+0000 7ffa967fc640 1 -- 172.21.15.76:0/1114629177 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564efa695170 con 0x564efa830ff0 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.539+0000 7ffa967fc640 10 client.17373 handle_command_reply: tid=0 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.539+0000 7ffab7ad2740 1 client.17373 shutdown 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 msgr2=0x564efa7beb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 0x564efa7beb30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000dc10 tx=0x7ffaa0008b80 comp rx=0 tx=0).stop 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 shutdown_connections 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564efa7b6370 0x564efa7ba3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564efa7acb40 0x564efa7b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x564efa830ff0 0x564efa8333e0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 --2- 172.21.15.76:0/1114629177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564efa7ab5d0 0x564efa7beb30 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 >> 172.21.15.76:0/1114629177 conn(0x564efa774310 msgr2=0x564efa7a64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:41.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffa967fc640 0 client.17373 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:41.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 shutdown_connections 2024-09-19T07:58:41.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 1 -- 172.21.15.76:0/1114629177 wait complete. 2024-09-19T07:58:41.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab7ad2740 20 client.17373 trim_cache size 0 max 16384 2024-09-19T07:58:41.555 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:58:41.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ffa9c0a33b0 msgr2=0x7ffa9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ffa9c0a33b0 0x7ffa9c0a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa98005fd0 tx=0x7ffa98013900 comp rx=0 tx=0).stop 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 msgr2=0x7ffab019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab019cd00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005ab0 tx=0x7ffaa80042f0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 shutdown_connections 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ffa9c0a33b0 0x7ffa9c0a5870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffab010c170 0x7ffab019cd00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffab0103660 0x7ffab0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 --2- 172.21.15.76:0/1548031449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab0102d40 0x7ffab0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.540+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 >> 172.21.15.76:0/1548031449 conn(0x7ffab00fc7a0 msgr2=0x7ffab00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.541+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 shutdown_connections 2024-09-19T07:58:41.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:41.541+0000 7ffab56f9640 1 -- 172.21.15.76:0/1548031449 wait complete. 2024-09-19T07:58:42.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:42 smithi076 ceph-mon[30930]: pgmap v231: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:42.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:42 smithi137 ceph-mon[35309]: pgmap v231: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:43.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:42 smithi152 ceph-mon[35117]: pgmap v231: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:43.418 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:58:43.418 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:58:43.689 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:44.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.197+0000 7fad93a5f640 1 -- 172.21.15.76:0/3655588647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 msgr2=0x7fad8c112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.197+0000 7fad93a5f640 1 --2- 172.21.15.76:0/3655588647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c112660 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009900 tx=0x7fad7c02a480 comp rx=0 tx=0).stop 2024-09-19T07:58:44.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- 172.21.15.76:0/3655588647 shutdown_connections 2024-09-19T07:58:44.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 --2- 172.21.15.76:0/3655588647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad8c112ba0 0x7fad8c114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 --2- 172.21.15.76:0/3655588647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c112660 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 --2- 172.21.15.76:0/3655588647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c074590 0x7fad8c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- 172.21.15.76:0/3655588647 >> 172.21.15.76:0/3655588647 conn(0x7fad8c0fd8b0 msgr2=0x7fad8c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- 172.21.15.76:0/3655588647 shutdown_connections 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- 172.21.15.76:0/3655588647 wait complete. 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 Processor -- start 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- start start 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c074590 0x7fad8c1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c1a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad8c112ba0 0x7fad8c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1187a0 con 0x7fad8c074eb0 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c118620 con 0x7fad8c074590 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.198+0000 7fad93a5f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c118920 con 0x7fad8c112ba0 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c1a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c1a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47468/0 (socket says 172.21.15.76:47468) 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 -- 172.21.15.76:0/300010622 learned_addr learned my addr 172.21.15.76:0/300010622 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad917fb640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c074590 0x7fad8c1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad91ffc640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad8c112ba0 0x7fad8c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 -- 172.21.15.76:0/300010622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad8c112ba0 msgr2=0x7fad8c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad8c112ba0 0x7fad8c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 -- 172.21.15.76:0/300010622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c074590 msgr2=0x7fad8c1a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c074590 0x7fad8c1a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 -- 172.21.15.76:0/300010622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c19f3a0 con 0x7fad8c074eb0 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad90ffa640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c1a4fa0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006010 tx=0x7fad7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad827fc640 1 -- 172.21.15.76:0/300010622 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c03f030 con 0x7fad8c074eb0 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad827fc640 1 -- 172.21.15.76:0/300010622 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad7c003d00 con 0x7fad8c074eb0 2024-09-19T07:58:44.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c19f630 con 0x7fad8c074eb0 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad827fc640 1 -- 172.21.15.76:0/300010622 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c035070 con 0x7fad8c074eb0 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.199+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c1ab810 con 0x7fad8c074eb0 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad827fc640 1 -- 172.21.15.76:0/300010622 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fad7c042030 con 0x7fad8c074eb0 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 Processor -- start 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 -- start start 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4f4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560dbf44c280 con 0x560dbf4e6b60 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560dbf3f3b10 con 0x560dbf4e7480 2024-09-19T07:58:44.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad95e38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dbf448240 con 0x560dbf4f1d40 2024-09-19T07:58:44.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad827fc640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fad780a33b0 0x7fad780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.202+0000 7fad91ffc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4e6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47480/0 (socket says 172.21.15.76:47480) 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 -- 172.21.15.76:0/2517189418 learned_addr learned my addr 172.21.15.76:0/2517189418 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad90ffa640 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad917fb640 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fad780a33b0 0x7fad780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 -- 172.21.15.76:0/2517189418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 msgr2=0x560dbf4f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad827fc640 1 -- 172.21.15.76:0/300010622 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fad7c0f0780 con 0x7fad8c074eb0 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 -- 172.21.15.76:0/2517189418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 msgr2=0x560dbf4f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 -- 172.21.15.76:0/2517189418 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dbf4001f0 con 0x560dbf4e6b60 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad90ffa640 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad91ffc640 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4e6f40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fad8400caf0 tx=0x7fad840072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ee9422a4c6ca4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad777fe640 1 -- 172.21.15.76:0/2517189418 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84015070 con 0x560dbf4e6b60 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad777fe640 1 -- 172.21.15.76:0/2517189418 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad84016040 con 0x560dbf4e6b60 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.203+0000 7fad777fe640 1 -- 172.21.15.76:0/2517189418 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8401e020 con 0x560dbf4e6b60 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 -- 172.21.15.76:0/2517189418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 msgr2=0x560dbf4e6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad91ffc640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fad780a33b0 0x7fad780a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad8401f000 tx=0x7fad8401b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:44.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4e6f40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fad8400caf0 tx=0x7fad840072b0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 -- 172.21.15.76:0/2517189418 shutdown_connections 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 --2- 172.21.15.76:0/2517189418 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4e6f40 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 -- 172.21.15.76:0/2517189418 >> 172.21.15.76:0/2517189418 conn(0x560dbf4e30f0 msgr2=0x560dbf4e34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 -- 172.21.15.76:0/2517189418 shutdown_connections 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.204+0000 7fad95e38740 1 -- 172.21.15.76:0/2517189418 wait complete. 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 -- start start 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 Processor -- start 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4eec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x560dbf4f4910 con 0x560dbf4e6b60 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560dbf406f10 con 0x560dbf4e7480 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560dbf4f4a90 con 0x560dbf4f1d40 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad95e38740 10 client.0 _ll_register_callbacks cb 0x560dbf3cfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad917fb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad917fb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4eec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47488/0 (socket says 172.21.15.76:47488) 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.205+0000 7fad917fb640 1 -- 172.21.15.76:0/2462206635 learned_addr learned my addr 172.21.15.76:0/2462206635 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad91ffc640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad917fb640 1 -- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 msgr2=0x560dbf4ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad917fb640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad917fb640 1 -- 172.21.15.76:0/2462206635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 msgr2=0x560dbf4ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad917fb640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad917fb640 1 -- 172.21.15.76:0/2462206635 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dbf1bd6a0 con 0x560dbf4e6b60 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad91ffc640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad917fb640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4eec60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fad88010500 tx=0x7fad880109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2473b918412b71a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad74ff9640 1 -- 172.21.15.76:0/2462206635 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8801a020 con 0x560dbf4e6b60 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad74ff9640 1 -- 172.21.15.76:0/2462206635 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fad88016690 con 0x560dbf4e6b60 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad84016040 con 0x560dbf4e6b60 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad74ff9640 1 -- 172.21.15.76:0/2462206635 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fad88025050 con 0x560dbf4e6b60 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad95e38740 10 client.17385 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560dbf500580 con 0x560dbf4e6b60 2024-09-19T07:58:44.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.206+0000 7fad74ff9640 1 -- 172.21.15.76:0/2462206635 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad84016040 con 0x560dbf4e6b60 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad74ff9640 1 -- 172.21.15.76:0/2462206635 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fad88014b50 con 0x560dbf4e6b60 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad95e38740 10 client.17385 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad95e38740 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad95e38740 20 client.17385 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad95e38740 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf503f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad95e38740 4 client.17385 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dbf4597f0 con 0x560dbf501a40 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad90ffa640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf503f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad90ffa640 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf503f00 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b3e2b909079f25 server_cookie=8c0194ee47ad31f3 in_seq=0 out_seq=0 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.207+0000 7fad74ff9640 10 client.17385 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:44.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad74ff9640 1 -- 172.21.15.76:0/2462206635 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560dbf4597f0 con 0x560dbf501a40 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad74ff9640 10 client.17385 handle_command_reply: tid=0 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 client.17385 shutdown 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 msgr2=0x560dbf4eec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4eec60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fad88010500 tx=0x7fad880109c0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 shutdown_connections 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf4ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e7480 0x560dbf4ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf503f00 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 --2- 172.21.15.76:0/2462206635 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e6b60 0x560dbf4eec60 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad74ff9640 0 client.17385 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 >> 172.21.15.76:0/2462206635 conn(0x560dbf4e30f0 msgr2=0x560dbf4e8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:44.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 shutdown_connections 2024-09-19T07:58:44.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 1 -- 172.21.15.76:0/2462206635 wait complete. 2024-09-19T07:58:44.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.208+0000 7fad95e38740 20 client.17385 trim_cache size 0 max 16384 2024-09-19T07:58:44.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.225+0000 7fad95e38740 1 Processor -- start 2024-09-19T07:58:44.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.225+0000 7fad95e38740 1 -- start start 2024-09-19T07:58:44.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad95e38740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad95e38740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 0x560dbf509820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad95e38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf509d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad95e38740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1b6c90 con 0x560dbf4e7480 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad95e38740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1b4560 con 0x560dbf4e6b60 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad95e38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1b23d0 con 0x560dbf4f1d40 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 0x560dbf509820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 0x560dbf509820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47496/0 (socket says 172.21.15.76:47496) 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 -- 172.21.15.76:0/368184074 learned_addr learned my addr 172.21.15.76:0/368184074 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad917fb640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad91ffc640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf509d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 -- 172.21.15.76:0/368184074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 msgr2=0x560dbf509d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf509d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 -- 172.21.15.76:0/368184074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 msgr2=0x560dbf4e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4e2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 -- 172.21.15.76:0/368184074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dbf4e2b90 con 0x560dbf4e7480 2024-09-19T07:58:44.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad917fb640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:58:44.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad91ffc640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf509d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:44.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad90ffa640 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 0x560dbf509820 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0bc960 tx=0x7fad7c08f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a5ae004bf2069e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:44.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad76ffd640 1 -- 172.21.15.76:0/368184074 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c049040 con 0x560dbf4e7480 2024-09-19T07:58:44.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad76ffd640 1 -- 172.21.15.76:0/368184074 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad7c0bc9d0 con 0x560dbf4e7480 2024-09-19T07:58:44.230 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.226+0000 7fad76ffd640 1 -- 172.21.15.76:0/368184074 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0b9040 con 0x560dbf4e7480 2024-09-19T07:58:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 -- 172.21.15.76:0/368184074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 msgr2=0x560dbf509820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 0x560dbf509820 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0bc960 tx=0x7fad7c08f800 comp rx=0 tx=0).stop 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 -- 172.21.15.76:0/368184074 shutdown_connections 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4f1d40 0x560dbf509d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4e7480 0x560dbf509820 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 --2- 172.21.15.76:0/368184074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 -- 172.21.15.76:0/368184074 >> 172.21.15.76:0/368184074 conn(0x560dbf4e30f0 msgr2=0x560dbf4e1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 -- 172.21.15.76:0/368184074 shutdown_connections 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 -- 172.21.15.76:0/368184074 wait complete. 2024-09-19T07:58:44.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.227+0000 7fad95e38740 1 -- start start 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 Processor -- start 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4e7480 0x560dbf4f6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 0x560dbf4f6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1b2a20 con 0x560dbf4f1d40 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1b3e90 con 0x560dbf4e6b60 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c1b30f0 con 0x560dbf4e7480 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad95e38740 10 client.0 _ll_register_callbacks cb 0x7fad8800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:44.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 0x560dbf4f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 0x560dbf4f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47506/0 (socket says 172.21.15.76:47506) 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 -- 172.21.15.76:0/656693493 learned_addr learned my addr 172.21.15.76:0/656693493 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad90ffa640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4e7480 0x560dbf4f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad917fb640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 -- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4e7480 msgr2=0x560dbf4f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4e7480 0x560dbf4f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 -- 172.21.15.76:0/656693493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 msgr2=0x560dbf4f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad91ffc640 1 -- 172.21.15.76:0/656693493 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dbf56b950 con 0x560dbf4f1d40 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.228+0000 7fad917fb640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:58:44.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad91ffc640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 0x560dbf4f6650 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fad84000f80 tx=0x7fad8400a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301f1e36557553ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad74ff9640 1 -- 172.21.15.76:0/656693493 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84031060 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad74ff9640 1 -- 172.21.15.76:0/656693493 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7fad8400a9a0 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad7c0bc9d0 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad74ff9640 1 -- 172.21.15.76:0/656693493 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fad84038050 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 10 client.17391 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560dbf56cba0 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad74ff9640 1 -- 172.21.15.76:0/656693493 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad7c0bc9d0 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad74ff9640 1 -- 172.21.15.76:0/656693493 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fad8401aa60 con 0x560dbf4f1d40 2024-09-19T07:58:44.238 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 10 client.17391 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 20 client.17391 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf56f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 4 client.17391 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.229+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560dbf453d00 con 0x560dbf501a40 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.230+0000 7fad917fb640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf56f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.230+0000 7fad74ff9640 10 client.17391 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.230+0000 7fad917fb640 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf56f160 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72decbac36a1e370 server_cookie=6fd619ba630f9a5f in_seq=0 out_seq=0 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad74ff9640 1 -- 172.21.15.76:0/656693493 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560dbf453d00 con 0x560dbf501a40 2024-09-19T07:58:44.239 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad74ff9640 10 client.17391 handle_command_reply: tid=0 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 client.17391 shutdown 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 msgr2=0x560dbf4f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 0x560dbf4f6650 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fad84000f80 tx=0x7fad8400a810 comp rx=0 tx=0).stop 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 shutdown_connections 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x560dbf501a40 0x560dbf56f160 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560dbf4f1d40 0x560dbf4f6650 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad74ff9640 0 client.17391 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560dbf4e7480 0x560dbf4f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 --2- 172.21.15.76:0/656693493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560dbf4e6b60 0x560dbf4f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.231+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 >> 172.21.15.76:0/656693493 conn(0x560dbf4e30f0 msgr2=0x560dbf4ed100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 shutdown_connections 2024-09-19T07:58:44.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad95e38740 1 -- 172.21.15.76:0/656693493 wait complete. 2024-09-19T07:58:44.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad95e38740 20 client.17391 trim_cache size 0 max 16384 2024-09-19T07:58:44.241 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:58:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "c61586e9-257a-4ee4-a7f1-db3ebc9209fb", 2024-09-19T07:58:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:58:44.241 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:44.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fad780a33b0 msgr2=0x7fad780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fad780a33b0 0x7fad780a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad8401f000 tx=0x7fad8401b000 comp rx=0 tx=0).stop 2024-09-19T07:58:44.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 msgr2=0x7fad8c1a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:44.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c1a4fa0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006010 tx=0x7fad7c0042f0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 shutdown_connections 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fad780a33b0 0x7fad780a5870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad8c112ba0 0x7fad8c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fad8c074eb0 0x7fad8c1a4fa0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 --2- 172.21.15.76:0/300010622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c074590 0x7fad8c1a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 >> 172.21.15.76:0/300010622 conn(0x7fad8c0fd8b0 msgr2=0x7fad8c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 shutdown_connections 2024-09-19T07:58:44.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:44.232+0000 7fad93a5f640 1 -- 172.21.15.76:0/300010622 wait complete. 2024-09-19T07:58:44.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:44 smithi137 ceph-mon[35309]: pgmap v232: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:44.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:44 smithi076 ceph-mon[30930]: pgmap v232: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:45.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:44 smithi152 ceph-mon[35117]: pgmap v232: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:45.062 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:58:45.309 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:58:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:45 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:58:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:45 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:45 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:58:45.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:45 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 -- 172.21.15.76:0/3506735493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102ef0 msgr2=0x7ff42010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 --2- 172.21.15.76:0/3506735493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102ef0 0x7ff42010da40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff418009ca0 tx=0x7ff41802a950 comp rx=0 tx=0).stop 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 -- 172.21.15.76:0/3506735493 shutdown_connections 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 --2- 172.21.15.76:0/3506735493 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102ef0 0x7ff42010da40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 --2- 172.21.15.76:0/3506735493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff420102570 0x7ff4201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 --2- 172.21.15.76:0/3506735493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420100e20 0x7ff420101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 -- 172.21.15.76:0/3506735493 >> 172.21.15.76:0/3506735493 conn(0x7ff4200fc7d0 msgr2=0x7ff4200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 -- 172.21.15.76:0/3506735493 shutdown_connections 2024-09-19T07:58:45.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.796+0000 7ff424c32640 1 -- 172.21.15.76:0/3506735493 wait complete. 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 Processor -- start 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 -- start start 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff420100e20 0x7ff4200fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 0x7ff4200fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102ef0 0x7ff4200fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201110a0 con 0x7ff420102570 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff420110f20 con 0x7ff420102ef0 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff424c32640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff420111220 con 0x7ff420100e20 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 0x7ff4200fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 0x7ff4200fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47520/0 (socket says 172.21.15.76:47520) 2024-09-19T07:58:45.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 -- 172.21.15.76:0/1662598423 learned_addr learned my addr 172.21.15.76:0/1662598423 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41e59c640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff420100e20 0x7ff4200fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 -- 172.21.15.76:0/1662598423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff420100e20 msgr2=0x7ff4200fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff420100e20 0x7ff4200fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 -- 172.21.15.76:0/1662598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102ef0 msgr2=0x7ff4200fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102ef0 0x7ff4200fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.797+0000 7ff41dd9b640 1 -- 172.21.15.76:0/1662598423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4201a6a40 con 0x7ff420102570 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.798+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 0x7ff4200fd1c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff40800d950 tx=0x7ff40800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.798+0000 7ff4177fe640 1 -- 172.21.15.76:0/1662598423 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408017030 con 0x7ff420102570 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.798+0000 7ff4177fe640 1 -- 172.21.15.76:0/1662598423 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff408004020 con 0x7ff420102570 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.798+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4201a6d30 con 0x7ff420102570 2024-09-19T07:58:45.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.798+0000 7ff4177fe640 1 -- 172.21.15.76:0/1662598423 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408004a00 con 0x7ff420102570 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.798+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4201a7210 con 0x7ff420102570 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.800+0000 7ff42700b740 1 Processor -- start 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.800+0000 7ff4177fe640 1 -- 172.21.15.76:0/1662598423 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff4080041d0 con 0x7ff420102570 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.800+0000 7ff42700b740 1 -- start start 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff42700b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfc8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff42700b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff42700b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff42700b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e6dcf2e2e0 con 0x55e6dcfd3680 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff42700b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e6dced5ce0 con 0x55e6dcfc84a0 2024-09-19T07:58:45.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff42700b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e6dcf2a2a0 con 0x55e6dcfc8dc0 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47530/0 (socket says 172.21.15.76:47530) 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfc8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 -- 172.21.15.76:0/608192086 learned_addr learned my addr 172.21.15.76:0/608192086 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41e59c640 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 -- 172.21.15.76:0/608192086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 msgr2=0x55e6dcfd3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 -- 172.21.15.76:0/608192086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 msgr2=0x55e6dcfc8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfc8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 -- 172.21.15.76:0/608192086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6dceba440 con 0x55e6dcfd3680 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff4177fe640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff40c0a33b0 0x7ff40c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff40c0a33b0 0x7ff40c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.801+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd5a70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff4080ccd70 tx=0x7ff4080d5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac0506a84c11ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff4177fe640 1 -- 172.21.15.76:0/1662598423 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ff4080cf740 con 0x7ff420102570 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff414ff9640 1 -- 172.21.15.76:0/608192086 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40809b760 con 0x55e6dcfd3680 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff414ff9640 1 -- 172.21.15.76:0/608192086 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff40809c090 con 0x55e6dcfd3680 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff414ff9640 1 -- 172.21.15.76:0/608192086 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40809b2f0 con 0x55e6dcfd3680 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 -- 172.21.15.76:0/608192086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 msgr2=0x55e6dcfd5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff40c0a33b0 0x7ff40c0a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff418004af0 tx=0x7ff41802fec0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd5a70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff4080ccd70 tx=0x7ff4080d5f10 comp rx=0 tx=0).stop 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 -- 172.21.15.76:0/608192086 shutdown_connections 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd5a70 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 --2- 172.21.15.76:0/608192086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfc8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.802+0000 7ff42700b740 1 -- 172.21.15.76:0/608192086 >> 172.21.15.76:0/608192086 conn(0x55e6dcfc4a30 msgr2=0x55e6dcfc4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 -- 172.21.15.76:0/608192086 shutdown_connections 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 -- 172.21.15.76:0/608192086 wait complete. 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 -- start start 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 Processor -- start 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55e6dcfd6250 con 0x55e6dcfc84a0 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e6dcee9050 con 0x55e6dcfd3680 2024-09-19T07:58:45.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e6dcfd63d0 con 0x55e6dcfc8dc0 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff42700b740 10 client.0 _ll_register_callbacks cb 0x55e6dcf29160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff41e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff41e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47542/0 (socket says 172.21.15.76:47542) 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff41e59c640 1 -- 172.21.15.76:0/3264228513 learned_addr learned my addr 172.21.15.76:0/3264228513 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.803+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff41e59c640 1 -- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 msgr2=0x55e6dcfd0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff41e59c640 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff41e59c640 1 -- 172.21.15.76:0/3264228513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfd3680 msgr2=0x55e6dcfd0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff41e59c640 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff41e59c640 1 -- 172.21.15.76:0/3264228513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6dcc9f3c0 con 0x55e6dcfc84a0 2024-09-19T07:58:45.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff41e59c640 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd2f80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff41000bad0 tx=0x7ff41000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844c6fc15b4a6409 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff405ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff405ffb640 1 -- 172.21.15.76:0/3264228513 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410005020 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff405ffb640 1 -- 172.21.15.76:0/3264228513 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ff4100051c0 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff40809c090 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff405ffb640 1 -- 172.21.15.76:0/3264228513 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff410005400 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff42700b740 10 client.17403 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e6dcfe1c80 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff405ffb640 1 -- 172.21.15.76:0/3264228513 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff40809c090 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.804+0000 7ff405ffb640 1 -- 172.21.15.76:0/3264228513 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff41001b7c0 con 0x55e6dcfc84a0 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff42700b740 10 client.17403 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:45.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff42700b740 10 client.17403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff42700b740 20 client.17403 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff42700b740 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dcfe3140 0x55e6dcfe55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff42700b740 4 client.17403 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6dcf3b850 con 0x55e6dcfe3140 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dcfe3140 0x55e6dcfe55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dcfe3140 0x55e6dcfe55b0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abbfb73fc0333437 server_cookie=c062db9b32f721a2 in_seq=0 out_seq=0 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.805+0000 7ff405ffb640 10 client.17403 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff405ffb640 1 -- 172.21.15.76:0/3264228513 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6dcf3b850 con 0x55e6dcfe3140 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff405ffb640 10 client.17403 handle_command_reply: tid=0 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 client.17403 shutdown 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 msgr2=0x55e6dcfd2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd2f80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff41000bad0 tx=0x7ff41000bed0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 shutdown_connections 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dcfe3140 0x55e6dcfe55b0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 --2- 172.21.15.76:0/3264228513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd2f80 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff405ffb640 0 client.17403 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 >> 172.21.15.76:0/3264228513 conn(0x55e6dcfc4a30 msgr2=0x55e6dcfca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 shutdown_connections 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 1 -- 172.21.15.76:0/3264228513 wait complete. 2024-09-19T07:58:45.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.806+0000 7ff42700b740 20 client.17403 trim_cache size 0 max 16384 2024-09-19T07:58:45.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 Processor -- start 2024-09-19T07:58:45.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 -- start start 2024-09-19T07:58:45.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfdf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfeae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfeb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201b2710 con 0x55e6dcfd3680 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201affe0 con 0x55e6dcfc84a0 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.823+0000 7ff42700b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201ade50 con 0x55e6dcfc8dc0 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfeb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfeb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47558/0 (socket says 172.21.15.76:47558) 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 -- 172.21.15.76:0/141588630 learned_addr learned my addr 172.21.15.76:0/141588630 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfeae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 -- 172.21.15.76:0/141588630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 msgr2=0x55e6dcfeae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfeae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 -- 172.21.15.76:0/141588630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 msgr2=0x55e6dcfdf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfdf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 -- 172.21.15.76:0/141588630 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6dcfc44d0 con 0x55e6dcfd3680 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfeb3c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff418035000 tx=0x7ff418005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13bb24ac780adab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff407fff640 1 -- 172.21.15.76:0/141588630 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418034040 con 0x55e6dcfd3680 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff407fff640 1 -- 172.21.15.76:0/141588630 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff41804c070 con 0x55e6dcfd3680 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.824+0000 7ff407fff640 1 -- 172.21.15.76:0/141588630 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418051470 con 0x55e6dcfd3680 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 -- 172.21.15.76:0/141588630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 msgr2=0x55e6dcfeb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfeb3c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff418035000 tx=0x7ff418005d80 comp rx=0 tx=0).stop 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 -- 172.21.15.76:0/141588630 shutdown_connections 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfeb3c0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfeae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 --2- 172.21.15.76:0/141588630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfdf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 -- 172.21.15.76:0/141588630 >> 172.21.15.76:0/141588630 conn(0x55e6dcfc4a30 msgr2=0x55e6dcfceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 -- 172.21.15.76:0/141588630 shutdown_connections 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 -- 172.21.15.76:0/141588630 wait complete. 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 -- start start 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.825+0000 7ff42700b740 1 Processor -- start 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201ae4a0 con 0x55e6dcfd3680 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201af910 con 0x55e6dcfc8dc0 2024-09-19T07:58:45.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4201aeb70 con 0x55e6dcfc84a0 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 10 client.0 _ll_register_callbacks cb 0x7ff4100040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47568/0 (socket says 172.21.15.76:47568) 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 -- 172.21.15.76:0/1314854285 learned_addr learned my addr 172.21.15.76:0/1314854285 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41dd9b640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41e59c640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 -- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc84a0 msgr2=0x55e6dcfd7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 -- 172.21.15.76:0/1314854285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc8dc0 msgr2=0x55e6dcfd7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 -- 172.21.15.76:0/1314854285 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6dd04ced0 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff41ed9d640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd7ed0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff418041040 tx=0x7ff418004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357befd1618c4138 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff405ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff405ffb640 1 -- 172.21.15.76:0/1314854285 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418034070 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff405ffb640 1 -- 172.21.15.76:0/1314854285 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8658+0+0 (secure 0 0 0) 0x7ff418003b70 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.826+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff41804c070 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff405ffb640 1 -- 172.21.15.76:0/1314854285 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff418004830 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 10 client.17409 fetch_fsmap learned FSMap version 35 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e6dd04e1c0 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff405ffb640 1 -- 172.21.15.76:0/1314854285 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff41804c070 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff405ffb640 1 -- 172.21.15.76:0/1314854285 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff418030600 con 0x55e6dcfd3680 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 10 client.17409 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:58:45.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 10 client.17409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 20 client.17409 populate_metadata read hostname 'smithi076' 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dd04e880 0x55e6dd050ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 4 client.17409 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e6dcfd0b00 con 0x55e6dd04e880 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.827+0000 7ff41e59c640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dd04e880 0x55e6dd050ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff405ffb640 10 client.17409 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff41e59c640 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dd04e880 0x55e6dd050ca0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9516f4dbd81e1d4 server_cookie=4d522593e2faeeb1 in_seq=0 out_seq=0 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff405ffb640 1 -- 172.21.15.76:0/1314854285 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e6dcfd0b00 con 0x55e6dd04e880 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff405ffb640 10 client.17409 handle_command_reply: tid=0 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 client.17409 shutdown 2024-09-19T07:58:45.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 msgr2=0x55e6dcfd7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd7ed0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff418041040 tx=0x7ff418004640 comp rx=0 tx=0).stop 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 shutdown_connections 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55e6dd04e880 0x55e6dd050ca0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e6dcfd3680 0x55e6dcfd7ed0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e6dcfc8dc0 0x55e6dcfd7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 --2- 172.21.15.76:0/1314854285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6dcfc84a0 0x55e6dcfd7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 >> 172.21.15.76:0/1314854285 conn(0x55e6dcfc4a30 msgr2=0x55e6dcfc9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff405ffb640 0 client.17409 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 shutdown_connections 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 1 -- 172.21.15.76:0/1314854285 wait complete. 2024-09-19T07:58:45.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.828+0000 7ff42700b740 20 client.17409 trim_cache size 0 max 16384 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: "c61586e9-257a-4ee4-a7f1-db3ebc9209fb": { 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "c61586e9-257a-4ee4-a7f1-db3ebc9209fb", 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:58:45.838 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:58:45.839 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:58:45.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff40c0a33b0 msgr2=0x7ff40c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff40c0a33b0 0x7ff40c0a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff418004af0 tx=0x7ff41802fec0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 msgr2=0x7ff4200fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 0x7ff4200fd1c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff40800d950 tx=0x7ff40800de10 comp rx=0 tx=0).stop 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 shutdown_connections 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff40c0a33b0 0x7ff40c0a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102ef0 0x7ff4200fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff420102570 0x7ff4200fd1c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 --2- 172.21.15.76:0/1662598423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff420100e20 0x7ff4200fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 >> 172.21.15.76:0/1662598423 conn(0x7ff4200fc7d0 msgr2=0x7ff42006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 shutdown_connections 2024-09-19T07:58:45.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:58:45.829+0000 7ff424c32640 1 -- 172.21.15.76:0/1662598423 wait complete. 2024-09-19T07:58:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:45 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:58:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:45 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:45 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:58:45.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:45 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:45 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:58:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:45 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:45 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:58:46.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:45 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:58:46.666 INFO:tasks.cephfs.filesystem:scrub status for tag:c61586e9-257a-4ee4-a7f1-db3ebc9209fb - {'path': '/', 'tag': 'c61586e9-257a-4ee4-a7f1-db3ebc9209fb', 'options': 'recursive,force'} 2024-09-19T07:58:46.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:46 smithi137 ceph-mon[35309]: pgmap v233: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:58:46.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:46 smithi076 ceph-mon[30930]: pgmap v233: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:58:46.962 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:46 smithi152 ceph-mon[35117]: pgmap v233: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:58:48.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:48 smithi137 ceph-mon[35309]: pgmap v234: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:58:48.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:48 smithi076 ceph-mon[30930]: pgmap v234: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:58:49.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:48 smithi152 ceph-mon[35117]: pgmap v234: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:58:49.904 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:49 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:58:49.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:49 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:58:50.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:49 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:58:50.903 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:50 smithi137 ceph-mon[35309]: pgmap v235: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:58:50.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:50 smithi076 ceph-mon[30930]: pgmap v235: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:58:51.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:50 smithi152 ceph-mon[35117]: pgmap v235: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:58:52.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:52 smithi076 ceph-mon[30930]: pgmap v236: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:53.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:52 smithi152 ceph-mon[35117]: pgmap v236: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:53.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:52 smithi137 ceph-mon[35309]: pgmap v236: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:58:54.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:54 smithi076 ceph-mon[30930]: pgmap v237: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:55.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:54 smithi152 ceph-mon[35117]: pgmap v237: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:55.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:54 smithi137 ceph-mon[35309]: pgmap v237: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:56.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:56 smithi076 ceph-mon[30930]: pgmap v238: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:58:57.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:56 smithi152 ceph-mon[35117]: pgmap v238: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:58:57.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:56 smithi137 ceph-mon[35309]: pgmap v238: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:58:58.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:58:58 smithi076 ceph-mon[30930]: pgmap v239: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:59.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:58:58 smithi152 ceph-mon[35117]: pgmap v239: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:58:59.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:58:58 smithi137 ceph-mon[35309]: pgmap v239: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:00.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:00 smithi076 ceph-mon[30930]: pgmap v240: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:59:01.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:00 smithi152 ceph-mon[35117]: pgmap v240: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:59:01.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:00 smithi137 ceph-mon[35309]: pgmap v240: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:59:02.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:02 smithi076 ceph-mon[30930]: pgmap v241: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:03.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:02 smithi152 ceph-mon[35117]: pgmap v241: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:03.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:02 smithi137 ceph-mon[35309]: pgmap v241: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:04.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:04 smithi076 ceph-mon[30930]: pgmap v242: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:05.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:04 smithi152 ceph-mon[35117]: pgmap v242: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:05.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:04 smithi137 ceph-mon[35309]: pgmap v242: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:06.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:06 smithi076 ceph-mon[30930]: pgmap v243: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:59:07.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:06 smithi152 ceph-mon[35117]: pgmap v243: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:59:07.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:06 smithi137 ceph-mon[35309]: pgmap v243: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:59:08.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:08 smithi076 ceph-mon[30930]: pgmap v244: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T07:59:09.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:08 smithi152 ceph-mon[35117]: pgmap v244: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T07:59:09.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:08 smithi137 ceph-mon[35309]: pgmap v244: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T07:59:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:10 smithi076 ceph-mon[30930]: pgmap v245: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:59:10.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:10 smithi076 ceph-mon[30930]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:59:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:10 smithi152 ceph-mon[35117]: pgmap v245: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:59:11.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:10 smithi152 ceph-mon[35117]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:59:11.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:10 smithi137 ceph-mon[35309]: pgmap v245: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:59:11.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:10 smithi137 ceph-mon[35309]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:59:12.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:12 smithi076 ceph-mon[30930]: pgmap v247: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:59:13.060 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:12 smithi152 ceph-mon[35117]: pgmap v247: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:59:13.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:12 smithi137 ceph-mon[35309]: pgmap v247: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:59:14.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:14 smithi076 ceph-mon[30930]: pgmap v248: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:59:14.956 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:14 smithi137 ceph-mon[35309]: pgmap v248: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:59:15.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:14 smithi152 ceph-mon[35117]: pgmap v248: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:59:16.668 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:59:16.941 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:17.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:16 smithi152 ceph-mon[35117]: pgmap v249: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:17.062 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:16 smithi076 ceph-mon[30930]: pgmap v249: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:17.153 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:16 smithi137 ceph-mon[35309]: pgmap v249: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:17.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 -- 172.21.15.76:0/2504690309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f161810c1a0 msgr2=0x7f161810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 --2- 172.21.15.76:0/2504690309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f161810c1a0 0x7f161810e610 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f1610009ca0 tx=0x7f161002a950 comp rx=0 tx=0).stop 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 -- 172.21.15.76:0/2504690309 shutdown_connections 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 --2- 172.21.15.76:0/2504690309 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f161810c1a0 0x7f161810e610 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 --2- 172.21.15.76:0/2504690309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1618103720 0x7f161810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 --2- 172.21.15.76:0/2504690309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 0x7f16181031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 -- 172.21.15.76:0/2504690309 >> 172.21.15.76:0/2504690309 conn(0x7f16180fc7a0 msgr2=0x7f16180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 -- 172.21.15.76:0/2504690309 shutdown_connections 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.521+0000 7f161d94d640 1 -- 172.21.15.76:0/2504690309 wait complete. 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 Processor -- start 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 -- start start 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 0x7f1618198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 0x7f1618198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f161810c1a0 0x7f161819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1618112070 con 0x7f1618103720 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1618111ef0 con 0x7f1618102e00 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f161d94d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16181121f0 con 0x7f161810c1a0 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 0x7f1618198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 0x7f1618198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39924/0 (socket says 172.21.15.76:39924) 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 -- 172.21.15.76:0/900894498 learned_addr learned my addr 172.21.15.76:0/900894498 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f16177fe640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f161810c1a0 0x7f161819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f1616ffd640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 0x7f1618198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 -- 172.21.15.76:0/900894498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f161810c1a0 msgr2=0x7f161819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f161810c1a0 0x7f161819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 -- 172.21.15.76:0/900894498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 msgr2=0x7f1618198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 0x7f1618198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f160ffff640 1 -- 172.21.15.76:0/900894498 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161819d4c0 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.522+0000 7f1616ffd640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 0x7f1618198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.523+0000 7f160ffff640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 0x7f1618198a50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f160000d950 tx=0x7f160000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.523+0000 7f161c94b640 1 -- 172.21.15.76:0/900894498 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600017030 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.523+0000 7f161c94b640 1 -- 172.21.15.76:0/900894498 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1600004020 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.523+0000 7f161c94b640 1 -- 172.21.15.76:0/900894498 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600004a00 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.523+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161819d7b0 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.523+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16181a5090 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.525+0000 7f161c94b640 1 -- 172.21.15.76:0/900894498 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f16000041d0 con 0x7f1618103720 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.525+0000 7f161fd26740 1 Processor -- start 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 -- start start 2024-09-19T07:59:17.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 0x55be46bcb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bd6680 0x55be46bd8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55be46b312e0 con 0x55be46bcb4a0 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55be46ad8ce0 con 0x55be46bcbdc0 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161fd26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55be46b2d2a0 con 0x55be46bd6680 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161c94b640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16040a33b0 0x7f16040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 0x55be46bcb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 0x55be46bcb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39928/0 (socket says 172.21.15.76:39928) 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 -- 172.21.15.76:0/500376775 learned_addr learned my addr 172.21.15.76:0/500376775 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16040a33b0 0x7f16040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f1616ffd640 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f161c94b640 1 -- 172.21.15.76:0/900894498 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f16000cf830 con 0x7f1618103720 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f160ffff640 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bd6680 0x55be46bd8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 -- 172.21.15.76:0/500376775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bd6680 msgr2=0x55be46bd8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bd6680 0x55be46bd8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 -- 172.21.15.76:0/500376775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 msgr2=0x55be46bd6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bd6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.526+0000 7f16177fe640 1 -- 172.21.15.76:0/500376775 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be46abd440 con 0x55be46bcb4a0 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f16177fe640 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 0x55be46bcb880 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1610009430 tx=0x7f161002f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63b2ad234078496 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f16177fe640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16040a33b0 0x7f16040a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f161002f650 tx=0x7f1610042000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:17.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f160dffb640 1 -- 172.21.15.76:0/500376775 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610034040 con 0x55be46bcb4a0 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f160dffb640 1 -- 172.21.15.76:0/500376775 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f161002fc30 con 0x55be46bcb4a0 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f160dffb640 1 -- 172.21.15.76:0/500376775 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610005030 con 0x55be46bcb4a0 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f161fd26740 1 -- 172.21.15.76:0/500376775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 msgr2=0x55be46bcb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.527+0000 7f161fd26740 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 0x55be46bcb880 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1610009430 tx=0x7f161002f5e0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- 172.21.15.76:0/500376775 shutdown_connections 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bd6680 0x55be46bd8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bd6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 --2- 172.21.15.76:0/500376775 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bcb4a0 0x55be46bcb880 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- 172.21.15.76:0/500376775 >> 172.21.15.76:0/500376775 conn(0x55be46bc7a30 msgr2=0x55be46bc7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- 172.21.15.76:0/500376775 shutdown_connections 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- 172.21.15.76:0/500376775 wait complete. 2024-09-19T07:59:17.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- start start 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 Processor -- start 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bd32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bd3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55be46bd9250 con 0x55be46bd6680 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55be46aec050 con 0x55be46bcb4a0 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55be46bd93d0 con 0x55be46bcbdc0 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.528+0000 7f161fd26740 10 client.0 _ll_register_callbacks cb 0x55be46b2c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bd3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bd3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39932/0 (socket says 172.21.15.76:39932) 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 -- 172.21.15.76:0/2482462094 learned_addr learned my addr 172.21.15.76:0/2482462094 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f160ffff640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bd32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f1616ffd640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 -- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 msgr2=0x55be46bd32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bd32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 -- 172.21.15.76:0/2482462094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 msgr2=0x55be46bd6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bd6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 -- 172.21.15.76:0/2482462094 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be468a23c0 con 0x55be46bd6680 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f16177fe640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bd3880 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f161002a990 tx=0x7f1610004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6aacad6d336383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f15f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f15f6ffd640 1 -- 172.21.15.76:0/2482462094 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610057030 con 0x55be46bd6680 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f15f6ffd640 1 -- 172.21.15.76:0/2482462094 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f1610030440 con 0x55be46bd6680 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be46b3e850 con 0x55be46bd6680 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f15f6ffd640 1 -- 172.21.15.76:0/2482462094 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1610030640 con 0x55be46bd6680 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f161fd26740 10 client.17421 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.529+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55be46bd9250 con 0x55be46bd6680 2024-09-19T07:59:17.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f15f6ffd640 1 -- 172.21.15.76:0/2482462094 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55be46b3e850 con 0x55be46bd6680 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f15f6ffd640 1 -- 172.21.15.76:0/2482462094 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1610039680 con 0x55be46bd6680 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f161fd26740 10 client.17421 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f161fd26740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f161fd26740 20 client.17421 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f161fd26740 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46be5d50 0x55be46be8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f161fd26740 4 client.17421 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be46b38d60 con 0x55be46be5d50 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.530+0000 7f1616ffd640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46be5d50 0x55be46be8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f15f6ffd640 10 client.17421 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f1616ffd640 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46be5d50 0x55be46be8140 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd28a5187a470b8 server_cookie=574e7800641851cc in_seq=0 out_seq=0 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f15f6ffd640 1 -- 172.21.15.76:0/2482462094 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be46b38d60 con 0x55be46be5d50 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f15f6ffd640 10 client.17421 handle_command_reply: tid=0 2024-09-19T07:59:17.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f161fd26740 1 client.17421 shutdown 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 msgr2=0x55be46bd3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.531+0000 7f161fd26740 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bd3880 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f161002a990 tx=0x7f1610004690 comp rx=0 tx=0).stop 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 shutdown_connections 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46be5d50 0x55be46be8140 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bd3880 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bd32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 --2- 172.21.15.76:0/2482462094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bd6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f15f6ffd640 0 client.17421 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 >> 172.21.15.76:0/2482462094 conn(0x55be46bc7a30 msgr2=0x55be46bc6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 shutdown_connections 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 1 -- 172.21.15.76:0/2482462094 wait complete. 2024-09-19T07:59:17.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.532+0000 7f161fd26740 20 client.17421 trim_cache size 0 max 16384 2024-09-19T07:59:17.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 Processor -- start 2024-09-19T07:59:17.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 -- start start 2024-09-19T07:59:17.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcb4a0 0x55be46bd1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bed830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f16181b0510 con 0x55be46bd6680 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16181adde0 con 0x55be46bcbdc0 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f161fd26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16181abc50 con 0x55be46bcb4a0 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bedd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39946/0 (socket says 172.21.15.76:39946) 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.549+0000 7f16177fe640 1 -- 172.21.15.76:0/3999937871 learned_addr learned my addr 172.21.15.76:0/3999937871 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f1616ffd640 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcb4a0 0x55be46bd1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f160ffff640 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f16177fe640 1 -- 172.21.15.76:0/3999937871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcb4a0 msgr2=0x55be46bd1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f16177fe640 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcb4a0 0x55be46bd1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f16177fe640 1 -- 172.21.15.76:0/3999937871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 msgr2=0x55be46bed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f16177fe640 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bed830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f16177fe640 1 -- 172.21.15.76:0/3999937871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be46bd63a0 con 0x55be46bd6680 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f160ffff640 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f16177fe640 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bedd70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f1610004af0 tx=0x7f16100305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76343801e3c2f812 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f160d7fa640 1 -- 172.21.15.76:0/3999937871 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610057030 con 0x55be46bd6680 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f160d7fa640 1 -- 172.21.15.76:0/3999937871 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1610004700 con 0x55be46bd6680 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.550+0000 7f160d7fa640 1 -- 172.21.15.76:0/3999937871 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610030a40 con 0x55be46bd6680 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 -- 172.21.15.76:0/3999937871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 msgr2=0x55be46bedd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bedd70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f1610004af0 tx=0x7f16100305d0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 -- 172.21.15.76:0/3999937871 shutdown_connections 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bedd70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcbdc0 0x55be46bed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 --2- 172.21.15.76:0/3999937871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcb4a0 0x55be46bd1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 -- 172.21.15.76:0/3999937871 >> 172.21.15.76:0/3999937871 conn(0x55be46bc7a30 msgr2=0x55be46bc6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:17.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 -- 172.21.15.76:0/3999937871 shutdown_connections 2024-09-19T07:59:17.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 -- 172.21.15.76:0/3999937871 wait complete. 2024-09-19T07:59:17.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 -- start start 2024-09-19T07:59:17.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.551+0000 7f161fd26740 1 Processor -- start 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bdc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bdc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bdce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f16181ac2a0 con 0x55be46bd6680 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16181ad710 con 0x55be46bcb4a0 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16181ac970 con 0x55be46bcbdc0 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bdce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f161fd26740 10 client.0 _ll_register_callbacks cb 0x7f161002f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:17.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bdce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39950/0 (socket says 172.21.15.76:39950) 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 -- 172.21.15.76:0/1620596312 learned_addr learned my addr 172.21.15.76:0/1620596312 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f160ffff640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bdc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f1616ffd640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bdc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 -- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 msgr2=0x55be46bdc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bdc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 -- 172.21.15.76:0/1620596312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 msgr2=0x55be46bdc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bdc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 -- 172.21.15.76:0/1620596312 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be46c4f860 con 0x55be46bd6680 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f160ffff640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bdc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f16177fe640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bdce70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1610002230 tx=0x7f161002f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387c593ff59e49bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.552+0000 7f15f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f15f6ffd640 1 -- 172.21.15.76:0/1620596312 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610067020 con 0x55be46bd6680 2024-09-19T07:59:17.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f15f6ffd640 1 -- 172.21.15.76:0/1620596312 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f16100309f0 con 0x55be46bd6680 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1610004700 con 0x55be46bd6680 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f15f6ffd640 1 -- 172.21.15.76:0/1620596312 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1610072050 con 0x55be46bd6680 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 10 client.17427 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55be46c50ac0 con 0x55be46bd6680 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f15f6ffd640 1 -- 172.21.15.76:0/1620596312 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1610004700 con 0x55be46bd6680 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f15f6ffd640 1 -- 172.21.15.76:0/1620596312 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1610063a40 con 0x55be46bd6680 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 10 client.17427 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 20 client.17427 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46c50ef0 0x55be46c532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 4 client.17427 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.553+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be46ab5210 con 0x55be46c50ef0 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f1616ffd640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46c50ef0 0x55be46c532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:17.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f15f6ffd640 10 client.17427 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f1616ffd640 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46c50ef0 0x55be46c532e0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6893ed736d467167 server_cookie=7ea0d3b7e6d62552 in_seq=0 out_seq=0 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f15f6ffd640 1 -- 172.21.15.76:0/1620596312 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55be46ab5210 con 0x55be46c50ef0 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f15f6ffd640 10 client.17427 handle_command_reply: tid=0 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 client.17427 shutdown 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 msgr2=0x55be46bdce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bdce70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1610002230 tx=0x7f161002f5e0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 shutdown_connections 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55be46c50ef0 0x55be46c532e0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be46bd6680 0x55be46bdce70 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55be46bcbdc0 0x55be46bdc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 --2- 172.21.15.76:0/1620596312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55be46bcb4a0 0x55be46bdc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 >> 172.21.15.76:0/1620596312 conn(0x55be46bc7a30 msgr2=0x55be46bd2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:17.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.554+0000 7f15f6ffd640 0 client.17427 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:18.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 shutdown_connections 2024-09-19T07:59:18.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161fd26740 1 -- 172.21.15.76:0/1620596312 wait complete. 2024-09-19T07:59:18.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161fd26740 20 client.17427 trim_cache size 0 max 16384 2024-09-19T07:59:18.593 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:59:18.593 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T07:59:18.593 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T07:59:18.593 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:59:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16040a33b0 msgr2=0x7f16040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16040a33b0 0x7f16040a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f161002f650 tx=0x7f1610042000 comp rx=0 tx=0).stop 2024-09-19T07:59:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 msgr2=0x7f1618198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:18.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 0x7f1618198a50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f160000d950 tx=0x7f160000de10 comp rx=0 tx=0).stop 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 shutdown_connections 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16040a33b0 0x7f16040a5870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f161810c1a0 0x7f161819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1618103720 0x7f1618198a50 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 --2- 172.21.15.76:0/900894498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1618102e00 0x7f1618198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 >> 172.21.15.76:0/900894498 conn(0x7f16180fc7a0 msgr2=0x7f16180fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 shutdown_connections 2024-09-19T07:59:18.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:17.555+0000 7f161d94d640 1 -- 172.21.15.76:0/900894498 wait complete. 2024-09-19T07:59:18.595 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:59:18.596 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:59:18.596 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:17 smithi076 ceph-mon[30930]: pgmap v250: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:18.597 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:17 smithi076 ceph-mon[30930]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:59:18.597 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:17 smithi137 ceph-mon[35309]: pgmap v250: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:18.598 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:17 smithi137 ceph-mon[35309]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:59:18.598 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:17 smithi152 ceph-mon[35117]: pgmap v250: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:18.598 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:17 smithi152 ceph-mon[35117]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:59:18.852 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:19.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1629536822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8100a80 msgr2=0x7f11d8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:19.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1629536822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8100a80 0x7f11d8100ee0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009930 tx=0x7f11c002a420 comp rx=0 tx=0).stop 2024-09-19T07:59:19.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1629536822 shutdown_connections 2024-09-19T07:59:19.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1629536822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11d8101420 0x7f11d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1629536822 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8100a80 0x7f11d8100ee0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1629536822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d8106a80 0x7f11d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1629536822 >> 172.21.15.76:0/1629536822 conn(0x7f11d80fc7a0 msgr2=0x7f11d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1629536822 shutdown_connections 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.385+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1629536822 wait complete. 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 Processor -- start 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 -- start start 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d8100a80 0x7f11d80fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 0x7f11d80fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11d8106a80 0x7f11d80fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8111000 con 0x7f11d8101420 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8110e80 con 0x7f11d8106a80 2024-09-19T07:59:19.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.386+0000 7f11dcf3c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11d8111180 con 0x7f11d8100a80 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 0x7f11d80fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 0x7f11d80fd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39964/0 (socket says 172.21.15.76:39964) 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 -- 172.21.15.76:0/1369995567 learned_addr learned my addr 172.21.15.76:0/1369995567 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11d659c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d8100a80 0x7f11d80fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11d6d9d640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11d8106a80 0x7f11d80fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 -- 172.21.15.76:0/1369995567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d8100a80 msgr2=0x7f11d80fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d8100a80 0x7f11d80fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 -- 172.21.15.76:0/1369995567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11d8106a80 msgr2=0x7f11d80fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11d8106a80 0x7f11d80fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 -- 172.21.15.76:0/1369995567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d81a6a90 con 0x7f11d8101420 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cffff640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 0x7f11d80fd250 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009230 tx=0x7f11c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c003f030 con 0x7f11d8101420 2024-09-19T07:59:19.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d81a6d20 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11c0003af0 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0035070 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.387+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d81a71b0 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.388+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d8100ee0 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.389+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f11c0042030 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.390+0000 7f11cf7fe640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f11c40a33b0 0x7f11c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.390+0000 7f11d659c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f11c40a33b0 0x7f11c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.390+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f11c00f04d0 con 0x7f11d8101420 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.390+0000 7f11d659c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f11c40a33b0 0x7f11c40a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005fd0 tx=0x7f11c800b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:19.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.394+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11c00bc890 con 0x7f11d8101420 2024-09-19T07:59:19.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.592+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11d810a000 con 0x7f11d8101420 2024-09-19T07:59:19.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.593+0000 7f11cf7fe640 1 -- 172.21.15.76:0/1369995567 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f11c00c0b90 con 0x7f11d8101420 2024-09-19T07:59:19.594 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T07:59:19.594 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T07:59:19.594 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T07:59:19.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f11c40a33b0 msgr2=0x7f11c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:19.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f11c40a33b0 0x7f11c40a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005fd0 tx=0x7f11c800b390 comp rx=0 tx=0).stop 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 msgr2=0x7f11d80fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 0x7f11d80fd250 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009230 tx=0x7f11c0004270 comp rx=0 tx=0).stop 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 shutdown_connections 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f11c40a33b0 0x7f11c40a5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11d8106a80 0x7f11d80fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11d8101420 0x7f11d80fd250 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 --2- 172.21.15.76:0/1369995567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11d8100a80 0x7f11d80fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 >> 172.21.15.76:0/1369995567 conn(0x7f11d80fc7a0 msgr2=0x7f11d806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 shutdown_connections 2024-09-19T07:59:19.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:19.595+0000 7f11dcf3c640 1 -- 172.21.15.76:0/1369995567 wait complete. 2024-09-19T07:59:20.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:19 smithi152 ceph-mon[35117]: pgmap v252: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 222 B/s wr, 6 op/s 2024-09-19T07:59:20.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:19 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1369995567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:59:20.328 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:19 smithi076 ceph-mon[30930]: pgmap v252: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 222 B/s wr, 6 op/s 2024-09-19T07:59:20.329 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:19 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1369995567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:59:20.355 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:59:20.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:19 smithi137 ceph-mon[35309]: pgmap v252: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 222 B/s wr, 6 op/s 2024-09-19T07:59:20.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:19 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1369995567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:59:20.603 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:21.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 -- 172.21.15.76:0/3687559284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c1037a0 msgr2=0x7f5f8c10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 --2- 172.21.15.76:0/3687559284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c1037a0 0x7f5f8c10bc00 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009900 tx=0x7f5f7402a410 comp rx=0 tx=0).stop 2024-09-19T07:59:21.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 -- 172.21.15.76:0/3687559284 shutdown_connections 2024-09-19T07:59:21.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 --2- 172.21.15.76:0/3687559284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 --2- 172.21.15.76:0/3687559284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c1037a0 0x7f5f8c10bc00 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 --2- 172.21.15.76:0/3687559284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f8c102df0 0x7f5f8c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 -- 172.21.15.76:0/3687559284 >> 172.21.15.76:0/3687559284 conn(0x7f5f8c0fc7d0 msgr2=0x7f5f8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 -- 172.21.15.76:0/3687559284 shutdown_connections 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 -- 172.21.15.76:0/3687559284 wait complete. 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 Processor -- start 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.122+0000 7f5f93085640 1 -- start start 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f8c102df0 0x7f5f8c100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f8c1037a0 0x7f5f8c100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c112270 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1120f0 con 0x7f5f8c1037a0 2024-09-19T07:59:21.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1123f0 con 0x7f5f8c102df0 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c1014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39984/0 (socket says 172.21.15.76:39984) 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 -- 172.21.15.76:0/1263681368 learned_addr learned my addr 172.21.15.76:0/1263681368 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f8c1037a0 0x7f5f8c100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f90e21640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f8c102df0 0x7f5f8c100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 -- 172.21.15.76:0/1263681368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f8c102df0 msgr2=0x7f5f8c100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f8c102df0 0x7f5f8c100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 -- 172.21.15.76:0/1263681368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f8c1037a0 msgr2=0x7f5f8c100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f8c1037a0 0x7f5f8c100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 -- 172.21.15.76:0/1263681368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8c1a6bb0 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f91622640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c1014d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009fd0 tx=0x7f5f8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:21.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f89ffb640 1 -- 172.21.15.76:0/1263681368 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84011830 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f89ffb640 1 -- 172.21.15.76:0/1263681368 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f84016070 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8c1a6ea0 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.123+0000 7f5f89ffb640 1 -- 172.21.15.76:0/1263681368 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400f2e0 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.124+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8c1a73b0 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.126+0000 7f5f89ffb640 1 -- 172.21.15.76:0/1263681368 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5f8401b460 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.126+0000 7f5f9545e740 1 Processor -- start 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.126+0000 7f5f9545e740 1 -- start start 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.126+0000 7f5f89ffb640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5f780a33b0 0x7f5f780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.126+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d02d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.126+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d02da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d038370 0x56074d03a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f9545e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56074cf932f0 con 0x56074d02eb40 2024-09-19T07:59:21.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f9545e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56074cf3acf0 con 0x56074d02d5d0 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f9545e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56074cf8f2b0 con 0x56074d038370 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5f780a33b0 0x7f5f780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d02d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d02d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39996/0 (socket says 172.21.15.76:39996) 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f89ffb640 1 -- 172.21.15.76:0/1263681368 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f5f840cf370 con 0x7f5f8c10c2f0 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 -- 172.21.15.76:0/285331538 learned_addr learned my addr 172.21.15.76:0/285331538 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f91622640 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d038370 0x56074d03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 -- 172.21.15.76:0/285331538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d038370 msgr2=0x56074d03a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d038370 0x56074d03a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d02da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 -- 172.21.15.76:0/285331538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 msgr2=0x56074d02da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d02da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 -- 172.21.15.76:0/285331538 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56074cf1f3a0 con 0x56074d02eb40 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d02da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5f780a33b0 0x7f5f780a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f74006010 tx=0x7f5f740095f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f90e21640 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d02d090 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c008e20 tx=0x7f5f7c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdca06023d7bd417 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f82ffd640 1 -- 172.21.15.76:0/285331538 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00f830 con 0x56074d02eb40 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f82ffd640 1 -- 172.21.15.76:0/285331538 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f7c018480 con 0x56074d02eb40 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.127+0000 7f5f82ffd640 1 -- 172.21.15.76:0/285331538 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00e5b0 con 0x56074d02eb40 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 -- 172.21.15.76:0/285331538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 msgr2=0x56074d02d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d02d090 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c008e20 tx=0x7f5f7c00d710 comp rx=0 tx=0).stop 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 -- 172.21.15.76:0/285331538 shutdown_connections 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d038370 0x56074d03a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d02da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 --2- 172.21.15.76:0/285331538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d02d090 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 -- 172.21.15.76:0/285331538 >> 172.21.15.76:0/285331538 conn(0x56074cff6310 msgr2=0x56074d029c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 -- 172.21.15.76:0/285331538 shutdown_connections 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 -- 172.21.15.76:0/285331538 wait complete. 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.128+0000 7f5f9545e740 1 -- start start 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 Processor -- start 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d037c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d034f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x56074d03b070 con 0x56074d02eb40 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56074cf4e060 con 0x56074d038370 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56074d03b1f0 con 0x56074d02d5d0 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f9545e740 10 client.0 _ll_register_callbacks cb 0x56074cca18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:21.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d034f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d034f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40008/0 (socket says 172.21.15.76:40008) 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 -- 172.21.15.76:0/4037323333 learned_addr learned my addr 172.21.15.76:0/4037323333 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f90e21640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d037c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 -- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 msgr2=0x56074d037c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d037c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f91622640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 -- 172.21.15.76:0/4037323333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 msgr2=0x56074d0354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f8bfff640 1 -- 172.21.15.76:0/4037323333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56074cd043c0 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.129+0000 7f5f90e21640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d037c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d034f80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5f74033000 tx=0x7f5f7402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fc6302019efcc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f6bfff640 1 -- 172.21.15.76:0/4037323333 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7404f060 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f6bfff640 1 -- 172.21.15.76:0/4037323333 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f5f74005450 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f7c018480 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f6bfff640 1 -- 172.21.15.76:0/4037323333 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5f74056050 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 10 client.17445 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56074d0469f0 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f6bfff640 1 -- 172.21.15.76:0/4037323333 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f7c018480 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f6bfff640 1 -- 172.21.15.76:0/4037323333 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5f74003780 con 0x56074d02eb40 2024-09-19T07:59:21.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 10 client.17445 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 10 client.17445 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 20 client.17445 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d047eb0 0x56074d04a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 4 client.17445 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.130+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56074cfa0860 con 0x56074d047eb0 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.131+0000 7f5f90e21640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d047eb0 0x56074d04a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.131+0000 7f5f6bfff640 10 client.17445 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.131+0000 7f5f90e21640 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d047eb0 0x56074d04a370 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1413f68605234d7 server_cookie=780376b176bee728 in_seq=0 out_seq=0 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f6bfff640 1 -- 172.21.15.76:0/4037323333 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56074cfa0860 con 0x56074d047eb0 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f6bfff640 10 client.17445 handle_command_reply: tid=0 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 client.17445 shutdown 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 msgr2=0x56074d034f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d034f80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5f74033000 tx=0x7f5f7402a410 comp rx=0 tx=0).stop 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 shutdown_connections 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d047eb0 0x56074d04a370 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d034f80 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 --2- 172.21.15.76:0/4037323333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d037c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 >> 172.21.15.76:0/4037323333 conn(0x56074cff6310 msgr2=0x56074d02f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f6bfff640 0 client.17445 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.132+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 shutdown_connections 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.133+0000 7f5f9545e740 1 -- 172.21.15.76:0/4037323333 wait complete. 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.133+0000 7f5f9545e740 20 client.17445 trim_cache size 0 max 16384 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 Processor -- start 2024-09-19T07:59:21.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 -- start start 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d044310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d04fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1b2710 con 0x56074d02eb40 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1affe0 con 0x56074d038370 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f9545e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1ade50 con 0x56074d02d5d0 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f8bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d04fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f8bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d04fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40012/0 (socket says 172.21.15.76:40012) 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.145+0000 7f5f8bfff640 1 -- 172.21.15.76:0/1176290976 learned_addr learned my addr 172.21.15.76:0/1176290976 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f8bfff640 1 -- 172.21.15.76:0/1176290976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 msgr2=0x56074d044310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f90e21640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d044310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f91622640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d044310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f8bfff640 1 -- 172.21.15.76:0/1176290976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 msgr2=0x56074d0501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f8bfff640 1 -- 172.21.15.76:0/1176290976 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56074d02d3f0 con 0x56074d02eb40 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f91622640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f90e21640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d044310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d04fc90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009850 tx=0x7f5f7403d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270ebcc054d97adc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f827fc640 1 -- 172.21.15.76:0/1176290976 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7404f040 con 0x56074d02eb40 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f827fc640 1 -- 172.21.15.76:0/1176290976 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f74046040 con 0x56074d02eb40 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.146+0000 7f5f827fc640 1 -- 172.21.15.76:0/1176290976 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74035050 con 0x56074d02eb40 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 -- 172.21.15.76:0/1176290976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 msgr2=0x56074d04fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d04fc90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009850 tx=0x7f5f7403d480 comp rx=0 tx=0).stop 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 -- 172.21.15.76:0/1176290976 shutdown_connections 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d038370 0x56074d0501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d02eb40 0x56074d04fc90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 --2- 172.21.15.76:0/1176290976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02d5d0 0x56074d044310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 -- 172.21.15.76:0/1176290976 >> 172.21.15.76:0/1176290976 conn(0x56074cff6310 msgr2=0x56074d0302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 -- 172.21.15.76:0/1176290976 shutdown_connections 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 -- 172.21.15.76:0/1176290976 wait complete. 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 -- start start 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 Processor -- start 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.147+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d0aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02eb40 0x56074d0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 0x56074d03ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1ae4a0 con 0x56074d038370 2024-09-19T07:59:21.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1af910 con 0x56074d02d5d0 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1aeb70 con 0x56074d02eb40 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 10 client.0 _ll_register_callbacks cb 0x7f5f74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 0x56074d03ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 0x56074d03ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40016/0 (socket says 172.21.15.76:40016) 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 -- 172.21.15.76:0/3015881916 learned_addr learned my addr 172.21.15.76:0/3015881916 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f90e21640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d0aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02eb40 0x56074d0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 -- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02eb40 msgr2=0x56074d0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02eb40 0x56074d0ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 -- 172.21.15.76:0/3015881916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 msgr2=0x56074d0aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d0aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 -- 172.21.15.76:0/3015881916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56074d03c0f0 con 0x56074d038370 2024-09-19T07:59:21.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f8bfff640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02eb40 0x56074d0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f90e21640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d0aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f91622640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 0x56074d03ba00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5f8409b3d0 tx=0x7f5f8409b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92ef76b7032424e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f6bfff640 1 -- 172.21.15.76:0/3015881916 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f840667b0 con 0x56074d038370 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f6bfff640 1 -- 172.21.15.76:0/3015881916 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f5f840cccb0 con 0x56074d038370 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f74046040 con 0x56074d038370 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f6bfff640 1 -- 172.21.15.76:0/3015881916 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5f84067380 con 0x56074d038370 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 10 client.17451 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.148+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56074d0b26f0 con 0x56074d038370 2024-09-19T07:59:21.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f6bfff640 1 -- 172.21.15.76:0/3015881916 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f74046040 con 0x56074d038370 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f6bfff640 1 -- 172.21.15.76:0/3015881916 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5f8408b9c0 con 0x56074d038370 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f9545e740 10 client.17451 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f9545e740 10 client.17451 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f9545e740 20 client.17451 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f9545e740 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d0b2e40 0x56074d0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f9545e740 4 client.17451 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56074cf9ad70 con 0x56074d0b2e40 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.149+0000 7f5f90e21640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d0b2e40 0x56074d0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f6bfff640 10 client.17451 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f90e21640 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d0b2e40 0x56074d0b5260 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0eaecc19b12db38 server_cookie=440b5e9cfcb4fcc7 in_seq=0 out_seq=0 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f6bfff640 1 -- 172.21.15.76:0/3015881916 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56074cf9ad70 con 0x56074d0b2e40 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f6bfff640 10 client.17451 handle_command_reply: tid=0 2024-09-19T07:59:21.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 client.17451 shutdown 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 msgr2=0x56074d03ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 0x56074d03ba00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5f8409b3d0 tx=0x7f5f8409b0f0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 shutdown_connections 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56074d0b2e40 0x56074d0b5260 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56074d038370 0x56074d03ba00 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56074d02eb40 0x56074d0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f6bfff640 0 client.17451 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 --2- 172.21.15.76:0/3015881916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074d02d5d0 0x56074d0aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 >> 172.21.15.76:0/3015881916 conn(0x56074cff6310 msgr2=0x56074d033850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 shutdown_connections 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 1 -- 172.21.15.76:0/3015881916 wait complete. 2024-09-19T07:59:21.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.150+0000 7f5f9545e740 20 client.17451 trim_cache size 0 max 16384 2024-09-19T07:59:21.169 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:59:21.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5f780a33b0 msgr2=0x7f5f780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5f780a33b0 0x7f5f780a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f74006010 tx=0x7f5f740095f0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 msgr2=0x7f5f8c1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c1014d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009fd0 tx=0x7f5f8400b8e0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 shutdown_connections 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f5f780a33b0 0x7f5f780a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5f8c10c2f0 0x7f5f8c1014d0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f8c1037a0 0x7f5f8c100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 --2- 172.21.15.76:0/1263681368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f8c102df0 0x7f5f8c100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 >> 172.21.15.76:0/1263681368 conn(0x7f5f8c0fc7d0 msgr2=0x7f5f8c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 shutdown_connections 2024-09-19T07:59:21.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:21.151+0000 7f5f93085640 1 -- 172.21.15.76:0/1263681368 wait complete. 2024-09-19T07:59:22.007 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:59:22.033 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:22 smithi076 ceph-mon[30930]: pgmap v253: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:22.255 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:22 smithi152 ceph-mon[35117]: pgmap v253: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:22.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:22 smithi137 ceph-mon[35309]: pgmap v253: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:22.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 -- 172.21.15.76:0/2612662554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc106a80 msgr2=0x7f20fc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 --2- 172.21.15.76:0/2612662554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc106a80 0x7f20fc106e60 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009930 tx=0x7f20ec02a420 comp rx=0 tx=0).stop 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 -- 172.21.15.76:0/2612662554 shutdown_connections 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 --2- 172.21.15.76:0/2612662554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20fc101420 0x7f20fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 --2- 172.21.15.76:0/2612662554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20fc100a80 0x7f20fc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 --2- 172.21.15.76:0/2612662554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc106a80 0x7f20fc106e60 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 -- 172.21.15.76:0/2612662554 >> 172.21.15.76:0/2612662554 conn(0x7f20fc0fc7a0 msgr2=0x7f20fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 -- 172.21.15.76:0/2612662554 shutdown_connections 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.752+0000 7f21029c3640 1 -- 172.21.15.76:0/2612662554 wait complete. 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.753+0000 7f21029c3640 1 Processor -- start 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.753+0000 7f21029c3640 1 -- start start 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.753+0000 7f21029c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20fc100a80 0x7f20fc1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.753+0000 7f21029c3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 0x7f20fc197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.753+0000 7f21029c3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20fc106a80 0x7f20fc19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f21029c3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc111060 con 0x7f20fc101420 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f21029c3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc110ee0 con 0x7f20fc106a80 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f21029c3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1111e0 con 0x7f20fc100a80 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 0x7f20fc197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 0x7f20fc197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40048/0 (socket says 172.21.15.76:40048) 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1840672700 learned_addr learned my addr 172.21.15.76:0/1840672700 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fbfff640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20fc100a80 0x7f20fc1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f2100f60640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20fc106a80 0x7f20fc19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1840672700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20fc100a80 msgr2=0x7f20fc1975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20fc100a80 0x7f20fc1975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1840672700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20fc106a80 msgr2=0x7f20fc19be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20fc106a80 0x7f20fc19be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1840672700 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc19c550 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 0x7f20fc197ae0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b4a0 tx=0x7f20f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20f97fa640 1 -- 172.21.15.76:0/1840672700 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0014070 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20f97fa640 1 -- 172.21.15.76:0/1840672700 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20f0010b10 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20fc19c840 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f20f97fa640 1 -- 172.21.15.76:0/1840672700 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0017d60 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.754+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20fc1a4120 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.756+0000 7f20f97fa640 1 -- 172.21.15.76:0/1840672700 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f20f0017070 con 0x7f20fc101420 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 Processor -- start 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 -- start start 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932bb40 0x55d6f932a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f932aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9339970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d6f92902f0 con 0x55d6f9337580 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9237cf0 con 0x55d6f932a5d0 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2104d9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d6f928c2b0 con 0x55d6f932bb40 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f20f97fa640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f20e40a33b0 0x7f20e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f20fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9339970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f20fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9339970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40052/0 (socket says 172.21.15.76:40052) 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1659899066 learned_addr learned my addr 172.21.15.76:0/1659899066 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2100f60640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f20e40a33b0 0x7f20e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f20fbfff640 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f932aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.757+0000 7f2100f60640 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932bb40 0x55d6f932a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20f97fa640 1 -- 172.21.15.76:0/1840672700 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f20f00cf0b0 con 0x7f20fc101420 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1659899066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932bb40 msgr2=0x55d6f932a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932bb40 0x55d6f932a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1659899066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 msgr2=0x55d6f932aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f932aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20fb7fe640 1 -- 172.21.15.76:0/1659899066 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f921c3a0 con 0x55d6f9337580 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9339970 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f20f00cc7f0 tx=0x7f20f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76cae27028c0bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f2100f60640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f20e40a33b0 0x7f20e40a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009fd0 tx=0x7f20f4009d80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20e27fc640 1 -- 172.21.15.76:0/1659899066 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f001e070 con 0x55d6f9337580 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20e27fc640 1 -- 172.21.15.76:0/1659899066 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20f009b410 con 0x55d6f9337580 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.758+0000 7f20e27fc640 1 -- 172.21.15.76:0/1659899066 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f00cc9f0 con 0x55d6f9337580 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 -- 172.21.15.76:0/1659899066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 msgr2=0x55d6f9339970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9339970 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f20f00cc7f0 tx=0x7f20f00046c0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 -- 172.21.15.76:0/1659899066 shutdown_connections 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9339970 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f932aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 --2- 172.21.15.76:0/1659899066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932bb40 0x55d6f932a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 -- 172.21.15.76:0/1659899066 >> 172.21.15.76:0/1659899066 conn(0x55d6f92f3310 msgr2=0x55d6f9326c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 -- 172.21.15.76:0/1659899066 shutdown_connections 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 -- 172.21.15.76:0/1659899066 wait complete. 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.759+0000 7f2104d9c740 1 -- start start 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 Processor -- start 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932a5d0 0x55d6f9332600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9332b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9333080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d6f932d490 con 0x55d6f9337580 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d6f924b060 con 0x55d6f932bb40 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d6f932d610 con 0x55d6f932a5d0 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2104d9c740 10 client.0 _ll_register_callbacks cb 0x55d6f8f9e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:22.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9333080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9333080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40056/0 (socket says 172.21.15.76:40056) 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 -- 172.21.15.76:0/2286971486 learned_addr learned my addr 172.21.15.76:0/2286971486 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932a5d0 0x55d6f9332600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9332b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 -- 172.21.15.76:0/2286971486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932a5d0 msgr2=0x55d6f9332600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932a5d0 0x55d6f9332600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 -- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 msgr2=0x55d6f9332b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9332b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 -- 172.21.15.76:0/2286971486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f90013c0 con 0x55d6f9337580 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9332b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f2100f60640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9333080 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f20f4016ed0 tx=0x7f20f40093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b967ce73b6b51d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:22.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.760+0000 7f20db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f20db7fe640 1 -- 172.21.15.76:0/2286971486 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4028060 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f20db7fe640 1 -- 172.21.15.76:0/2286971486 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f20f4018560 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f009b410 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f20db7fe640 1 -- 172.21.15.76:0/2286971486 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f20f402f050 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 10 client.17463 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d6f9347e80 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f20db7fe640 1 -- 172.21.15.76:0/2286971486 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20f009b410 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f20db7fe640 1 -- 172.21.15.76:0/2286971486 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f20f4022070 con 0x55d6f9337580 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 10 client.17463 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 10 client.17463 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 20 client.17463 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f9349340 0x55d6f934b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 4 client.17463 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:59:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.761+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6f929d860 con 0x55d6f9349340 2024-09-19T07:59:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.762+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f9349340 0x55d6f934b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.762+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f9349340 0x55d6f934b750 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e66ed749d438963f server_cookie=405a47e8cce8dd8 in_seq=0 out_seq=0 2024-09-19T07:59:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.762+0000 7f20db7fe640 10 client.17463 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f20db7fe640 1 -- 172.21.15.76:0/2286971486 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6f929d860 con 0x55d6f9349340 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f20db7fe640 10 client.17463 handle_command_reply: tid=0 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 client.17463 shutdown 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 msgr2=0x55d6f9333080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9333080 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f20f4016ed0 tx=0x7f20f40093d0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 shutdown_connections 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f9349340 0x55d6f934b750 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f9337580 0x55d6f9333080 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f20db7fe640 0 client.17463 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:59:22.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9332b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2286971486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f932a5d0 0x55d6f9332600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 >> 172.21.15.76:0/2286971486 conn(0x55d6f92f3310 msgr2=0x55d6f932c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:22.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 shutdown_connections 2024-09-19T07:59:22.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.763+0000 7f2104d9c740 1 -- 172.21.15.76:0/2286971486 wait complete. 2024-09-19T07:59:22.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.764+0000 7f2104d9c740 20 client.17463 trim_cache size 0 max 16384 2024-09-19T07:59:22.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.776+0000 7f2104d9c740 1 Processor -- start 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.776+0000 7f2104d9c740 1 -- start start 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.776+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 0x55d6f9338970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.776+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9338eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.776+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f9351020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f2104d9c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1ae390 con 0x55d6f932a5d0 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f2104d9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1abc60 con 0x55d6f932bb40 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f2104d9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1a9ad0 con 0x55d6f9337580 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 0x55d6f9338970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 0x55d6f9338970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40064/0 (socket says 172.21.15.76:40064) 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 -- 172.21.15.76:0/3092803313 learned_addr learned my addr 172.21.15.76:0/3092803313 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9338eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f2100f60640 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f9351020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 -- 172.21.15.76:0/3092803313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 msgr2=0x55d6f9351020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f9351020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 -- 172.21.15.76:0/3092803313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 msgr2=0x55d6f9338eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9338eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 -- 172.21.15.76:0/3092803313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f9339d30 con 0x55d6f932a5d0 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9338eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20fbfff640 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 0x55d6f9338970 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f20ec02a940 tx=0x7f20ec0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4011d9d3ab1904 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20e1ffb640 1 -- 172.21.15.76:0/3092803313 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec04a070 con 0x55d6f932a5d0 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20e1ffb640 1 -- 172.21.15.76:0/3092803313 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20ec005520 con 0x55d6f932a5d0 2024-09-19T07:59:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.777+0000 7f20e1ffb640 1 -- 172.21.15.76:0/3092803313 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec035040 con 0x55d6f932a5d0 2024-09-19T07:59:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 -- 172.21.15.76:0/3092803313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 msgr2=0x55d6f9338970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 0x55d6f9338970 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f20ec02a940 tx=0x7f20ec0058d0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 -- 172.21.15.76:0/3092803313 shutdown_connections 2024-09-19T07:59:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f9351020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932bb40 0x55d6f9338eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 --2- 172.21.15.76:0/3092803313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932a5d0 0x55d6f9338970 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 -- 172.21.15.76:0/3092803313 >> 172.21.15.76:0/3092803313 conn(0x55d6f92f3310 msgr2=0x55d6f932d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 -- 172.21.15.76:0/3092803313 shutdown_connections 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 -- 172.21.15.76:0/3092803313 wait complete. 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.778+0000 7f2104d9c740 1 -- start start 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 Processor -- start 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f933e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 0x55d6f933e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f933eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1aa120 con 0x55d6f932bb40 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1ab590 con 0x55d6f932a5d0 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1aa7f0 con 0x55d6f9337580 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2104d9c740 10 client.0 _ll_register_callbacks cb 0x7f20f400a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 0x55d6f933e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 0x55d6f933e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:40080/0 (socket says 172.21.15.76:40080) 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 -- 172.21.15.76:0/2637864941 learned_addr learned my addr 172.21.15.76:0/2637864941 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f933e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2100f60640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f933eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 -- 172.21.15.76:0/2637864941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 msgr2=0x55d6f933eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f933eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 -- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 msgr2=0x55d6f933e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f933e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 -- 172.21.15.76:0/2637864941 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f9342c10 con 0x55d6f932bb40 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f933e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f2100f60640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f933eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20fb7fe640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 0x55d6f933e990 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f20f00ccd70 tx=0x7f20f0017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaaeaf2d3a2a45a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:22.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.779+0000 7f20db7fe640 1 -- 172.21.15.76:0/2637864941 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f001e040 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f20db7fe640 1 -- 172.21.15.76:0/2637864941 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f20f00173f0 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ec005520 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f20db7fe640 1 -- 172.21.15.76:0/2637864941 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f20f009f7c0 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 10 client.17469 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d6f93b4370 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f20db7fe640 1 -- 172.21.15.76:0/2637864941 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20ec005520 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f20db7fe640 1 -- 172.21.15.76:0/2637864941 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f20f0097a80 con 0x55d6f932bb40 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 10 client.17469 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 10 client.17469 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 20 client.17469 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f93b46a0 0x55d6f93b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 4 client.17469 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.780+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6f9297d70 con 0x55d6f93b46a0 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f93b46a0 0x55d6f93b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f20db7fe640 10 client.17469 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f20fbfff640 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f93b46a0 0x55d6f93b6a90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f0f1ed7d7282602 server_cookie=2d20c48450094d64 in_seq=0 out_seq=0 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f20db7fe640 1 -- 172.21.15.76:0/2637864941 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6f9297d70 con 0x55d6f93b46a0 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f20db7fe640 10 client.17469 handle_command_reply: tid=0 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 client.17469 shutdown 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 msgr2=0x55d6f933e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 0x55d6f933e990 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f20f00ccd70 tx=0x7f20f0017360 comp rx=0 tx=0).stop 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 shutdown_connections 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55d6f93b46a0 0x55d6f93b6a90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6f9337580 0x55d6f933eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d6f932bb40 0x55d6f933e990 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f20db7fe640 0 client.17469 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T07:59:22.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 --2- 172.21.15.76:0/2637864941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d6f932a5d0 0x55d6f933e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.781+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 >> 172.21.15.76:0/2637864941 conn(0x55d6f92f3310 msgr2=0x55d6f93254e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:22.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 shutdown_connections 2024-09-19T07:59:22.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f2104d9c740 1 -- 172.21.15.76:0/2637864941 wait complete. 2024-09-19T07:59:22.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f2104d9c740 20 client.17469 trim_cache size 0 max 16384 2024-09-19T07:59:22.788 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f20e40a33b0 msgr2=0x7f20e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f20e40a33b0 0x7f20e40a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009fd0 tx=0x7f20f4009d80 comp rx=0 tx=0).stop 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 msgr2=0x7f20fc197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 0x7f20fc197ae0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b4a0 tx=0x7f20f000b960 comp rx=0 tx=0).stop 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 shutdown_connections 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f20e40a33b0 0x7f20e40a5870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20fc106a80 0x7f20fc19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20fc101420 0x7f20fc197ae0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 --2- 172.21.15.76:0/1840672700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20fc100a80 0x7f20fc1975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:22.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 >> 172.21.15.76:0/1840672700 conn(0x7f20fc0fc7a0 msgr2=0x7f20fc0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:22.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 shutdown_connections 2024-09-19T07:59:22.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:22.782+0000 7f21029c3640 1 -- 172.21.15.76:0/1840672700 wait complete. 2024-09-19T07:59:23.522 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:59:23.812 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:24.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:24 smithi076 ceph-mon[30930]: pgmap v254: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:24.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:24 smithi152 ceph-mon[35117]: pgmap v254: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:24.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 -- 172.21.15.76:0/2539078570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 msgr2=0x7f1c341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 --2- 172.21.15.76:0/2539078570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c341021c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009900 tx=0x7f1c2402a410 comp rx=0 tx=0).stop 2024-09-19T07:59:24.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 -- 172.21.15.76:0/2539078570 shutdown_connections 2024-09-19T07:59:24.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 --2- 172.21.15.76:0/2539078570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c34106f10 0x7f1c3410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 --2- 172.21.15.76:0/2539078570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c34102790 0x7f1c341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 --2- 172.21.15.76:0/2539078570 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c341021c0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 -- 172.21.15.76:0/2539078570 >> 172.21.15.76:0/2539078570 conn(0x7f1c340fd8c0 msgr2=0x7f1c340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:24.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 -- 172.21.15.76:0/2539078570 shutdown_connections 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 -- 172.21.15.76:0/2539078570 wait complete. 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 Processor -- start 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.330+0000 7f1c3a288640 1 -- start start 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c3a288640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c34198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c3a288640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c34102790 0x7f1c34198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c3a288640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c34106f10 0x7f1c3419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c3a288640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c34112150 con 0x7f1c34101de0 2024-09-19T07:59:24.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c3a288640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c34111fd0 con 0x7f1c34102790 2024-09-19T07:59:24.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c3a288640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341122d0 con 0x7f1c34106f10 2024-09-19T07:59:24.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c34198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c34198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51984/0 (socket says 172.21.15.76:51984) 2024-09-19T07:59:24.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 -- 172.21.15.76:0/1690209924 learned_addr learned my addr 172.21.15.76:0/1690209924 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:24.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c38825640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c34106f10 0x7f1c3419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c34102790 0x7f1c34198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 -- 172.21.15.76:0/1690209924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c34106f10 msgr2=0x7f1c3419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c34106f10 0x7f1c3419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 -- 172.21.15.76:0/1690209924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c34102790 msgr2=0x7f1c34198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c34102790 0x7f1c34198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 -- 172.21.15.76:0/1690209924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3419d620 con 0x7f1c34101de0 2024-09-19T07:59:24.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c34198670 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1c24006010 tx=0x7f1c240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:24.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.331+0000 7f1c31ffb640 1 -- 172.21.15.76:0/1690209924 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2403f030 con 0x7f1c34101de0 2024-09-19T07:59:24.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.332+0000 7f1c31ffb640 1 -- 172.21.15.76:0/1690209924 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c24003d00 con 0x7f1c34101de0 2024-09-19T07:59:24.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.332+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3419d8b0 con 0x7f1c34101de0 2024-09-19T07:59:24.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.332+0000 7f1c31ffb640 1 -- 172.21.15.76:0/1690209924 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24035070 con 0x7f1c34101de0 2024-09-19T07:59:24.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.332+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c341a51f0 con 0x7f1c34101de0 2024-09-19T07:59:24.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c31ffb640 1 -- 172.21.15.76:0/1690209924 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1c24042030 con 0x7f1c34101de0 2024-09-19T07:59:24.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 Processor -- start 2024-09-19T07:59:24.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 -- start start 2024-09-19T07:59:24.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68f5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561ac684e2f0 con 0x561ac68f3370 2024-09-19T07:59:24.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561ac67f5cf0 con 0x561ac68e9b40 2024-09-19T07:59:24.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c3c661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561ac684a2b0 con 0x561ac68e85d0 2024-09-19T07:59:24.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c2bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c2bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51992/0 (socket says 172.21.15.76:51992) 2024-09-19T07:59:24.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.334+0000 7f1c2bfff640 1 -- 172.21.15.76:0/829070659 learned_addr learned my addr 172.21.15.76:0/829070659 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:24.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c31ffb640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1c200a3430 0x7f1c200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c33fff640 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c38825640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1c200a3430 0x7f1c200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c38825640 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c31ffb640 1 -- 172.21.15.76:0/1690209924 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f1c240f06d0 con 0x7f1c34101de0 2024-09-19T07:59:24.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2bfff640 1 -- 172.21.15.76:0/829070659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 msgr2=0x561ac68e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2bfff640 1 -- 172.21.15.76:0/829070659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 msgr2=0x561ac68e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2bfff640 1 -- 172.21.15.76:0/829070659 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ac67da3a0 con 0x561ac68f3370 2024-09-19T07:59:24.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68f5760 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00b7f0 tx=0x7f1c1c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d97f393af933feb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:24.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c38825640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1c200a3430 0x7f1c200a58f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009fd0 tx=0x7f1c2c009c30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:24.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2a7fc640 1 -- 172.21.15.76:0/829070659 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00d950 con 0x561ac68f3370 2024-09-19T07:59:24.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2a7fc640 1 -- 172.21.15.76:0/829070659 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c1c018070 con 0x561ac68f3370 2024-09-19T07:59:24.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.335+0000 7f1c2a7fc640 1 -- 172.21.15.76:0/829070659 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0123e0 con 0x561ac68f3370 2024-09-19T07:59:24.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 -- 172.21.15.76:0/829070659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 msgr2=0x561ac68f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68f5760 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00b7f0 tx=0x7f1c1c00bcb0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 -- 172.21.15.76:0/829070659 shutdown_connections 2024-09-19T07:59:24.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68f5760 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 --2- 172.21.15.76:0/829070659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 -- 172.21.15.76:0/829070659 >> 172.21.15.76:0/829070659 conn(0x561ac68b1310 msgr2=0x561ac68e4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:24.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 -- 172.21.15.76:0/829070659 shutdown_connections 2024-09-19T07:59:24.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 -- 172.21.15.76:0/829070659 wait complete. 2024-09-19T07:59:24.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.336+0000 7f1c3c661740 1 -- start start 2024-09-19T07:59:24.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 Processor -- start 2024-09-19T07:59:24.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68eff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x561ac68f6070 con 0x561ac68e9b40 2024-09-19T07:59:24.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561ac6809060 con 0x561ac68f3370 2024-09-19T07:59:24.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561ac68f61f0 con 0x561ac68e85d0 2024-09-19T07:59:24.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c3c661740 10 client.0 _ll_register_callbacks cb 0x561ac655c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:24.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68eff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:51994/0 (socket says 172.21.15.76:51994) 2024-09-19T07:59:24.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 -- 172.21.15.76:0/1895179220 learned_addr learned my addr 172.21.15.76:0/1895179220 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:24.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c38825640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 -- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 msgr2=0x561ac68f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 -- 172.21.15.76:0/1895179220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 msgr2=0x561ac68f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.337+0000 7f1c2bfff640 1 -- 172.21.15.76:0/1895179220 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ac65bf3c0 con 0x561ac68e9b40 2024-09-19T07:59:24.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68eff80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c006aa0 tx=0x7f1c1c013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cafb661b5204400 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:24.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:24.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c137fe640 1 -- 172.21.15.76:0/1895179220 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c023070 con 0x561ac68e9b40 2024-09-19T07:59:24.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c137fe640 1 -- 172.21.15.76:0/1895179220 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f1c1c00dd60 con 0x561ac68e9b40 2024-09-19T07:59:24.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c1c018070 con 0x561ac68e9b40 2024-09-19T07:59:24.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c137fe640 1 -- 172.21.15.76:0/1895179220 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1c1c02f050 con 0x561ac68e9b40 2024-09-19T07:59:24.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 10 client.17481 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:24.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ac6901a80 con 0x561ac68e9b40 2024-09-19T07:59:24.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c137fe640 1 -- 172.21.15.76:0/1895179220 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c1c018070 con 0x561ac68e9b40 2024-09-19T07:59:24.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c137fe640 1 -- 172.21.15.76:0/1895179220 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1c1c01b380 con 0x561ac68e9b40 2024-09-19T07:59:24.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 10 client.17481 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:24.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:24.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 20 client.17481 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:24.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac6902dd0 0x561ac69051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 4 client.17481 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:59:24.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.338+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ac685b860 con 0x561ac6902dd0 2024-09-19T07:59:24.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.339+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac6902dd0 0x561ac69051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.339+0000 7f1c137fe640 10 client.17481 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:24.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.339+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac6902dd0 0x561ac69051c0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=197ff3195862adae server_cookie=8e949acc422d80c3 in_seq=0 out_seq=0 2024-09-19T07:59:24.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c137fe640 1 -- 172.21.15.76:0/1895179220 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ac685b860 con 0x561ac6902dd0 2024-09-19T07:59:24.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c137fe640 10 client.17481 handle_command_reply: tid=0 2024-09-19T07:59:24.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 client.17481 shutdown 2024-09-19T07:59:24.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 msgr2=0x561ac68eff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68eff80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c006aa0 tx=0x7f1c1c013730 comp rx=0 tx=0).stop 2024-09-19T07:59:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 shutdown_connections 2024-09-19T07:59:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac6902dd0 0x561ac69051c0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68eff80 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1895179220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c137fe640 0 client.17481 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:24.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 >> 172.21.15.76:0/1895179220 conn(0x561ac68b1310 msgr2=0x561ac68ea960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:24.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 shutdown_connections 2024-09-19T07:59:24.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 1 -- 172.21.15.76:0/1895179220 wait complete. 2024-09-19T07:59:24.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.340+0000 7f1c3c661740 20 client.17481 trim_cache size 0 max 16384 2024-09-19T07:59:24.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 Processor -- start 2024-09-19T07:59:24.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 -- start start 2024-09-19T07:59:24.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68ff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68eef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341b0540 con 0x561ac68f3370 2024-09-19T07:59:24.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341ade10 con 0x561ac68e9b40 2024-09-19T07:59:24.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c3c661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341abc80 con 0x561ac68e85d0 2024-09-19T07:59:24.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c38825640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c38825640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68eef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52000/0 (socket says 172.21.15.76:52000) 2024-09-19T07:59:24.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c38825640 1 -- 172.21.15.76:0/1265680781 learned_addr learned my addr 172.21.15.76:0/1265680781 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:24.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.353+0000 7f1c33fff640 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c38825640 1 -- 172.21.15.76:0/1265680781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 msgr2=0x561ac68ff310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c38825640 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68ff310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c38825640 1 -- 172.21.15.76:0/1265680781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 msgr2=0x561ac68ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c38825640 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c38825640 1 -- 172.21.15.76:0/1265680781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ac68e5960 con 0x561ac68f3370 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c38825640 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68eef60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c008a70 tx=0x7f1c2c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88618c9f5765973 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c29ffb640 1 -- 172.21.15.76:0/1265680781 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c014040 con 0x561ac68f3370 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c29ffb640 1 -- 172.21.15.76:0/1265680781 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c2c029070 con 0x561ac68f3370 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.354+0000 7f1c29ffb640 1 -- 172.21.15.76:0/1265680781 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0223b0 con 0x561ac68f3370 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 -- 172.21.15.76:0/1265680781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 msgr2=0x561ac68eef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68eef60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c008a70 tx=0x7f1c2c009650 comp rx=0 tx=0).stop 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 -- 172.21.15.76:0/1265680781 shutdown_connections 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68f3370 0x561ac68eef60 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68e9b40 0x561ac68ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- 172.21.15.76:0/1265680781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 -- 172.21.15.76:0/1265680781 >> 172.21.15.76:0/1265680781 conn(0x561ac68b1310 msgr2=0x561ac68ee850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 -- 172.21.15.76:0/1265680781 shutdown_connections 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 -- 172.21.15.76:0/1265680781 wait complete. 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 -- start start 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 Processor -- start 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.355+0000 7f1c3c661740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c3c661740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341ac2d0 con 0x561ac68e9b40 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c3c661740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341ad740 con 0x561ac68f3370 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c3c661740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1c341ac9a0 con 0x561ac68e85d0 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c3c661740 10 client.0 _ll_register_callbacks cb 0x7f1c240bc6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52004/0 (socket says 172.21.15.76:52004) 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c33fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 -- 172.21.15.76:0/3889896882 learned_addr learned my addr 172.21.15.76:0/3889896882 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 -- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 msgr2=0x561ac68fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68fb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c38825640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 -- 172.21.15.76:0/3889896882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 msgr2=0x561ac68f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 -- 172.21.15.76:0/3889896882 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ac68f4d60 con 0x561ac68e9b40 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c33fff640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c38825640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c2bfff640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68f42e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00bcf0 tx=0x7f1c1c0139d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553b0cabda8f0bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:24.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c137fe640 1 -- 172.21.15.76:0/3889896882 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c023050 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c137fe640 1 -- 172.21.15.76:0/3889896882 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f1c1c00db60 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.356+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c2c029070 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c137fe640 1 -- 172.21.15.76:0/3889896882 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1c1c03a050 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 10 client.17487 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ac68fb0d0 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c137fe640 1 -- 172.21.15.76:0/3889896882 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c2c029070 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c137fe640 1 -- 172.21.15.76:0/3889896882 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1c1c028560 con 0x561ac68e9b40 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 10 client.17487 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 10 client.17487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 20 client.17487 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac696da60 0x561ac696fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 4 client.17487 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:59:24.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561ac6855d70 con 0x561ac696da60 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.357+0000 7f1c33fff640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac696da60 0x561ac696fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c137fe640 10 client.17487 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c33fff640 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac696da60 0x561ac696fe80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791ecf71c7111170 server_cookie=5a0b30fbc14e7fce in_seq=0 out_seq=0 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c137fe640 1 -- 172.21.15.76:0/3889896882 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561ac6855d70 con 0x561ac696da60 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c137fe640 10 client.17487 handle_command_reply: tid=0 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 client.17487 shutdown 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 msgr2=0x561ac68f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68f42e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00bcf0 tx=0x7f1c1c0139d0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 shutdown_connections 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ac68f3370 0x561ac68f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561ac696da60 0x561ac696fe80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561ac68e9b40 0x561ac68f42e0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 --2- 172.21.15.76:0/3889896882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561ac68e85d0 0x561ac68fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 >> 172.21.15.76:0/3889896882 conn(0x561ac68b1310 msgr2=0x561ac68f17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:24.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c137fe640 0 client.17487 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:24.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 shutdown_connections 2024-09-19T07:59:24.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 1 -- 172.21.15.76:0/3889896882 wait complete. 2024-09-19T07:59:24.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.358+0000 7f1c3c661740 20 client.17487 trim_cache size 0 max 16384 2024-09-19T07:59:24.386 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1c200a3430 msgr2=0x7f1c200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1c200a3430 0x7f1c200a58f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009fd0 tx=0x7f1c2c009c30 comp rx=0 tx=0).stop 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 msgr2=0x7f1c34198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c34198670 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1c24006010 tx=0x7f1c240042f0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 shutdown_connections 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f1c200a3430 0x7f1c200a58f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c34106f10 0x7f1c3419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c34102790 0x7f1c34198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 --2- 172.21.15.76:0/1690209924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1c34101de0 0x7f1c34198670 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:24.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 >> 172.21.15.76:0/1690209924 conn(0x7f1c340fd8c0 msgr2=0x7f1c340fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:24.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 shutdown_connections 2024-09-19T07:59:24.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:24.359+0000 7f1c3a288640 1 -- 172.21.15.76:0/1690209924 wait complete. 2024-09-19T07:59:24.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:24 smithi137 ceph-mon[35309]: pgmap v254: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:59:26.180 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:59:26.181 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:59:26.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:26 smithi152 ceph-mon[35117]: pgmap v255: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:59:26.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:26 smithi137 ceph-mon[35309]: pgmap v255: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:59:26.436 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:26.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:26 smithi076 ceph-mon[30930]: pgmap v255: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:59:26.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 -- 172.21.15.76:0/3852509451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c102dd0 msgr2=0x7f006c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 --2- 172.21.15.76:0/3852509451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c102dd0 0x7f006c1031b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0068009930 tx=0x7f006802a420 comp rx=0 tx=0).stop 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 -- 172.21.15.76:0/3852509451 shutdown_connections 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 --2- 172.21.15.76:0/3852509451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f006c108300 0x7f006c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 --2- 172.21.15.76:0/3852509451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f006c103780 0x7f006c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 --2- 172.21.15.76:0/3852509451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c102dd0 0x7f006c1031b0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 -- 172.21.15.76:0/3852509451 >> 172.21.15.76:0/3852509451 conn(0x7f006c0fc7d0 msgr2=0x7f006c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 -- 172.21.15.76:0/3852509451 shutdown_connections 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.958+0000 7f0073f81640 1 -- 172.21.15.76:0/3852509451 wait complete. 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 Processor -- start 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 -- start start 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f006c102dd0 0x7f006c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f006c103780 0x7f006c198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 0x7f006c19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1121f0 con 0x7f006c108300 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f006c112070 con 0x7f006c102dd0 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0073f81640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f006c112370 con 0x7f006c103780 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 0x7f006c19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 0x7f006c19cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52024/0 (socket says 172.21.15.76:52024) 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 -- 172.21.15.76:0/1536416336 learned_addr learned my addr 172.21.15.76:0/1536416336 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007151c640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f006c103780 0x7f006c198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0071d1d640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f006c102dd0 0x7f006c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 -- 172.21.15.76:0/1536416336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f006c103780 msgr2=0x7f006c198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f006c103780 0x7f006c198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 -- 172.21.15.76:0/1536416336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f006c102dd0 msgr2=0x7f006c1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f006c102dd0 0x7f006c1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 -- 172.21.15.76:0/1536416336 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c19d680 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f007251e640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 0x7f006c19cfa0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0064009fd0 tx=0x7f006400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.959+0000 7f0062ffd640 1 -- 172.21.15.76:0/1536416336 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064017070 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.960+0000 7f0062ffd640 1 -- 172.21.15.76:0/1536416336 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0064004020 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.960+0000 7f0062ffd640 1 -- 172.21.15.76:0/1536416336 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00640106c0 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.960+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c19d970 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.960+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c1a5250 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f0062ffd640 1 -- 172.21.15.76:0/1536416336 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f00640041d0 con 0x7f006c108300 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 Processor -- start 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 -- start start 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55df18727280 con 0x55df187c1b60 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df186ceb10 con 0x55df187ccd40 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007635a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df18723240 con 0x55df187c2480 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.962+0000 7f007151c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0062ffd640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f00580a33b0 0x7f00580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52040/0 (socket says 172.21.15.76:52040) 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 -- 172.21.15.76:0/27807703 learned_addr learned my addr 172.21.15.76:0/27807703 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0071d1d640 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007251e640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f00580a33b0 0x7f00580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0062ffd640 1 -- 172.21.15.76:0/1536416336 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f00640cf9a0 con 0x7f006c108300 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 -- 172.21.15.76:0/27807703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 msgr2=0x55df187cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 -- 172.21.15.76:0/27807703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 msgr2=0x55df187cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 -- 172.21.15.76:0/27807703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df186db1f0 con 0x55df187c1b60 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0071d1d640 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007151c640 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c1f40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x55df187bf470 tx=0x7f005c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4047494f0f237d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f007251e640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f00580a33b0 0x7f00580a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f006409bc30 tx=0x7f006406a990 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0057fff640 1 -- 172.21.15.76:0/27807703 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c01e390 con 0x55df187c1b60 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0057fff640 1 -- 172.21.15.76:0/27807703 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f005c0138f0 con 0x55df187c1b60 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.963+0000 7f0057fff640 1 -- 172.21.15.76:0/27807703 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c003850 con 0x55df187c1b60 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 -- 172.21.15.76:0/27807703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 msgr2=0x55df187c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c1f40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x55df187bf470 tx=0x7f005c005850 comp rx=0 tx=0).stop 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 -- 172.21.15.76:0/27807703 shutdown_connections 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 --2- 172.21.15.76:0/27807703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c1f40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 -- 172.21.15.76:0/27807703 >> 172.21.15.76:0/27807703 conn(0x55df187be0f0 msgr2=0x55df187be4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 -- 172.21.15.76:0/27807703 shutdown_connections 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 -- 172.21.15.76:0/27807703 wait complete. 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 -- start start 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.964+0000 7f007635a740 1 Processor -- start 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c1b60 0x55df187c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c2480 0x55df187ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 0x55df187ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55df187cf910 con 0x55df187ccd40 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df186e1f10 con 0x55df187c2480 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55df187cfa90 con 0x55df187c1b60 2024-09-19T07:59:26.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007635a740 10 client.0 _ll_register_callbacks cb 0x55df186aaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 0x55df187ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 0x55df187ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52044/0 (socket says 172.21.15.76:52044) 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 -- 172.21.15.76:0/1827909866 learned_addr learned my addr 172.21.15.76:0/1827909866 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f0071d1d640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c2480 0x55df187ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c1b60 0x55df187c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 -- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c1b60 msgr2=0x55df187c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c1b60 0x55df187c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 -- 172.21.15.76:0/1827909866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c2480 msgr2=0x55df187ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c2480 0x55df187ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 -- 172.21.15.76:0/1827909866 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df184986a0 con 0x55df187ccd40 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f007151c640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 0x55df187ca670 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f005c0133e0 tx=0x7f005c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43515dfe18d0ada server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.965+0000 7f00557fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:26.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f00557fa640 1 -- 172.21.15.76:0/1827909866 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c030040 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f00557fa640 1 -- 172.21.15.76:0/1827909866 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f005c027a50 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f005c0138f0 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f00557fa640 1 -- 172.21.15.76:0/1827909866 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f005c010430 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 10 client.17499 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55df187db4e0 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f00557fa640 1 -- 172.21.15.76:0/1827909866 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f005c0138f0 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f00557fa640 1 -- 172.21.15.76:0/1827909866 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f005c0366a0 con 0x55df187ccd40 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 10 client.17499 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 20 client.17499 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df187dc830 0x55df187dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 4 client.17499 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df187347f0 con 0x55df187dc830 2024-09-19T07:59:26.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.966+0000 7f0071d1d640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df187dc830 0x55df187dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.967+0000 7f0071d1d640 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df187dc830 0x55df187dec20 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=897c90797bf24831 server_cookie=e202c99dc1fd99fe in_seq=0 out_seq=0 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.967+0000 7f00557fa640 10 client.17499 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.967+0000 7f00557fa640 1 -- 172.21.15.76:0/1827909866 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df187347f0 con 0x55df187dc830 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.967+0000 7f00557fa640 10 client.17499 handle_command_reply: tid=0 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.967+0000 7f007635a740 1 client.17499 shutdown 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 msgr2=0x55df187ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 0x55df187ca670 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f005c0133e0 tx=0x7f005c009260 comp rx=0 tx=0).stop 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 shutdown_connections 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df187dc830 0x55df187dec20 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187ccd40 0x55df187ca670 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f00557fa640 0 client.17499 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c2480 0x55df187ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 --2- 172.21.15.76:0/1827909866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c1b60 0x55df187c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 >> 172.21.15.76:0/1827909866 conn(0x55df187be0f0 msgr2=0x55df187c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:26.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 shutdown_connections 2024-09-19T07:59:26.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 1 -- 172.21.15.76:0/1827909866 wait complete. 2024-09-19T07:59:26.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.968+0000 7f007635a740 20 client.17499 trim_cache size 0 max 16384 2024-09-19T07:59:26.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.984+0000 7f007635a740 1 Processor -- start 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.984+0000 7f007635a740 1 -- start start 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007635a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c1b60 0x55df187c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007635a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 0x55df187c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007635a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187ccd40 0x55df187e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007635a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1ae2b0 con 0x55df187c2480 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007635a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1abb80 con 0x55df187c1b60 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007635a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1a99f0 con 0x55df187ccd40 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 0x55df187c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 0x55df187c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52054/0 (socket says 172.21.15.76:52054) 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 -- 172.21.15.76:0/3669572996 learned_addr learned my addr 172.21.15.76:0/3669572996 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:26.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007151c640 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c1b60 0x55df187c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007151c640 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187ccd40 0x55df187e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 -- 172.21.15.76:0/3669572996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187ccd40 msgr2=0x55df187e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187ccd40 0x55df187e41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 -- 172.21.15.76:0/3669572996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c1b60 msgr2=0x55df187c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c1b60 0x55df187c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 -- 172.21.15.76:0/3669572996 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df187cc1f0 con 0x55df187c2480 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f007151c640 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187ccd40 0x55df187e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f0071d1d640 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 0x55df187c45c0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f006802a940 tx=0x7f0068031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963f0181ac05cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f00577fe640 1 -- 172.21.15.76:0/3669572996 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006804d070 con 0x55df187c2480 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f00577fe640 1 -- 172.21.15.76:0/3669572996 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0068031aa0 con 0x55df187c2480 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.985+0000 7f00577fe640 1 -- 172.21.15.76:0/3669572996 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068035040 con 0x55df187c2480 2024-09-19T07:59:26.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 -- 172.21.15.76:0/3669572996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 msgr2=0x55df187c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 0x55df187c45c0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f006802a940 tx=0x7f0068031a30 comp rx=0 tx=0).stop 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 -- 172.21.15.76:0/3669572996 shutdown_connections 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187ccd40 0x55df187e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c2480 0x55df187c45c0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 --2- 172.21.15.76:0/3669572996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187c1b60 0x55df187c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 -- 172.21.15.76:0/3669572996 >> 172.21.15.76:0/3669572996 conn(0x55df187be0f0 msgr2=0x55df187bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 -- 172.21.15.76:0/3669572996 shutdown_connections 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 -- 172.21.15.76:0/3669572996 wait complete. 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.986+0000 7f007635a740 1 -- start start 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 Processor -- start 2024-09-19T07:59:26.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1aa040 con 0x55df187c1b60 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1ab4b0 con 0x55df187ccd40 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f006c1aa710 con 0x55df187c2480 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007635a740 10 client.0 _ll_register_callbacks cb 0x7f005c009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007151c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007151c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52058/0 (socket says 172.21.15.76:52058) 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007151c640 1 -- 172.21.15.76:0/3493297790 learned_addr learned my addr 172.21.15.76:0/3493297790 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f0071d1d640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.987+0000 7f007151c640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007151c640 1 -- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 msgr2=0x55df187c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007151c640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007151c640 1 -- 172.21.15.76:0/3493297790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 msgr2=0x55df187c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007151c640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007151c640 1 -- 172.21.15.76:0/3493297790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df18846190 con 0x55df187c1b60 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007151c640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c6a90 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f005c029010 tx=0x7f005c01e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c059a20b77d7cdf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f00557fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f00557fa640 1 -- 172.21.15.76:0/3493297790 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c027850 con 0x55df187c1b60 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f00557fa640 1 -- 172.21.15.76:0/3493297790 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f005c0279f0 con 0x55df187c1b60 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0068031aa0 con 0x55df187c1b60 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f00557fa640 1 -- 172.21.15.76:0/3493297790 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f005c005040 con 0x55df187c1b60 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007635a740 10 client.17505 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:26.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.988+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55df188473b0 con 0x55df187c1b60 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f00557fa640 1 -- 172.21.15.76:0/3493297790 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0068031aa0 con 0x55df187c1b60 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f00557fa640 1 -- 172.21.15.76:0/3493297790 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f005c0035f0 con 0x55df187c1b60 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f007635a740 10 client.17505 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f007635a740 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f007635a740 20 client.17505 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f007635a740 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df18847b00 0x55df18849f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f007635a740 4 client.17505 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:59:26.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55df1872ed00 con 0x55df18847b00 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.989+0000 7f0071d1d640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df18847b00 0x55df18849f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.990+0000 7f00557fa640 10 client.17505 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.990+0000 7f0071d1d640 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df18847b00 0x55df18849f20 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962ef176ef2416fe server_cookie=2221d794af19f4bc in_seq=0 out_seq=0 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.990+0000 7f00557fa640 1 -- 172.21.15.76:0/3493297790 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55df1872ed00 con 0x55df18847b00 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.990+0000 7f00557fa640 10 client.17505 handle_command_reply: tid=0 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.990+0000 7f007635a740 1 client.17505 shutdown 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 msgr2=0x55df187c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c6a90 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f005c029010 tx=0x7f005c01e770 comp rx=0 tx=0).stop 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 shutdown_connections 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df187ccd40 0x55df187c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55df187c2480 0x55df187c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55df18847b00 0x55df18849f20 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 --2- 172.21.15.76:0/3493297790 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df187c1b60 0x55df187c6a90 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 >> 172.21.15.76:0/3493297790 conn(0x55df187be0f0 msgr2=0x55df187d7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f00557fa640 0 client.17505 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 shutdown_connections 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 1 -- 172.21.15.76:0/3493297790 wait complete. 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.991+0000 7f007635a740 20 client.17505 trim_cache size 0 max 16384 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "46fc257f-b2d7-427b-aa2f-dd49fa56876c", 2024-09-19T07:59:26.998 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T07:59:26.999 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f00580a33b0 msgr2=0x7f00580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f00580a33b0 0x7f00580a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f006409bc30 tx=0x7f006406a990 comp rx=0 tx=0).stop 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 msgr2=0x7f006c19cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 0x7f006c19cfa0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f0064009fd0 tx=0x7f006400b260 comp rx=0 tx=0).stop 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 shutdown_connections 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f00580a33b0 0x7f00580a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f006c108300 0x7f006c19cfa0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f006c103780 0x7f006c198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:27.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 --2- 172.21.15.76:0/1536416336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f006c102dd0 0x7f006c1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:27.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 >> 172.21.15.76:0/1536416336 conn(0x7f006c0fc7d0 msgr2=0x7f006c105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:27.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 shutdown_connections 2024-09-19T07:59:27.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:26.992+0000 7f0073f81640 1 -- 172.21.15.76:0/1536416336 wait complete. 2024-09-19T07:59:27.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:27 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:59:27.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:27 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:59:27.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:27 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:59:27.773 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:59:28.023 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:59:28.273 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: pgmap v256: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:59:28.273 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T07:59:28.273 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:59:28.273 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T07:59:28.274 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T07:59:28.274 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:59:28.274 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:59:28.274 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: pgmap v256: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:59:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: pgmap v256: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:59:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 -- 172.21.15.76:0/1154812225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108100a80 msgr2=0x7f8108100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 --2- 172.21.15.76:0/1154812225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108100a80 0x7f8108100ee0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009930 tx=0x7f80f802a420 comp rx=0 tx=0).stop 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 -- 172.21.15.76:0/1154812225 shutdown_connections 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 --2- 172.21.15.76:0/1154812225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8108101420 0x7f810810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 --2- 172.21.15.76:0/1154812225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108100a80 0x7f8108100ee0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 --2- 172.21.15.76:0/1154812225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8108106a80 0x7f8108106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 -- 172.21.15.76:0/1154812225 >> 172.21.15.76:0/1154812225 conn(0x7f81080fc7a0 msgr2=0x7f81080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 -- 172.21.15.76:0/1154812225 shutdown_connections 2024-09-19T07:59:28.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.497+0000 7f810fae8640 1 -- 172.21.15.76:0/1154812225 wait complete. 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 Processor -- start 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 -- start start 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8108100a80 0x7f81081985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8108101420 0x7f8108198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 0x7f810819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8108111000 con 0x7f8108106a80 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8108110e80 con 0x7f8108100a80 2024-09-19T07:59:28.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810fae8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8108111180 con 0x7f8108101420 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 0x7f810819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 0x7f810819ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52072/0 (socket says 172.21.15.76:52072) 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 -- 172.21.15.76:0/169806353 learned_addr learned my addr 172.21.15.76:0/169806353 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810d083640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8108101420 0x7f8108198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810d884640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8108100a80 0x7f81081985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 -- 172.21.15.76:0/169806353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8108101420 msgr2=0x7f8108198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8108101420 0x7f8108198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 -- 172.21.15.76:0/169806353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8108100a80 msgr2=0x7f81081985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8108100a80 0x7f81081985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 -- 172.21.15.76:0/169806353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810819d570 con 0x7f8108106a80 2024-09-19T07:59:28.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.498+0000 7f810e085640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 0x7f810819ce90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f810000eaa0 tx=0x7f810000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:28.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.499+0000 7f80feffd640 1 -- 172.21.15.76:0/169806353 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100004d20 con 0x7f8108106a80 2024-09-19T07:59:28.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.499+0000 7f80feffd640 1 -- 172.21.15.76:0/169806353 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8100005020 con 0x7f8108106a80 2024-09-19T07:59:28.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.499+0000 7f80feffd640 1 -- 172.21.15.76:0/169806353 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000116b0 con 0x7f8108106a80 2024-09-19T07:59:28.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.499+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810819d860 con 0x7f8108106a80 2024-09-19T07:59:28.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.499+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81081a5140 con 0x7f8108106a80 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.501+0000 7f80feffd640 1 -- 172.21.15.76:0/169806353 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f81000051d0 con 0x7f8108106a80 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.501+0000 7f8111ec1740 1 Processor -- start 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.501+0000 7f8111ec1740 1 -- start start 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebf380 0x558fe4ebf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 0x558fe4ece550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ed0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f8111ec1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558fe4e252e0 con 0x558fe4ebfca0 2024-09-19T07:59:28.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f8111ec1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558fe4dccce0 con 0x558fe4ebf380 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f8111ec1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558fe4e212a0 con 0x558fe4ecea90 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f80feffd640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80f40a33b0 0x7f80f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 0x558fe4ece550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 0x558fe4ece550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52080/0 (socket says 172.21.15.76:52080) 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 -- 172.21.15.76:0/3989404689 learned_addr learned my addr 172.21.15.76:0/3989404689 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810e085640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80f40a33b0 0x7f80f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d083640 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebf380 0x558fe4ebf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d083640 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ed0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 -- 172.21.15.76:0/3989404689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 msgr2=0x558fe4ed0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ed0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 -- 172.21.15.76:0/3989404689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebf380 msgr2=0x558fe4ebf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebf380 0x558fe4ebf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 -- 172.21.15.76:0/3989404689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe4db1440 con 0x558fe4ebfca0 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d083640 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ed0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f80feffd640 1 -- 172.21.15.76:0/169806353 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f81000cff40 con 0x7f8108106a80 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.502+0000 7f810d884640 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 0x558fe4ece550 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8104009a70 tx=0x7f8104009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec2e76f40c87a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f810e085640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80f40a33b0 0x7f80f40a5870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81000cd6b0 tx=0x7f810009bbe0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f80f3fff640 1 -- 172.21.15.76:0/3989404689 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104017070 con 0x558fe4ebfca0 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f80f3fff640 1 -- 172.21.15.76:0/3989404689 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8104013470 con 0x558fe4ebfca0 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f80f3fff640 1 -- 172.21.15.76:0/3989404689 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104012630 con 0x558fe4ebfca0 2024-09-19T07:59:28.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 -- 172.21.15.76:0/3989404689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 msgr2=0x558fe4ece550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 0x558fe4ece550 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8104009a70 tx=0x7f8104009f30 comp rx=0 tx=0).stop 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 -- 172.21.15.76:0/3989404689 shutdown_connections 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ed0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebfca0 0x558fe4ece550 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 --2- 172.21.15.76:0/3989404689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebf380 0x558fe4ebf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.503+0000 7f8111ec1740 1 -- 172.21.15.76:0/3989404689 >> 172.21.15.76:0/3989404689 conn(0x558fe4ebba30 msgr2=0x558fe4ebbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 -- 172.21.15.76:0/3989404689 shutdown_connections 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 -- 172.21.15.76:0/3989404689 wait complete. 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 -- start start 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 Processor -- start 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ece3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebfca0 0x558fe4ecb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ecbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x558fe4ed1660 con 0x558fe4ebf380 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558fe4de0050 con 0x558fe4ebfca0 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558fe4ed17e0 con 0x558fe4ecea90 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f8111ec1740 10 client.0 _ll_register_callbacks cb 0x558fe4e20160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.504+0000 7f810d083640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ece3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ece3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52086/0 (socket says 172.21.15.76:52086) 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 -- 172.21.15.76:0/758875091 learned_addr learned my addr 172.21.15.76:0/758875091 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d884640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebfca0 0x558fe4ecb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ecbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 -- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 msgr2=0x558fe4ecbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ecbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 -- 172.21.15.76:0/758875091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebfca0 msgr2=0x558fe4ecb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebfca0 0x558fe4ecb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 -- 172.21.15.76:0/758875091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe4b963c0 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f810d083640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ece3d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f80f8000c00 tx=0x7f80f802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244dfb26660fb385 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f80f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f80f17fa640 1 -- 172.21.15.76:0/758875091 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8035070 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f80f17fa640 1 -- 172.21.15.76:0/758875091 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f80f8004450 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8104013470 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f80f17fa640 1 -- 172.21.15.76:0/758875091 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f80f8051050 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f8111ec1740 10 client.17517 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.505+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558fe4edcfc0 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f80f17fa640 1 -- 172.21.15.76:0/758875091 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8104013470 con 0x558fe4ebf380 2024-09-19T07:59:28.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f80f17fa640 1 -- 172.21.15.76:0/758875091 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f80f803d830 con 0x558fe4ebf380 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f8111ec1740 10 client.17517 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f8111ec1740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f8111ec1740 20 client.17517 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f8111ec1740 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4ede3d0 0x558fe4ee07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f8111ec1740 4 client.17517 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fe4e32850 con 0x558fe4ede3d0 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.506+0000 7f810d884640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4ede3d0 0x558fe4ee07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f80f17fa640 10 client.17517 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f810d884640 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4ede3d0 0x558fe4ee07c0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=606073deb72e04eb server_cookie=b1310bddd142cb1e in_seq=0 out_seq=0 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f80f17fa640 1 -- 172.21.15.76:0/758875091 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fe4e32850 con 0x558fe4ede3d0 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f80f17fa640 10 client.17517 handle_command_reply: tid=0 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 client.17517 shutdown 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 msgr2=0x558fe4ece3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ece3d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f80f8000c00 tx=0x7f80f802a420 comp rx=0 tx=0).stop 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 shutdown_connections 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ecea90 0x558fe4ecbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ebfca0 0x558fe4ecb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.507+0000 7f8111ec1740 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4ede3d0 0x558fe4ee07c0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.508+0000 7f8111ec1740 1 --2- 172.21.15.76:0/758875091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ece3d0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.508+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 >> 172.21.15.76:0/758875091 conn(0x558fe4ebba30 msgr2=0x558fe4ec1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.508+0000 7f80f17fa640 0 client.17517 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.508+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 shutdown_connections 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.508+0000 7f8111ec1740 1 -- 172.21.15.76:0/758875091 wait complete. 2024-09-19T07:59:28.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.508+0000 7f8111ec1740 20 client.17517 trim_cache size 0 max 16384 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.524+0000 7f8111ec1740 1 Processor -- start 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.524+0000 7f8111ec1740 1 -- start start 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4eda900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ee6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4ee6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f8111ec1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f81081ae3e0 con 0x558fe4ebf380 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f8111ec1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81081abcb0 con 0x558fe4ecea90 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f8111ec1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81081a9b20 con 0x558fe4ebfca0 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4eda900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4eda900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52092/0 (socket says 172.21.15.76:52092) 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 -- 172.21.15.76:0/4048510992 learned_addr learned my addr 172.21.15.76:0/4048510992 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4ee6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d884640 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ee6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 -- 172.21.15.76:0/4048510992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 msgr2=0x558fe4ee6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ee6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 -- 172.21.15.76:0/4048510992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 msgr2=0x558fe4ee6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4ee6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 -- 172.21.15.76:0/4048510992 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe4ec1ea0 con 0x558fe4ebf380 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d884640 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ee6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f810d083640 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4eda900 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f80f8033000 tx=0x7f80f8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4c2b553e346697 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:28.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f80f37fe640 1 -- 172.21.15.76:0/4048510992 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8041070 con 0x558fe4ebf380 2024-09-19T07:59:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f80f37fe640 1 -- 172.21.15.76:0/4048510992 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80f8004450 con 0x558fe4ebf380 2024-09-19T07:59:28.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.525+0000 7f80f37fe640 1 -- 172.21.15.76:0/4048510992 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8035070 con 0x558fe4ebf380 2024-09-19T07:59:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 -- 172.21.15.76:0/4048510992 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 msgr2=0x558fe4eda900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4eda900 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f80f8033000 tx=0x7f80f8001e50 comp rx=0 tx=0).stop 2024-09-19T07:59:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 -- 172.21.15.76:0/4048510992 shutdown_connections 2024-09-19T07:59:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4ee6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ee6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 --2- 172.21.15.76:0/4048510992 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4eda900 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 -- 172.21.15.76:0/4048510992 >> 172.21.15.76:0/4048510992 conn(0x558fe4ebba30 msgr2=0x558fe4ebab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 -- 172.21.15.76:0/4048510992 shutdown_connections 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.526+0000 7f8111ec1740 1 -- 172.21.15.76:0/4048510992 wait complete. 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 -- start start 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 Processor -- start 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ed3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ed3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4f41fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f81081aa170 con 0x558fe4ebf380 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81081ab5e0 con 0x558fe4ecea90 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f81081aa840 con 0x558fe4ebfca0 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f8111ec1740 10 client.0 _ll_register_callbacks cb 0x7f80f8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f810d083640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ed3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f810d083640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ed3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52094/0 (socket says 172.21.15.76:52094) 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.527+0000 7f810d083640 1 -- 172.21.15.76:0/2643673349 learned_addr learned my addr 172.21.15.76:0/2643673349 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d884640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ed3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4f41fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 -- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 msgr2=0x558fe4ed3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ed3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 -- 172.21.15.76:0/2643673349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 msgr2=0x558fe4f41fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4f41fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 -- 172.21.15.76:0/2643673349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe4f425d0 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f810d083640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ed3020 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f80f803dc30 tx=0x7f80f802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790c0ed5a9159045 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f80f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f80f17fa640 1 -- 172.21.15.76:0/2643673349 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8035070 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f80f17fa640 1 -- 172.21.15.76:0/2643673349 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f80f8003aa0 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f8004450 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f80f17fa640 1 -- 172.21.15.76:0/2643673349 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f80f8041030 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f8111ec1740 10 client.17523 fetch_fsmap learned FSMap version 35 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.528+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558fe4f498d0 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f80f17fa640 1 -- 172.21.15.76:0/2643673349 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80f8004450 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f80f17fa640 1 -- 172.21.15.76:0/2643673349 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f80f803c710 con 0x558fe4ebf380 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f8111ec1740 10 client.17523 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f8111ec1740 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:59:28.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f8111ec1740 20 client.17523 populate_metadata read hostname 'smithi076' 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f8111ec1740 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4f49f60 0x558fe4f4c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f8111ec1740 4 client.17523 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558fe4e2cd60 con 0x558fe4f49f60 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.529+0000 7f810d884640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4f49f60 0x558fe4f4c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f810d884640 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4f49f60 0x558fe4f4c380 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16686460e58affad server_cookie=6afff6de6952edd1 in_seq=0 out_seq=0 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f80f17fa640 10 client.17523 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f80f17fa640 1 -- 172.21.15.76:0/2643673349 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558fe4e2cd60 con 0x558fe4f49f60 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f80f17fa640 10 client.17523 handle_command_reply: tid=0 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 client.17523 shutdown 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 msgr2=0x558fe4ed3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ed3020 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f80f803dc30 tx=0x7f80f802a420 comp rx=0 tx=0).stop 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 shutdown_connections 2024-09-19T07:59:28.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558fe4ecea90 0x558fe4f41fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558fe4ebfca0 0x558fe4ed3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x558fe4f49f60 0x558fe4f4c380 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 --2- 172.21.15.76:0/2643673349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558fe4ebf380 0x558fe4ed3020 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f80f17fa640 0 client.17523 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 >> 172.21.15.76:0/2643673349 conn(0x558fe4ebba30 msgr2=0x558fe4eba350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 shutdown_connections 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 1 -- 172.21.15.76:0/2643673349 wait complete. 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.530+0000 7f8111ec1740 20 client.17523 trim_cache size 0 max 16384 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T07:59:28.536 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: "46fc257f-b2d7-427b-aa2f-dd49fa56876c": { 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "46fc257f-b2d7-427b-aa2f-dd49fa56876c", 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T07:59:28.537 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80f40a33b0 msgr2=0x7f80f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80f40a33b0 0x7f80f40a5870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81000cd6b0 tx=0x7f810009bbe0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 msgr2=0x7f810819ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 0x7f810819ce90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f810000eaa0 tx=0x7f810000eea0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 shutdown_connections 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f80f40a33b0 0x7f80f40a5870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8108106a80 0x7f810819ce90 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8108101420 0x7f8108198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 --2- 172.21.15.76:0/169806353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8108100a80 0x7f81081985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:59:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 >> 172.21.15.76:0/169806353 conn(0x7f81080fc7a0 msgr2=0x7f810806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:59:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 shutdown_connections 2024-09-19T07:59:28.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T07:59:28.531+0000 7f810fae8640 1 -- 172.21.15.76:0/169806353 wait complete. 2024-09-19T07:59:29.345 INFO:tasks.cephfs.filesystem:scrub status for tag:46fc257f-b2d7-427b-aa2f-dd49fa56876c - {'path': '/', 'tag': '46fc257f-b2d7-427b-aa2f-dd49fa56876c', 'options': 'recursive,force'} 2024-09-19T07:59:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:30 smithi152 ceph-mon[35117]: pgmap v257: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:59:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:30 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T07:59:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:30 smithi137 ceph-mon[35309]: pgmap v257: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:59:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:30 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T07:59:30.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:30 smithi076 ceph-mon[30930]: pgmap v257: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T07:59:30.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:30 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T07:59:32.269 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:32 smithi076 ceph-mon[30930]: pgmap v258: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:59:32.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:32 smithi152 ceph-mon[35117]: pgmap v258: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:59:32.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:32 smithi137 ceph-mon[35309]: pgmap v258: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T07:59:34.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:34 smithi152 ceph-mon[35117]: pgmap v259: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:34 smithi137 ceph-mon[35309]: pgmap v259: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:34.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:34 smithi076 ceph-mon[30930]: pgmap v259: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:36.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:36 smithi152 ceph-mon[35117]: pgmap v260: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:59:36.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:36 smithi137 ceph-mon[35309]: pgmap v260: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:59:36.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:36 smithi076 ceph-mon[30930]: pgmap v260: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T07:59:38.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:38 smithi152 ceph-mon[35117]: pgmap v261: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:38.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:38 smithi137 ceph-mon[35309]: pgmap v261: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:38.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:38 smithi076 ceph-mon[30930]: pgmap v261: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:59:40.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:40 smithi152 ceph-mon[35117]: pgmap v262: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:59:40.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:40 smithi137 ceph-mon[35309]: pgmap v262: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:59:40.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:40 smithi076 ceph-mon[30930]: pgmap v262: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T07:59:42.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:42 smithi152 ceph-mon[35117]: pgmap v263: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:42.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:42 smithi137 ceph-mon[35309]: pgmap v263: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:42.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:42 smithi076 ceph-mon[30930]: pgmap v263: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:44.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:44 smithi152 ceph-mon[35117]: pgmap v264: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:44.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:44 smithi137 ceph-mon[35309]: pgmap v264: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:44.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:44 smithi076 ceph-mon[30930]: pgmap v264: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:46.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:46 smithi152 ceph-mon[35117]: pgmap v265: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:59:46.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:46 smithi137 ceph-mon[35309]: pgmap v265: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:59:46.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:46 smithi076 ceph-mon[30930]: pgmap v265: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:59:48.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:48 smithi152 ceph-mon[35117]: pgmap v266: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:48.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:48 smithi137 ceph-mon[35309]: pgmap v266: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:48.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:48 smithi076 ceph-mon[30930]: pgmap v266: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:50.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:50 smithi152 ceph-mon[35117]: pgmap v267: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:59:50.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:50 smithi137 ceph-mon[35309]: pgmap v267: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:59:50.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:50 smithi076 ceph-mon[30930]: pgmap v267: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T07:59:52.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:52 smithi152 ceph-mon[35117]: pgmap v268: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:52 smithi137 ceph-mon[35309]: pgmap v268: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:52.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:52 smithi076 ceph-mon[30930]: pgmap v268: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:59:54.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:54 smithi152 ceph-mon[35117]: pgmap v269: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:54.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:54 smithi137 ceph-mon[35309]: pgmap v269: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:54.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:54 smithi076 ceph-mon[30930]: pgmap v269: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:56.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:56 smithi152 ceph-mon[35117]: pgmap v270: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:59:56.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:56 smithi137 ceph-mon[35309]: pgmap v270: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:59:56.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:56 smithi076 ceph-mon[30930]: pgmap v270: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:59:58.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 07:59:58 smithi152 ceph-mon[35117]: pgmap v271: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:58.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 07:59:58 smithi137 ceph-mon[35309]: pgmap v271: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:58.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 07:59:58 smithi076 ceph-mon[30930]: pgmap v271: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:59:59.346 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:59:59.610 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:00.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 -- 172.21.15.76:0/3691121544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 msgr2=0x7f2a98107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/3691121544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98107b90 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009930 tx=0x7f2a8c02a420 comp rx=0 tx=0).stop 2024-09-19T08:00:00.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 -- 172.21.15.76:0/3691121544 shutdown_connections 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/3691121544 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 0x7f2a9810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/3691121544 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98107b90 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/3691121544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 0x7f2a98103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 -- 172.21.15.76:0/3691121544 >> 172.21.15.76:0/3691121544 conn(0x7f2a980fc7d0 msgr2=0x7f2a980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 -- 172.21.15.76:0/3691121544 shutdown_connections 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.130+0000 7f2a9ce65640 1 -- 172.21.15.76:0/3691121544 wait complete. 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 Processor -- start 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 -- start start 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 0x7f2a98198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 0x7f2a9819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98112200 con 0x7f2a981036e0 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98112080 con 0x7f2a981082a0 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9ce65640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98112380 con 0x7f2a98102d30 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44382/0 (socket says 172.21.15.76:44382) 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 -- 172.21.15.76:0/1009974314 learned_addr learned my addr 172.21.15.76:0/1009974314 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9659c640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 0x7f2a98198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 -- 172.21.15.76:0/1009974314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 msgr2=0x7f2a98198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 0x7f2a9819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 0x7f2a98198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 -- 172.21.15.76:0/1009974314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 msgr2=0x7f2a9819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 0x7f2a9819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a95d9b640 1 -- 172.21.15.76:0/1009974314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9819d6d0 con 0x7f2a981036e0 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a9659c640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 0x7f2a98198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.131+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 0x7f2a9819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.132+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98198c60 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c004770 tx=0x7f2a8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.132+0000 7f2a877fe640 1 -- 172.21.15.76:0/1009974314 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c03f030 con 0x7f2a981036e0 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.132+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9819d960 con 0x7f2a981036e0 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.132+0000 7f2a877fe640 1 -- 172.21.15.76:0/1009974314 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a8c003d00 con 0x7f2a981036e0 2024-09-19T08:00:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.132+0000 7f2a877fe640 1 -- 172.21.15.76:0/1009974314 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c035070 con 0x7f2a981036e0 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.132+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981a52a0 con 0x7f2a981036e0 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.134+0000 7f2a877fe640 1 -- 172.21.15.76:0/1009974314 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2a8c042030 con 0x7f2a981036e0 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 Processor -- start 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 -- start start 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 0x556424ef2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424efd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424effa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556424e582e0 con 0x556424ef24a0 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556424dffce0 con 0x556424efd680 2024-09-19T08:00:00.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556424e542a0 con 0x556424ef2dc0 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a877fe640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a800a33b0 0x7f2a800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 0x556424ef2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 0x556424ef2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44396/0 (socket says 172.21.15.76:44396) 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3337647945 learned_addr learned my addr 172.21.15.76:0/3337647945 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a800a33b0 0x7f2a800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a877fe640 1 -- 172.21.15.76:0/1009974314 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f2a8c0f0360 con 0x7f2a981036e0 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424efd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.135+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424effa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3337647945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 msgr2=0x556424efd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424efd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3337647945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 msgr2=0x556424effa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424effa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3337647945 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556424de4440 con 0x556424ef24a0 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 0x556424ef2880 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2a90005fd0 tx=0x7f2a90010370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c317ff2baca1ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a800a33b0 0x7f2a800a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a90013fd0 tx=0x7f2a9001b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a84ff9640 1 -- 172.21.15.76:0/3337647945 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90023070 con 0x556424ef24a0 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a84ff9640 1 -- 172.21.15.76:0/3337647945 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a9000b970 con 0x556424ef24a0 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.136+0000 7f2a84ff9640 1 -- 172.21.15.76:0/3337647945 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9001a710 con 0x556424ef24a0 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3337647945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 msgr2=0x556424ef2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 0x556424ef2880 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2a90005fd0 tx=0x7f2a90010370 comp rx=0 tx=0).stop 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3337647945 shutdown_connections 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424effa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424efd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3337647945 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef24a0 0x556424ef2880 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3337647945 >> 172.21.15.76:0/3337647945 conn(0x556424eeea30 msgr2=0x556424eeee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3337647945 shutdown_connections 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3337647945 wait complete. 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 -- start start 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.137+0000 7f2a9f23e740 1 Processor -- start 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424efcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 0x556424efa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424efa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556424f00250 con 0x556424ef2dc0 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556424e13050 con 0x556424efd680 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556424f003d0 con 0x556424ef24a0 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 10 client.0 _ll_register_callbacks cb 0x556424e53160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 0x556424efa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 0x556424efa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44410/0 (socket says 172.21.15.76:44410) 2024-09-19T08:00:00.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 -- 172.21.15.76:0/3266828815 learned_addr learned my addr 172.21.15.76:0/3266828815 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424efa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424efcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 -- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 msgr2=0x556424efcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424efcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 -- 172.21.15.76:0/3266828815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 msgr2=0x556424efa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424efa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 -- 172.21.15.76:0/3266828815 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556424bc93c0 con 0x556424ef2dc0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424efcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 0x556424efa2a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c005ec0 tx=0x7f2a8c0b8850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efc9a1bb7e34eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3266828815 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0ef070 con 0x556424ef2dc0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556424e65850 con 0x556424ef2dc0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.138+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3266828815 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f2a8c0b8c20 con 0x556424ef2dc0 2024-09-19T08:00:00.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3266828815 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a8c049040 con 0x556424ef2dc0 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 10 client.17535 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556424f10030 con 0x556424ef2dc0 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3266828815 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x556424e65850 con 0x556424ef2dc0 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3266828815 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2a8c03bcc0 con 0x556424ef2dc0 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 10 client.17535 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 20 client.17535 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:00.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f138f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 4 client.17535 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:00.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556424e5fd60 con 0x556424f114e0 2024-09-19T08:00:00.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.139+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.140+0000 7f2a7dffb640 10 client.17535 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.140+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f138f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d534b19d99c28f server_cookie=d88bfcc63ad6626 in_seq=0 out_seq=0 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3266828815 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556424e5fd60 con 0x556424f114e0 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a7dffb640 10 client.17535 handle_command_reply: tid=0 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 client.17535 shutdown 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 msgr2=0x556424efa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 0x556424efa2a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c005ec0 tx=0x7f2a8c0b8850 comp rx=0 tx=0).stop 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 shutdown_connections 2024-09-19T08:00:00.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424efd680 0x556424efa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f138f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a7dffb640 0 client.17535 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424ef2dc0 0x556424efa2a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3266828815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424efcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 >> 172.21.15.76:0/3266828815 conn(0x556424eeea30 msgr2=0x556424ef4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 shutdown_connections 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3266828815 wait complete. 2024-09-19T08:00:00.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.141+0000 7f2a9f23e740 20 client.17535 trim_cache size 0 max 16384 2024-09-19T08:00:00.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 Processor -- start 2024-09-19T08:00:00.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 -- start start 2024-09-19T08:00:00.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424ef8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef2dc0 0x556424f191c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f19700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ae2c0 con 0x556424efd680 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981abb90 con 0x556424ef2dc0 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981a9a00 con 0x556424ef24a0 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f19700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44414/0 (socket says 172.21.15.76:44414) 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.158+0000 7f2a96d9d640 1 -- 172.21.15.76:0/5229249 learned_addr learned my addr 172.21.15.76:0/5229249 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef2dc0 0x556424f191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a9659c640 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424ef8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a96d9d640 1 -- 172.21.15.76:0/5229249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 msgr2=0x556424ef8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424ef8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a96d9d640 1 -- 172.21.15.76:0/5229249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef2dc0 msgr2=0x556424f191c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef2dc0 0x556424f191c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a96d9d640 1 -- 172.21.15.76:0/5229249 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556424ef9250 con 0x556424efd680 2024-09-19T08:00:00.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef2dc0 0x556424f191c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:00.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f19700 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2a90005fd0 tx=0x7f2a90004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd979d4a0353b8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:00.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a7ffff640 1 -- 172.21.15.76:0/5229249 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90023040 con 0x556424efd680 2024-09-19T08:00:00.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a7ffff640 1 -- 172.21.15.76:0/5229249 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a9001ae10 con 0x556424efd680 2024-09-19T08:00:00.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.159+0000 7f2a7ffff640 1 -- 172.21.15.76:0/5229249 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90004040 con 0x556424efd680 2024-09-19T08:00:00.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- 172.21.15.76:0/5229249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 msgr2=0x556424f19700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f19700 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2a90005fd0 tx=0x7f2a90004b90 comp rx=0 tx=0).stop 2024-09-19T08:00:00.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- 172.21.15.76:0/5229249 shutdown_connections 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f19700 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef2dc0 0x556424f191c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/5229249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef24a0 0x556424ef8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- 172.21.15.76:0/5229249 >> 172.21.15.76:0/5229249 conn(0x556424eeea30 msgr2=0x556424efc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- 172.21.15.76:0/5229249 shutdown_connections 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- 172.21.15.76:0/5229249 wait complete. 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- start start 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 Processor -- start 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef24a0 0x556424f03830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424f03d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f7b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981aa050 con 0x556424efd680 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ab4c0 con 0x556424ef24a0 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981aa720 con 0x556424ef2dc0 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a9f23e740 10 client.0 _ll_register_callbacks cb 0x7f2a8c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.160+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f7b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f7b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44420/0 (socket says 172.21.15.76:44420) 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3859046470 learned_addr learned my addr 172.21.15.76:0/3859046470 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a95d9b640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424f03d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef24a0 0x556424f03830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 msgr2=0x556424f03d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424f03d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3859046470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef24a0 msgr2=0x556424f03830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef24a0 0x556424f03830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 -- 172.21.15.76:0/3859046470 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556424efd360 con 0x556424efd680 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef24a0 0x556424f03830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a96d9d640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f7b1a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f2a90000c00 tx=0x7f2a9001a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4658a0a1b1c83c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3859046470 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9003e060 con 0x556424efd680 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3859046470 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f2a90004c00 con 0x556424efd680 2024-09-19T08:00:00.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a9001ae10 con 0x556424efd680 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3859046470 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a90023040 con 0x556424efd680 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a9f23e740 10 client.17541 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.161+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556424f7c700 con 0x556424efd680 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3859046470 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a9001ae10 con 0x556424efd680 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3859046470 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2a9002f070 con 0x556424efd680 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9f23e740 10 client.17541 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9f23e740 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9f23e740 20 client.17541 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f7ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9f23e740 4 client.17541 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556424ddc210 con 0x556424f114e0 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f7ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:00.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a9659c640 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f7ec30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe43831b8b9f110b server_cookie=9f8d4c62ecf12cd2 in_seq=0 out_seq=0 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.162+0000 7f2a7dffb640 10 client.17541 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a7dffb640 1 -- 172.21.15.76:0/3859046470 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556424ddc210 con 0x556424f114e0 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a7dffb640 10 client.17541 handle_command_reply: tid=0 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 client.17541 shutdown 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 msgr2=0x556424f7b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f7b1a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f2a90000c00 tx=0x7f2a9001a940 comp rx=0 tx=0).stop 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 shutdown_connections 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x556424f114e0 0x556424f7ec30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556424efd680 0x556424f7b1a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556424ef2dc0 0x556424f03d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 --2- 172.21.15.76:0/3859046470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556424ef24a0 0x556424f03830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 >> 172.21.15.76:0/3859046470 conn(0x556424eeea30 msgr2=0x556424f084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a7dffb640 0 client.17541 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:00.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 shutdown_connections 2024-09-19T08:00:00.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 1 -- 172.21.15.76:0/3859046470 wait complete. 2024-09-19T08:00:00.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9f23e740 20 client.17541 trim_cache size 0 max 16384 2024-09-19T08:00:00.171 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:00:00.171 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T08:00:00.171 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T08:00:00.171 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a800a33b0 msgr2=0x7f2a800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a800a33b0 0x7f2a800a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a90013fd0 tx=0x7f2a9001b000 comp rx=0 tx=0).stop 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.163+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 msgr2=0x7f2a98198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98198c60 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c004770 tx=0x7f2a8c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 shutdown_connections 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a800a33b0 0x7f2a800a5870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a981082a0 0x7f2a9819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a981036e0 0x7f2a98198c60 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 --2- 172.21.15.76:0/1009974314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a98102d30 0x7f2a98198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:00.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 >> 172.21.15.76:0/1009974314 conn(0x7f2a980fc7d0 msgr2=0x7f2a98105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:00.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 shutdown_connections 2024-09-19T08:00:00.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:00.164+0000 7f2a9ce65640 1 -- 172.21.15.76:0/1009974314 wait complete. 2024-09-19T08:00:00.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:00 smithi152 ceph-mon[35117]: pgmap v272: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:00.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:00 smithi152 ceph-mon[35117]: overall HEALTH_OK 2024-09-19T08:00:00.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:00 smithi137 ceph-mon[35309]: pgmap v272: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:00.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:00 smithi137 ceph-mon[35309]: overall HEALTH_OK 2024-09-19T08:00:00.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:00 smithi076 ceph-mon[30930]: pgmap v272: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:00.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:00 smithi076 ceph-mon[30930]: overall HEALTH_OK 2024-09-19T08:00:01.030 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:00:01.030 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:00:01.279 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:01.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 -- 172.21.15.76:0/1257030194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48106a80 msgr2=0x7f9c48106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:01.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 --2- 172.21.15.76:0/1257030194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48106a80 0x7f9c48106e60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009930 tx=0x7f9c3802a420 comp rx=0 tx=0).stop 2024-09-19T08:00:01.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 -- 172.21.15.76:0/1257030194 shutdown_connections 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 --2- 172.21.15.76:0/1257030194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c48101420 0x7f9c4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 --2- 172.21.15.76:0/1257030194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c48100a80 0x7f9c48100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 --2- 172.21.15.76:0/1257030194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48106a80 0x7f9c48106e60 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 -- 172.21.15.76:0/1257030194 >> 172.21.15.76:0/1257030194 conn(0x7f9c480fc7a0 msgr2=0x7f9c480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 -- 172.21.15.76:0/1257030194 shutdown_connections 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.760+0000 7f9c4d228640 1 -- 172.21.15.76:0/1257030194 wait complete. 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 Processor -- start 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 -- start start 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 0x7f9c48197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c48101420 0x7f9c48197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c48106a80 0x7f9c4819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48110f60 con 0x7f9c48100a80 2024-09-19T08:00:01.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48110de0 con 0x7f9c48101420 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c4d228640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481110e0 con 0x7f9c48106a80 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c46d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 0x7f9c48197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c46d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 0x7f9c48197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44434/0 (socket says 172.21.15.76:44434) 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.761+0000 7f9c46d9d640 1 -- 172.21.15.76:0/2555939135 learned_addr learned my addr 172.21.15.76:0/2555939135 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c4659c640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c48101420 0x7f9c48197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c4759e640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c48106a80 0x7f9c4819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c46d9d640 1 -- 172.21.15.76:0/2555939135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c48106a80 msgr2=0x7f9c4819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c46d9d640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c48106a80 0x7f9c4819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c46d9d640 1 -- 172.21.15.76:0/2555939135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c48101420 msgr2=0x7f9c48197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c46d9d640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c48101420 0x7f9c48197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c46d9d640 1 -- 172.21.15.76:0/2555939135 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4819c3d0 con 0x7f9c48100a80 2024-09-19T08:00:01.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c46d9d640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 0x7f9c48197420 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009230 tx=0x7f9c38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3803f030 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c38003af0 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4819c660 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38035070 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.762+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c481a3fa0 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.763+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c481021c0 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.765+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9c38042030 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.766+0000 7f9c2ffff640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c300a33b0 0x7f9c300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.766+0000 7f9c4659c640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c300a33b0 0x7f9c300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.766+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f9c380f08e0 con 0x7f9c48100a80 2024-09-19T08:00:01.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.766+0000 7f9c4659c640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c300a33b0 0x7f9c300a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c480fed70 tx=0x7f9c3c00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:01.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.769+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c380bcca0 con 0x7f9c48100a80 2024-09-19T08:00:01.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.970+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c48100ee0 con 0x7f9c48100a80 2024-09-19T08:00:01.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.971+0000 7f9c2ffff640 1 -- 172.21.15.76:0/2555939135 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f9c48100ee0 con 0x7f9c48100a80 2024-09-19T08:00:01.972 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:00:01.972 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T08:00:01.973 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c300a33b0 msgr2=0x7f9c300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c300a33b0 0x7f9c300a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c480fed70 tx=0x7f9c3c00b390 comp rx=0 tx=0).stop 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 msgr2=0x7f9c48197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 0x7f9c48197420 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009230 tx=0x7f9c38004270 comp rx=0 tx=0).stop 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 shutdown_connections 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9c300a33b0 0x7f9c300a5870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c48106a80 0x7f9c4819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c48101420 0x7f9c48197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 --2- 172.21.15.76:0/2555939135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9c48100a80 0x7f9c48197420 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:01.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 >> 172.21.15.76:0/2555939135 conn(0x7f9c480fc7a0 msgr2=0x7f9c480fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:01.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 shutdown_connections 2024-09-19T08:00:01.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:01.974+0000 7f9c4d228640 1 -- 172.21.15.76:0/2555939135 wait complete. 2024-09-19T08:00:02.284 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:02 smithi076 ceph-mon[30930]: pgmap v273: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:02.284 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:02 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2555939135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:02.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:02 smithi137 ceph-mon[35309]: pgmap v273: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:02.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:02 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2555939135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:02.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:02 smithi152 ceph-mon[35117]: pgmap v273: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:02 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2555939135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:02.707 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:00:02.954 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:03.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 -- 172.21.15.76:0/3052516880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 msgr2=0x7f2044107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 --2- 172.21.15.76:0/3052516880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f2044107b80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2038009930 tx=0x7f203802a420 comp rx=0 tx=0).stop 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 -- 172.21.15.76:0/3052516880 shutdown_connections 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 --2- 172.21.15.76:0/3052516880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2044108290 0x7f204410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 --2- 172.21.15.76:0/3052516880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f2044107b80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 --2- 172.21.15.76:0/3052516880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2044102d90 0x7f2044103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 -- 172.21.15.76:0/3052516880 >> 172.21.15.76:0/3052516880 conn(0x7f20440fc7d0 msgr2=0x7f20440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 -- 172.21.15.76:0/3052516880 shutdown_connections 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.379+0000 7f2049254640 1 -- 172.21.15.76:0/3052516880 wait complete. 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.380+0000 7f2049254640 1 Processor -- start 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.380+0000 7f2049254640 1 -- start start 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2049254640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2044102d90 0x7f204419e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2049254640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f204419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2049254640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2044108290 0x7f2044198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2049254640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2044112270 con 0x7f2044103740 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2049254640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20441120f0 con 0x7f2044108290 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2049254640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20441123f0 con 0x7f2044102d90 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f204419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f204419ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52084/0 (socket says 172.21.15.76:52084) 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 -- 172.21.15.76:0/647895764 learned_addr learned my addr 172.21.15.76:0/647895764 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f2042d9d640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2044102d90 0x7f204419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204359e640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2044108290 0x7f2044198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 -- 172.21.15.76:0/647895764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2044102d90 msgr2=0x7f204419e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2044102d90 0x7f204419e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 -- 172.21.15.76:0/647895764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2044108290 msgr2=0x7f2044198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2044108290 0x7f2044198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 -- 172.21.15.76:0/647895764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2044198ed0 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f204259c640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f204419ead0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2038005940 tx=0x7f20380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.381+0000 7f202bfff640 1 -- 172.21.15.76:0/647895764 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203803f030 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.382+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2044199160 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.382+0000 7f202bfff640 1 -- 172.21.15.76:0/647895764 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2038003d00 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.382+0000 7f202bfff640 1 -- 172.21.15.76:0/647895764 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038035070 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.382+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20441a5340 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.384+0000 7f202bfff640 1 -- 172.21.15.76:0/647895764 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2038042030 con 0x7f2044103740 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 Processor -- start 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 -- start start 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 0x555be5154090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be5154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be515f370 0x555be5161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555be50ba2f0 con 0x555be5155b40 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555be5061cf0 con 0x555be515f370 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204b62d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555be50b62b0 con 0x555be51545d0 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 0x555be5154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 0x555be5154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52090/0 (socket says 172.21.15.76:52090) 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 -- 172.21.15.76:0/243143935 learned_addr learned my addr 172.21.15.76:0/243143935 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f2042d9d640 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be5154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204259c640 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be515f370 0x555be5161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 -- 172.21.15.76:0/243143935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 msgr2=0x555be5154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be5154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 -- 172.21.15.76:0/243143935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be515f370 msgr2=0x555be5161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be515f370 0x555be5161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 -- 172.21.15.76:0/243143935 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be50463a0 con 0x555be5155b40 2024-09-19T08:00:03.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f202bfff640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f202c0a33b0 0x7f202c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f2042d9d640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f202c0a33b0 0x7f202c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f204359e640 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 0x555be5154090 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f203c00b7a0 tx=0x7f203c00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c6f9063cf4c4f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.385+0000 7f202bfff640 1 -- 172.21.15.76:0/647895764 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f20380f0470 con 0x7f2044103740 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f20297fa640 1 -- 172.21.15.76:0/243143935 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c00d950 con 0x555be5155b40 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f20297fa640 1 -- 172.21.15.76:0/243143935 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f203c012420 con 0x555be5155b40 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f20297fa640 1 -- 172.21.15.76:0/243143935 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c014650 con 0x555be5155b40 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 -- 172.21.15.76:0/243143935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 msgr2=0x555be5154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f2042d9d640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f202c0a33b0 0x7f202c0a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x555be5151ac0 tx=0x7f203400e040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 0x555be5154090 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f203c00b7a0 tx=0x7f203c00bc60 comp rx=0 tx=0).stop 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 -- 172.21.15.76:0/243143935 shutdown_connections 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be515f370 0x555be5161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be5154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 --2- 172.21.15.76:0/243143935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be5155b40 0x555be5154090 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 -- 172.21.15.76:0/243143935 >> 172.21.15.76:0/243143935 conn(0x555be511d310 msgr2=0x555be5150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.386+0000 7f204b62d740 1 -- 172.21.15.76:0/243143935 shutdown_connections 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 -- 172.21.15.76:0/243143935 wait complete. 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 -- start start 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 Processor -- start 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be51545d0 0x555be515ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be5155b40 0x555be515bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be515c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555be5162070 con 0x555be515f370 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555be5075060 con 0x555be51545d0 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555be51621f0 con 0x555be5155b40 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204b62d740 10 client.0 _ll_register_callbacks cb 0x555be4dc88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be515c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be515c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52098/0 (socket says 172.21.15.76:52098) 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 -- 172.21.15.76:0/1170368536 learned_addr learned my addr 172.21.15.76:0/1170368536 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f2042d9d640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be51545d0 0x555be515ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204259c640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be5155b40 0x555be515bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 -- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be5155b40 msgr2=0x555be515bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be5155b40 0x555be515bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 -- 172.21.15.76:0/1170368536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be51545d0 msgr2=0x555be515ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be51545d0 0x555be515ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.387+0000 7f204359e640 1 -- 172.21.15.76:0/1170368536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be4e2b3c0 con 0x555be515f370 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2042d9d640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be51545d0 0x555be515ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204259c640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be5155b40 0x555be515bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204359e640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be515c4d0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f203c006f50 tx=0x7f203c012880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460d7af5a5d279eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:03.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2026ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2026ff5640 1 -- 172.21.15.76:0/1170368536 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c00dd60 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2026ff5640 1 -- 172.21.15.76:0/1170368536 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f203c01d430 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203c012420 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2026ff5640 1 -- 172.21.15.76:0/1170368536 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f203c01d630 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 10 client.17559 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555be516dab0 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2026ff5640 1 -- 172.21.15.76:0/1170368536 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f203c012420 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f2026ff5640 1 -- 172.21.15.76:0/1170368536 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f203c013070 con 0x555be515f370 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 10 client.17559 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 10 client.17559 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 20 client.17559 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be516eeb0 0x555be51712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 4 client.17559 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:03.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.388+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555be50c7860 con 0x555be516eeb0 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.389+0000 7f2042d9d640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be516eeb0 0x555be51712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.389+0000 7f2026ff5640 10 client.17559 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.389+0000 7f2042d9d640 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be516eeb0 0x555be51712a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cfc1c5f43651f6e server_cookie=e6284f81285a818 in_seq=0 out_seq=0 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f2026ff5640 1 -- 172.21.15.76:0/1170368536 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555be50c7860 con 0x555be516eeb0 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f2026ff5640 10 client.17559 handle_command_reply: tid=0 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 client.17559 shutdown 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 msgr2=0x555be515c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be515c4d0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f203c006f50 tx=0x7f203c012880 comp rx=0 tx=0).stop 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 shutdown_connections 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be516eeb0 0x555be51712a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be515c4d0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be5155b40 0x555be515bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f2026ff5640 0 client.17559 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:03.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 --2- 172.21.15.76:0/1170368536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be51545d0 0x555be515ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 >> 172.21.15.76:0/1170368536 conn(0x555be511d310 msgr2=0x555be5156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:03.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 shutdown_connections 2024-09-19T08:00:03.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 1 -- 172.21.15.76:0/1170368536 wait complete. 2024-09-19T08:00:03.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.390+0000 7f204b62d740 20 client.17559 trim_cache size 0 max 16384 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 Processor -- start 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 -- start start 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be516b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5157120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5157660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b05c0 con 0x555be515f370 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20441ade90 con 0x555be5155b40 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204b62d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20441abd00 con 0x555be51545d0 2024-09-19T08:00:03.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52112/0 (socket says 172.21.15.76:52112) 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.403+0000 7f204359e640 1 -- 172.21.15.76:0/424294270 learned_addr learned my addr 172.21.15.76:0/424294270 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f2042d9d640 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be516b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204259c640 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204359e640 1 -- 172.21.15.76:0/424294270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 msgr2=0x555be516b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204359e640 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be516b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204359e640 1 -- 172.21.15.76:0/424294270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 msgr2=0x555be5157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204359e640 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204359e640 1 -- 172.21.15.76:0/424294270 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be515e8e0 con 0x555be515f370 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204259c640 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f204359e640 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5157660 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f203c025950 tx=0x7f203c012da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b862879ab7e24e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f2028ff9640 1 -- 172.21.15.76:0/424294270 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c00d530 con 0x555be515f370 2024-09-19T08:00:03.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f2028ff9640 1 -- 172.21.15.76:0/424294270 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f203c01dcd0 con 0x555be515f370 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.404+0000 7f2028ff9640 1 -- 172.21.15.76:0/424294270 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c00db60 con 0x555be515f370 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 -- 172.21.15.76:0/424294270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 msgr2=0x555be5157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5157660 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f203c025950 tx=0x7f203c012da0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 -- 172.21.15.76:0/424294270 shutdown_connections 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5157660 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 --2- 172.21.15.76:0/424294270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be516b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 -- 172.21.15.76:0/424294270 >> 172.21.15.76:0/424294270 conn(0x555be511d310 msgr2=0x555be515b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 -- 172.21.15.76:0/424294270 shutdown_connections 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 -- 172.21.15.76:0/424294270 wait complete. 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 -- start start 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.405+0000 7f204b62d740 1 Processor -- start 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be51678e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5162c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5163150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20441ac350 con 0x555be515f370 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20441ad7c0 con 0x555be5155b40 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20441aca20 con 0x555be51545d0 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 10 client.0 _ll_register_callbacks cb 0x7f203c00b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5163150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5163150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52122/0 (socket says 172.21.15.76:52122) 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 -- 172.21.15.76:0/70444335 learned_addr learned my addr 172.21.15.76:0/70444335 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f2042d9d640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be51678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204259c640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 -- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 msgr2=0x555be51678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be51678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 -- 172.21.15.76:0/70444335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 msgr2=0x555be5162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 -- 172.21.15.76:0/70444335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be5163690 con 0x555be515f370 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f2042d9d640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be51678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204359e640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5163150 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f203c004810 tx=0x7f203c025400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae90c7a40c0561a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f2026ff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f2026ff5640 1 -- 172.21.15.76:0/70444335 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c039060 con 0x555be515f370 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f2026ff5640 1 -- 172.21.15.76:0/70444335 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f203c012860 con 0x555be515f370 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203c01dcd0 con 0x555be515f370 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f2026ff5640 1 -- 172.21.15.76:0/70444335 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f203c040050 con 0x555be515f370 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 10 client.17565 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.406+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555be51d9530 con 0x555be515f370 2024-09-19T08:00:03.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f2026ff5640 1 -- 172.21.15.76:0/70444335 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f203c01dcd0 con 0x555be515f370 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f2026ff5640 1 -- 172.21.15.76:0/70444335 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f203c005b80 con 0x555be515f370 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f204b62d740 10 client.17565 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f204b62d740 10 client.17565 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f204b62d740 20 client.17565 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f204b62d740 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be51d9b90 0x555be51dbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f204b62d740 4 client.17565 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555be50c1d70 con 0x555be51d9b90 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.407+0000 7f2042d9d640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be51d9b90 0x555be51dbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f2042d9d640 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be51d9b90 0x555be51dbf80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b43455ce5f0c3f3a server_cookie=6b5bb4a275f314d7 in_seq=0 out_seq=0 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f2026ff5640 10 client.17565 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f2026ff5640 1 -- 172.21.15.76:0/70444335 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555be50c1d70 con 0x555be51d9b90 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f2026ff5640 10 client.17565 handle_command_reply: tid=0 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 client.17565 shutdown 2024-09-19T08:00:03.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 msgr2=0x555be5163150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5163150 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f203c004810 tx=0x7f203c025400 comp rx=0 tx=0).stop 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 shutdown_connections 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x555be51d9b90 0x555be51dbf80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555be515f370 0x555be5163150 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555be5155b40 0x555be5162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 --2- 172.21.15.76:0/70444335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555be51545d0 0x555be51678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f2026ff5640 0 client.17565 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 >> 172.21.15.76:0/70444335 conn(0x555be511d310 msgr2=0x555be515d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 shutdown_connections 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 1 -- 172.21.15.76:0/70444335 wait complete. 2024-09-19T08:00:03.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.408+0000 7f204b62d740 20 client.17565 trim_cache size 0 max 16384 2024-09-19T08:00:03.424 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f202c0a33b0 msgr2=0x7f202c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f202c0a33b0 0x7f202c0a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x555be5151ac0 tx=0x7f203400e040 comp rx=0 tx=0).stop 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 msgr2=0x7f204419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f204419ead0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2038005940 tx=0x7f20380042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 shutdown_connections 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f202c0a33b0 0x7f202c0a5870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2044108290 0x7f2044198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2044103740 0x7f204419ead0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 --2- 172.21.15.76:0/647895764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2044102d90 0x7f204419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 >> 172.21.15.76:0/647895764 conn(0x7f20440fc7d0 msgr2=0x7f2044105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 shutdown_connections 2024-09-19T08:00:03.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:03.409+0000 7f2049254640 1 -- 172.21.15.76:0/647895764 wait complete. 2024-09-19T08:00:04.154 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:04 smithi076 ceph-mon[30930]: pgmap v274: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:04.183 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:00:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:04 smithi137 ceph-mon[35309]: pgmap v274: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:04.432 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:04.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:04 smithi152 ceph-mon[35117]: pgmap v274: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 -- 172.21.15.76:0/1505763963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8181027c0 msgr2=0x7fe818106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1505763963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8181027c0 0x7fe818106810 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe800009900 tx=0x7fe80002a410 comp rx=0 tx=0).stop 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 -- 172.21.15.76:0/1505763963 shutdown_connections 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1505763963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe818106f40 0x7fe81810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1505763963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe8181027c0 0x7fe818106810 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1505763963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe818101e10 0x7fe8181021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 -- 172.21.15.76:0/1505763963 >> 172.21.15.76:0/1505763963 conn(0x7fe8180fd8d0 msgr2=0x7fe8180ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:04.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 -- 172.21.15.76:0/1505763963 shutdown_connections 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.939+0000 7fe81cb91640 1 -- 172.21.15.76:0/1505763963 wait complete. 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 Processor -- start 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 -- start start 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe818101e10 0x7fe8180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8181027c0 0x7fe818074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 0x7fe818074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe818112180 con 0x7fe818106f40 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe818112000 con 0x7fe8181027c0 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81cb91640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe818112300 con 0x7fe818101e10 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 0x7fe818074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 0x7fe818074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52136/0 (socket says 172.21.15.76:52136) 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 -- 172.21.15.76:0/1838743948 learned_addr learned my addr 172.21.15.76:0/1838743948 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:04.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe81659c640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe818101e10 0x7fe8180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe80ffff640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8181027c0 0x7fe818074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 -- 172.21.15.76:0/1838743948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe818101e10 msgr2=0x7fe8180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe818101e10 0x7fe8180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 -- 172.21.15.76:0/1838743948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8181027c0 msgr2=0x7fe818074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8181027c0 0x7fe818074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.940+0000 7fe816d9d640 1 -- 172.21.15.76:0/1838743948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8181a6b60 con 0x7fe818106f40 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.941+0000 7fe816d9d640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 0x7fe818074f70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b970 tx=0x7fe81000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.941+0000 7fe80f7fe640 1 -- 172.21.15.76:0/1838743948 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810019070 con 0x7fe818106f40 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.941+0000 7fe80f7fe640 1 -- 172.21.15.76:0/1838743948 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe81000cb40 con 0x7fe818106f40 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.941+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8181a6e50 con 0x7fe818106f40 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.941+0000 7fe80f7fe640 1 -- 172.21.15.76:0/1838743948 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810007700 con 0x7fe818106f40 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.941+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8181a7300 con 0x7fe818106f40 2024-09-19T08:00:04.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.943+0000 7fe80f7fe640 1 -- 172.21.15.76:0/1838743948 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe81001c070 con 0x7fe818106f40 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.943+0000 7fe81ef6a740 1 Processor -- start 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 -- start start 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80f7fe640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe8040a33b0 0x7fe8040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab8aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab97760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5573caaf02f0 con 0x5573cab8a5d0 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5573caa97cf0 con 0x5573cab95370 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5573caaec2b0 con 0x5573cab8bb40 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe8040a33b0 0x7fe8040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab8aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80f7fe640 1 -- 172.21.15.76:0/1838743948 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7fe8100cf2a0 con 0x7fe818106f40 2024-09-19T08:00:04.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab8aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52150/0 (socket says 172.21.15.76:52150) 2024-09-19T08:00:04.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 -- 172.21.15.76:0/588952865 learned_addr learned my addr 172.21.15.76:0/588952865 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:04.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe816d9d640 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab97760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe81659c640 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 -- 172.21.15.76:0/588952865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 msgr2=0x5573cab8a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 -- 172.21.15.76:0/588952865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 msgr2=0x5573cab97760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab97760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.944+0000 7fe80ffff640 1 -- 172.21.15.76:0/588952865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573caa7c3a0 con 0x5573cab8a5d0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe80ffff640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe8040a33b0 0x7fe8040a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe80002a930 tx=0x7fe800005e80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe80ffff640 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab8aa10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fe800033000 tx=0x7fe800045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2afc6c0199a36f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe80cff9640 1 -- 172.21.15.76:0/588952865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800035040 con 0x5573cab8a5d0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe80cff9640 1 -- 172.21.15.76:0/588952865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe800032e20 con 0x5573cab8a5d0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe80cff9640 1 -- 172.21.15.76:0/588952865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80003d9c0 con 0x5573cab8a5d0 2024-09-19T08:00:04.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 -- 172.21.15.76:0/588952865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 msgr2=0x5573cab8aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab8aa10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fe800033000 tx=0x7fe800045000 comp rx=0 tx=0).stop 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 -- 172.21.15.76:0/588952865 shutdown_connections 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab97760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab8aa10 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/588952865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.945+0000 7fe81ef6a740 1 -- 172.21.15.76:0/588952865 >> 172.21.15.76:0/588952865 conn(0x5573cab53310 msgr2=0x5573cab86c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 -- 172.21.15.76:0/588952865 shutdown_connections 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 -- 172.21.15.76:0/588952865 wait complete. 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 -- start start 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 Processor -- start 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab94d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab91fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5573cab98010 con 0x5573cab8a5d0 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5573caaab060 con 0x5573cab95370 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5573cab98190 con 0x5573cab8bb40 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81ef6a740 10 client.0 _ll_register_callbacks cb 0x5573ca7fe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab94d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab94d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52154/0 (socket says 172.21.15.76:52154) 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe81659c640 1 -- 172.21.15.76:0/3254651086 learned_addr learned my addr 172.21.15.76:0/3254651086 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.946+0000 7fe816d9d640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe80ffff640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab91fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81659c640 1 -- 172.21.15.76:0/3254651086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 msgr2=0x5573cab91fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81659c640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab91fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81659c640 1 -- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 msgr2=0x5573cab925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81659c640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81659c640 1 -- 172.21.15.76:0/3254651086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ca8613c0 con 0x5573cab8a5d0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe816d9d640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81659c640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab94d30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fe808010500 tx=0x7fe8080109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85425b6879f739f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe7fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe7fdffb640 1 -- 172.21.15.76:0/3254651086 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80801a020 con 0x5573cab8a5d0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe7fdffb640 1 -- 172.21.15.76:0/3254651086 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7fe808016690 con 0x5573cab8a5d0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe800032e20 con 0x5573cab8a5d0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe7fdffb640 1 -- 172.21.15.76:0/3254651086 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe808025050 con 0x5573cab8a5d0 2024-09-19T08:00:04.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81ef6a740 10 client.17577 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5573caba3b20 con 0x5573cab8a5d0 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe7fdffb640 1 -- 172.21.15.76:0/3254651086 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe800032e20 con 0x5573cab8a5d0 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe7fdffb640 1 -- 172.21.15.76:0/3254651086 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe808014b50 con 0x5573cab8a5d0 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81ef6a740 10 client.17577 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.947+0000 7fe81ef6a740 10 client.17577 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe81ef6a740 20 client.17577 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573caba7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe81ef6a740 4 client.17577 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573caafd860 con 0x5573caba4fe0 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe80ffff640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573caba7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe80ffff640 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573caba7480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=794ae88c64a9662 server_cookie=72581c5423f8e9d0 in_seq=0 out_seq=0 2024-09-19T08:00:04.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.948+0000 7fe7fdffb640 10 client.17577 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe7fdffb640 1 -- 172.21.15.76:0/3254651086 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573caafd860 con 0x5573caba4fe0 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe7fdffb640 10 client.17577 handle_command_reply: tid=0 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 client.17577 shutdown 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 msgr2=0x5573cab94d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab94d30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fe808010500 tx=0x7fe8080109c0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 shutdown_connections 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573caba7480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab91fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe7fdffb640 0 client.17577 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/3254651086 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab94d30 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 >> 172.21.15.76:0/3254651086 conn(0x5573cab53310 msgr2=0x5573cab8c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:04.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 shutdown_connections 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 1 -- 172.21.15.76:0/3254651086 wait complete. 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.949+0000 7fe81ef6a740 20 client.17577 trim_cache size 0 max 16384 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 Processor -- start 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 -- start start 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab918a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab8d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181b2760 con 0x5573cab8a5d0 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181b0030 con 0x5573cab95370 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181adea0 con 0x5573cab8bb40 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab918a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52160/0 (socket says 172.21.15.76:52160) 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.962+0000 7fe81659c640 1 -- 172.21.15.76:0/290694052 learned_addr learned my addr 172.21.15.76:0/290694052 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:04.978 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe80ffff640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe81659c640 1 -- 172.21.15.76:0/290694052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 msgr2=0x5573cab8d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe81659c640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe816d9d640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab8d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe81659c640 1 -- 172.21.15.76:0/290694052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 msgr2=0x5573cab8d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe81659c640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab8d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe81659c640 1 -- 172.21.15.76:0/290694052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cab90f90 con 0x5573cab8a5d0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe80ffff640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe816d9d640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe81659c640 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab918a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe80800b150 tx=0x7fe80800bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772089b095dee0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe7fffff640 1 -- 172.21.15.76:0/290694052 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80801a050 con 0x5573cab8a5d0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe7fffff640 1 -- 172.21.15.76:0/290694052 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe80800bd80 con 0x5573cab8a5d0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.963+0000 7fe7fffff640 1 -- 172.21.15.76:0/290694052 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808016690 con 0x5573cab8a5d0 2024-09-19T08:00:04.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- 172.21.15.76:0/290694052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 msgr2=0x5573cab918a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab918a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe80800b150 tx=0x7fe80800bb00 comp rx=0 tx=0).stop 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- 172.21.15.76:0/290694052 shutdown_connections 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab95370 0x5573cab8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab8bb40 0x5573cab8d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/290694052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8a5d0 0x5573cab918a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- 172.21.15.76:0/290694052 >> 172.21.15.76:0/290694052 conn(0x5573cab53310 msgr2=0x5573cab85d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- 172.21.15.76:0/290694052 shutdown_connections 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- 172.21.15.76:0/290694052 wait complete. 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- start start 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 Processor -- start 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab8a5d0 0x5573cab99460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 0x5573cab999a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab95370 0x5573cab99ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181ae4f0 con 0x5573cab8bb40 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181af960 con 0x5573cab8a5d0 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181aebc0 con 0x5573cab95370 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81ef6a740 10 client.0 _ll_register_callbacks cb 0x7fe80800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe80ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 0x5573cab999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe80ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 0x5573cab999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52172/0 (socket says 172.21.15.76:52172) 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe80ffff640 1 -- 172.21.15.76:0/2765975715 learned_addr learned my addr 172.21.15.76:0/2765975715 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe81659c640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab8a5d0 0x5573cab99460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.964+0000 7fe816d9d640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab95370 0x5573cab99ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe80ffff640 1 -- 172.21.15.76:0/2765975715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab95370 msgr2=0x5573cab99ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe80ffff640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab95370 0x5573cab99ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe80ffff640 1 -- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab8a5d0 msgr2=0x5573cab99460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe80ffff640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab8a5d0 0x5573cab99460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe80ffff640 1 -- 172.21.15.76:0/2765975715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573cac17780 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81659c640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab8a5d0 0x5573cab99460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe80ffff640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 0x5573cab999a0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe80003d630 tx=0x7fe800005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda7f31c83f74f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe7fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe7fdffb640 1 -- 172.21.15.76:0/2765975715 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800035040 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe7fdffb640 1 -- 172.21.15.76:0/2765975715 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7fe80003d8e0 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe80800bd80 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe7fdffb640 1 -- 172.21.15.76:0/2765975715 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe800032e20 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 10 client.17583 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5573cac189d0 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe7fdffb640 1 -- 172.21.15.76:0/2765975715 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe80800bd80 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe7fdffb640 1 -- 172.21.15.76:0/2765975715 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe80003a040 con 0x5573cab8bb40 2024-09-19T08:00:04.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 10 client.17583 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 10 client.17583 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 20 client.17583 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573cac1acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 4 client.17583 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.965+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573caaf7d70 con 0x5573caba4fe0 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.966+0000 7fe81659c640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573cac1acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81659c640 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573cac1acc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8011556063b51ca8 server_cookie=27f5ccf3d4ee852c in_seq=0 out_seq=0 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe7fdffb640 10 client.17583 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe7fdffb640 1 -- 172.21.15.76:0/2765975715 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573caaf7d70 con 0x5573caba4fe0 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe7fdffb640 10 client.17583 handle_command_reply: tid=0 2024-09-19T08:00:04.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 client.17583 shutdown 2024-09-19T08:00:04.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 msgr2=0x5573cab999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 0x5573cab999a0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe80003d630 tx=0x7fe800005de0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 shutdown_connections 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x5573caba4fe0 0x5573cac1acc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5573cab95370 0x5573cab99ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5573cab8bb40 0x5573cab999a0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 --2- 172.21.15.76:0/2765975715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5573cab8a5d0 0x5573cab99460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 >> 172.21.15.76:0/2765975715 conn(0x5573cab53310 msgr2=0x5573cab93840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe7fdffb640 0 client.17583 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:04.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 shutdown_connections 2024-09-19T08:00:04.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.967+0000 7fe81ef6a740 1 -- 172.21.15.76:0/2765975715 wait complete. 2024-09-19T08:00:04.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81ef6a740 20 client.17583 trim_cache size 0 max 16384 2024-09-19T08:00:04.986 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe8040a33b0 msgr2=0x7fe8040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe8040a33b0 0x7fe8040a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe80002a930 tx=0x7fe800005e80 comp rx=0 tx=0).stop 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 msgr2=0x7fe818074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 0x7fe818074f70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b970 tx=0x7fe81000be30 comp rx=0 tx=0).stop 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 shutdown_connections 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe8040a33b0 0x7fe8040a5870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe818106f40 0x7fe818074f70 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8181027c0 0x7fe818074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 --2- 172.21.15.76:0/1838743948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe818101e10 0x7fe8180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 >> 172.21.15.76:0/1838743948 conn(0x7fe8180fd8d0 msgr2=0x7fe8180fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:04.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 shutdown_connections 2024-09-19T08:00:04.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:04.968+0000 7fe81cb91640 1 -- 172.21.15.76:0/1838743948 wait complete. 2024-09-19T08:00:05.788 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:00:06.041 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:06.328 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:06 smithi076 ceph-mon[30930]: pgmap v275: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:00:06.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:06 smithi137 ceph-mon[35309]: pgmap v275: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 -- 172.21.15.76:0/1687736536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390102790 msgr2=0x7f33901067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 --2- 172.21.15.76:0/1687736536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390102790 0x7f33901067e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3384009900 tx=0x7f338402a410 comp rx=0 tx=0).stop 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 -- 172.21.15.76:0/1687736536 shutdown_connections 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 --2- 172.21.15.76:0/1687736536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3390106f10 0x7f339010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 --2- 172.21.15.76:0/1687736536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390102790 0x7f33901067e0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 --2- 172.21.15.76:0/1687736536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3390101de0 0x7f33901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 -- 172.21.15.76:0/1687736536 >> 172.21.15.76:0/1687736536 conn(0x7f33900fd8c0 msgr2=0x7f33900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 -- 172.21.15.76:0/1687736536 shutdown_connections 2024-09-19T08:00:06.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.514+0000 7f3394bb4640 1 -- 172.21.15.76:0/1687736536 wait complete. 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 Processor -- start 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 -- start start 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3390101de0 0x7f3390198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3390102790 0x7f3390198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 0x7f339019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3390112150 con 0x7f3390106f10 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3390111fd0 con 0x7f3390101de0 2024-09-19T08:00:06.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.515+0000 7f3394bb4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33901122d0 con 0x7f3390102790 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 0x7f339019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 0x7f339019cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52178/0 (socket says 172.21.15.76:52178) 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 -- 172.21.15.76:0/3716283733 learned_addr learned my addr 172.21.15.76:0/3716283733 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338dd9b640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3390102790 0x7f3390198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338e59c640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3390101de0 0x7f3390198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 -- 172.21.15.76:0/3716283733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3390102790 msgr2=0x7f3390198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3390102790 0x7f3390198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 -- 172.21.15.76:0/3716283733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3390101de0 msgr2=0x7f3390198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3390101de0 0x7f3390198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 -- 172.21.15.76:0/3716283733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339019d620 con 0x7f3390106f10 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f338ed9d640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 0x7f339019cf40 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f338800b970 tx=0x7f338800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f337f7fe640 1 -- 172.21.15.76:0/3716283733 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388019070 con 0x7f3390106f10 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339019d910 con 0x7f3390106f10 2024-09-19T08:00:06.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f337f7fe640 1 -- 172.21.15.76:0/3716283733 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338800cb40 con 0x7f3390106f10 2024-09-19T08:00:06.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f337f7fe640 1 -- 172.21.15.76:0/3716283733 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388007700 con 0x7f3390106f10 2024-09-19T08:00:06.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.516+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33901a51f0 con 0x7f3390106f10 2024-09-19T08:00:06.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f337f7fe640 1 -- 172.21.15.76:0/3716283733 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f338801c070 con 0x7f3390106f10 2024-09-19T08:00:06.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 Processor -- start 2024-09-19T08:00:06.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 -- start start 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 0x55bbff2c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c65d0 0x55bbff2c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bbff22c2f0 con 0x55bbff2c7b40 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbff1d3cf0 con 0x55bbff2c65d0 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f3396f8d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bbff2282b0 con 0x55bbff2d1370 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 0x55bbff2c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 0x55bbff2c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52192/0 (socket says 172.21.15.76:52192) 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.519+0000 7f338dd9b640 1 -- 172.21.15.76:0/2572013425 learned_addr learned my addr 172.21.15.76:0/2572013425 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338e59c640 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c65d0 0x55bbff2c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f337f7fe640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f33780a33b0 0x7f33780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338ed9d640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f33780a33b0 0x7f33780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 -- 172.21.15.76:0/2572013425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 msgr2=0x55bbff2d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 -- 172.21.15.76:0/2572013425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c65d0 msgr2=0x55bbff2c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c65d0 0x55bbff2c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f337f7fe640 1 -- 172.21.15.76:0/3716283733 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f33880cf320 con 0x7f3390106f10 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 -- 172.21.15.76:0/2572013425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbff1b83a0 con 0x55bbff2c7b40 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338dd9b640 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 0x55bbff2c6090 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f3384005ab0 tx=0x7f33840058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e2048525a8b9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f337cff9640 1 -- 172.21.15.76:0/2572013425 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384043020 con 0x55bbff2c7b40 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f338ed9d640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f33780a33b0 0x7f33780a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33880ccfe0 tx=0x7f3388004b50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f337cff9640 1 -- 172.21.15.76:0/2572013425 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3384005520 con 0x55bbff2c7b40 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.520+0000 7f337cff9640 1 -- 172.21.15.76:0/2572013425 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384035050 con 0x55bbff2c7b40 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 -- 172.21.15.76:0/2572013425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 msgr2=0x55bbff2c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 0x55bbff2c6090 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f3384005ab0 tx=0x7f33840058b0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 -- 172.21.15.76:0/2572013425 shutdown_connections 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c65d0 0x55bbff2c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 --2- 172.21.15.76:0/2572013425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c7b40 0x55bbff2c6090 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 -- 172.21.15.76:0/2572013425 >> 172.21.15.76:0/2572013425 conn(0x55bbff28f310 msgr2=0x55bbff2c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 -- 172.21.15.76:0/2572013425 shutdown_connections 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 -- 172.21.15.76:0/2572013425 wait complete. 2024-09-19T08:00:06.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.521+0000 7f3396f8d740 1 -- start start 2024-09-19T08:00:06.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 Processor -- start 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55bbff2d4010 con 0x55bbff2c65d0 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbff1e7060 con 0x55bbff2c7b40 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bbff2d4190 con 0x55bbff2d1370 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3396f8d740 10 client.0 _ll_register_callbacks cb 0x55bbfef3a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52198/0 (socket says 172.21.15.76:52198) 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 -- 172.21.15.76:0/281369122 learned_addr learned my addr 172.21.15.76:0/281369122 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338e59c640 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 -- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 msgr2=0x55bbff2ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 -- 172.21.15.76:0/281369122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 msgr2=0x55bbff2ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 -- 172.21.15.76:0/281369122 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbfef9d3c0 con 0x55bbff2c65d0 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f338dd9b640 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2d0d80 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3384006010 tx=0x7f33840056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38df15db18ac1ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.522+0000 7f3375ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3375ffb640 1 -- 172.21.15.76:0/281369122 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338404e060 con 0x55bbff2c65d0 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3375ffb640 1 -- 172.21.15.76:0/281369122 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f3384049480 con 0x55bbff2c65d0 2024-09-19T08:00:06.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3384005520 con 0x55bbff2c65d0 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3375ffb640 1 -- 172.21.15.76:0/281369122 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3384043070 con 0x55bbff2c65d0 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 10 client.17595 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bbff2dfae0 con 0x55bbff2c65d0 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3375ffb640 1 -- 172.21.15.76:0/281369122 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3384005520 con 0x55bbff2c65d0 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3375ffb640 1 -- 172.21.15.76:0/281369122 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f338403a810 con 0x55bbff2c65d0 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 10 client.17595 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 10 client.17595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 20 client.17595 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff2e0e30 0x55bbff2e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 4 client.17595 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.523+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbff239860 con 0x55bbff2e0e30 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.524+0000 7f338e59c640 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff2e0e30 0x55bbff2e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.524+0000 7f338e59c640 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff2e0e30 0x55bbff2e3220 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233657ef7cb5a126 server_cookie=73ef0da45716de37 in_seq=0 out_seq=0 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.524+0000 7f3375ffb640 10 client.17595 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3375ffb640 1 -- 172.21.15.76:0/281369122 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbff239860 con 0x55bbff2e0e30 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3375ffb640 10 client.17595 handle_command_reply: tid=0 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 client.17595 shutdown 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 msgr2=0x55bbff2d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2d0d80 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3384006010 tx=0x7f33840056d0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 shutdown_connections 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff2e0e30 0x55bbff2e3220 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 --2- 172.21.15.76:0/281369122 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2d0d80 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3375ffb640 0 client.17595 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:06.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 >> 172.21.15.76:0/281369122 conn(0x55bbff28f310 msgr2=0x55bbff2c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:06.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 shutdown_connections 2024-09-19T08:00:06.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 1 -- 172.21.15.76:0/281369122 wait complete. 2024-09-19T08:00:06.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.525+0000 7f3396f8d740 20 client.17595 trim_cache size 0 max 16384 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 Processor -- start 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 -- start start 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f33901b0470 con 0x55bbff2c65d0 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33901add40 con 0x55bbff2c7b40 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f3396f8d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33901abbb0 con 0x55bbff2d1370 2024-09-19T08:00:06.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52204/0 (socket says 172.21.15.76:52204) 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 -- 172.21.15.76:0/1231223175 learned_addr learned my addr 172.21.15.76:0/1231223175 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338e59c640 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 -- 172.21.15.76:0/1231223175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 msgr2=0x55bbff2c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 -- 172.21.15.76:0/1231223175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 msgr2=0x55bbff2c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.538+0000 7f338dd9b640 1 -- 172.21.15.76:0/1231223175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbff2ccfe0 con 0x55bbff2c65d0 2024-09-19T08:00:06.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f338dd9b640 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2cd8f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f33840057c0 tx=0x7f3384004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4682444f8a9dbc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:06.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3377fff640 1 -- 172.21.15.76:0/1231223175 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338405e070 con 0x55bbff2c65d0 2024-09-19T08:00:06.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3377fff640 1 -- 172.21.15.76:0/1231223175 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338403a980 con 0x55bbff2c65d0 2024-09-19T08:00:06.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3377fff640 1 -- 172.21.15.76:0/1231223175 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338404e050 con 0x55bbff2c65d0 2024-09-19T08:00:06.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 -- 172.21.15.76:0/1231223175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 msgr2=0x55bbff2cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2cd8f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f33840057c0 tx=0x7f3384004a30 comp rx=0 tx=0).stop 2024-09-19T08:00:06.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 -- 172.21.15.76:0/1231223175 shutdown_connections 2024-09-19T08:00:06.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1231223175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2cd8f0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 -- 172.21.15.76:0/1231223175 >> 172.21.15.76:0/1231223175 conn(0x55bbff28f310 msgr2=0x55bbff2c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 -- 172.21.15.76:0/1231223175 shutdown_connections 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.539+0000 7f3396f8d740 1 -- 172.21.15.76:0/1231223175 wait complete. 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 -- start start 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 Processor -- start 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f33901ac200 con 0x55bbff2c65d0 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33901ad670 con 0x55bbff2c7b40 2024-09-19T08:00:06.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f33901ac8d0 con 0x55bbff2d1370 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f3396f8d740 10 client.0 _ll_register_callbacks cb 0x7f338000b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52208/0 (socket says 172.21.15.76:52208) 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 -- 172.21.15.76:0/1230617250 learned_addr learned my addr 172.21.15.76:0/1230617250 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338e59c640 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 -- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 msgr2=0x55bbff2e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 -- 172.21.15.76:0/1230617250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 msgr2=0x55bbff2e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:06.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.540+0000 7f338dd9b640 1 -- 172.21.15.76:0/1230617250 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbff2e46a0 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f338dd9b640 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2e67d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f338402a930 tx=0x7f33840053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174c0c3c263ed88a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3375ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3375ffb640 1 -- 172.21.15.76:0/1230617250 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338405e070 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3375ffb640 1 -- 172.21.15.76:0/1230617250 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f338403a680 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f338403a980 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3375ffb640 1 -- 172.21.15.76:0/1230617250 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f338404e040 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 10 client.17601 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bbff34b5a0 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3375ffb640 1 -- 172.21.15.76:0/1230617250 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338403a980 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3375ffb640 1 -- 172.21.15.76:0/1230617250 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3384049480 con 0x55bbff2c65d0 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 10 client.17601 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:06.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 20 client.17601 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff34bac0 0x55bbff34deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 4 client.17601 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.541+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbff233d70 con 0x55bbff34bac0 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f338e59c640 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff34bac0 0x55bbff34deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f338e59c640 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff34bac0 0x55bbff34deb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3acea0f0bc19ac2 server_cookie=f8e256c043d56693 in_seq=0 out_seq=0 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3375ffb640 10 client.17601 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3375ffb640 1 -- 172.21.15.76:0/1230617250 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbff233d70 con 0x55bbff34bac0 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3375ffb640 10 client.17601 handle_command_reply: tid=0 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 client.17601 shutdown 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 msgr2=0x55bbff2e67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2e67d0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f338402a930 tx=0x7f33840053a0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 shutdown_connections 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bbff2d1370 0x55bbff2e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbff2c7b40 0x55bbff2e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55bbff34bac0 0x55bbff34deb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 --2- 172.21.15.76:0/1230617250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbff2c65d0 0x55bbff2e67d0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3375ffb640 0 client.17601 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 >> 172.21.15.76:0/1230617250 conn(0x55bbff28f310 msgr2=0x55bbff2c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 shutdown_connections 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.542+0000 7f3396f8d740 1 -- 172.21.15.76:0/1230617250 wait complete. 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3396f8d740 20 client.17601 trim_cache size 0 max 16384 2024-09-19T08:00:06.549 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f33780a33b0 msgr2=0x7f33780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f33780a33b0 0x7f33780a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33880ccfe0 tx=0x7f3388004b50 comp rx=0 tx=0).stop 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 msgr2=0x7f339019cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 0x7f339019cf40 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f338800b970 tx=0x7f338800be30 comp rx=0 tx=0).stop 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 shutdown_connections 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f33780a33b0 0x7f33780a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3390106f10 0x7f339019cf40 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3390102790 0x7f3390198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 --2- 172.21.15.76:0/3716283733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3390101de0 0x7f3390198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:06.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 >> 172.21.15.76:0/3716283733 conn(0x7f33900fd8c0 msgr2=0x7f33900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:06.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 shutdown_connections 2024-09-19T08:00:06.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:06.543+0000 7f3394bb4640 1 -- 172.21.15.76:0/3716283733 wait complete. 2024-09-19T08:00:06.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:06 smithi152 ceph-mon[35117]: pgmap v275: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:00:08.167 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:00:08.168 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:00:08.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:08 smithi137 ceph-mon[35309]: pgmap v276: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:00:08.422 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:08.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:08 smithi076 ceph-mon[30930]: pgmap v276: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:00:08.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:08 smithi152 ceph-mon[35117]: pgmap v276: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:00:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 -- 172.21.15.76:0/1358669087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784101420 msgr2=0x7f878410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 --2- 172.21.15.76:0/1358669087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784101420 0x7f878410d950 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f876c009930 tx=0x7f876c02a420 comp rx=0 tx=0).stop 2024-09-19T08:00:08.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 -- 172.21.15.76:0/1358669087 shutdown_connections 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 --2- 172.21.15.76:0/1358669087 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784101420 0x7f878410d950 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 --2- 172.21.15.76:0/1358669087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784100a80 0x7f8784100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 --2- 172.21.15.76:0/1358669087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784106a80 0x7f8784106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 -- 172.21.15.76:0/1358669087 >> 172.21.15.76:0/1358669087 conn(0x7f87840fc7a0 msgr2=0x7f87840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 -- 172.21.15.76:0/1358669087 shutdown_connections 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.908+0000 7f878b219640 1 -- 172.21.15.76:0/1358669087 wait complete. 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 Processor -- start 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 -- start start 2024-09-19T08:00:08.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784100a80 0x7f8784199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784101420 0x7f87841998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 0x7f87841a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8784110fa0 con 0x7f8784106a80 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8784110e20 con 0x7f8784100a80 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.909+0000 7f878b219640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8784111120 con 0x7f8784101420 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 0x7f87841a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 0x7f87841a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52236/0 (socket says 172.21.15.76:52236) 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 -- 172.21.15.76:0/3614243788 learned_addr learned my addr 172.21.15.76:0/3614243788 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8783fff640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784101420 0x7f87841998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8788fb5640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784100a80 0x7f8784199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 -- 172.21.15.76:0/3614243788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784101420 msgr2=0x7f87841998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784101420 0x7f87841998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 -- 172.21.15.76:0/3614243788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784100a80 msgr2=0x7f8784199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784100a80 0x7f8784199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 -- 172.21.15.76:0/3614243788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87841a4930 con 0x7f8784106a80 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8783fff640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784101420 0x7f87841998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8788fb5640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784100a80 0x7f8784199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f87897b6640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 0x7f87841a43f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f876c004770 tx=0x7f876c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8781ffb640 1 -- 172.21.15.76:0/3614243788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c03f030 con 0x7f8784106a80 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8781ffb640 1 -- 172.21.15.76:0/3614243788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f876c003d00 con 0x7f8784106a80 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87841a4b00 con 0x7f8784106a80 2024-09-19T08:00:08.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f8781ffb640 1 -- 172.21.15.76:0/3614243788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c035070 con 0x7f8784106a80 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.910+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87841a4f50 con 0x7f8784106a80 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f8781ffb640 1 -- 172.21.15.76:0/3614243788 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f876c042030 con 0x7f8784106a80 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 Processor -- start 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 -- start start 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a78af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a78b480 0x55de0a795800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a795d40 0x55de0a798130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55de0a6f0280 con 0x55de0a78ab60 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55de0a697b10 con 0x55de0a795d40 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f878d5f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55de0a6ec240 con 0x55de0a78b480 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.913+0000 7f8783fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a78af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a78af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52246/0 (socket says 172.21.15.76:52246) 2024-09-19T08:00:08.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 -- 172.21.15.76:0/3241882202 learned_addr learned my addr 172.21.15.76:0/3241882202 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8788fb5640 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a78b480 0x55de0a795800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a795d40 0x55de0a798130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8781ffb640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f87700a33b0 0x7f87700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 -- 172.21.15.76:0/3241882202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a78b480 msgr2=0x55de0a795800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a78b480 0x55de0a795800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 -- 172.21.15.76:0/3241882202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a795d40 msgr2=0x55de0a798130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a795d40 0x55de0a798130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 -- 172.21.15.76:0/3241882202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de0a6a41f0 con 0x55de0a78ab60 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f87897b6640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f87700a33b0 0x7f87700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8783fff640 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a78af40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f87740148f0 tx=0x7f87740099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9468133227ea8639 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f8781ffb640 1 -- 172.21.15.76:0/3614243788 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f876c0f02e0 con 0x7f8784106a80 2024-09-19T08:00:08.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f877affd640 1 -- 172.21.15.76:0/3241882202 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877401a020 con 0x55de0a78ab60 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f877affd640 1 -- 172.21.15.76:0/3241882202 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8774012d90 con 0x55de0a78ab60 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.914+0000 7f877affd640 1 -- 172.21.15.76:0/3241882202 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774010960 con 0x55de0a78ab60 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 -- 172.21.15.76:0/3241882202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 msgr2=0x55de0a78af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f87897b6640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f87700a33b0 0x7f87700a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f876c004650 tx=0x7f876c0c0040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a78af40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f87740148f0 tx=0x7f87740099f0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 -- 172.21.15.76:0/3241882202 shutdown_connections 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a795d40 0x55de0a798130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a78b480 0x55de0a795800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 --2- 172.21.15.76:0/3241882202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a78af40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 -- 172.21.15.76:0/3241882202 >> 172.21.15.76:0/3241882202 conn(0x55de0a7870f0 msgr2=0x55de0a7874d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 -- 172.21.15.76:0/3241882202 shutdown_connections 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 -- 172.21.15.76:0/3241882202 wait complete. 2024-09-19T08:00:08.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 -- start start 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.915+0000 7f878d5f2740 1 Processor -- start 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a792be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a793120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a793660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55de0a798910 con 0x55de0a78b480 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55de0a6aaf10 con 0x55de0a78ab60 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55de0a798a90 con 0x55de0a795d40 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f878d5f2740 10 client.0 _ll_register_callbacks cb 0x55de0a673a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a793120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a793120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52252/0 (socket says 172.21.15.76:52252) 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 -- 172.21.15.76:0/915845860 learned_addr learned my addr 172.21.15.76:0/915845860 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8783fff640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a792be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8783fff640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a793660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 -- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 msgr2=0x55de0a793660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a793660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 -- 172.21.15.76:0/915845860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 msgr2=0x55de0a792be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a792be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 -- 172.21.15.76:0/915845860 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de0a4616a0 con 0x55de0a78b480 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8783fff640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a792be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8788fb5640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a793120 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f877c012450 tx=0x7f877c012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fb9bcf4977a28f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.916+0000 7f8763fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f8763fff640 1 -- 172.21.15.76:0/915845860 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0035f0 con 0x55de0a78b480 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f8763fff640 1 -- 172.21.15.76:0/915845860 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f877c003790 con 0x55de0a78b480 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8774012d90 con 0x55de0a78b480 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f8763fff640 1 -- 172.21.15.76:0/915845860 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f877c003990 con 0x55de0a78b480 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 10 client.17613 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:08.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55de0a7a45a0 con 0x55de0a78b480 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f8763fff640 1 -- 172.21.15.76:0/915845860 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8774012d90 con 0x55de0a78b480 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f8763fff640 1 -- 172.21.15.76:0/915845860 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f877c019070 con 0x55de0a78b480 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 10 client.17613 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 20 client.17613 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a7a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 4 client.17613 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de0a6fd7f0 con 0x55de0a7a5a60 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.917+0000 7f8783fff640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a7a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.918+0000 7f8783fff640 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a7a7e90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3481bdf411b57db0 server_cookie=8dc17a957baa4caa in_seq=0 out_seq=0 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.918+0000 7f8763fff640 10 client.17613 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f8763fff640 1 -- 172.21.15.76:0/915845860 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de0a6fd7f0 con 0x55de0a7a5a60 2024-09-19T08:00:08.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f8763fff640 10 client.17613 handle_command_reply: tid=0 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 client.17613 shutdown 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 msgr2=0x55de0a793120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a793120 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f877c012450 tx=0x7f877c012910 comp rx=0 tx=0).stop 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 shutdown_connections 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a793660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a7a7e90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f8763fff640 0 client.17613 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a793120 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 --2- 172.21.15.76:0/915845860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a792be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 >> 172.21.15.76:0/915845860 conn(0x55de0a7870f0 msgr2=0x55de0a78ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 shutdown_connections 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 1 -- 172.21.15.76:0/915845860 wait complete. 2024-09-19T08:00:08.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.919+0000 7f878d5f2740 20 client.17613 trim_cache size 0 max 16384 2024-09-19T08:00:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 Processor -- start 2024-09-19T08:00:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 -- start start 2024-09-19T08:00:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a78d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a7ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a7adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f87841b0440 con 0x55de0a78b480 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87841add10 con 0x55de0a78ab60 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f878d5f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87841abb80 con 0x55de0a795d40 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a7ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a7ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52264/0 (socket says 172.21.15.76:52264) 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 -- 172.21.15.76:0/1797551280 learned_addr learned my addr 172.21.15.76:0/1797551280 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8783fff640 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a78d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8783fff640 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a7adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 -- 172.21.15.76:0/1797551280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 msgr2=0x55de0a7adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a7adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 -- 172.21.15.76:0/1797551280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 msgr2=0x55de0a78d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a78d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8788fb5640 1 -- 172.21.15.76:0/1797551280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de0a7881a0 con 0x55de0a78b480 2024-09-19T08:00:08.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.938+0000 7f8783fff640 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a78d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f8788fb5640 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a7ad7a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f877c010f30 tx=0x7f877c004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975d0dc05ef1e1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f877a7fc640 1 -- 172.21.15.76:0/1797551280 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c00b850 con 0x55de0a78b480 2024-09-19T08:00:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f877a7fc640 1 -- 172.21.15.76:0/1797551280 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f877c01b5b0 con 0x55de0a78b480 2024-09-19T08:00:08.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f877a7fc640 1 -- 172.21.15.76:0/1797551280 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0107b0 con 0x55de0a78b480 2024-09-19T08:00:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f878d5f2740 1 -- 172.21.15.76:0/1797551280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 msgr2=0x55de0a7ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a7ad7a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f877c010f30 tx=0x7f877c004590 comp rx=0 tx=0).stop 2024-09-19T08:00:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f878d5f2740 1 -- 172.21.15.76:0/1797551280 shutdown_connections 2024-09-19T08:00:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a7adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78b480 0x55de0a7ad7a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.939+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1797551280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78ab60 0x55de0a78d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- 172.21.15.76:0/1797551280 >> 172.21.15.76:0/1797551280 conn(0x55de0a7870f0 msgr2=0x55de0a794b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- 172.21.15.76:0/1797551280 shutdown_connections 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- 172.21.15.76:0/1797551280 wait complete. 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- start start 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 Processor -- start 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a79dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78b480 0x55de0a79e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a79ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f87841ac1d0 con 0x55de0a78ab60 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87841ad640 con 0x55de0a78b480 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87841ac8a0 con 0x55de0a795d40 2024-09-19T08:00:08.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.940+0000 7f878d5f2740 10 client.0 _ll_register_callbacks cb 0x7f877c00bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a79dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a79dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52278/0 (socket says 172.21.15.76:52278) 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 -- 172.21.15.76:0/1663947316 learned_addr learned my addr 172.21.15.76:0/1663947316 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8788fb5640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78b480 0x55de0a79e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a79ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 -- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 msgr2=0x55de0a79ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a79ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 -- 172.21.15.76:0/1663947316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78b480 msgr2=0x55de0a79e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78b480 0x55de0a79e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 -- 172.21.15.76:0/1663947316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de0a79b300 con 0x55de0a78ab60 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8783fff640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a79dd40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8774010510 tx=0x7f87740099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5705dd4727eeed08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8763fff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:08.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8763fff640 1 -- 172.21.15.76:0/1663947316 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877401a040 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8763fff640 1 -- 172.21.15.76:0/1663947316 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8658+0+0 (secure 0 0 0) 0x7f8774012c60 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f877c01b5b0 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f8763fff640 1 -- 172.21.15.76:0/1663947316 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8774012e60 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f878d5f2740 10 client.17619 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.941+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55de0a8110a0 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f8763fff640 1 -- 172.21.15.76:0/1663947316 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f877c01b5b0 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f8763fff640 1 -- 172.21.15.76:0/1663947316 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f8774036060 con 0x55de0a78ab60 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f878d5f2740 10 client.17619 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f878d5f2740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f878d5f2740 20 client.17619 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a813690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f878d5f2740 4 client.17619 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:00:08.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55de0a6f7d00 con 0x55de0a7a5a60 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f8788fb5640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a813690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f8763fff640 10 client.17619 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.942+0000 7f8788fb5640 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a813690 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2281f31e7920c54 server_cookie=d5db3da781eff4c5 in_seq=0 out_seq=0 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.943+0000 7f8763fff640 1 -- 172.21.15.76:0/1663947316 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55de0a6f7d00 con 0x55de0a7a5a60 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.943+0000 7f8763fff640 10 client.17619 handle_command_reply: tid=0 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.943+0000 7f878d5f2740 1 client.17619 shutdown 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 msgr2=0x55de0a79dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a79dd40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8774010510 tx=0x7f87740099f0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 shutdown_connections 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55de0a795d40 0x55de0a79ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55de0a78b480 0x55de0a79e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55de0a7a5a60 0x55de0a813690 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 --2- 172.21.15.76:0/1663947316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55de0a78ab60 0x55de0a79dd40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 >> 172.21.15.76:0/1663947316 conn(0x55de0a7870f0 msgr2=0x55de0a7940a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f8763fff640 0 client.17619 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 shutdown_connections 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 1 -- 172.21.15.76:0/1663947316 wait complete. 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.944+0000 7f878d5f2740 20 client.17619 trim_cache size 0 max 16384 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "a5183d00-f982-4ea1-b849-8a79c9adff69", 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T08:00:08.949 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:00:08.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f87700a33b0 msgr2=0x7f87700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f87700a33b0 0x7f87700a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f876c004650 tx=0x7f876c0c0040 comp rx=0 tx=0).stop 2024-09-19T08:00:08.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 msgr2=0x7f87841a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:08.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 0x7f87841a43f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f876c004770 tx=0x7f876c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 shutdown_connections 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f87700a33b0 0x7f87700a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8784106a80 0x7f87841a43f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8784101420 0x7f87841998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 --2- 172.21.15.76:0/3614243788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8784100a80 0x7f8784199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 >> 172.21.15.76:0/3614243788 conn(0x7f87840fc7a0 msgr2=0x7f87840fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 shutdown_connections 2024-09-19T08:00:08.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:08.945+0000 7f878b219640 1 -- 172.21.15.76:0/3614243788 wait complete. 2024-09-19T08:00:09.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:09 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T08:00:09.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:09 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:09.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:09 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T08:00:09.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:09 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:09.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:09 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T08:00:09.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:09 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T08:00:09.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:09 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:09.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:09 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T08:00:09.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:09 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:09.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:09 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T08:00:09.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:09 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T08:00:09.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:09 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:09.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:09 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T08:00:09.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:09 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:09.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:09 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T08:00:09.719 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:00:10.007 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:10.350 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:10 smithi076 ceph-mon[30930]: pgmap v277: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:00:10.350 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:10 smithi076 ceph-mon[30930]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:00:10.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:10 smithi137 ceph-mon[35309]: pgmap v277: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:00:10.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:10 smithi137 ceph-mon[35309]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:00:10.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:10 smithi152 ceph-mon[35117]: pgmap v277: 97 pgs: 97 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:00:10.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:10 smithi152 ceph-mon[35117]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:00:10.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 -- 172.21.15.76:0/81855969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c101de0 msgr2=0x7fe06c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 --2- 172.21.15.76:0/81855969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c101de0 0x7fe06c1021c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009900 tx=0x7fe05c02a410 comp rx=0 tx=0).stop 2024-09-19T08:00:10.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 -- 172.21.15.76:0/81855969 shutdown_connections 2024-09-19T08:00:10.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 --2- 172.21.15.76:0/81855969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe06c106f10 0x7fe06c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 --2- 172.21.15.76:0/81855969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe06c102790 0x7fe06c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 --2- 172.21.15.76:0/81855969 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c101de0 0x7fe06c1021c0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 -- 172.21.15.76:0/81855969 >> 172.21.15.76:0/81855969 conn(0x7fe06c0fd8c0 msgr2=0x7fe06c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:10.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 -- 172.21.15.76:0/81855969 shutdown_connections 2024-09-19T08:00:10.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.736+0000 7fe070a85640 1 -- 172.21.15.76:0/81855969 wait complete. 2024-09-19T08:00:10.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 Processor -- start 2024-09-19T08:00:10.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 -- start start 2024-09-19T08:00:10.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe06c101de0 0x7fe06c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe06c102790 0x7fe06c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 0x7fe06c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c112090 con 0x7fe06c106f10 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c111f10 con 0x7fe06c102790 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe070a85640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c112210 con 0x7fe06c101de0 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe06ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 0x7fe06c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe06ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 0x7fe06c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52306/0 (socket says 172.21.15.76:52306) 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe06ad9d640 1 -- 172.21.15.76:0/2306883483 learned_addr learned my addr 172.21.15.76:0/2306883483 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:10.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.737+0000 7fe069d9b640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe06c102790 0x7fe06c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06a59c640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe06c101de0 0x7fe06c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06ad9d640 1 -- 172.21.15.76:0/2306883483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe06c101de0 msgr2=0x7fe06c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06ad9d640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe06c101de0 0x7fe06c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06ad9d640 1 -- 172.21.15.76:0/2306883483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe06c102790 msgr2=0x7fe06c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06ad9d640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe06c102790 0x7fe06c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06ad9d640 1 -- 172.21.15.76:0/2306883483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c1a69e0 con 0x7fe06c106f10 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe06ad9d640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 0x7fe06c074f70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe06400eaa0 tx=0x7fe06400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe05b7fe640 1 -- 172.21.15.76:0/2306883483 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06400cdb0 con 0x7fe06c106f10 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe05b7fe640 1 -- 172.21.15.76:0/2306883483 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe064004b20 con 0x7fe06c106f10 2024-09-19T08:00:10.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c1a6cd0 con 0x7fe06c106f10 2024-09-19T08:00:10.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe05b7fe640 1 -- 172.21.15.76:0/2306883483 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064011760 con 0x7fe06c106f10 2024-09-19T08:00:10.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.738+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c1a7210 con 0x7fe06c106f10 2024-09-19T08:00:10.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.741+0000 7fe05b7fe640 1 -- 172.21.15.76:0/2306883483 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe064004cd0 con 0x7fe06c106f10 2024-09-19T08:00:10.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.741+0000 7fe072e5e740 1 Processor -- start 2024-09-19T08:00:10.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.741+0000 7fe072e5e740 1 -- start start 2024-09-19T08:00:10.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 0x55a365cbd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbddc0 0x55a365cc8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ccaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe072e5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a365c232e0 con 0x55a365cbd4a0 2024-09-19T08:00:10.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe072e5e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a365bcace0 con 0x55a365cbddc0 2024-09-19T08:00:10.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe072e5e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a365c1f2a0 con 0x55a365cc8680 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 0x55a365cbd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 0x55a365cbd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52312/0 (socket says 172.21.15.76:52312) 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 -- 172.21.15.76:0/646991203 learned_addr learned my addr 172.21.15.76:0/646991203 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe06a59c640 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbddc0 0x55a365cc8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe05b7fe640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe0540a33b0 0x7fe0540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ccaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 -- 172.21.15.76:0/646991203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 msgr2=0x55a365ccaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ccaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 -- 172.21.15.76:0/646991203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbddc0 msgr2=0x55a365cc8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbddc0 0x55a365cc8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 -- 172.21.15.76:0/646991203 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a365baf440 con 0x55a365cbd4a0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe06ad9d640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe0540a33b0 0x7fe0540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe05b7fe640 1 -- 172.21.15.76:0/2306883483 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7fe0640cffb0 con 0x7fe06c106f10 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe069d9b640 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 0x55a365cbd880 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe0600058a0 tx=0x7fe06000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f596ff91c2716441 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.742+0000 7fe058ff9640 1 -- 172.21.15.76:0/646991203 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060004030 con 0x55a365cbd4a0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe058ff9640 1 -- 172.21.15.76:0/646991203 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe060005520 con 0x55a365cbd4a0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe058ff9640 1 -- 172.21.15.76:0/646991203 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060004ca0 con 0x55a365cbd4a0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 -- 172.21.15.76:0/646991203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 msgr2=0x55a365cbd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe06ad9d640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe0540a33b0 0x7fe0540a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cd700 tx=0x7fe06401eb40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 0x55a365cbd880 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe0600058a0 tx=0x7fe06000b840 comp rx=0 tx=0).stop 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 -- 172.21.15.76:0/646991203 shutdown_connections 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ccaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbddc0 0x55a365cc8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 --2- 172.21.15.76:0/646991203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbd4a0 0x55a365cbd880 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 -- 172.21.15.76:0/646991203 >> 172.21.15.76:0/646991203 conn(0x55a365cb9a30 msgr2=0x55a365cb9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 -- 172.21.15.76:0/646991203 shutdown_connections 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.743+0000 7fe072e5e740 1 -- 172.21.15.76:0/646991203 wait complete. 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 -- start start 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 Processor -- start 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cc7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cc5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365cc5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a365ccb250 con 0x55a365cbddc0 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a365bde050 con 0x55a365cbd4a0 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a365ccb3d0 con 0x55a365cc8680 2024-09-19T08:00:10.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe072e5e740 10 client.0 _ll_register_callbacks cb 0x55a365c1e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cc5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cc5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52328/0 (socket says 172.21.15.76:52328) 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe06a59c640 1 -- 172.21.15.76:0/1812720863 learned_addr learned my addr 172.21.15.76:0/1812720863 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe069d9b640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cc7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.744+0000 7fe069d9b640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365cc5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe06a59c640 1 -- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 msgr2=0x55a365cc5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe06a59c640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365cc5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe06a59c640 1 -- 172.21.15.76:0/1812720863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 msgr2=0x55a365cc7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe06a59c640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cc7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe06a59c640 1 -- 172.21.15.76:0/1812720863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3659943c0 con 0x55a365cbddc0 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe06a59c640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cc5200 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009900 tx=0x7fe05c031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a94dfa1fd7939ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:10.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe051ffb640 1 -- 172.21.15.76:0/1812720863 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c035040 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe051ffb640 1 -- 172.21.15.76:0/1812720863 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7fe05c004240 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe060005520 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe051ffb640 1 -- 172.21.15.76:0/1812720863 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe05c004440 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe072e5e740 10 client.17631 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a365cd6ba0 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.745+0000 7fe051ffb640 1 -- 172.21.15.76:0/1812720863 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe060005520 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe051ffb640 1 -- 172.21.15.76:0/1812720863 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe05c004af0 con 0x55a365cbddc0 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe072e5e740 10 client.17631 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe072e5e740 10 client.17631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe072e5e740 20 client.17631 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe072e5e740 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365cd80b0 0x55a365cda510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe072e5e740 4 client.17631 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a365c30850 con 0x55a365cd80b0 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe069d9b640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365cd80b0 0x55a365cda510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe069d9b640 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365cd80b0 0x55a365cda510 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f1e01abb9a5d1c server_cookie=fc2dfbaeed192265 in_seq=0 out_seq=0 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.746+0000 7fe051ffb640 10 client.17631 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe051ffb640 1 -- 172.21.15.76:0/1812720863 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a365c30850 con 0x55a365cd80b0 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe051ffb640 10 client.17631 handle_command_reply: tid=0 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 client.17631 shutdown 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 msgr2=0x55a365cc5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cc5200 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009900 tx=0x7fe05c031870 comp rx=0 tx=0).stop 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 shutdown_connections 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365cc5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365cd80b0 0x55a365cda510 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cc5200 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 --2- 172.21.15.76:0/1812720863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cc7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 >> 172.21.15.76:0/1812720863 conn(0x55a365cb9a30 msgr2=0x55a365cbf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:10.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe051ffb640 0 client.17631 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:10.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 shutdown_connections 2024-09-19T08:00:10.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 1 -- 172.21.15.76:0/1812720863 wait complete. 2024-09-19T08:00:10.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.747+0000 7fe072e5e740 20 client.17631 trim_cache size 0 max 16384 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 Processor -- start 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 -- start start 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cd44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cdfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ce0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b27c0 con 0x55a365cbddc0 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1b0090 con 0x55a365cbd4a0 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe072e5e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1adf00 con 0x55a365cc8680 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cdfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cdfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52330/0 (socket says 172.21.15.76:52330) 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 -- 172.21.15.76:0/388094250 learned_addr learned my addr 172.21.15.76:0/388094250 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:10.768 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe069d9b640 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cd44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 -- 172.21.15.76:0/388094250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 msgr2=0x55a365ce0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ce0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 -- 172.21.15.76:0/388094250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 msgr2=0x55a365cd44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cd44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe06a59c640 1 -- 172.21.15.76:0/388094250 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a365cbaae0 con 0x55a365cbddc0 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.764+0000 7fe069d9b640 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cd44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:10.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe06a59c640 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cdfde0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0036e0 tx=0x7fe05c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937ec819030d0510 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe053fff640 1 -- 172.21.15.76:0/388094250 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c035030 con 0x55a365cbddc0 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe053fff640 1 -- 172.21.15.76:0/388094250 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe05c004bc0 con 0x55a365cbddc0 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe053fff640 1 -- 172.21.15.76:0/388094250 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0053e0 con 0x55a365cbddc0 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 -- 172.21.15.76:0/388094250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 msgr2=0x55a365cdfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cdfde0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0036e0 tx=0x7fe05c0039e0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 -- 172.21.15.76:0/388094250 shutdown_connections 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cc8680 0x55a365ce0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cbddc0 0x55a365cdfde0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 --2- 172.21.15.76:0/388094250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365cd44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 -- 172.21.15.76:0/388094250 >> 172.21.15.76:0/388094250 conn(0x55a365cb9a30 msgr2=0x55a365cc7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 -- 172.21.15.76:0/388094250 shutdown_connections 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.765+0000 7fe072e5e740 1 -- 172.21.15.76:0/388094250 wait complete. 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 -- start start 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 Processor -- start 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365ccdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cbddc0 0x55a365cce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 0x55a365d3adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1ae550 con 0x55a365cc8680 2024-09-19T08:00:10.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1af9c0 con 0x55a365cbd4a0 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1aec20 con 0x55a365cbddc0 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe072e5e740 10 client.0 _ll_register_callbacks cb 0x7fe05c0314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 0x55a365d3adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 0x55a365d3adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52338/0 (socket says 172.21.15.76:52338) 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 -- 172.21.15.76:0/27577716 learned_addr learned my addr 172.21.15.76:0/27577716 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe06a59c640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cbddc0 0x55a365cce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365ccdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 -- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cbddc0 msgr2=0x55a365cce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cbddc0 0x55a365cce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 -- 172.21.15.76:0/27577716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 msgr2=0x55a365ccdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365ccdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.766+0000 7fe069d9b640 1 -- 172.21.15.76:0/27577716 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a365d3b3e0 con 0x55a365cc8680 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe069d9b640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 0x55a365d3adf0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe0600058a0 tx=0x7fe060004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afc991f6f60b51f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe051ffb640 1 -- 172.21.15.76:0/27577716 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060026040 con 0x55a365cc8680 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe051ffb640 1 -- 172.21.15.76:0/27577716 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7fe06002e660 con 0x55a365cc8680 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe05c004bc0 con 0x55a365cc8680 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe051ffb640 1 -- 172.21.15.76:0/27577716 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe06000b770 con 0x55a365cc8680 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 10 client.17637 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:10.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a365d426c0 con 0x55a365cc8680 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe051ffb640 1 -- 172.21.15.76:0/27577716 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe05c004bc0 con 0x55a365cc8680 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe051ffb640 1 -- 172.21.15.76:0/27577716 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe06002c040 con 0x55a365cc8680 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 10 client.17637 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 10 client.17637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 20 client.17637 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365d42c40 0x55a365d45030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 4 client.17637 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.767+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a365cc5ad0 con 0x55a365d42c40 2024-09-19T08:00:10.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe06a59c640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365d42c40 0x55a365d45030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:10.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe06a59c640 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365d42c40 0x55a365d45030 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8573278c008866e6 server_cookie=84ab7d0c1a919d19 in_seq=0 out_seq=0 2024-09-19T08:00:10.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe051ffb640 10 client.17637 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:10.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe051ffb640 1 -- 172.21.15.76:0/27577716 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a365cc5ad0 con 0x55a365d42c40 2024-09-19T08:00:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe051ffb640 10 client.17637 handle_command_reply: tid=0 2024-09-19T08:00:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 client.17637 shutdown 2024-09-19T08:00:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 msgr2=0x55a365d3adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 0x55a365d3adf0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe0600058a0 tx=0x7fe060004840 comp rx=0 tx=0).stop 2024-09-19T08:00:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 shutdown_connections 2024-09-19T08:00:10.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55a365d42c40 0x55a365d45030 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a365cc8680 0x55a365d3adf0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a365cbddc0 0x55a365cce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe072e5e740 1 --2- 172.21.15.76:0/27577716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a365cbd4a0 0x55a365ccdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.768+0000 7fe051ffb640 0 client.17637 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:10.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 >> 172.21.15.76:0/27577716 conn(0x55a365cb9a30 msgr2=0x55a365cc39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:10.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 shutdown_connections 2024-09-19T08:00:10.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe072e5e740 1 -- 172.21.15.76:0/27577716 wait complete. 2024-09-19T08:00:10.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe072e5e740 20 client.17637 trim_cache size 0 max 16384 2024-09-19T08:00:10.779 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:00:10.780 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T08:00:10.780 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T08:00:10.780 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:00:10.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe0540a33b0 msgr2=0x7fe0540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe0540a33b0 0x7fe0540a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cd700 tx=0x7fe06401eb40 comp rx=0 tx=0).stop 2024-09-19T08:00:10.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 msgr2=0x7fe06c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:10.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 0x7fe06c074f70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe06400eaa0 tx=0x7fe06400ef60 comp rx=0 tx=0).stop 2024-09-19T08:00:10.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 shutdown_connections 2024-09-19T08:00:10.781 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe0540a33b0 0x7fe0540a5870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe06c106f10 0x7fe06c074f70 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe06c102790 0x7fe06c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 --2- 172.21.15.76:0/2306883483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe06c101de0 0x7fe06c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 >> 172.21.15.76:0/2306883483 conn(0x7fe06c0fd8c0 msgr2=0x7fe06c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 shutdown_connections 2024-09-19T08:00:10.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:10.769+0000 7fe070a85640 1 -- 172.21.15.76:0/2306883483 wait complete. 2024-09-19T08:00:11.476 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:00:11.476 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:00:11.721 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:12.120 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:12 smithi076 ceph-mon[30930]: pgmap v279: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:00:12.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 -- 172.21.15.76:0/1453492613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 msgr2=0x7ff1441021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:12.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 --2- 172.21.15.76:0/1453492613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff1441021d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff134009900 tx=0x7ff13402a410 comp rx=0 tx=0).stop 2024-09-19T08:00:12.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 -- 172.21.15.76:0/1453492613 shutdown_connections 2024-09-19T08:00:12.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 --2- 172.21.15.76:0/1453492613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff144106f20 0x7ff14410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 --2- 172.21.15.76:0/1453492613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1441027a0 0x7ff1441067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 --2- 172.21.15.76:0/1453492613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff1441021d0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 -- 172.21.15.76:0/1453492613 >> 172.21.15.76:0/1453492613 conn(0x7ff1440fd8b0 msgr2=0x7ff1440ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 -- 172.21.15.76:0/1453492613 shutdown_connections 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.199+0000 7ff14991c640 1 -- 172.21.15.76:0/1453492613 wait complete. 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 Processor -- start 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 -- start start 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff144198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1441027a0 0x7ff144198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff144106f20 0x7ff14419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff1441120e0 con 0x7ff144101df0 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff144111f60 con 0x7ff144106f20 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff14991c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff144112260 con 0x7ff1441027a0 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff142ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff144198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:12.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff142ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff144198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52350/0 (socket says 172.21.15.76:52350) 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.200+0000 7ff142ffd640 1 -- 172.21.15.76:0/711024442 learned_addr learned my addr 172.21.15.76:0/711024442 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff1427fc640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1441027a0 0x7ff144198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff142ffd640 1 -- 172.21.15.76:0/711024442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1441027a0 msgr2=0x7ff144198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff142ffd640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1441027a0 0x7ff144198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff142ffd640 1 -- 172.21.15.76:0/711024442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff144106f20 msgr2=0x7ff14419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff142ffd640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff144106f20 0x7ff14419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff142ffd640 1 -- 172.21.15.76:0/711024442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14419d4d0 con 0x7ff144101df0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff142ffd640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff144198520 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff134006010 tx=0x7ff1340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13403f030 con 0x7ff144101df0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff134003d00 con 0x7ff144101df0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14419d760 con 0x7ff144101df0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134035070 con 0x7ff144101df0 2024-09-19T08:00:12.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.201+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1441a50a0 con 0x7ff144101df0 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.202+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1441032d0 con 0x7ff144101df0 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.203+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff134042030 con 0x7ff144101df0 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.204+0000 7ff14891a640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff12c0a33b0 0x7ff12c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.204+0000 7ff1427fc640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff12c0a33b0 0x7ff12c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.204+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7ff1340f0490 con 0x7ff144101df0 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.205+0000 7ff1427fc640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff12c0a33b0 0x7ff12c0a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff138005fd0 tx=0x7ff138005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:12.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.208+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1340bce80 con 0x7ff144101df0 2024-09-19T08:00:12.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:12 smithi137 ceph-mon[35309]: pgmap v279: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:00:12.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.408+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1441a52d0 con 0x7ff144101df0 2024-09-19T08:00:12.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.409+0000 7ff14891a640 1 -- 172.21.15.76:0/711024442 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7ff1340bc780 con 0x7ff144101df0 2024-09-19T08:00:12.409 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:00:12.410 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T08:00:12.410 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T08:00:12.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff12c0a33b0 msgr2=0x7ff12c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:12.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff12c0a33b0 0x7ff12c0a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff138005fd0 tx=0x7ff138005850 comp rx=0 tx=0).stop 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 msgr2=0x7ff144198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff144198520 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff134006010 tx=0x7ff1340042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 shutdown_connections 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff12c0a33b0 0x7ff12c0a5870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff144106f20 0x7ff14419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1441027a0 0x7ff144198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 --2- 172.21.15.76:0/711024442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff144101df0 0x7ff144198520 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 >> 172.21.15.76:0/711024442 conn(0x7ff1440fd8b0 msgr2=0x7ff1440fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 shutdown_connections 2024-09-19T08:00:12.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:12.411+0000 7ff14991c640 1 -- 172.21.15.76:0/711024442 wait complete. 2024-09-19T08:00:12.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:12 smithi152 ceph-mon[35117]: pgmap v279: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:00:13.044 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:00:13.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:13 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/711024442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:13.292 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:13.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:13 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/711024442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:13.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:13 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/711024442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:13.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 -- 172.21.15.76:0/2439949602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 msgr2=0x7f9d241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 --2- 172.21.15.76:0/2439949602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d241021d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009900 tx=0x7f9d1802a410 comp rx=0 tx=0).stop 2024-09-19T08:00:13.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 -- 172.21.15.76:0/2439949602 shutdown_connections 2024-09-19T08:00:13.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 --2- 172.21.15.76:0/2439949602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24106f20 0x7f9d2410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 --2- 172.21.15.76:0/2439949602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d241027a0 0x7f9d241067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 --2- 172.21.15.76:0/2439949602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d241021d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.797+0000 7f9d2c750640 1 -- 172.21.15.76:0/2439949602 >> 172.21.15.76:0/2439949602 conn(0x7f9d240fd8f0 msgr2=0x7f9d240ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 -- 172.21.15.76:0/2439949602 shutdown_connections 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 -- 172.21.15.76:0/2439949602 wait complete. 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 Processor -- start 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 -- start start 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d24198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d241027a0 0x7f9d24198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24106f20 0x7f9d2419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241120a0 con 0x7f9d24101df0 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24111f20 con 0x7f9d24106f20 2024-09-19T08:00:13.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2c750640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24112220 con 0x7f9d241027a0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2a4ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d24198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2a4ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d24198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54734/0 (socket says 172.21.15.76:54734) 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.798+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3490135862 learned_addr learned my addr 172.21.15.76:0/3490135862 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d241027a0 0x7f9d24198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24106f20 0x7f9d2419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3490135862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d241027a0 msgr2=0x7f9d24198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d241027a0 0x7f9d24198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3490135862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24106f20 msgr2=0x7f9d2419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24106f20 0x7f9d2419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3490135862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2419d4d0 con 0x7f9d24101df0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d24198520 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006010 tx=0x7f9d180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d177fe640 1 -- 172.21.15.76:0/3490135862 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1803f030 con 0x7f9d24101df0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2419d760 con 0x7f9d24101df0 2024-09-19T08:00:13.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d177fe640 1 -- 172.21.15.76:0/3490135862 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d18003d00 con 0x7f9d24101df0 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d177fe640 1 -- 172.21.15.76:0/3490135862 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18035070 con 0x7f9d24101df0 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.799+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d241a50a0 con 0x7f9d24101df0 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.801+0000 7f9d177fe640 1 -- 172.21.15.76:0/3490135862 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9d18042030 con 0x7f9d24101df0 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.801+0000 7f9d2eb29740 1 Processor -- start 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 -- start start 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991785090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991785a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991794780 0x561991796b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5619916eb2f0 con 0x5619917855d0 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561991692cf0 con 0x561991794780 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5619916e72b0 con 0x561991786b40 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991785a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991785a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54750/0 (socket says 172.21.15.76:54750) 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3743558749 learned_addr learned my addr 172.21.15.76:0/3743558749 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d177fe640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9d100a33b0 0x7f9d100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991785090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991794780 0x561991796b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3743558749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 msgr2=0x561991785090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991785090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3743558749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991794780 msgr2=0x561991796b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991794780 0x561991796b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d177fe640 1 -- 172.21.15.76:0/3490135862 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7f9d180f0490 con 0x7f9d24101df0 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3743558749 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619916773a0 con 0x5619917855d0 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991794780 0x561991796b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.802+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991785090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.803+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9d100a33b0 0x7f9d100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.803+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991785a10 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9d180edaa0 tx=0x7f9d18037f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c1634361b49e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.803+0000 7f9d14ff9640 1 -- 172.21.15.76:0/3743558749 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18049020 con 0x5619917855d0 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.803+0000 7f9d14ff9640 1 -- 172.21.15.76:0/3743558749 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d180bce80 con 0x5619917855d0 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.803+0000 7f9d14ff9640 1 -- 172.21.15.76:0/3743558749 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d180bc0e0 con 0x5619917855d0 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3743558749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 msgr2=0x561991785a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9d100a33b0 0x7f9d100a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005fd0 tx=0x7f9d1c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991785a10 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9d180edaa0 tx=0x7f9d18037f50 comp rx=0 tx=0).stop 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3743558749 shutdown_connections 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991794780 0x561991796b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991785a10 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3743558749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991785090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3743558749 >> 172.21.15.76:0/3743558749 conn(0x56199174e310 msgr2=0x561991781c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3743558749 shutdown_connections 2024-09-19T08:00:13.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3743558749 wait complete. 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- start start 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 Processor -- start 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991794110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 0x5619917913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x561991791940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5619916eb2f0 con 0x561991786b40 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5619916a6060 con 0x5619917855d0 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561991797240 con 0x561991794780 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d2eb29740 10 client.0 _ll_register_callbacks cb 0x5619913f98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d29ceb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 0x5619917913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d29ceb640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 0x5619917913c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54756/0 (socket says 172.21.15.76:54756) 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.804+0000 7f9d29ceb640 1 -- 172.21.15.76:0/1003334074 learned_addr learned my addr 172.21.15.76:0/1003334074 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:13.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d2aced640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x561991791940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991794110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d29ceb640 1 -- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 msgr2=0x561991791940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x561991791940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d29ceb640 1 -- 172.21.15.76:0/1003334074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 msgr2=0x561991794110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991794110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d29ceb640 1 -- 172.21.15.76:0/1003334074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199145c3c0 con 0x561991786b40 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d2aced640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x561991791940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 0x5619917913c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000de80 tx=0x7f9d200117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1ebe53fa49caeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d0dffb640 1 -- 172.21.15.76:0/1003334074 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20005220 con 0x561991786b40 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d0dffb640 1 -- 172.21.15.76:0/1003334074 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7f9d200053c0 con 0x561991786b40 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d180bce80 con 0x561991786b40 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d0dffb640 1 -- 172.21.15.76:0/1003334074 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d200055c0 con 0x561991786b40 2024-09-19T08:00:13.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d2eb29740 10 client.17655 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5619917a2b50 con 0x561991786b40 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.805+0000 7f9d0dffb640 1 -- 172.21.15.76:0/1003334074 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d180bce80 con 0x561991786b40 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d0dffb640 1 -- 172.21.15.76:0/1003334074 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9d2001c430 con 0x561991786b40 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2eb29740 10 client.17655 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2eb29740 10 client.17655 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2eb29740 20 client.17655 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5619917a4100 0x5619917a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2eb29740 4 client.17655 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619916f8860 con 0x5619917a4100 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5619917a4100 0x5619917a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5619917a4100 0x5619917a64f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eef2e8325f0cbd56 server_cookie=5dd9e710a23be4c8 in_seq=0 out_seq=0 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.806+0000 7f9d0dffb640 10 client.17655 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:13.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d0dffb640 1 -- 172.21.15.76:0/1003334074 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619916f8860 con 0x5619917a4100 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d0dffb640 10 client.17655 handle_command_reply: tid=0 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 client.17655 shutdown 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 msgr2=0x5619917913c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 0x5619917913c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000de80 tx=0x7f9d200117b0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 shutdown_connections 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x5619917a4100 0x5619917a64f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x561991791940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991786b40 0x5619917913c0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/1003334074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991794110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 >> 172.21.15.76:0/1003334074 conn(0x56199174e310 msgr2=0x561991787960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d0dffb640 0 client.17655 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:13.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 shutdown_connections 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.807+0000 7f9d2eb29740 1 -- 172.21.15.76:0/1003334074 wait complete. 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.808+0000 7f9d2eb29740 20 client.17655 trim_cache size 0 max 16384 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 Processor -- start 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 -- start start 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991791390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991786b40 0x5619917a0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x5619917abde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241ae270 con 0x5619917855d0 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241abb40 con 0x561991786b40 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241a99b0 con 0x561991794780 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991791390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991791390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54762/0 (socket says 172.21.15.76:54762) 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3073384380 learned_addr learned my addr 172.21.15.76:0/3073384380 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991786b40 0x5619917a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x5619917abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3073384380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 msgr2=0x5619917abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x5619917abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3073384380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991786b40 msgr2=0x5619917a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.821+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991786b40 0x5619917a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.822+0000 7f9d2a4ec640 1 -- 172.21.15.76:0/3073384380 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619917852d0 con 0x5619917855d0 2024-09-19T08:00:13.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.822+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991791390 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9d180ee130 tx=0x7f9d18037f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e8bbfded79a98c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:13.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.822+0000 7f9d0ffff640 1 -- 172.21.15.76:0/3073384380 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18075070 con 0x5619917855d0 2024-09-19T08:00:13.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.822+0000 7f9d0ffff640 1 -- 172.21.15.76:0/3073384380 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d180bce80 con 0x5619917855d0 2024-09-19T08:00:13.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.822+0000 7f9d0ffff640 1 -- 172.21.15.76:0/3073384380 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18049040 con 0x5619917855d0 2024-09-19T08:00:13.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3073384380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 msgr2=0x561991791390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991791390 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9d180ee130 tx=0x7f9d18037f50 comp rx=0 tx=0).stop 2024-09-19T08:00:13.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3073384380 shutdown_connections 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991794780 0x5619917abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561991786b40 0x5619917a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3073384380 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619917855d0 0x561991791390 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3073384380 >> 172.21.15.76:0/3073384380 conn(0x56199174e310 msgr2=0x561991790c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3073384380 shutdown_connections 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3073384380 wait complete. 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- start start 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 Processor -- start 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991807110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991807650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 0x561991797a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241aa000 con 0x561991794780 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241ab470 con 0x5619917855d0 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9d241aa6d0 con 0x561991786b40 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.823+0000 7f9d2eb29740 10 client.0 _ll_register_callbacks cb 0x7f9d2000d3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 0x561991797a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 0x561991797a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54766/0 (socket says 172.21.15.76:54766) 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 -- 172.21.15.76:0/3461354018 learned_addr learned my addr 172.21.15.76:0/3461354018 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d29ceb640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991807650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991807110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 -- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 msgr2=0x561991807650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991807650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 -- 172.21.15.76:0/3461354018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 msgr2=0x561991807110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991807110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 -- 172.21.15.76:0/3461354018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561991788120 con 0x561991794780 2024-09-19T08:00:13.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991807110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2aced640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 0x561991797a70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0129f0 tx=0x7f9d1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37860954a385edd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d0dffb640 1 -- 172.21.15.76:0/3461354018 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c01eb80 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d0dffb640 1 -- 172.21.15.76:0/3461354018 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7f9d1c01ed20 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d180bce80 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d0dffb640 1 -- 172.21.15.76:0/3461354018 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d1c01b430 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2eb29740 10 client.17661 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.824+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56199180e730 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d0dffb640 1 -- 172.21.15.76:0/3461354018 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d180bce80 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d0dffb640 1 -- 172.21.15.76:0/3461354018 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9d1c01c8c0 con 0x561991794780 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2eb29740 10 client.17661 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2eb29740 10 client.17661 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:00:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2eb29740 20 client.17661 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56199180eed0 0x5619918112f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2eb29740 4 client.17661 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619916f2d70 con 0x56199180eed0 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56199180eed0 0x5619918112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d2a4ec640 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56199180eed0 0x5619918112f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d411d6056db0181c server_cookie=8a74bca9c24b9f0f in_seq=0 out_seq=0 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.825+0000 7f9d0dffb640 10 client.17661 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d0dffb640 1 -- 172.21.15.76:0/3461354018 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619916f2d70 con 0x56199180eed0 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d0dffb640 10 client.17661 handle_command_reply: tid=0 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 client.17661 shutdown 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 msgr2=0x561991797a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 0x561991797a70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0129f0 tx=0x7f9d1c004ab0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 shutdown_connections 2024-09-19T08:00:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x56199180eed0 0x5619918112f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561991794780 0x561991797a70 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561991786b40 0x561991807650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d0dffb640 0 client.17661 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 --2- 172.21.15.76:0/3461354018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619917855d0 0x561991807110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 >> 172.21.15.76:0/3461354018 conn(0x56199174e310 msgr2=0x56199178fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 shutdown_connections 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 1 -- 172.21.15.76:0/3461354018 wait complete. 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.826+0000 7f9d2eb29740 20 client.17661 trim_cache size 0 max 16384 2024-09-19T08:00:13.842 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9d100a33b0 msgr2=0x7f9d100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9d100a33b0 0x7f9d100a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005fd0 tx=0x7f9d1c004a40 comp rx=0 tx=0).stop 2024-09-19T08:00:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 msgr2=0x7f9d24198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d24198520 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006010 tx=0x7f9d180042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 shutdown_connections 2024-09-19T08:00:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f9d100a33b0 0x7f9d100a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24106f20 0x7f9d2419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d241027a0 0x7f9d24198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 --2- 172.21.15.76:0/3490135862 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9d24101df0 0x7f9d24198520 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 >> 172.21.15.76:0/3490135862 conn(0x7f9d240fd8f0 msgr2=0x7f9d240fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 shutdown_connections 2024-09-19T08:00:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:13.827+0000 7f9d2c750640 1 -- 172.21.15.76:0/3490135862 wait complete. 2024-09-19T08:00:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:14 smithi137 ceph-mon[35309]: pgmap v280: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:00:14.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:14 smithi076 ceph-mon[30930]: pgmap v280: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:00:14.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:14 smithi152 ceph-mon[35117]: pgmap v280: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 291 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:00:14.725 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:00:14.974 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:15.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 -- 172.21.15.76:0/3132345151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 msgr2=0x7f6c1810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3132345151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c1810d950 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009cd0 tx=0x7f6c1002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 -- 172.21.15.76:0/3132345151 shutdown_connections 2024-09-19T08:00:15.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3132345151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c1810d950 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3132345151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c18100a80 0x7f6c18100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3132345151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 0x7f6c18106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 -- 172.21.15.76:0/3132345151 >> 172.21.15.76:0/3132345151 conn(0x7f6c180fc7a0 msgr2=0x7f6c180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 -- 172.21.15.76:0/3132345151 shutdown_connections 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.866+0000 7f6c1d635640 1 -- 172.21.15.76:0/3132345151 wait complete. 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 Processor -- start 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 -- start start 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c18100a80 0x7f6c18198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c18198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 0x7f6c1819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18110fe0 con 0x7f6c18101420 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18110e60 con 0x7f6c18106a80 2024-09-19T08:00:15.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c1d635640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18111160 con 0x7f6c18100a80 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c167fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c18198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c167fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c18198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54788/0 (socket says 172.21.15.76:54788) 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.867+0000 7f6c167fc640 1 -- 172.21.15.76:0/3727487147 learned_addr learned my addr 172.21.15.76:0/3727487147 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c18100a80 0x7f6c18198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c177fe640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 0x7f6c1819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c167fc640 1 -- 172.21.15.76:0/3727487147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c18100a80 msgr2=0x7f6c18198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c167fc640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c18100a80 0x7f6c18198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c167fc640 1 -- 172.21.15.76:0/3727487147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 msgr2=0x7f6c1819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c167fc640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 0x7f6c1819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c167fc640 1 -- 172.21.15.76:0/3727487147 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1819d4e0 con 0x7f6c18101420 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c177fe640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 0x7f6c1819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c167fc640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c18198a70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b4a0 tx=0x7f6c0c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6bfffff640 1 -- 172.21.15.76:0/3727487147 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c015020 con 0x7f6c18101420 2024-09-19T08:00:15.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6bfffff640 1 -- 172.21.15.76:0/3727487147 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c0c011d30 con 0x7f6c18101420 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1819d7d0 con 0x7f6c18101420 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6bfffff640 1 -- 172.21.15.76:0/3727487147 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00f2e0 con 0x7f6c18101420 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.868+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c181a50b0 con 0x7f6c18101420 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.870+0000 7f6bfffff640 1 -- 172.21.15.76:0/3727487147 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6c0c018020 con 0x7f6c18101420 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 Processor -- start 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 -- start start 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a235d0 0x562f65a23a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a2e370 0x562f65a30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6bfffff640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c000a33b0 0x7f6c000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562f659892f0 con 0x562f65a24b40 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562f65930cf0 con 0x562f65a235d0 2024-09-19T08:00:15.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562f659852b0 con 0x562f65a2e370 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c167fc640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c000a33b0 0x7f6c000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a23090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54802/0 (socket says 172.21.15.76:54802) 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 -- 172.21.15.76:0/3535165364 learned_addr learned my addr 172.21.15.76:0/3535165364 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6bfffff640 1 -- 172.21.15.76:0/3727487147 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7f6c0c0cf5e0 con 0x7f6c18101420 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a235d0 0x562f65a23a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 -- 172.21.15.76:0/3535165364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a2e370 msgr2=0x562f65a30760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a2e370 0x562f65a30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 -- 172.21.15.76:0/3535165364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a235d0 msgr2=0x562f65a23a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a235d0 0x562f65a23a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c177fe640 1 -- 172.21.15.76:0/3535165364 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f659153a0 con 0x562f65a24b40 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.871+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a235d0 0x562f65a23a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:15.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.872+0000 7f6c167fc640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c000a33b0 0x7f6c000a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0cce40 tx=0x7f6c0c086040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.872+0000 7f6c177fe640 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a23090 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6c10005cc0 tx=0x7f6c10031590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd12b11c380b96df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.872+0000 7f6bfd7fa640 1 -- 172.21.15.76:0/3535165364 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10031bc0 con 0x562f65a24b40 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.872+0000 7f6bfd7fa640 1 -- 172.21.15.76:0/3535165364 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c10036040 con 0x562f65a24b40 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.872+0000 7f6bfd7fa640 1 -- 172.21.15.76:0/3535165364 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10004670 con 0x562f65a24b40 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/3535165364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 msgr2=0x562f65a23090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a23090 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6c10005cc0 tx=0x7f6c10031590 comp rx=0 tx=0).stop 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/3535165364 shutdown_connections 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a2e370 0x562f65a30760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a235d0 0x562f65a23a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/3535165364 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a23090 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/3535165364 >> 172.21.15.76:0/3535165364 conn(0x562f659ec310 msgr2=0x562f65a1fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/3535165364 shutdown_connections 2024-09-19T08:00:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/3535165364 wait complete. 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.873+0000 7f6c1fa0e740 1 -- start start 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 Processor -- start 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a2dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65a2b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562f65a31010 con 0x562f65a24b40 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562f65944060 con 0x562f65a2e370 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562f65a31190 con 0x562f65a235d0 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c1fa0e740 10 client.0 _ll_register_callbacks cb 0x562f656978c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54808/0 (socket says 172.21.15.76:54808) 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 -- 172.21.15.76:0/1312382993 learned_addr learned my addr 172.21.15.76:0/1312382993 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a2dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 -- 172.21.15.76:0/1312382993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 msgr2=0x562f65a2dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a2dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 -- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 msgr2=0x562f65a2b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65a2b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 -- 172.21.15.76:0/1312382993 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f656fa3c0 con 0x562f65a24b40 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a2dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2afb0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6c080117d0 tx=0x7f6c08011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef1d37d914d8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.874+0000 7f6bfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1312382993 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801f060 con 0x562f65a24b40 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1312382993 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7f6c0800fcd0 con 0x562f65a24b40 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c10036040 con 0x562f65a24b40 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1312382993 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6c08026050 con 0x562f65a24b40 2024-09-19T08:00:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 10 client.17673 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562f65a3ca10 con 0x562f65a24b40 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1312382993 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c10036040 con 0x562f65a24b40 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1312382993 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6c08018460 con 0x562f65a24b40 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 10 client.17673 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 10 client.17673 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 20 client.17673 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65a3df20 0x562f65a40360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 4 client.17673 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.875+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f65996860 con 0x562f65a3df20 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.876+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65a3df20 0x562f65a40360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.876+0000 7f6bfaff5640 10 client.17673 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.876+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65a3df20 0x562f65a40360 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0f2cf696656ba49 server_cookie=d608325290222f61 in_seq=0 out_seq=0 2024-09-19T08:00:15.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1312382993 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f65996860 con 0x562f65a3df20 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6bfaff5640 10 client.17673 handle_command_reply: tid=0 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 client.17673 shutdown 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 msgr2=0x562f65a2afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2afb0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6c080117d0 tx=0x7f6c08011c90 comp rx=0 tx=0).stop 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 shutdown_connections 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65a3df20 0x562f65a40360 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65a2b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2afb0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1312382993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a2dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 >> 172.21.15.76:0/1312382993 conn(0x562f659ec310 msgr2=0x562f65a25930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6bfaff5640 0 client.17673 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 shutdown_connections 2024-09-19T08:00:15.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1312382993 wait complete. 2024-09-19T08:00:15.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.877+0000 7f6c1fa0e740 20 client.17673 trim_cache size 0 max 16384 2024-09-19T08:00:15.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 Processor -- start 2024-09-19T08:00:15.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 -- start start 2024-09-19T08:00:15.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a3a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65a45c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181b04f0 con 0x562f65a24b40 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181addc0 con 0x562f65a2e370 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181abc30 con 0x562f65a235d0 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54810/0 (socket says 172.21.15.76:54810) 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 -- 172.21.15.76:0/2104125496 learned_addr learned my addr 172.21.15.76:0/2104125496 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 -- 172.21.15.76:0/2104125496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 msgr2=0x562f65a3a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a3a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 -- 172.21.15.76:0/2104125496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 msgr2=0x562f65a45c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65a45c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 -- 172.21.15.76:0/2104125496 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f65a20960 con 0x562f65a24b40 2024-09-19T08:00:15.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.890+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2a870 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6c08018830 tx=0x7f6c08011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef9800b20a75470 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6bfcff9640 1 -- 172.21.15.76:0/2104125496 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08018ca0 con 0x562f65a24b40 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6bfcff9640 1 -- 172.21.15.76:0/2104125496 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c08018340 con 0x562f65a24b40 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6bfcff9640 1 -- 172.21.15.76:0/2104125496 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08004660 con 0x562f65a24b40 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/2104125496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 msgr2=0x562f65a2a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2a870 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6c08018830 tx=0x7f6c08011f60 comp rx=0 tx=0).stop 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/2104125496 shutdown_connections 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65a45c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a24b40 0x562f65a2a870 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/2104125496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a235d0 0x562f65a3a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/2104125496 >> 172.21.15.76:0/2104125496 conn(0x562f659ec310 msgr2=0x562f65a26310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/2104125496 shutdown_connections 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.891+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/2104125496 wait complete. 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 -- start start 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 Processor -- start 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 0x562f65a31980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a24b40 0x562f65a31ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65aab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181ac280 con 0x562f65a235d0 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181ad6f0 con 0x562f65a2e370 2024-09-19T08:00:15.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c181ac950 con 0x562f65a24b40 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c1fa0e740 10 client.0 _ll_register_callbacks cb 0x7f6c0800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 0x562f65a31980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 0x562f65a31980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54814/0 (socket says 172.21.15.76:54814) 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 -- 172.21.15.76:0/1643661624 learned_addr learned my addr 172.21.15.76:0/1643661624 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a24b40 0x562f65a31ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 -- 172.21.15.76:0/1643661624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a24b40 msgr2=0x562f65a31ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a24b40 0x562f65a31ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 -- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 msgr2=0x562f65aab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65aab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 -- 172.21.15.76:0/1643661624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f65aab570 con 0x562f65a235d0 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.892+0000 7f6c177fe640 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 0x562f65a31980 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6c10031040 tx=0x7f6c10009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b2994afe147a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6bfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:15.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1643661624 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10031dd0 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1643661624 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8702+0+0 (secure 0 0 0) 0x7f6c10004360 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c08018340 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1643661624 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6c10004560 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 10 client.17679 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562f65aac870 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1643661624 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c08018340 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1643661624 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6c10030070 con 0x562f65a235d0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 10 client.17679 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 10 client.17679 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 20 client.17679 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65aacbb0 0x562f65aaefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 4 client.17679 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.893+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f65990d70 con 0x562f65aacbb0 2024-09-19T08:00:15.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65aacbb0 0x562f65aaefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6bfaff5640 10 client.17679 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c16ffd640 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65aacbb0 0x562f65aaefa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f121e91f8e1c4b15 server_cookie=1d0b3cab254bab85 in_seq=0 out_seq=0 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6bfaff5640 1 -- 172.21.15.76:0/1643661624 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f65990d70 con 0x562f65aacbb0 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6bfaff5640 10 client.17679 handle_command_reply: tid=0 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 client.17679 shutdown 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 msgr2=0x562f65a31980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 0x562f65a31980 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6c10031040 tx=0x7f6c10009c60 comp rx=0 tx=0).stop 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 shutdown_connections 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x562f65aacbb0 0x562f65aaefa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f65a2e370 0x562f65aab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f65a24b40 0x562f65a31ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 --2- 172.21.15.76:0/1643661624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562f65a235d0 0x562f65a31980 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 >> 172.21.15.76:0/1643661624 conn(0x562f659ec310 msgr2=0x562f65a2d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:15.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6bfaff5640 0 client.17679 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:15.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 shutdown_connections 2024-09-19T08:00:15.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.894+0000 7f6c1fa0e740 1 -- 172.21.15.76:0/1643661624 wait complete. 2024-09-19T08:00:15.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1fa0e740 20 client.17679 trim_cache size 0 max 16384 2024-09-19T08:00:15.901 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:15.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c000a33b0 msgr2=0x7f6c000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c000a33b0 0x7f6c000a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0cce40 tx=0x7f6c0c086040 comp rx=0 tx=0).stop 2024-09-19T08:00:15.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 msgr2=0x7f6c18198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c18198a70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b4a0 tx=0x7f6c0c00b8a0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 shutdown_connections 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f6c000a33b0 0x7f6c000a5870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c18106a80 0x7f6c1819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c18101420 0x7f6c18198a70 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 --2- 172.21.15.76:0/3727487147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c18100a80 0x7f6c18198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 >> 172.21.15.76:0/3727487147 conn(0x7f6c180fc7a0 msgr2=0x7f6c1806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 shutdown_connections 2024-09-19T08:00:15.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:15.895+0000 7f6c1d635640 1 -- 172.21.15.76:0/3727487147 wait complete. 2024-09-19T08:00:16.363 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:16 smithi152 ceph-mon[35117]: pgmap v281: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:16.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:16 smithi137 ceph-mon[35309]: pgmap v281: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:16.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:16 smithi076 ceph-mon[30930]: pgmap v281: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:16.536 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:00:16.790 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:17.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- 172.21.15.76:0/4113072744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 msgr2=0x7f7c10107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- 172.21.15.76:0/4113072744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c10107b90 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009930 tx=0x7f7bfc02a420 comp rx=0 tx=0).stop 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- 172.21.15.76:0/4113072744 shutdown_connections 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- 172.21.15.76:0/4113072744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c101082a0 0x7f7c1010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- 172.21.15.76:0/4113072744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c10107b90 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- 172.21.15.76:0/4113072744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c10102d30 0x7f7c10103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- 172.21.15.76:0/4113072744 >> 172.21.15.76:0/4113072744 conn(0x7f7c100fc7d0 msgr2=0x7f7c100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- 172.21.15.76:0/4113072744 shutdown_connections 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- 172.21.15.76:0/4113072744 wait complete. 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 Processor -- start 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- start start 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c10102d30 0x7f7c101a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c101a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c101082a0 0x7f7c1019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101121c0 con 0x7f7c101036e0 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10112040 con 0x7f7c10102d30 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.315+0000 7f7c16e22640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10112340 con 0x7f7c101082a0 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c101a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c101a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54830/0 (socket says 172.21.15.76:54830) 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 -- 172.21.15.76:0/1304917551 learned_addr learned my addr 172.21.15.76:0/1304917551 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:17.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c10102d30 0x7f7c101a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c153bf640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c101082a0 0x7f7c1019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 -- 172.21.15.76:0/1304917551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c101082a0 msgr2=0x7f7c1019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c101082a0 0x7f7c1019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 -- 172.21.15.76:0/1304917551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c10102d30 msgr2=0x7f7c101a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c10102d30 0x7f7c101a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 -- 172.21.15.76:0/1304917551 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1019aeb0 con 0x7f7c101036e0 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c101a0ab0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc004770 tx=0x7f7bfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0dffb640 1 -- 172.21.15.76:0/1304917551 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc03f030 con 0x7f7c101036e0 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1019b140 con 0x7f7c101036e0 2024-09-19T08:00:17.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0dffb640 1 -- 172.21.15.76:0/1304917551 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bfc003d00 con 0x7f7c101036e0 2024-09-19T08:00:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c0dffb640 1 -- 172.21.15.76:0/1304917551 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc035070 con 0x7f7c101036e0 2024-09-19T08:00:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.316+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c101a7320 con 0x7f7c101036e0 2024-09-19T08:00:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c0dffb640 1 -- 172.21.15.76:0/1304917551 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7bfc042030 con 0x7f7c101036e0 2024-09-19T08:00:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 Processor -- start 2024-09-19T08:00:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 -- start start 2024-09-19T08:00:17.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290ca5d0 0x555b290caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 0x555b290d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555b290302f0 con 0x555b290d5370 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555b28fd7cf0 con 0x555b290cbb40 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c191fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555b2902c2b0 con 0x555b290ca5d0 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 0x555b290d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 0x555b290d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54846/0 (socket says 172.21.15.76:54846) 2024-09-19T08:00:17.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c0ffff640 1 -- 172.21.15.76:0/2203892289 learned_addr learned my addr 172.21.15.76:0/2203892289 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c0dffb640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7c000a33b0 0x7f7c000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.319+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290ca5d0 0x555b290caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c153bf640 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c153bf640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7c000a33b0 0x7f7c000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0dffb640 1 -- 172.21.15.76:0/1304917551 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f7bfc0f0310 con 0x7f7c101036e0 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0ffff640 1 -- 172.21.15.76:0/2203892289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290ca5d0 msgr2=0x555b290caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290ca5d0 0x555b290caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0ffff640 1 -- 172.21.15.76:0/2203892289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 msgr2=0x555b290ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0ffff640 1 -- 172.21.15.76:0/2203892289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b28fbc3a0 con 0x555b290d5370 2024-09-19T08:00:17.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290ca5d0 0x555b290caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:00:17.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 0x555b290d7760 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0c4c40 tx=0x7f7bfc0b8700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2569429dadc1cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:17.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7c153bf640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7c000a33b0 0x7f7c000a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800bfd0 tx=0x7f7c08004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:17.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7bfaffd640 1 -- 172.21.15.76:0/2203892289 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc049070 con 0x555b290d5370 2024-09-19T08:00:17.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7bfaffd640 1 -- 172.21.15.76:0/2203892289 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bfc0bcc00 con 0x555b290d5370 2024-09-19T08:00:17.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.320+0000 7f7bfaffd640 1 -- 172.21.15.76:0/2203892289 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0b8b70 con 0x555b290d5370 2024-09-19T08:00:17.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 -- 172.21.15.76:0/2203892289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 msgr2=0x555b290d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 0x555b290d7760 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0c4c40 tx=0x7f7bfc0b8700 comp rx=0 tx=0).stop 2024-09-19T08:00:17.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 -- 172.21.15.76:0/2203892289 shutdown_connections 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290d5370 0x555b290d7760 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290ca5d0 0x555b290caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 --2- 172.21.15.76:0/2203892289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 -- 172.21.15.76:0/2203892289 >> 172.21.15.76:0/2203892289 conn(0x555b29093310 msgr2=0x555b290c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 -- 172.21.15.76:0/2203892289 shutdown_connections 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 -- 172.21.15.76:0/2203892289 wait complete. 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 -- start start 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.321+0000 7f7c191fb740 1 Processor -- start 2024-09-19T08:00:17.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290d5370 0x555b290d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555b290d7e30 con 0x555b290ca5d0 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555b28feb060 con 0x555b290cbb40 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555b290d7fb0 con 0x555b290d5370 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c191fb740 10 client.0 _ll_register_callbacks cb 0x555b28d3e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290d4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54848/0 (socket says 172.21.15.76:54848) 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1244171183 learned_addr learned my addr 172.21.15.76:0/1244171183 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c153bf640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290d5370 0x555b290d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290d5370 msgr2=0x555b290d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290d5370 0x555b290d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1244171183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 msgr2=0x555b290d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.322+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1244171183 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b28da13c0 con 0x555b290ca5d0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290d4dc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400baa0 tx=0x7f7c0400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52a7182d65e4403 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7beffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7beffff640 1 -- 172.21.15.76:0/1244171183 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04003df0 con 0x555b290ca5d0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7beffff640 1 -- 172.21.15.76:0/1244171183 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f7c04011440 con 0x555b290ca5d0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bfc0bcc00 con 0x555b290ca5d0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7beffff640 1 -- 172.21.15.76:0/1244171183 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7c04011640 con 0x555b290ca5d0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 10 client.17691 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555b290e3890 con 0x555b290ca5d0 2024-09-19T08:00:17.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7beffff640 1 -- 172.21.15.76:0/1244171183 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bfc0bcc00 con 0x555b290ca5d0 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7beffff640 1 -- 172.21.15.76:0/1244171183 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7c040229f0 con 0x555b290ca5d0 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 10 client.17691 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 10 client.17691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 20 client.17691 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b290e4d50 0x555b290e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 4 client.17691 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.323+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b2903d860 con 0x555b290e4d50 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.324+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b290e4d50 0x555b290e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.324+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b290e4d50 0x555b290e71f0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=251e000114ad2ca9 server_cookie=47b6ea41d4c08b97 in_seq=0 out_seq=0 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.324+0000 7f7beffff640 10 client.17691 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7beffff640 1 -- 172.21.15.76:0/1244171183 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b2903d860 con 0x555b290e4d50 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7beffff640 10 client.17691 handle_command_reply: tid=0 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 client.17691 shutdown 2024-09-19T08:00:17.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 msgr2=0x555b290d4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290d4dc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400baa0 tx=0x7f7c0400bea0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 shutdown_connections 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290d5370 0x555b290d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290cbb40 0x555b290d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b290e4d50 0x555b290e71f0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1244171183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290d4dc0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7beffff640 0 client.17691 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 >> 172.21.15.76:0/1244171183 conn(0x555b29093310 msgr2=0x555b290cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 shutdown_connections 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 1 -- 172.21.15.76:0/1244171183 wait complete. 2024-09-19T08:00:17.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.325+0000 7f7c191fb740 20 client.17691 trim_cache size 0 max 16384 2024-09-19T08:00:17.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 Processor -- start 2024-09-19T08:00:17.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 -- start start 2024-09-19T08:00:17.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101b26e0 con 0x555b290ca5d0 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101affb0 con 0x555b290d5370 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.338+0000 7f7c191fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ade20 con 0x555b290cbb40 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54854/0 (socket says 172.21.15.76:54854) 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 -- 172.21.15.76:0/86838710 learned_addr learned my addr 172.21.15.76:0/86838710 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c153bf640 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 -- 172.21.15.76:0/86838710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 msgr2=0x555b290cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 -- 172.21.15.76:0/86838710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 msgr2=0x555b290ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290ecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 -- 172.21.15.76:0/86838710 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b290e7870 con 0x555b290ca5d0 2024-09-19T08:00:17.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c153bf640 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:17.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290cd120 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7c040043e0 tx=0x7f7c040115d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b335679a241d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:17.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7bfa7fc640 1 -- 172.21.15.76:0/86838710 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400b400 con 0x555b290ca5d0 2024-09-19T08:00:17.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7bfa7fc640 1 -- 172.21.15.76:0/86838710 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c0401bd40 con 0x555b290ca5d0 2024-09-19T08:00:17.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.339+0000 7f7bfa7fc640 1 -- 172.21.15.76:0/86838710 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011d30 con 0x555b290ca5d0 2024-09-19T08:00:17.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 -- 172.21.15.76:0/86838710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 msgr2=0x555b290cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290cd120 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7c040043e0 tx=0x7f7c040115d0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 -- 172.21.15.76:0/86838710 shutdown_connections 2024-09-19T08:00:17.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 --2- 172.21.15.76:0/86838710 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290cd120 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 -- 172.21.15.76:0/86838710 >> 172.21.15.76:0/86838710 conn(0x555b29093310 msgr2=0x555b290d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 -- 172.21.15.76:0/86838710 shutdown_connections 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 -- 172.21.15.76:0/86838710 wait complete. 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 -- start start 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.340+0000 7f7c191fb740 1 Processor -- start 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ae470 con 0x555b290ca5d0 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101af8e0 con 0x555b290d5370 2024-09-19T08:00:17.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101aeb40 con 0x555b290cbb40 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c191fb740 10 client.0 _ll_register_callbacks cb 0x7f7c040040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290dd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54864/0 (socket says 172.21.15.76:54864) 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1488089638 learned_addr learned my addr 172.21.15.76:0/1488089638 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c153bf640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 msgr2=0x555b290cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1488089638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 msgr2=0x555b290cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 -- 172.21.15.76:0/1488089638 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b290cffb0 con 0x555b290ca5d0 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:17.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7c14bbe640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290dd900 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400bee0 tx=0x7f7c04011530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64c5a44c4462f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.341+0000 7f7beffff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7beffff640 1 -- 172.21.15.76:0/1488089638 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0401b420 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7beffff640 1 -- 172.21.15.76:0/1488089638 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f7c0401b5c0 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c0401bd40 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7beffff640 1 -- 172.21.15.76:0/1488089638 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7c04041050 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 10 client.17697 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555b2914fae0 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7beffff640 1 -- 172.21.15.76:0/1488089638 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c0401bd40 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7beffff640 1 -- 172.21.15.76:0/1488089638 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7c0403c030 con 0x555b290ca5d0 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 10 client.17697 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 10 client.17697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 20 client.17697 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:17.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b29150190 0x555b29152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 4 client.17697 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b29037d70 con 0x555b29150190 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.342+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b29150190 0x555b29152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c0ffff640 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b29150190 0x555b29152580 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbe91cb11b13edc0 server_cookie=2be2854399acc053 in_seq=0 out_seq=0 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7beffff640 10 client.17697 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7beffff640 1 -- 172.21.15.76:0/1488089638 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b29037d70 con 0x555b29150190 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7beffff640 10 client.17697 handle_command_reply: tid=0 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 client.17697 shutdown 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 msgr2=0x555b290dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290dd900 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400bee0 tx=0x7f7c04011530 comp rx=0 tx=0).stop 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 shutdown_connections 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555b290d5370 0x555b290cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555b290cbb40 0x555b290cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x555b29150190 0x555b29152580 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 --2- 172.21.15.76:0/1488089638 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555b290ca5d0 0x555b290dd900 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7beffff640 0 client.17697 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.343+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 >> 172.21.15.76:0/1488089638 conn(0x555b29093310 msgr2=0x555b290c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 shutdown_connections 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c191fb740 1 -- 172.21.15.76:0/1488089638 wait complete. 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c191fb740 20 client.17697 trim_cache size 0 max 16384 2024-09-19T08:00:17.361 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7c000a33b0 msgr2=0x7f7c000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7c000a33b0 0x7f7c000a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800bfd0 tx=0x7f7c08004a40 comp rx=0 tx=0).stop 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 msgr2=0x7f7c101a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c101a0ab0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc004770 tx=0x7f7bfc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 shutdown_connections 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f7c000a33b0 0x7f7c000a5870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c101082a0 0x7f7c1019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c101036e0 0x7f7c101a0ab0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 --2- 172.21.15.76:0/1304917551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c10102d30 0x7f7c101a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:17.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 >> 172.21.15.76:0/1304917551 conn(0x7f7c100fc7d0 msgr2=0x7f7c10101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:17.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 shutdown_connections 2024-09-19T08:00:17.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:17.344+0000 7f7c16e22640 1 -- 172.21.15.76:0/1304917551 wait complete. 2024-09-19T08:00:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:18 smithi152 ceph-mon[35117]: pgmap v282: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:18 smithi152 ceph-mon[35117]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:00:18.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:18 smithi137 ceph-mon[35309]: pgmap v282: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:18 smithi137 ceph-mon[35309]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:00:18.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:18 smithi076 ceph-mon[30930]: pgmap v282: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:18.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:18 smithi076 ceph-mon[30930]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:00:19.096 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:00:19.097 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:00:19.361 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:19.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 -- 172.21.15.76:0/533494863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 msgr2=0x7f34e8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 --2- 172.21.15.76:0/533494863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e8100ee0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009930 tx=0x7f34dc02a420 comp rx=0 tx=0).stop 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 -- 172.21.15.76:0/533494863 shutdown_connections 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 --2- 172.21.15.76:0/533494863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8101420 0x7f34e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 --2- 172.21.15.76:0/533494863 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e8100ee0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 --2- 172.21.15.76:0/533494863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8106a80 0x7f34e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 -- 172.21.15.76:0/533494863 >> 172.21.15.76:0/533494863 conn(0x7f34e80fc7a0 msgr2=0x7f34e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 -- 172.21.15.76:0/533494863 shutdown_connections 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.824+0000 7f34ecf49640 1 -- 172.21.15.76:0/533494863 wait complete. 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.825+0000 7f34ecf49640 1 Processor -- start 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.825+0000 7f34ecf49640 1 -- start start 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.825+0000 7f34ecf49640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e81973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8101420 0x7f34e8197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8106a80 0x7f34e819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8110fa0 con 0x7f34e8100a80 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8110e20 con 0x7f34e8106a80 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8111120 con 0x7f34e8101420 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e81973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e81973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54894/0 (socket says 172.21.15.76:54894) 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 -- 172.21.15.76:0/195216553 learned_addr learned my addr 172.21.15.76:0/195216553 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8101420 0x7f34e8197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8106a80 0x7f34e819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 -- 172.21.15.76:0/195216553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8101420 msgr2=0x7f34e8197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8101420 0x7f34e8197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 -- 172.21.15.76:0/195216553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8106a80 msgr2=0x7f34e819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8106a80 0x7f34e819bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 -- 172.21.15.76:0/195216553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e819c370 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8106a80 0x7f34e819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34e659c640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e81973c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f34d800d950 tx=0x7f34d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34d77fe640 1 -- 172.21.15.76:0/195216553 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8017030 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e819c660 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34d77fe640 1 -- 172.21.15.76:0/195216553 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34d8004020 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34d77fe640 1 -- 172.21.15.76:0/195216553 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8004a00 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.826+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e81a3f40 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34d77fe640 1 -- 172.21.15.76:0/195216553 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f34d80041d0 con 0x7f34e8100a80 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 Processor -- start 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 -- start start 2024-09-19T08:00:19.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d2899b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d2899c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d28991b280 con 0x55d2899b6300 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d2898c2b10 con 0x55d2899b59e0 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34ef322740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d289917240 con 0x55d2899c2f50 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34d77fe640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34d00a33b0 0x7f34d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d2899c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d2899c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54900/0 (socket says 172.21.15.76:54900) 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.829+0000 7f34e659c640 1 -- 172.21.15.76:0/1415122114 learned_addr learned my addr 172.21.15.76:0/1415122114 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d2899b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34d00a33b0 0x7f34d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34d77fe640 1 -- 172.21.15.76:0/195216553 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f34d80cf800 con 0x7f34e8100a80 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e659c640 1 -- 172.21.15.76:0/1415122114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 msgr2=0x55d2899c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e659c640 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e659c640 1 -- 172.21.15.76:0/1415122114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 msgr2=0x55d2899b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e659c640 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d2899b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e659c640 1 -- 172.21.15.76:0/1415122114 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2898cf1f0 con 0x55d2899b6300 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e659c640 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d2899c2a10 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f34d8097eb0 tx=0x7f34d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569dead5d8d2c34e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34d00a33b0 0x7f34d00a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34e0005fd0 tx=0x7f34e0005f40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34d4ff9640 1 -- 172.21.15.76:0/1415122114 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d809c150 con 0x55d2899b6300 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34d4ff9640 1 -- 172.21.15.76:0/1415122114 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34d800e350 con 0x55d2899b6300 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.830+0000 7f34d4ff9640 1 -- 172.21.15.76:0/1415122114 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80860b0 con 0x55d2899b6300 2024-09-19T08:00:19.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 -- 172.21.15.76:0/1415122114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 msgr2=0x55d2899c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d2899c2a10 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f34d8097eb0 tx=0x7f34d8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 -- 172.21.15.76:0/1415122114 shutdown_connections 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d2899c2a10 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 --2- 172.21.15.76:0/1415122114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d2899b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 -- 172.21.15.76:0/1415122114 >> 172.21.15.76:0/1415122114 conn(0x55d2899b20f0 msgr2=0x55d2899b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 -- 172.21.15.76:0/1415122114 shutdown_connections 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 -- 172.21.15.76:0/1415122114 wait complete. 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.831+0000 7f34ef322740 1 -- start start 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 Processor -- start 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899bff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899b6300 0x55d2899c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899c2f50 0x55d2899c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55d2899c5ac0 con 0x55d2899b59e0 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d2898d5f10 con 0x55d2899c2f50 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d2899c5c40 con 0x55d2899b6300 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 10 client.0 _ll_register_callbacks cb 0x55d28989ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899bff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54908/0 (socket says 172.21.15.76:54908) 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 -- 172.21.15.76:0/3446817100 learned_addr learned my addr 172.21.15.76:0/3446817100 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 -- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899b6300 msgr2=0x55d2899c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899b6300 0x55d2899c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 -- 172.21.15.76:0/3446817100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899c2f50 msgr2=0x55d2899c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899c2f50 0x55d2899c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 -- 172.21.15.76:0/3446817100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d28968c6a0 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34e659c640 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899bff80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f34d80ccf70 tx=0x7f34d8005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9962978dca0fe1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34cdffb640 1 -- 172.21.15.76:0/3446817100 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d809fe00 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34cdffb640 1 -- 172.21.15.76:0/3446817100 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f34d80980c0 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.832+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d800e350 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34cdffb640 1 -- 172.21.15.76:0/3446817100 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f34d80a46c0 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 10 client.17709 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d2899d1850 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34cdffb640 1 -- 172.21.15.76:0/3446817100 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34d800e350 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34cdffb640 1 -- 172.21.15.76:0/3446817100 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f34d80b4020 con 0x55d2899b59e0 2024-09-19T08:00:19.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 10 client.17709 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 10 client.17709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 20 client.17709 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d2899d2ba0 0x55d2899d4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 4 client.17709 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2899287f0 con 0x55d2899d2ba0 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.833+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d2899d2ba0 0x55d2899d4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.834+0000 7f34cdffb640 10 client.17709 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.834+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d2899d2ba0 0x55d2899d4f90 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b16387453505d06 server_cookie=79ad5a1de13b2bba in_seq=0 out_seq=0 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34cdffb640 1 -- 172.21.15.76:0/3446817100 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2899287f0 con 0x55d2899d2ba0 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34cdffb640 10 client.17709 handle_command_reply: tid=0 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 client.17709 shutdown 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 msgr2=0x55d2899bff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899bff80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f34d80ccf70 tx=0x7f34d8005650 comp rx=0 tx=0).stop 2024-09-19T08:00:19.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 shutdown_connections 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899c2f50 0x55d2899c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899b6300 0x55d2899c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d2899d2ba0 0x55d2899d4f90 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 --2- 172.21.15.76:0/3446817100 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899bff80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 >> 172.21.15.76:0/3446817100 conn(0x55d2899b20f0 msgr2=0x55d2899b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34cdffb640 0 client.17709 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 shutdown_connections 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 1 -- 172.21.15.76:0/3446817100 wait complete. 2024-09-19T08:00:19.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.835+0000 7f34ef322740 20 client.17709 trim_cache size 0 max 16384 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 Processor -- start 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 -- start start 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b6300 0x55d2899d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899d8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81ae2a0 con 0x55d2899b59e0 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81abb70 con 0x55d2899b6300 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.852+0000 7f34ef322740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81a99e0 con 0x55d2899c2f50 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54910/0 (socket says 172.21.15.76:54910) 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 -- 172.21.15.76:0/1079441165 learned_addr learned my addr 172.21.15.76:0/1079441165 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899d8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b6300 0x55d2899d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 -- 172.21.15.76:0/1079441165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 msgr2=0x55d2899d8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899d8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 -- 172.21.15.76:0/1079441165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b6300 msgr2=0x55d2899d7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b6300 0x55d2899d7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 -- 172.21.15.76:0/1079441165 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2899bef30 con 0x55d2899b59e0 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34e659c640 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899ce5a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f34d8099d00 tx=0x7f34d8099f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6317189b76465d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:19.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34cffff640 1 -- 172.21.15.76:0/1079441165 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d809bcb0 con 0x55d2899b59e0 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34cffff640 1 -- 172.21.15.76:0/1079441165 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34d800e350 con 0x55d2899b59e0 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.853+0000 7f34cffff640 1 -- 172.21.15.76:0/1079441165 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80a4280 con 0x55d2899b59e0 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- 172.21.15.76:0/1079441165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 msgr2=0x55d2899ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899ce5a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f34d8099d00 tx=0x7f34d8099f60 comp rx=0 tx=0).stop 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- 172.21.15.76:0/1079441165 shutdown_connections 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d2899d8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b6300 0x55d2899d7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- 172.21.15.76:0/1079441165 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b59e0 0x55d2899ce5a0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- 172.21.15.76:0/1079441165 >> 172.21.15.76:0/1079441165 conn(0x55d2899b20f0 msgr2=0x55d2899cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- 172.21.15.76:0/1079441165 shutdown_connections 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- 172.21.15.76:0/1079441165 wait complete. 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- start start 2024-09-19T08:00:19.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 Processor -- start 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d289a33480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d289a339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d289a33f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.854+0000 7f34ef322740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81aa030 con 0x55d2899b6300 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34ef322740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81ab4a0 con 0x55d2899b59e0 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34ef322740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81aa700 con 0x55d2899c2f50 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34ef322740 10 client.0 _ll_register_callbacks cb 0x7f34e000add0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d289a339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d289a339c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54922/0 (socket says 172.21.15.76:54922) 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 -- 172.21.15.76:0/4158230981 learned_addr learned my addr 172.21.15.76:0/4158230981 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e6d9d640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d289a33f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e659c640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d289a33480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 -- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 msgr2=0x55d289a33f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d289a33f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 -- 172.21.15.76:0/4158230981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 msgr2=0x55d289a33480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d289a33480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 -- 172.21.15.76:0/4158230981 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d289a3e750 con 0x55d2899b6300 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e659c640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d289a33480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34e5d9b640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d289a339c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f34dc02a940 tx=0x7f34dc032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f128216b3f76c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34cdffb640 1 -- 172.21.15.76:0/4158230981 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc035040 con 0x55d2899b6300 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34cdffb640 1 -- 172.21.15.76:0/4158230981 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f34dc004450 con 0x55d2899b6300 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.855+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d800e350 con 0x55d2899b6300 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34cdffb640 1 -- 172.21.15.76:0/4158230981 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f34dc052050 con 0x55d2899b6300 2024-09-19T08:00:19.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 10 client.17715 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d289a3fb20 con 0x55d2899b6300 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34cdffb640 1 -- 172.21.15.76:0/4158230981 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34d800e350 con 0x55d2899b6300 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34cdffb640 1 -- 172.21.15.76:0/4158230981 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f34dc031640 con 0x55d2899b6300 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 10 client.17715 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 10 client.17715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 20 client.17715 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d289a40280 0x55d289a426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 4 client.17715 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d289922d00 con 0x55d289a40280 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.856+0000 7f34e659c640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d289a40280 0x55d289a426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.857+0000 7f34e659c640 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d289a40280 0x55d289a426a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ef89385475fd6c server_cookie=15ab594af239888f in_seq=0 out_seq=0 2024-09-19T08:00:19.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.857+0000 7f34cdffb640 10 client.17715 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:19.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34cdffb640 1 -- 172.21.15.76:0/4158230981 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d289922d00 con 0x55d289a40280 2024-09-19T08:00:19.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34cdffb640 10 client.17715 handle_command_reply: tid=0 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 client.17715 shutdown 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 msgr2=0x55d289a339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d289a339c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f34dc02a940 tx=0x7f34dc032d60 comp rx=0 tx=0).stop 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 shutdown_connections 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d2899c2f50 0x55d289a33f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55d289a40280 0x55d289a426a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2899b6300 0x55d289a339c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34cdffb640 0 client.17715 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 --2- 172.21.15.76:0/4158230981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d2899b59e0 0x55d289a33480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 >> 172.21.15.76:0/4158230981 conn(0x55d2899b20f0 msgr2=0x55d2899b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 shutdown_connections 2024-09-19T08:00:19.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 1 -- 172.21.15.76:0/4158230981 wait complete. 2024-09-19T08:00:19.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.858+0000 7f34ef322740 20 client.17715 trim_cache size 0 max 16384 2024-09-19T08:00:19.865 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:00:19.865 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T08:00:19.865 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "38e2d432-a063-4137-9368-ea63308313ca", 2024-09-19T08:00:19.865 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T08:00:19.865 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34d00a33b0 msgr2=0x7f34d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34d00a33b0 0x7f34d00a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34e0005fd0 tx=0x7f34e0005f40 comp rx=0 tx=0).stop 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 msgr2=0x7f34e81973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e81973c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f34d800d950 tx=0x7f34d800de10 comp rx=0 tx=0).stop 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 shutdown_connections 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f34d00a33b0 0x7f34d00a5870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34e8106a80 0x7f34e819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34e8101420 0x7f34e8197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 --2- 172.21.15.76:0/195216553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f34e8100a80 0x7f34e81973c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:19.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 >> 172.21.15.76:0/195216553 conn(0x7f34e80fc7a0 msgr2=0x7f34e80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:19.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 shutdown_connections 2024-09-19T08:00:19.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:19.859+0000 7f34ecf49640 1 -- 172.21.15.76:0/195216553 wait complete. 2024-09-19T08:00:20.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:20 smithi152 ceph-mon[35117]: pgmap v284: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 208 B/s wr, 6 op/s 2024-09-19T08:00:20.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:20 smithi137 ceph-mon[35309]: pgmap v284: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 208 B/s wr, 6 op/s 2024-09-19T08:00:20.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:20 smithi076 ceph-mon[30930]: pgmap v284: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 208 B/s wr, 6 op/s 2024-09-19T08:00:20.686 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:00:20.933 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:21.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:21 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T08:00:21.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:21 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:21.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:21 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T08:00:21.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:21 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:21.333 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:21 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T08:00:21.333 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:21 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:21.333 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:21 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T08:00:21.334 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:21 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:21.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:21 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T08:00:21.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:21 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:21.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:21 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T08:00:21.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:21 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- 172.21.15.76:0/4184535054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc100e20 msgr2=0x7fd3bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/4184535054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc100e20 0x7fd3bc101200 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009900 tx=0x7fd3b002a480 comp rx=0 tx=0).stop 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- 172.21.15.76:0/4184535054 shutdown_connections 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/4184535054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 0x7fd3bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/4184535054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc102570 0x7fd3bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/4184535054 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc100e20 0x7fd3bc101200 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- 172.21.15.76:0/4184535054 >> 172.21.15.76:0/4184535054 conn(0x7fd3bc0fc7d0 msgr2=0x7fd3bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:21.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- 172.21.15.76:0/4184535054 shutdown_connections 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- 172.21.15.76:0/4184535054 wait complete. 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 Processor -- start 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- start start 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc100e20 0x7fd3bc198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 0x7fd3bc198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 0x7fd3bc19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc111160 con 0x7fd3bc102570 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc110fe0 con 0x7fd3bc102ef0 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.414+0000 7fd3c2d69640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1112e0 con 0x7fd3bc100e20 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 0x7fd3bc198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 0x7fd3bc198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54946/0 (socket says 172.21.15.76:54946) 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 -- 172.21.15.76:0/3142446138 learned_addr learned my addr 172.21.15.76:0/3142446138 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:21.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc100e20 0x7fd3bc198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3c1306640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 0x7fd3bc19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 -- 172.21.15.76:0/3142446138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc100e20 msgr2=0x7fd3bc198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc100e20 0x7fd3bc198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 -- 172.21.15.76:0/3142446138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 msgr2=0x7fd3bc19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 0x7fd3bc19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 -- 172.21.15.76:0/3142446138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc19d620 con 0x7fd3bc102570 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc100e20 0x7fd3bc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3c1306640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 0x7fd3bc19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 0x7fd3bc198bb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800b4a0 tx=0x7fd3a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3b9ffb640 1 -- 172.21.15.76:0/3142446138 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8014070 con 0x7fd3bc102570 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc19d910 con 0x7fd3bc102570 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3b9ffb640 1 -- 172.21.15.76:0/3142446138 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3a8010b10 con 0x7fd3bc102570 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.415+0000 7fd3b9ffb640 1 -- 172.21.15.76:0/3142446138 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8017d60 con 0x7fd3bc102570 2024-09-19T08:00:21.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.416+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc1a51f0 con 0x7fd3bc102570 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3b9ffb640 1 -- 172.21.15.76:0/3142446138 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd3a8017070 con 0x7fd3bc102570 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 Processor -- start 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 -- start start 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3b9ffb640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd3ac0a33b0 0x7fd3ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x557624062880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x55762406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 0x55762406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c1306640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd3ac0a33b0 0x7fd3ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557623fc82e0 con 0x55762406d680 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557623f6fce0 con 0x5576240624a0 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3c5142740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557623fc42a0 con 0x557624062dc0 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.418+0000 7fd3b9ffb640 1 -- 172.21.15.76:0/3142446138 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fd3a80cf0f0 con 0x7fd3bc102570 2024-09-19T08:00:21.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 0x55762406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 0x55762406fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54956/0 (socket says 172.21.15.76:54956) 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 -- 172.21.15.76:0/2537616195 learned_addr learned my addr 172.21.15.76:0/2537616195 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x557624062880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x55762406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd3ac0a33b0 0x7fd3ac0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c8c0 tx=0x7fd3b400ccc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 -- 172.21.15.76:0/2537616195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 msgr2=0x55762406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x55762406d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 -- 172.21.15.76:0/2537616195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 msgr2=0x557624062880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x557624062880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 -- 172.21.15.76:0/2537616195 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557623f54440 con 0x55762406d680 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x557624062880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3c1306640 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 0x55762406fa70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4007b90 tx=0x7fd3b401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8706b6757b2c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3a6ffd640 1 -- 172.21.15.76:0/2537616195 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b401cd80 con 0x55762406d680 2024-09-19T08:00:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3a6ffd640 1 -- 172.21.15.76:0/2537616195 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b4020070 con 0x55762406d680 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.419+0000 7fd3a6ffd640 1 -- 172.21.15.76:0/2537616195 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40236e0 con 0x55762406d680 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 -- 172.21.15.76:0/2537616195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 msgr2=0x55762406fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 0x55762406fa70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4007b90 tx=0x7fd3b401d000 comp rx=0 tx=0).stop 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 -- 172.21.15.76:0/2537616195 shutdown_connections 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55762406d680 0x55762406fa70 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x55762406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 --2- 172.21.15.76:0/2537616195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x557624062880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 -- 172.21.15.76:0/2537616195 >> 172.21.15.76:0/2537616195 conn(0x55762405ea30 msgr2=0x55762405ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 -- 172.21.15.76:0/2537616195 shutdown_connections 2024-09-19T08:00:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 -- 172.21.15.76:0/2537616195 wait complete. 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 -- start start 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.420+0000 7fd3c5142740 1 Processor -- start 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x55762406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x55762406a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55762406d680 0x55762406a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557624070250 con 0x557624062dc0 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557623f83050 con 0x5576240624a0 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5576240703d0 con 0x55762406d680 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c5142740 10 client.0 _ll_register_callbacks cb 0x557623fc3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x55762406a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x55762406a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54958/0 (socket says 172.21.15.76:54958) 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 -- 172.21.15.76:0/636147876 learned_addr learned my addr 172.21.15.76:0/636147876 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:21.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 -- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55762406d680 msgr2=0x55762406a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55762406d680 0x55762406a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x55762406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 -- 172.21.15.76:0/636147876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 msgr2=0x55762406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x55762406cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 -- 172.21.15.76:0/636147876 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557623d393c0 con 0x557624062dc0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x55762406a1e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80ccdb0 tx=0x7fd3a8017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7725e170d351c020 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.421+0000 7fd39bfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd39bfff640 1 -- 172.21.15.76:0/636147876 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80b4060 con 0x557624062dc0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd39bfff640 1 -- 172.21.15.76:0/636147876 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fd3a80cca30 con 0x557624062dc0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b4020070 con 0x557624062dc0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd39bfff640 1 -- 172.21.15.76:0/636147876 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd3a801e070 con 0x557624062dc0 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 10 client.17727 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:21.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55762407bbd0 con 0x557624062dc0 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd39bfff640 1 -- 172.21.15.76:0/636147876 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b4020070 con 0x557624062dc0 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd39bfff640 1 -- 172.21.15.76:0/636147876 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd3a80b4290 con 0x557624062dc0 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 10 client.17727 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 10 client.17727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 20 client.17727 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762407d090 0x55762407f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 4 client.17727 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.422+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557623fd5850 con 0x55762407d090 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.423+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762407d090 0x55762407f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.423+0000 7fd39bfff640 10 client.17727 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.423+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762407d090 0x55762407f520 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce61dde2bcd86f28 server_cookie=739586316ce5dd9d in_seq=0 out_seq=0 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd39bfff640 1 -- 172.21.15.76:0/636147876 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557623fd5850 con 0x55762407d090 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd39bfff640 10 client.17727 handle_command_reply: tid=0 2024-09-19T08:00:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 client.17727 shutdown 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 msgr2=0x55762406a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x55762406a1e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80ccdb0 tx=0x7fd3a8017360 comp rx=0 tx=0).stop 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 shutdown_connections 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55762406d680 0x55762406a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762407d090 0x55762407f520 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x55762406a1e0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 --2- 172.21.15.76:0/636147876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5576240624a0 0x55762406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd39bfff640 0 client.17727 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 >> 172.21.15.76:0/636147876 conn(0x55762405ea30 msgr2=0x557624064710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 shutdown_connections 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 1 -- 172.21.15.76:0/636147876 wait complete. 2024-09-19T08:00:21.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.424+0000 7fd3c5142740 20 client.17727 trim_cache size 0 max 16384 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 Processor -- start 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 -- start start 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x5576240794b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5576240624a0 0x5576240691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x557624084df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1b0530 con 0x557624062dc0 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1ade00 con 0x55762405ea30 2024-09-19T08:00:21.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.441+0000 7fd3c5142740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1abc70 con 0x5576240624a0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x557624084df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x557624084df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54970/0 (socket says 172.21.15.76:54970) 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 -- 172.21.15.76:0/4264466288 learned_addr learned my addr 172.21.15.76:0/4264466288 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x5576240794b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 -- 172.21.15.76:0/4264466288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5576240624a0 msgr2=0x5576240691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5576240624a0 0x5576240691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 -- 172.21.15.76:0/4264466288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 msgr2=0x5576240794b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x5576240794b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 -- 172.21.15.76:0/4264466288 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762406d2a0 con 0x557624062dc0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3c1306640 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x557624084df0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c420 tx=0x7fd3b4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94936e74647906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3a67fc640 1 -- 172.21.15.76:0/4264466288 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4031070 con 0x557624062dc0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3a67fc640 1 -- 172.21.15.76:0/4264466288 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b4020050 con 0x557624062dc0 2024-09-19T08:00:21.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.442+0000 7fd3a67fc640 1 -- 172.21.15.76:0/4264466288 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4024410 con 0x557624062dc0 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 -- 172.21.15.76:0/4264466288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 msgr2=0x557624084df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x557624084df0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c420 tx=0x7fd3b4007f90 comp rx=0 tx=0).stop 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 -- 172.21.15.76:0/4264466288 shutdown_connections 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557624062dc0 0x557624084df0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5576240624a0 0x5576240691c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 --2- 172.21.15.76:0/4264466288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x5576240794b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 -- 172.21.15.76:0/4264466288 >> 172.21.15.76:0/4264466288 conn(0x55762406a880 msgr2=0x557624068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 -- 172.21.15.76:0/4264466288 shutdown_connections 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 -- 172.21.15.76:0/4264466288 wait complete. 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 -- start start 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.443+0000 7fd3c5142740 1 Processor -- start 2024-09-19T08:00:21.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x557624071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 0x557624071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x557624071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1ac2c0 con 0x5576240624a0 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1ad730 con 0x55762405ea30 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1ac990 con 0x557624062dc0 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 10 client.0 _ll_register_callbacks cb 0x7fd3a8009310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 0x557624071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 0x557624071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54980/0 (socket says 172.21.15.76:54980) 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 -- 172.21.15.76:0/1002517293 learned_addr learned my addr 172.21.15.76:0/1002517293 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c1306640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x557624071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x557624071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 -- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 msgr2=0x557624071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x557624071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 -- 172.21.15.76:0/1002517293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 msgr2=0x557624071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x557624071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 -- 172.21.15.76:0/1002517293 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576240e6e90 con 0x5576240624a0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c1306640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x557624071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x557624071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3bbfff640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 0x557624071980 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8097130 tx=0x7fd3a8017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b6e69ea8e573b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd39bfff640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd39bfff640 1 -- 172.21.15.76:0/1002517293 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a809af90 con 0x5576240624a0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd39bfff640 1 -- 172.21.15.76:0/1002517293 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fd3a8010610 con 0x5576240624a0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.444+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b4020050 con 0x5576240624a0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd39bfff640 1 -- 172.21.15.76:0/1002517293 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd3a809adb0 con 0x5576240624a0 2024-09-19T08:00:21.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 10 client.17733 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5576240e8180 con 0x5576240624a0 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd39bfff640 1 -- 172.21.15.76:0/1002517293 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b4020050 con 0x5576240624a0 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd39bfff640 1 -- 172.21.15.76:0/1002517293 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd3a8081080 con 0x5576240624a0 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 10 client.17733 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 10 client.17733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 20 client.17733 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762406d680 0x5576240ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 4 client.17733 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557623fcfd60 con 0x55762406d680 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.445+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762406d680 0x5576240ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c0b05640 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762406d680 0x5576240ea6d0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7ab04557ab47fa server_cookie=f66bb28ed784993d in_seq=0 out_seq=0 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd39bfff640 10 client.17733 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd39bfff640 1 -- 172.21.15.76:0/1002517293 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557623fcfd60 con 0x55762406d680 2024-09-19T08:00:21.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd39bfff640 10 client.17733 handle_command_reply: tid=0 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 client.17733 shutdown 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 msgr2=0x557624071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 0x557624071980 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8097130 tx=0x7fd3a8017360 comp rx=0 tx=0).stop 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 shutdown_connections 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557624062dc0 0x557624071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55762406d680 0x5576240ea6d0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5576240624a0 0x557624071980 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 --2- 172.21.15.76:0/1002517293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55762405ea30 0x557624071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 >> 172.21.15.76:0/1002517293 conn(0x55762406a880 msgr2=0x5576240692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:21.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd39bfff640 0 client.17733 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:21.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 shutdown_connections 2024-09-19T08:00:21.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.446+0000 7fd3c5142740 1 -- 172.21.15.76:0/1002517293 wait complete. 2024-09-19T08:00:21.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c5142740 20 client.17733 trim_cache size 0 max 16384 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: "38e2d432-a063-4137-9368-ea63308313ca": { 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "38e2d432-a063-4137-9368-ea63308313ca", 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:00:21.458 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd3ac0a33b0 msgr2=0x7fd3ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd3ac0a33b0 0x7fd3ac0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c8c0 tx=0x7fd3b400ccc0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 msgr2=0x7fd3bc198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 0x7fd3bc198bb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800b4a0 tx=0x7fd3a800b960 comp rx=0 tx=0).stop 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 shutdown_connections 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd3ac0a33b0 0x7fd3ac0a5870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3bc102ef0 0x7fd3bc19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd3bc102570 0x7fd3bc198bb0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 --2- 172.21.15.76:0/3142446138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3bc100e20 0x7fd3bc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:21.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 >> 172.21.15.76:0/3142446138 conn(0x7fd3bc0fc7d0 msgr2=0x7fd3bc06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:21.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 shutdown_connections 2024-09-19T08:00:21.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:21.447+0000 7fd3c2d69640 1 -- 172.21.15.76:0/3142446138 wait complete. 2024-09-19T08:00:22.122 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:22 smithi076 ceph-mon[30930]: pgmap v285: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:22.157 INFO:tasks.cephfs.filesystem:scrub status for tag:38e2d432-a063-4137-9368-ea63308313ca - {'path': '/', 'tag': '38e2d432-a063-4137-9368-ea63308313ca', 'options': 'recursive,force'} 2024-09-19T08:00:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:22 smithi152 ceph-mon[35117]: pgmap v285: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:22 smithi137 ceph-mon[35309]: pgmap v285: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:24.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:24 smithi152 ceph-mon[35117]: pgmap v286: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:24.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:24 smithi137 ceph-mon[35309]: pgmap v286: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:24.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:24 smithi076 ceph-mon[30930]: pgmap v286: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:00:25.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:25 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T08:00:25.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:25 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T08:00:25.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:25 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T08:00:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:26 smithi152 ceph-mon[35117]: pgmap v287: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:00:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:26 smithi137 ceph-mon[35309]: pgmap v287: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:00:26.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:26 smithi076 ceph-mon[30930]: pgmap v287: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:00:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:28 smithi152 ceph-mon[35117]: pgmap v288: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:00:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:00:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:00:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:00:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:00:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:28 smithi137 ceph-mon[35309]: pgmap v288: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:00:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:00:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:00:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:00:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:00:28.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:28 smithi076 ceph-mon[30930]: pgmap v288: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:00:28.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:00:28.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:00:28.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:00:28.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:00:30.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:30 smithi152 ceph-mon[35117]: pgmap v289: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:00:30.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:30 smithi137 ceph-mon[35309]: pgmap v289: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:00:30.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:30 smithi076 ceph-mon[30930]: pgmap v289: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:00:32.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:32 smithi152 ceph-mon[35117]: pgmap v290: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T08:00:32.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:32 smithi137 ceph-mon[35309]: pgmap v290: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T08:00:32.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:32 smithi076 ceph-mon[30930]: pgmap v290: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T08:00:34.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:34 smithi152 ceph-mon[35117]: pgmap v291: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:00:34.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:34 smithi137 ceph-mon[35309]: pgmap v291: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:00:34.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:34 smithi076 ceph-mon[30930]: pgmap v291: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:00:36.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:36 smithi152 ceph-mon[35117]: pgmap v292: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:00:36.405 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:36 smithi137 ceph-mon[35309]: pgmap v292: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:00:36.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:36 smithi076 ceph-mon[30930]: pgmap v292: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:00:38.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:38 smithi152 ceph-mon[35117]: pgmap v293: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:38.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:38 smithi137 ceph-mon[35309]: pgmap v293: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:38.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:38 smithi076 ceph-mon[30930]: pgmap v293: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:40.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:40 smithi152 ceph-mon[35117]: pgmap v294: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:40.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:40 smithi137 ceph-mon[35309]: pgmap v294: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:40.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:40 smithi076 ceph-mon[30930]: pgmap v294: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:42.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:42 smithi152 ceph-mon[35117]: pgmap v295: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:42.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:42 smithi137 ceph-mon[35309]: pgmap v295: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:42.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:42 smithi076 ceph-mon[30930]: pgmap v295: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:44.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:44 smithi137 ceph-mon[35309]: pgmap v296: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:44.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:44 smithi076 ceph-mon[30930]: pgmap v296: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:44.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:44 smithi152 ceph-mon[35117]: pgmap v296: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:46.363 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:46 smithi152 ceph-mon[35117]: pgmap v297: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:00:46.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:46 smithi137 ceph-mon[35309]: pgmap v297: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:00:46.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:46 smithi076 ceph-mon[30930]: pgmap v297: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:00:48.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:48 smithi137 ceph-mon[35309]: pgmap v298: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:48.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:48 smithi076 ceph-mon[30930]: pgmap v298: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:48.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:48 smithi152 ceph-mon[35117]: pgmap v298: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:50.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:50 smithi137 ceph-mon[35309]: pgmap v299: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:50.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:50 smithi076 ceph-mon[30930]: pgmap v299: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:50 smithi152 ceph-mon[35117]: pgmap v299: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:00:52.159 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:00:52.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:52 smithi137 ceph-mon[35309]: pgmap v300: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:52.427 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:52.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:52 smithi076 ceph-mon[30930]: pgmap v300: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:52.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:52 smithi152 ceph-mon[35117]: pgmap v300: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:00:52.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 -- 172.21.15.76:0/3905294590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 msgr2=0x7f1710107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:52.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 --2- 172.21.15.76:0/3905294590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710107b80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f1704009930 tx=0x7f170402a420 comp rx=0 tx=0).stop 2024-09-19T08:00:52.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 -- 172.21.15.76:0/3905294590 shutdown_connections 2024-09-19T08:00:52.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 --2- 172.21.15.76:0/3905294590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710108290 0x7f171010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 --2- 172.21.15.76:0/3905294590 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710107b80 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 --2- 172.21.15.76:0/3905294590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710102d90 0x7f1710103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 -- 172.21.15.76:0/3905294590 >> 172.21.15.76:0/3905294590 conn(0x7f17100fc7d0 msgr2=0x7f17100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 -- 172.21.15.76:0/3905294590 shutdown_connections 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 -- 172.21.15.76:0/3905294590 wait complete. 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 Processor -- start 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.908+0000 7f17164e2640 1 -- start start 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f17164e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710102d90 0x7f17101009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f17164e2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f17164e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710108290 0x7f1710101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f17164e2640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17101121b0 con 0x7f1710103740 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f17164e2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1710112030 con 0x7f1710102d90 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f17164e2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1710112330 con 0x7f1710108290 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41158/0 (socket says 172.21.15.76:41158) 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 -- 172.21.15.76:0/1356805173 learned_addr learned my addr 172.21.15.76:0/1356805173 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170ffff640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710102d90 0x7f17101009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f1714a7f640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710108290 0x7f1710101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 -- 172.21.15.76:0/1356805173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710108290 msgr2=0x7f1710101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710108290 0x7f1710101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 -- 172.21.15.76:0/1356805173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710102d90 msgr2=0x7f17101009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710102d90 0x7f17101009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170f7fe640 1 -- 172.21.15.76:0/1356805173 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17101a6af0 con 0x7f1710103740 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f170ffff640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710102d90 0x7f17101009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.909+0000 7f1714a7f640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710108290 0x7f1710101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.910+0000 7f170f7fe640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710100f30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1704005940 tx=0x7f17040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.910+0000 7f170d7fa640 1 -- 172.21.15.76:0/1356805173 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170403f030 con 0x7f1710103740 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.910+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17101a6d80 con 0x7f1710103740 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.910+0000 7f170d7fa640 1 -- 172.21.15.76:0/1356805173 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1704003d00 con 0x7f1710103740 2024-09-19T08:00:52.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.910+0000 7f170d7fa640 1 -- 172.21.15.76:0/1356805173 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704035070 con 0x7f1710103740 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.910+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17101a7200 con 0x7f1710103740 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.912+0000 7f170d7fa640 1 -- 172.21.15.76:0/1356805173 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1704042030 con 0x7f1710103740 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.912+0000 7f17188bb740 1 Processor -- start 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.912+0000 7f17188bb740 1 -- start start 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f17188bb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x559598796880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f17188bb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f17188bb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f17188bb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5595986fc2e0 con 0x5595987964a0 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f17188bb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5595986a3ce0 con 0x5595987a1680 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f17188bb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5595986f82a0 con 0x559598796dc0 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x559598796880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x559598796880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41170/0 (socket says 172.21.15.76:41170) 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 -- 172.21.15.76:0/2423240174 learned_addr learned my addr 172.21.15.76:0/2423240174 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f170d7fa640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16f80a33b0 0x7f16f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f170ffff640 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f170f7fe640 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16f80a33b0 0x7f16f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 -- 172.21.15.76:0/2423240174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 msgr2=0x5595987a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f170d7fa640 1 -- 172.21.15.76:0/1356805173 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f17040f0340 con 0x7f1710103740 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 -- 172.21.15.76:0/2423240174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 msgr2=0x5595987a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 -- 172.21.15.76:0/2423240174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559598688440 con 0x5595987964a0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.913+0000 7f1714a7f640 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x559598796880 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f1708014990 tx=0x7f1708014e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28f691ec042a86f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f16f67fc640 1 -- 172.21.15.76:0/2423240174 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708021070 con 0x5595987964a0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f16f67fc640 1 -- 172.21.15.76:0/2423240174 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1708013460 con 0x5595987964a0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f16f67fc640 1 -- 172.21.15.76:0/2423240174 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170800d5b0 con 0x5595987964a0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f1714a7f640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16f80a33b0 0x7f16f80a5870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f170801e000 tx=0x7f170801a000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 -- 172.21.15.76:0/2423240174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 msgr2=0x559598796880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:52.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x559598796880 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f1708014990 tx=0x7f1708014e50 comp rx=0 tx=0).stop 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 -- 172.21.15.76:0/2423240174 shutdown_connections 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 --2- 172.21.15.76:0/2423240174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x559598796880 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 -- 172.21.15.76:0/2423240174 >> 172.21.15.76:0/2423240174 conn(0x559598792a30 msgr2=0x559598792e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 -- 172.21.15.76:0/2423240174 shutdown_connections 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.914+0000 7f17188bb740 1 -- 172.21.15.76:0/2423240174 wait complete. 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 -- start start 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 Processor -- start 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5595987964a0 0x5595987a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559598796dc0 0x55959879e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 0x55959879e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5595987a4250 con 0x5595987a1680 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5595986b7050 con 0x559598796dc0 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5595987a43d0 con 0x5595987964a0 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f17188bb740 10 client.0 _ll_register_callbacks cb 0x5595986f7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f1714a7f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 0x55959879e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f1714a7f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 0x55959879e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41184/0 (socket says 172.21.15.76:41184) 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.915+0000 7f1714a7f640 1 -- 172.21.15.76:0/2356087090 learned_addr learned my addr 172.21.15.76:0/2356087090 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f170ffff640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5595987964a0 0x5595987a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f170f7fe640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559598796dc0 0x55959879e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f1714a7f640 1 -- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5595987964a0 msgr2=0x5595987a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f1714a7f640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5595987964a0 0x5595987a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f1714a7f640 1 -- 172.21.15.76:0/2356087090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559598796dc0 msgr2=0x55959879e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:52.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f1714a7f640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559598796dc0 0x55959879e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f1714a7f640 1 -- 172.21.15.76:0/2356087090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959846d3c0 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f1714a7f640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 0x55959879e800 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1708005fa0 tx=0x7f1708013bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a921b55a238e34b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f16ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2356087090 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708021040 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1708013460 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2356087090 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f1708013f80 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2356087090 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1708014180 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f17188bb740 10 client.17745 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5595987afc20 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.916+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2356087090 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1708013460 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2356087090 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f170802f070 con 0x5595987a1680 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f17188bb740 10 client.17745 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:52.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f17188bb740 10 client.17745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f17188bb740 20 client.17745 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f17188bb740 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5595987b0f70 0x5595987b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f17188bb740 4 client.17745 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559598709850 con 0x5595987b0f70 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f170ffff640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5595987b0f70 0x5595987b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f170ffff640 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5595987b0f70 0x5595987b3360 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5551152f27488ab2 server_cookie=4fa0068a679c1bcf in_seq=0 out_seq=0 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.917+0000 7f16ef7fe640 10 client.17745 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2356087090 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559598709850 con 0x5595987b0f70 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f16ef7fe640 10 client.17745 handle_command_reply: tid=0 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 client.17745 shutdown 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 msgr2=0x55959879e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 0x55959879e800 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1708005fa0 tx=0x7f1708013bb0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 shutdown_connections 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5595987b0f70 0x5595987b3360 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987a1680 0x55959879e800 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559598796dc0 0x55959879e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f16ef7fe640 0 client.17745 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 --2- 172.21.15.76:0/2356087090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5595987964a0 0x5595987a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 >> 172.21.15.76:0/2356087090 conn(0x559598792a30 msgr2=0x559598798710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 shutdown_connections 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 1 -- 172.21.15.76:0/2356087090 wait complete. 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.918+0000 7f17188bb740 20 client.17745 trim_cache size 0 max 16384 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.935+0000 7f17188bb740 1 Processor -- start 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.935+0000 7f17188bb740 1 -- start start 2024-09-19T08:00:52.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.935+0000 7f17188bb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x55959879cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f17188bb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f17188bb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987b9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f17188bb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17101b2690 con 0x5595987964a0 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f17188bb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17101aff60 con 0x5595987a1680 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f17188bb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17101addd0 con 0x559598796dc0 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x55959879cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x55959879cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41198/0 (socket says 172.21.15.76:41198) 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 -- 172.21.15.76:0/3204458531 learned_addr learned my addr 172.21.15.76:0/3204458531 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170f7fe640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f1714a7f640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 -- 172.21.15.76:0/3204458531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 msgr2=0x5595987b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:52.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987b8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 -- 172.21.15.76:0/3204458531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 msgr2=0x5595987b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 -- 172.21.15.76:0/3204458531 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959879eb70 con 0x5595987964a0 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f1714a7f640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170f7fe640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f170ffff640 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x55959879cb70 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x5595987b3ba0 tx=0x7f1700011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2138968a0f64c744 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f16f5ffb640 1 -- 172.21.15.76:0/3204458531 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700022030 con 0x5595987964a0 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f16f5ffb640 1 -- 172.21.15.76:0/3204458531 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1700005520 con 0x5595987964a0 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.936+0000 7f16f5ffb640 1 -- 172.21.15.76:0/3204458531 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170001d680 con 0x5595987964a0 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 -- 172.21.15.76:0/3204458531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 msgr2=0x55959879cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x55959879cb70 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x5595987b3ba0 tx=0x7f1700011810 comp rx=0 tx=0).stop 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 -- 172.21.15.76:0/3204458531 shutdown_connections 2024-09-19T08:00:52.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 --2- 172.21.15.76:0/3204458531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x55959879cb70 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 -- 172.21.15.76:0/3204458531 >> 172.21.15.76:0/3204458531 conn(0x559598792a30 msgr2=0x5595987a0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 -- 172.21.15.76:0/3204458531 shutdown_connections 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 -- 172.21.15.76:0/3204458531 wait complete. 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.937+0000 7f17188bb740 1 -- start start 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 Processor -- start 2024-09-19T08:00:53.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x5595987a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f17101ae420 con 0x5595987964a0 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17101af890 con 0x5595987a1680 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17101aeaf0 con 0x559598796dc0 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f17188bb740 10 client.0 _ll_register_callbacks cb 0x7f170801f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x5595987a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x5595987a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41202/0 (socket says 172.21.15.76:41202) 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 -- 172.21.15.76:0/2648614776 learned_addr learned my addr 172.21.15.76:0/2648614776 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 -- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 msgr2=0x5595987a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 -- 172.21.15.76:0/2648614776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 msgr2=0x5595987a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.938+0000 7f170ffff640 1 -- 172.21.15.76:0/2648614776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595987a7830 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f170ffff640 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x5595987a9a60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1700005bc0 tx=0x7f1700005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f022f0a34de372 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f16ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2648614776 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170002b070 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2648614776 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f1700004b10 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1700005520 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2648614776 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1700004d10 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 10 client.17751 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55959881b850 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2648614776 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1700005520 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2648614776 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1700030830 con 0x5595987964a0 2024-09-19T08:00:53.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 10 client.17751 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 10 client.17751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 20 client.17751 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55959881bf10 0x55959881e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 4 client.17751 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.939+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559598703d60 con 0x55959881bf10 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f170f7fe640 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55959881bf10 0x55959881e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f16ef7fe640 10 client.17751 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f170f7fe640 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55959881bf10 0x55959881e380 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=945b9409bf3c4c9d server_cookie=1da5ba50e03fae7a in_seq=0 out_seq=0 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f16ef7fe640 1 -- 172.21.15.76:0/2648614776 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559598703d60 con 0x55959881bf10 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f16ef7fe640 10 client.17751 handle_command_reply: tid=0 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 client.17751 shutdown 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 msgr2=0x5595987a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:53.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x5595987a9a60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1700005bc0 tx=0x7f1700005210 comp rx=0 tx=0).stop 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 shutdown_connections 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5595987a1680 0x5595987a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559598796dc0 0x5595987a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55959881bf10 0x55959881e380 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 --2- 172.21.15.76:0/2648614776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595987964a0 0x5595987a9a60 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f16ef7fe640 0 client.17751 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.940+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 >> 172.21.15.76:0/2648614776 conn(0x559598792a30 msgr2=0x559598791370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 shutdown_connections 2024-09-19T08:00:53.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17188bb740 1 -- 172.21.15.76:0/2648614776 wait complete. 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17188bb740 20 client.17751 trim_cache size 0 max 16384 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16f80a33b0 msgr2=0x7f16f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16f80a33b0 0x7f16f80a5870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f170801e000 tx=0x7f170801a000 comp rx=0 tx=0).stop 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 msgr2=0x7f1710100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:53.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710100f30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1704005940 tx=0x7f17040042f0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 shutdown_connections 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f16f80a33b0 0x7f16f80a5870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1710108290 0x7f1710101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1710103740 0x7f1710100f30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 --2- 172.21.15.76:0/1356805173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1710102d90 0x7f17101009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 >> 172.21.15.76:0/1356805173 conn(0x7f17100fc7d0 msgr2=0x7f1710106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 shutdown_connections 2024-09-19T08:00:53.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:52.941+0000 7f17164e2640 1 -- 172.21.15.76:0/1356805173 wait complete. 2024-09-19T08:00:53.823 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:00:53.823 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:00:54.075 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:54.336 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:54 smithi076 ceph-mon[30930]: pgmap v301: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:54.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:54 smithi137 ceph-mon[35309]: pgmap v301: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:54.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:54 smithi152 ceph-mon[35117]: pgmap v301: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:54.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 -- 172.21.15.76:0/1969921404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 msgr2=0x7fea1c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 --2- 172.21.15.76:0/1969921404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c10ea90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ca0 tx=0x7fea1402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 -- 172.21.15.76:0/1969921404 shutdown_connections 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 --2- 172.21.15.76:0/1969921404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c10ea90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 --2- 172.21.15.76:0/1969921404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c102790 0x7fea1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 --2- 172.21.15.76:0/1969921404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 0x7fea1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 -- 172.21.15.76:0/1969921404 >> 172.21.15.76:0/1969921404 conn(0x7fea1c0fd8c0 msgr2=0x7fea1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 -- 172.21.15.76:0/1969921404 shutdown_connections 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.571+0000 7fea231bf640 1 -- 172.21.15.76:0/1969921404 wait complete. 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 Processor -- start 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 -- start start 2024-09-19T08:00:54.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 0x7fea1c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c102790 0x7fea1c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c112090 con 0x7fea1c106f10 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c111f10 con 0x7fea1c101de0 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea231bf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c112210 con 0x7fea1c102790 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.572+0000 7fea2175c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48856/0 (socket says 172.21.15.76:48856) 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 -- 172.21.15.76:0/3938984052 learned_addr learned my addr 172.21.15.76:0/3938984052 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea1bfff640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c102790 0x7fea1c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea20f5b640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 0x7fea1c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 -- 172.21.15.76:0/3938984052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c102790 msgr2=0x7fea1c198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c102790 0x7fea1c198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 -- 172.21.15.76:0/3938984052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 msgr2=0x7fea1c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 0x7fea1c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 -- 172.21.15.76:0/3938984052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c19d410 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea20f5b640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 0x7fea1c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea2175c640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c19cd30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fea14006010 tx=0x7fea140319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1402fa20 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c19d6a0 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea1402fbc0 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14046860 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.573+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c1a4fe0 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.574+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1c1021c0 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.575+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fea14046a00 con 0x7fea1c106f10 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.576+0000 7fea19ffb640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fea0c0a33b0 0x7fea0c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.576+0000 7fea20f5b640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fea0c0a33b0 0x7fea0c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:54.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.576+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fea140f1180 con 0x7fea1c106f10 2024-09-19T08:00:54.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.577+0000 7fea20f5b640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fea0c0a33b0 0x7fea0c0a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea10009b40 tx=0x7fea10005e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:54.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.580+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea140bdc70 con 0x7fea1c106f10 2024-09-19T08:00:54.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.782+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea1c10a0f0 con 0x7fea1c106f10 2024-09-19T08:00:54.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.782+0000 7fea19ffb640 1 -- 172.21.15.76:0/3938984052 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7fea140bd570 con 0x7fea1c106f10 2024-09-19T08:00:54.782 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:00:54.783 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T08:00:54.783 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T08:00:54.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fea0c0a33b0 msgr2=0x7fea0c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fea0c0a33b0 0x7fea0c0a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea10009b40 tx=0x7fea10005e50 comp rx=0 tx=0).stop 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 msgr2=0x7fea1c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c19cd30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fea14006010 tx=0x7fea140319f0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 shutdown_connections 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fea0c0a33b0 0x7fea0c0a5870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea1c106f10 0x7fea1c19cd30 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c102790 0x7fea1c198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 --2- 172.21.15.76:0/3938984052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea1c101de0 0x7fea1c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.784+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 >> 172.21.15.76:0/3938984052 conn(0x7fea1c0fd8c0 msgr2=0x7fea1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.785+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 shutdown_connections 2024-09-19T08:00:54.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:54.785+0000 7fea231bf640 1 -- 172.21.15.76:0/3938984052 wait complete. 2024-09-19T08:00:55.372 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:55 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3938984052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:55.401 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:00:55.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:55 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3938984052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:55.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:55 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3938984052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:00:55.648 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:56.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 -- 172.21.15.76:0/428649258 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688106a80 msgr2=0x7f6688106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 --2- 172.21.15.76:0/428649258 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688106a80 0x7f6688106e60 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6680009930 tx=0x7f668002a420 comp rx=0 tx=0).stop 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 -- 172.21.15.76:0/428649258 shutdown_connections 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 --2- 172.21.15.76:0/428649258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6688101420 0x7f668810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 --2- 172.21.15.76:0/428649258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6688100a80 0x7f6688100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 --2- 172.21.15.76:0/428649258 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688106a80 0x7f6688106e60 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 -- 172.21.15.76:0/428649258 >> 172.21.15.76:0/428649258 conn(0x7f66880fc7a0 msgr2=0x7f66880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 -- 172.21.15.76:0/428649258 shutdown_connections 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.124+0000 7f668f29b640 1 -- 172.21.15.76:0/428649258 wait complete. 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 Processor -- start 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 -- start start 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 0x7f6688198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6688101420 0x7f6688198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6688106a80 0x7f668819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6688110fa0 con 0x7f6688100a80 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6688110e20 con 0x7f6688101420 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668f29b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6688111120 con 0x7f6688106a80 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 0x7f6688198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 0x7f6688198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48874/0 (socket says 172.21.15.76:48874) 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 -- 172.21.15.76:0/404889316 learned_addr learned my addr 172.21.15.76:0/404889316 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668c836640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6688101420 0x7f6688198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d838640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6688106a80 0x7f668819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 -- 172.21.15.76:0/404889316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6688106a80 msgr2=0x7f668819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6688106a80 0x7f668819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 -- 172.21.15.76:0/404889316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6688101420 msgr2=0x7f6688198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6688101420 0x7f6688198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.125+0000 7f668d037640 1 -- 172.21.15.76:0/404889316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668819d4c0 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.126+0000 7f668d037640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 0x7f6688198510 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6680009a50 tx=0x7f6680004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.126+0000 7f66867fc640 1 -- 172.21.15.76:0/404889316 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668003f030 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.126+0000 7f66867fc640 1 -- 172.21.15.76:0/404889316 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6680003af0 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.126+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668819d750 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.126+0000 7f66867fc640 1 -- 172.21.15.76:0/404889316 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680035070 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.126+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66881a5090 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 Processor -- start 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 -- start start 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f66867fc640 1 -- 172.21.15.76:0/404889316 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6680042030 con 0x7f6688100a80 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fb0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fb0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 0x55a0f2fc1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a0f2f162f0 con 0x55a0f2fbf780 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a0f2ebdcf0 con 0x55a0f2fb1b40 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f6691674740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a0f2f122b0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f668c836640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 0x55a0f2fc1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f668c836640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 0x55a0f2fc1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48882/0 (socket says 172.21.15.76:48882) 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f668c836640 1 -- 172.21.15.76:0/3985284025 learned_addr learned my addr 172.21.15.76:0/3985284025 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.129+0000 7f668d037640 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fb0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668d838640 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fb0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668c836640 1 -- 172.21.15.76:0/3985284025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 msgr2=0x55a0f2fb0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668c836640 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fb0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668c836640 1 -- 172.21.15.76:0/3985284025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 msgr2=0x55a0f2fb0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668c836640 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fb0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668c836640 1 -- 172.21.15.76:0/3985284025 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0f2ea23a0 con 0x55a0f2fbf780 2024-09-19T08:00:56.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f66867fc640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f66700a33b0 0x7f66700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668d838640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f66700a33b0 0x7f66700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f668c836640 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 0x55a0f2fc1b70 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f667c00abe0 tx=0x7f667c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc43f0b6efd4ac53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f66867fc640 1 -- 172.21.15.76:0/404889316 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f66800f0680 con 0x7f6688100a80 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f666f7fe640 1 -- 172.21.15.76:0/3985284025 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c01d070 con 0x55a0f2fbf780 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f666f7fe640 1 -- 172.21.15.76:0/3985284025 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f667c018b40 con 0x55a0f2fbf780 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.130+0000 7f666f7fe640 1 -- 172.21.15.76:0/3985284025 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c010bd0 con 0x55a0f2fbf780 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 -- 172.21.15.76:0/3985284025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 msgr2=0x55a0f2fc1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 0x55a0f2fc1b70 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f667c00abe0 tx=0x7f667c00f790 comp rx=0 tx=0).stop 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f668d838640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f66700a33b0 0x7f66700a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6678005cc0 tx=0x7f667800b340 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 -- 172.21.15.76:0/3985284025 shutdown_connections 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fbf780 0x55a0f2fc1b70 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fb0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 --2- 172.21.15.76:0/3985284025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fb0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 -- 172.21.15.76:0/3985284025 >> 172.21.15.76:0/3985284025 conn(0x55a0f2f79310 msgr2=0x55a0f2facc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 -- 172.21.15.76:0/3985284025 shutdown_connections 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 -- 172.21.15.76:0/3985284025 wait complete. 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 -- start start 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.131+0000 7f6691674740 1 Processor -- start 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fbf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a0f2fc2480 con 0x55a0f2fb1b40 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a0f2ed1060 con 0x55a0f2fbf780 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a0f2fc2600 con 0x55a0f2fb05d0 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f6691674740 10 client.0 _ll_register_callbacks cb 0x55a0f2c248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48898/0 (socket says 172.21.15.76:48898) 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 -- 172.21.15.76:0/986997667 learned_addr learned my addr 172.21.15.76:0/986997667 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668d838640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 -- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 msgr2=0x55a0f2fbf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fbf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 -- 172.21.15.76:0/986997667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 msgr2=0x55a0f2fbc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 -- 172.21.15.76:0/986997667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0f2c873c0 con 0x55a0f2fb1b40 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668d838640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f668c836640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbc3f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f667c00a7e0 tx=0x7f667c00aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b6d3300aecfff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.132+0000 7f666cff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f666cff9640 1 -- 172.21.15.76:0/986997667 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c026020 con 0x55a0f2fb1b40 2024-09-19T08:00:56.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f667c018b40 con 0x55a0f2fb1b40 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f666cff9640 1 -- 172.21.15.76:0/986997667 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f667c010ad0 con 0x55a0f2fb1b40 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f666cff9640 1 -- 172.21.15.76:0/986997667 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f667c031050 con 0x55a0f2fb1b40 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 10 client.17769 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a0f2fcdee0 con 0x55a0f2fb1b40 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f666cff9640 1 -- 172.21.15.76:0/986997667 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f667c018b40 con 0x55a0f2fb1b40 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f666cff9640 1 -- 172.21.15.76:0/986997667 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f667c004ac0 con 0x55a0f2fb1b40 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 10 client.17769 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 10 client.17769 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 20 client.17769 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f2fcf2e0 0x55a0f2fd16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 4 client.17769 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0f2f23860 con 0x55a0f2fcf2e0 2024-09-19T08:00:56.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.133+0000 7f668d037640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f2fcf2e0 0x55a0f2fd16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.134+0000 7f666cff9640 10 client.17769 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.134+0000 7f668d037640 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f2fcf2e0 0x55a0f2fd16d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc865441dbf5835c server_cookie=b40165ff3f9c0030 in_seq=0 out_seq=0 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f666cff9640 1 -- 172.21.15.76:0/986997667 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0f2f23860 con 0x55a0f2fcf2e0 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f666cff9640 10 client.17769 handle_command_reply: tid=0 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 client.17769 shutdown 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 msgr2=0x55a0f2fbc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbc3f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f667c00a7e0 tx=0x7f667c00aee0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 shutdown_connections 2024-09-19T08:00:56.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f2fcf2e0 0x55a0f2fd16d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbc3f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 --2- 172.21.15.76:0/986997667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fbf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f666cff9640 0 client.17769 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 >> 172.21.15.76:0/986997667 conn(0x55a0f2f79310 msgr2=0x55a0f2fb2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 shutdown_connections 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 1 -- 172.21.15.76:0/986997667 wait complete. 2024-09-19T08:00:56.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.135+0000 7f6691674740 20 client.17769 trim_cache size 0 max 16384 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.148+0000 7f6691674740 1 Processor -- start 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.148+0000 7f6691674740 1 -- start start 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f6691674740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fcb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f6691674740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f6691674740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f6691674740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66881ae1f0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f6691674740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66881abac0 con 0x55a0f2fbf780 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f6691674740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f66881a9930 con 0x55a0f2fb1b40 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fcb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fcb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48914/0 (socket says 172.21.15.76:48914) 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 -- 172.21.15.76:0/1863205286 learned_addr learned my addr 172.21.15.76:0/1863205286 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668c836640 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d838640 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 -- 172.21.15.76:0/1863205286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb1b40 msgr2=0x55a0f2fbbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 -- 172.21.15.76:0/1863205286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 msgr2=0x55a0f2fbe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbe360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 -- 172.21.15.76:0/1863205286 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0f2fad960 con 0x55a0f2fb05d0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f668d037640 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fcb720 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f66800f6520 tx=0x7f66800f2b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9956556f847c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f666effd640 1 -- 172.21.15.76:0/1863205286 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680049040 con 0x55a0f2fb05d0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f666effd640 1 -- 172.21.15.76:0/1863205286 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66800bcfd0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.149+0000 7f666effd640 1 -- 172.21.15.76:0/1863205286 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680003ca0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 -- 172.21.15.76:0/1863205286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 msgr2=0x55a0f2fcb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fcb720 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f66800f6520 tx=0x7f66800f2b90 comp rx=0 tx=0).stop 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 -- 172.21.15.76:0/1863205286 shutdown_connections 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fbf780 0x55a0f2fbe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fbbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 --2- 172.21.15.76:0/1863205286 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fcb720 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 -- 172.21.15.76:0/1863205286 >> 172.21.15.76:0/1863205286 conn(0x55a0f2f79310 msgr2=0x55a0f2fbdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 -- 172.21.15.76:0/1863205286 shutdown_connections 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 -- 172.21.15.76:0/1863205286 wait complete. 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.150+0000 7f6691674740 1 -- start start 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 Processor -- start 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fd6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fd6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fbf780 0x55a0f2fd7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f66881a9f80 con 0x55a0f2fb05d0 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66881ab3f0 con 0x55a0f2fb1b40 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f66881aa650 con 0x55a0f2fbf780 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f6691674740 10 client.0 _ll_register_callbacks cb 0x7f667c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fd6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fd6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48930/0 (socket says 172.21.15.76:48930) 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 -- 172.21.15.76:0/1429134093 learned_addr learned my addr 172.21.15.76:0/1429134093 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668c836640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fd6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d838640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fbf780 0x55a0f2fd7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 -- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fbf780 msgr2=0x55a0f2fd7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fbf780 0x55a0f2fd7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 -- 172.21.15.76:0/1429134093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 msgr2=0x55a0f2fd6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:56.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.151+0000 7f668d037640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fd6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f668d037640 1 -- 172.21.15.76:0/1429134093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0f2fc5cb0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f668d838640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fbf780 0x55a0f2fd7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f668d037640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fd6890 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f66800bd180 tx=0x7f66800bc4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c8b02332257f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f666cff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f666cff9640 1 -- 172.21.15.76:0/1429134093 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800bc230 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f666cff9640 1 -- 172.21.15.76:0/1429134093 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f668003b460 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66800bcfd0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f666cff9640 1 -- 172.21.15.76:0/1429134093 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f66800bc8d0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 10 client.17775 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a0f3039f60 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f666cff9640 1 -- 172.21.15.76:0/1429134093 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66800bcfd0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f666cff9640 1 -- 172.21.15.76:0/1429134093 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f66800f3ce0 con 0x55a0f2fb05d0 2024-09-19T08:00:56.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 10 client.17775 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 10 client.17775 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 20 client.17775 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f303a620 0x55a0f303ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 4 client.17775 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.152+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0f2f1dd70 con 0x55a0f303a620 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f668c836640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f303a620 0x55a0f303ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f668c836640 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f303a620 0x55a0f303ca10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9473d02cad03562e server_cookie=8a3dac8985209597 in_seq=0 out_seq=0 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f666cff9640 10 client.17775 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f666cff9640 1 -- 172.21.15.76:0/1429134093 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0f2f1dd70 con 0x55a0f303a620 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f666cff9640 10 client.17775 handle_command_reply: tid=0 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f6691674740 1 client.17775 shutdown 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 msgr2=0x55a0f2fd6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f6691674740 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fd6890 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f66800bd180 tx=0x7f66800bc4d0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 shutdown_connections 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f6691674740 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x55a0f303a620 0x55a0f303ca10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.153+0000 7f6691674740 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0f2fbf780 0x55a0f2fd7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f6691674740 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0f2fb1b40 0x55a0f2fd6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f6691674740 1 --2- 172.21.15.76:0/1429134093 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0f2fb05d0 0x55a0f2fd6890 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 >> 172.21.15.76:0/1429134093 conn(0x55a0f2f79310 msgr2=0x55a0f2fbe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f666cff9640 0 client.17775 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 shutdown_connections 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f6691674740 1 -- 172.21.15.76:0/1429134093 wait complete. 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f6691674740 20 client.17775 trim_cache size 0 max 16384 2024-09-19T08:00:56.164 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:56.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f66700a33b0 msgr2=0x7f66700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f66700a33b0 0x7f66700a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6678005cc0 tx=0x7f667800b340 comp rx=0 tx=0).stop 2024-09-19T08:00:56.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 msgr2=0x7f6688198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 0x7f6688198510 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6680009a50 tx=0x7f6680004270 comp rx=0 tx=0).stop 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 shutdown_connections 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f66700a33b0 0x7f66700a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6688106a80 0x7f668819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6688101420 0x7f6688198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 --2- 172.21.15.76:0/404889316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6688100a80 0x7f6688198510 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 >> 172.21.15.76:0/404889316 conn(0x7f66880fc7a0 msgr2=0x7f668806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 shutdown_connections 2024-09-19T08:00:56.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:56.154+0000 7f668f29b640 1 -- 172.21.15.76:0/404889316 wait complete. 2024-09-19T08:00:56.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:56 smithi137 ceph-mon[35309]: pgmap v302: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:00:56.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:56 smithi076 ceph-mon[30930]: pgmap v302: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:00:56.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:56 smithi152 ceph-mon[35117]: pgmap v302: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:00:56.817 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:00:57.082 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 -- 172.21.15.76:0/2076484712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101df0 msgr2=0x7fc3a8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/2076484712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101df0 0x7fc3a8105920 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009900 tx=0x7fc3a402a410 comp rx=0 tx=0).stop 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 -- 172.21.15.76:0/2076484712 shutdown_connections 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/2076484712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3a8106050 0x7fc3a810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/2076484712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101df0 0x7fc3a8105920 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/2076484712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101440 0x7fc3a8101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 -- 172.21.15.76:0/2076484712 >> 172.21.15.76:0/2076484712 conn(0x7fc3a8077210 msgr2=0x7fc3a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 -- 172.21.15.76:0/2076484712 shutdown_connections 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.566+0000 7fc3b03f4640 1 -- 172.21.15.76:0/2076484712 wait complete. 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 Processor -- start 2024-09-19T08:00:57.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 -- start start 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 0x7fc3a8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101df0 0x7fc3a8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3a8106050 0x7fc3a819d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81122f0 con 0x7fc3a8101440 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8112170 con 0x7fc3a8101df0 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3b03f4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8112470 con 0x7fc3a8106050 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3ae190640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 0x7fc3a8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3ae190640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 0x7fc3a8198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48940/0 (socket says 172.21.15.76:48940) 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3ae190640 1 -- 172.21.15.76:0/1239108409 learned_addr learned my addr 172.21.15.76:0/1239108409 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.567+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101df0 0x7fc3a8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae991640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3a8106050 0x7fc3a819d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae190640 1 -- 172.21.15.76:0/1239108409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3a8106050 msgr2=0x7fc3a819d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae190640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3a8106050 0x7fc3a819d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae190640 1 -- 172.21.15.76:0/1239108409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101df0 msgr2=0x7fc3a8198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae190640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101df0 0x7fc3a8198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae190640 1 -- 172.21.15.76:0/1239108409 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a819d6e0 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101df0 0x7fc3a8198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3ae190640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 0x7fc3a8198730 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00d950 tx=0x7fc39c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc39b7fe640 1 -- 172.21.15.76:0/1239108409 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c017070 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a819d9d0 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc39b7fe640 1 -- 172.21.15.76:0/1239108409 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc39c009c30 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc39b7fe640 1 -- 172.21.15.76:0/1239108409 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00f740 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.568+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81a52b0 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.570+0000 7fc39b7fe640 1 -- 172.21.15.76:0/1239108409 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc39c010a80 con 0x7fc3a8101440 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc39b7fe640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3940a33b0 0x7fc3940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 Processor -- start 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3940a33b0 0x7fc3940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc39b7fe640 1 -- 172.21.15.76:0/1239108409 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fc39c0cfab0 con 0x7fc3a8101440 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 -- start start 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b7128e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b7128ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b7129fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564b711f42f0 con 0x564b7129d780 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b7119bcf0 con 0x564b7128e5d0 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.571+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b711f02b0 con 0x564b7128fb40 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b7129fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b7129fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48946/0 (socket says 172.21.15.76:48946) 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 -- 172.21.15.76:0/4051656352 learned_addr learned my addr 172.21.15.76:0/4051656352 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:57.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3940a33b0 0x7fc3940a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80ff6c0 tx=0x7fc3a4005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae190640 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b7128e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b7128ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 -- 172.21.15.76:0/4051656352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 msgr2=0x564b7128e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b7128e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 -- 172.21.15.76:0/4051656352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 msgr2=0x564b7128ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b7128ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 -- 172.21.15.76:0/4051656352 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b711803a0 con 0x564b7129d780 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b7128ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc3ae991640 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b7129fb70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009d70 tx=0x7fc3a000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80083a7c3850aab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc398dea640 1 -- 172.21.15.76:0/4051656352 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0003970 con 0x564b7129d780 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc398dea640 1 -- 172.21.15.76:0/4051656352 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc3a0004530 con 0x564b7129d780 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.572+0000 7fc398dea640 1 -- 172.21.15.76:0/4051656352 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0011850 con 0x564b7129d780 2024-09-19T08:00:57.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4051656352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 msgr2=0x564b7129fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b7129fb70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009d70 tx=0x7fc3a000f730 comp rx=0 tx=0).stop 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4051656352 shutdown_connections 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b7129fb70 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b7128ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4051656352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b7128e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4051656352 >> 172.21.15.76:0/4051656352 conn(0x564b71257310 msgr2=0x564b7128ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4051656352 shutdown_connections 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4051656352 wait complete. 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 -- start start 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.573+0000 7fc3b27cd740 1 Processor -- start 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 0x564b7129d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128fb40 0x564b7129a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 0x564b7129a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x564b712a0480 con 0x564b7128e5d0 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b711af060 con 0x564b7128fb40 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564b712a0600 con 0x564b7129d780 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 10 client.0 _ll_register_callbacks cb 0x564b70f028c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 0x564b7129d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 0x564b7129d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48952/0 (socket says 172.21.15.76:48952) 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 -- 172.21.15.76:0/2693141366 learned_addr learned my addr 172.21.15.76:0/2693141366 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128fb40 0x564b7129a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 -- 172.21.15.76:0/2693141366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 msgr2=0x564b7129a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 0x564b7129a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 -- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128fb40 msgr2=0x564b7129a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128fb40 0x564b7129a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 -- 172.21.15.76:0/2693141366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b70f653c0 con 0x564b7128e5d0 2024-09-19T08:00:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3ae190640 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 0x564b7129d0e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc39c09ba00 tx=0x7fc39c09c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e677350f9fe091 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc391ffb640 1 -- 172.21.15.76:0/2693141366 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c020040 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc391ffb640 1 -- 172.21.15.76:0/2693141366 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fc39c09b150 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a0004530 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc391ffb640 1 -- 172.21.15.76:0/2693141366 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc39c0b9050 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 10 client.17787 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.574+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564b712abe00 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc391ffb640 1 -- 172.21.15.76:0/2693141366 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc3a0004530 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc391ffb640 1 -- 172.21.15.76:0/2693141366 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc39c09ad50 con 0x564b7128e5d0 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3b27cd740 10 client.17787 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3b27cd740 10 client.17787 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3b27cd740 20 client.17787 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b712ad260 0x564b712af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3b27cd740 4 client.17787 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b71201860 con 0x564b712ad260 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.575+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b712ad260 0x564b712af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.576+0000 7fc391ffb640 10 client.17787 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.576+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b712ad260 0x564b712af6d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18abdacc12a3fded server_cookie=a03018916a7bfe6a in_seq=0 out_seq=0 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.576+0000 7fc391ffb640 1 -- 172.21.15.76:0/2693141366 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b71201860 con 0x564b712ad260 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.576+0000 7fc391ffb640 10 client.17787 handle_command_reply: tid=0 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.576+0000 7fc3b27cd740 1 client.17787 shutdown 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 msgr2=0x564b7129d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 0x564b7129d0e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc39c09ba00 tx=0x7fc39c09c400 comp rx=0 tx=0).stop 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 shutdown_connections 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b712ad260 0x564b712af6d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 0x564b7129a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128fb40 0x564b7129a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/2693141366 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128e5d0 0x564b7129d0e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 >> 172.21.15.76:0/2693141366 conn(0x564b71257310 msgr2=0x564b71290960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc391ffb640 0 client.17787 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 shutdown_connections 2024-09-19T08:00:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 1 -- 172.21.15.76:0/2693141366 wait complete. 2024-09-19T08:00:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.577+0000 7fc3b27cd740 20 client.17787 trim_cache size 0 max 16384 2024-09-19T08:00:57.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 Processor -- start 2024-09-19T08:00:57.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 -- start start 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 0x564b71298c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 0x564b712991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81ae360 con 0x564b7128fb40 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81abc30 con 0x564b7128e5d0 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81a9aa0 con 0x564b7129d780 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 0x564b71298c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 0x564b71298c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48956/0 (socket says 172.21.15.76:48956) 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 -- 172.21.15.76:0/513510747 learned_addr learned my addr 172.21.15.76:0/513510747 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 -- 172.21.15.76:0/513510747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 msgr2=0x564b712991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 0x564b712991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 -- 172.21.15.76:0/513510747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 msgr2=0x564b712a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ae190640 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ad98f640 1 -- 172.21.15.76:0/513510747 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7128b960 con 0x564b7128fb40 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.590+0000 7fc3ae190640 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 0x564b71298c60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc3a402a930 tx=0x7fc3a403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c6fed561ef5cba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc393fff640 1 -- 172.21.15.76:0/513510747 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4057070 con 0x564b7128fb40 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc393fff640 1 -- 172.21.15.76:0/513510747 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc3a4031960 con 0x564b7128fb40 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc393fff640 1 -- 172.21.15.76:0/513510747 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4035050 con 0x564b7128fb40 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 -- 172.21.15.76:0/513510747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 msgr2=0x564b71298c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 0x564b71298c60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc3a402a930 tx=0x7fc3a403c000 comp rx=0 tx=0).stop 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 -- 172.21.15.76:0/513510747 shutdown_connections 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7129d780 0x564b712991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7128fb40 0x564b71298c60 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/513510747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 -- 172.21.15.76:0/513510747 >> 172.21.15.76:0/513510747 conn(0x564b71257310 msgr2=0x564b71295720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 -- 172.21.15.76:0/513510747 shutdown_connections 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.591+0000 7fc3b27cd740 1 -- 172.21.15.76:0/513510747 wait complete. 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 -- start start 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 Processor -- start 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b712a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b712a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81aa0f0 con 0x564b7129d780 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81ab560 con 0x564b7128e5d0 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81aa7c0 con 0x564b7128fb40 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3b27cd740 10 client.0 _ll_register_callbacks cb 0x7fc39c09b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3ae991640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b712a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3ae991640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b712a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48968/0 (socket says 172.21.15.76:48968) 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3ae991640 1 -- 172.21.15.76:0/4040477539 learned_addr learned my addr 172.21.15.76:0/4040477539 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3ae190640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.592+0000 7fc3ad98f640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b712a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3ae991640 1 -- 172.21.15.76:0/4040477539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 msgr2=0x564b712a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3ae991640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b712a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3ae991640 1 -- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 msgr2=0x564b712a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3ae991640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3ae991640 1 -- 172.21.15.76:0/4040477539 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b712a1ac0 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3ae991640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b712a1580 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0018000 tx=0x7fc3a0005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b3d0cffdd57826 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc391ffb640 1 -- 172.21.15.76:0/4040477539 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0028060 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc391ffb640 1 -- 172.21.15.76:0/4040477539 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fc3a0003b80 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a4031960 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc391ffb640 1 -- 172.21.15.76:0/4040477539 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc3a002f050 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3b27cd740 10 client.17793 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564b71317bb0 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc391ffb640 1 -- 172.21.15.76:0/4040477539 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc3a4031960 con 0x564b7129d780 2024-09-19T08:00:57.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.593+0000 7fc391ffb640 1 -- 172.21.15.76:0/4040477539 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc3a0011710 con 0x564b7129d780 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3b27cd740 10 client.17793 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3b27cd740 10 client.17793 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3b27cd740 20 client.17793 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b71317f40 0x564b7131a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3b27cd740 4 client.17793 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b711fbd70 con 0x564b71317f40 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3ae190640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b71317f40 0x564b7131a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc3ae190640 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b71317f40 0x564b7131a330 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bba05e6d4cb99ed server_cookie=84d5e1ccd8613e69 in_seq=0 out_seq=0 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc391ffb640 10 client.17793 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc391ffb640 1 -- 172.21.15.76:0/4040477539 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b711fbd70 con 0x564b71317f40 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.594+0000 7fc391ffb640 10 client.17793 handle_command_reply: tid=0 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 client.17793 shutdown 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 msgr2=0x564b712a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b712a1580 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0018000 tx=0x7fc3a0005af0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 shutdown_connections 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x564b71317f40 0x564b7131a330 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564b7129d780 0x564b712a1580 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564b7128fb40 0x564b712a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 --2- 172.21.15.76:0/4040477539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b7128e5d0 0x564b712a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 >> 172.21.15.76:0/4040477539 conn(0x564b71257310 msgr2=0x564b71298c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc391ffb640 0 client.17793 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 shutdown_connections 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 1 -- 172.21.15.76:0/4040477539 wait complete. 2024-09-19T08:00:57.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b27cd740 20 client.17793 trim_cache size 0 max 16384 2024-09-19T08:00:57.607 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:57.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3940a33b0 msgr2=0x7fc3940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3940a33b0 0x7fc3940a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80ff6c0 tx=0x7fc3a4005a20 comp rx=0 tx=0).stop 2024-09-19T08:00:57.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 msgr2=0x7fc3a8198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:57.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.595+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 0x7fc3a8198730 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00d950 tx=0x7fc39c00de10 comp rx=0 tx=0).stop 2024-09-19T08:00:57.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 shutdown_connections 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fc3940a33b0 0x7fc3940a5870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3a8106050 0x7fc3a819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3a8101df0 0x7fc3a8198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 --2- 172.21.15.76:0/1239108409 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc3a8101440 0x7fc3a8198730 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 >> 172.21.15.76:0/1239108409 conn(0x7fc3a8077210 msgr2=0x7fc3a8104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 shutdown_connections 2024-09-19T08:00:57.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:57.596+0000 7fc3b03f4640 1 -- 172.21.15.76:0/1239108409 wait complete. 2024-09-19T08:00:58.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:00:58 smithi076 ceph-mon[30930]: pgmap v303: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:58.321 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:00:58.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:00:58 smithi137 ceph-mon[35309]: pgmap v303: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:58.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:00:58 smithi152 ceph-mon[35117]: pgmap v303: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:00:58.572 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:00:59.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 -- 172.21.15.76:0/1432876088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c100a80 msgr2=0x7fd18c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 --2- 172.21.15.76:0/1432876088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c100a80 0x7fd18c100ee0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd180009930 tx=0x7fd18002a420 comp rx=0 tx=0).stop 2024-09-19T08:00:59.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 -- 172.21.15.76:0/1432876088 shutdown_connections 2024-09-19T08:00:59.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 --2- 172.21.15.76:0/1432876088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 0x7fd18c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 --2- 172.21.15.76:0/1432876088 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c100a80 0x7fd18c100ee0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 --2- 172.21.15.76:0/1432876088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd18c106a80 0x7fd18c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.068+0000 7fd190ac5640 1 -- 172.21.15.76:0/1432876088 >> 172.21.15.76:0/1432876088 conn(0x7fd18c0fc7a0 msgr2=0x7fd18c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:59.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 -- 172.21.15.76:0/1432876088 shutdown_connections 2024-09-19T08:00:59.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 -- 172.21.15.76:0/1432876088 wait complete. 2024-09-19T08:00:59.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 Processor -- start 2024-09-19T08:00:59.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 -- start start 2024-09-19T08:00:59.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd18c100a80 0x7fd18c0fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 0x7fd18c0fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.069+0000 7fd190ac5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 0x7fd18c0fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd190ac5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c110fe0 con 0x7fd18c106a80 2024-09-19T08:00:59.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd190ac5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c110e60 con 0x7fd18c100a80 2024-09-19T08:00:59.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd190ac5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c111160 con 0x7fd18c101420 2024-09-19T08:00:59.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 0x7fd18c0fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 0x7fd18c0fd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48990/0 (socket says 172.21.15.76:48990) 2024-09-19T08:00:59.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 -- 172.21.15.76:0/3875604441 learned_addr learned my addr 172.21.15.76:0/3875604441 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:59.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18a59c640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd18c100a80 0x7fd18c0fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 0x7fd18c0fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 -- 172.21.15.76:0/3875604441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 msgr2=0x7fd18c0fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 0x7fd18c0fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 -- 172.21.15.76:0/3875604441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd18c100a80 msgr2=0x7fd18c0fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd18c100a80 0x7fd18c0fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 -- 172.21.15.76:0/3875604441 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c1a6a90 con 0x7fd18c106a80 2024-09-19T08:00:59.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 0x7fd18c0fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:59.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd18ad9d640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 0x7fd18c0fd840 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd18400b970 tx=0x7fd18400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:59.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd17b7fe640 1 -- 172.21.15.76:0/3875604441 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184019070 con 0x7fd18c106a80 2024-09-19T08:00:59.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd17b7fe640 1 -- 172.21.15.76:0/3875604441 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd18400cb40 con 0x7fd18c106a80 2024-09-19T08:00:59.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c1a6d80 con 0x7fd18c106a80 2024-09-19T08:00:59.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd17b7fe640 1 -- 172.21.15.76:0/3875604441 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184007700 con 0x7fd18c106a80 2024-09-19T08:00:59.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.070+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c1a7240 con 0x7fd18c106a80 2024-09-19T08:00:59.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd17b7fe640 1 -- 172.21.15.76:0/3875604441 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd18401c070 con 0x7fd18c106a80 2024-09-19T08:00:59.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 Processor -- start 2024-09-19T08:00:59.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 -- start start 2024-09-19T08:00:59.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 0x55dee0188090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0188a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee0195760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55dee00ee2f0 con 0x55dee0189b40 2024-09-19T08:00:59.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dee0095cf0 con 0x55dee01885d0 2024-09-19T08:00:59.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd192e9e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dee00ea2b0 con 0x55dee0193370 2024-09-19T08:00:59.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 0x55dee0188090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 0x55dee0188090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48998/0 (socket says 172.21.15.76:48998) 2024-09-19T08:00:59.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd189d9b640 1 -- 172.21.15.76:0/1304690614 learned_addr learned my addr 172.21.15.76:0/1304690614 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:59.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.073+0000 7fd17b7fe640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd1740a33b0 0x7fd1740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd18a59c640 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0188a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee0195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 -- 172.21.15.76:0/1304690614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 msgr2=0x55dee0195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee0195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 -- 172.21.15.76:0/1304690614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 msgr2=0x55dee0188a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0188a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd18ad9d640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd1740a33b0 0x7fd1740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 -- 172.21.15.76:0/1304690614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee007a3a0 con 0x55dee0189b40 2024-09-19T08:00:59.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd18a59c640 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0188a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:59.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd17b7fe640 1 -- 172.21.15.76:0/3875604441 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fd1840cf260 con 0x7fd18c106a80 2024-09-19T08:00:59.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 0x55dee0188090 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fd180005ec0 tx=0x7fd1800095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf6220548906d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:59.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd178ff9640 1 -- 172.21.15.76:0/1304690614 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180035050 con 0x55dee0189b40 2024-09-19T08:00:59.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd18ad9d640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd1740a33b0 0x7fd1740a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd1840ccf20 tx=0x7fd184090b00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd178ff9640 1 -- 172.21.15.76:0/1304690614 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd180031890 con 0x55dee0189b40 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.074+0000 7fd178ff9640 1 -- 172.21.15.76:0/1304690614 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800046c0 con 0x55dee0189b40 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 -- 172.21.15.76:0/1304690614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 msgr2=0x55dee0188090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 0x55dee0188090 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fd180005ec0 tx=0x7fd1800095e0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 -- 172.21.15.76:0/1304690614 shutdown_connections 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee0195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0188a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1304690614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0189b40 0x55dee0188090 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 -- 172.21.15.76:0/1304690614 >> 172.21.15.76:0/1304690614 conn(0x55dee0151310 msgr2=0x55dee0184c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 -- 172.21.15.76:0/1304690614 shutdown_connections 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 -- 172.21.15.76:0/1304690614 wait complete. 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 -- start start 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.075+0000 7fd192e9e740 1 Processor -- start 2024-09-19T08:00:59.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0192d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 0x55dee0190530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55dee0196010 con 0x55dee0193370 2024-09-19T08:00:59.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dee00a9060 con 0x55dee01885d0 2024-09-19T08:00:59.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dee0196190 con 0x55dee0189b40 2024-09-19T08:00:59.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd192e9e740 10 client.0 _ll_register_callbacks cb 0x55dedfdfc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:59.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 0x55dee0190530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 0x55dee0190530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49004/0 (socket says 172.21.15.76:49004) 2024-09-19T08:00:59.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 -- 172.21.15.76:0/1936522176 learned_addr learned my addr 172.21.15.76:0/1936522176 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:59.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0192d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd18a59c640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 -- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 msgr2=0x55dee018ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 -- 172.21.15.76:0/1936522176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 msgr2=0x55dee0192d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0192d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 -- 172.21.15.76:0/1936522176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dedfe5f3c0 con 0x55dee0193370 2024-09-19T08:00:59.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd189d9b640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 0x55dee0190530 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd180004910 tx=0x7fd18003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83232eb569147160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:59.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.076+0000 7fd171ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:59.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd171ffb640 1 -- 172.21.15.76:0/1936522176 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180051060 con 0x55dee0193370 2024-09-19T08:00:59.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd171ffb640 1 -- 172.21.15.76:0/1936522176 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fd180004260 con 0x55dee0193370 2024-09-19T08:00:59.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd180031890 con 0x55dee0193370 2024-09-19T08:00:59.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd171ffb640 1 -- 172.21.15.76:0/1936522176 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd180035070 con 0x55dee0193370 2024-09-19T08:00:59.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 10 client.17805 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:59.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dee01a1aa0 con 0x55dee0193370 2024-09-19T08:00:59.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd171ffb640 1 -- 172.21.15.76:0/1936522176 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd180031890 con 0x55dee0193370 2024-09-19T08:00:59.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd171ffb640 1 -- 172.21.15.76:0/1936522176 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd180003b40 con 0x55dee0193370 2024-09-19T08:00:59.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 10 client.17805 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:59.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 10 client.17805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:59.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 20 client.17805 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee01a2df0 0x55dee01a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 4 client.17805 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:00:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dee00fb860 con 0x55dee01a2df0 2024-09-19T08:00:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.077+0000 7fd18a59c640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee01a2df0 0x55dee01a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd171ffb640 10 client.17805 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:59.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd18a59c640 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee01a2df0 0x55dee01a51e0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841554ab98808f1a server_cookie=515307c97efdb6c3 in_seq=0 out_seq=0 2024-09-19T08:00:59.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd171ffb640 1 -- 172.21.15.76:0/1936522176 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dee00fb860 con 0x55dee01a2df0 2024-09-19T08:00:59.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd171ffb640 10 client.17805 handle_command_reply: tid=0 2024-09-19T08:00:59.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 client.17805 shutdown 2024-09-19T08:00:59.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 msgr2=0x55dee0190530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 0x55dee0190530 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd180004910 tx=0x7fd18003f040 comp rx=0 tx=0).stop 2024-09-19T08:00:59.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 shutdown_connections 2024-09-19T08:00:59.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee01a2df0 0x55dee01a51e0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee0193370 0x55dee0190530 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.079+0000 7fd192e9e740 1 --2- 172.21.15.76:0/1936522176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee01885d0 0x55dee0192d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.080+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 >> 172.21.15.76:0/1936522176 conn(0x55dee0151310 msgr2=0x55dee018a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:59.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.080+0000 7fd171ffb640 0 client.17805 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:59.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.080+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 shutdown_connections 2024-09-19T08:00:59.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.080+0000 7fd192e9e740 1 -- 172.21.15.76:0/1936522176 wait complete. 2024-09-19T08:00:59.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.080+0000 7fd192e9e740 20 client.17805 trim_cache size 0 max 16384 2024-09-19T08:00:59.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.092+0000 7fd192e9e740 1 Processor -- start 2024-09-19T08:00:59.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.092+0000 7fd192e9e740 1 -- start start 2024-09-19T08:00:59.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee0191f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0193370 0x55dee018b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd192e9e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1b2610 con 0x55dee01885d0 2024-09-19T08:00:59.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd192e9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1afee0 con 0x55dee0193370 2024-09-19T08:00:59.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd192e9e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1add50 con 0x55dee0189b40 2024-09-19T08:00:59.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee0191f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee0191f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49018/0 (socket says 172.21.15.76:49018) 2024-09-19T08:00:59.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 -- 172.21.15.76:0/3647112552 learned_addr learned my addr 172.21.15.76:0/3647112552 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:59.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd18a59c640 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0193370 0x55dee018b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 -- 172.21.15.76:0/3647112552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 msgr2=0x55dee018b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 -- 172.21.15.76:0/3647112552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0193370 msgr2=0x55dee018b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0193370 0x55dee018b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 -- 172.21.15.76:0/3647112552 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee018bba0 con 0x55dee01885d0 2024-09-19T08:00:59.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.093+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee0191f20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd18002a940 tx=0x7fd18002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89da21a87883c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:59.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd173fff640 1 -- 172.21.15.76:0/3647112552 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180051020 con 0x55dee01885d0 2024-09-19T08:00:59.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd173fff640 1 -- 172.21.15.76:0/3647112552 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd18003ae50 con 0x55dee01885d0 2024-09-19T08:00:59.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd173fff640 1 -- 172.21.15.76:0/3647112552 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180004940 con 0x55dee01885d0 2024-09-19T08:00:59.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 -- 172.21.15.76:0/3647112552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 msgr2=0x55dee0191f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee0191f20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd18002a940 tx=0x7fd18002a420 comp rx=0 tx=0).stop 2024-09-19T08:00:59.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 -- 172.21.15.76:0/3647112552 shutdown_connections 2024-09-19T08:00:59.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0193370 0x55dee018b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0189b40 0x55dee018b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3647112552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee0191f20 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 -- 172.21.15.76:0/3647112552 >> 172.21.15.76:0/3647112552 conn(0x55dee0151310 msgr2=0x55dee0191810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:59.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 -- 172.21.15.76:0/3647112552 shutdown_connections 2024-09-19T08:00:59.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.094+0000 7fd192e9e740 1 -- 172.21.15.76:0/3647112552 wait complete. 2024-09-19T08:00:59.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 -- start start 2024-09-19T08:00:59.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 Processor -- start 2024-09-19T08:00:59.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee01a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0189b40 0x55dee01a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee01a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1ae3a0 con 0x55dee01885d0 2024-09-19T08:00:59.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1af810 con 0x55dee0189b40 2024-09-19T08:00:59.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1aea70 con 0x55dee0193370 2024-09-19T08:00:59.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd192e9e740 10 client.0 _ll_register_callbacks cb 0x7fd180031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:00:59.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee01a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee01a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49024/0 (socket says 172.21.15.76:49024) 2024-09-19T08:00:59.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 -- 172.21.15.76:0/3535343540 learned_addr learned my addr 172.21.15.76:0/3535343540 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:00:59.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd18a59c640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0189b40 0x55dee01a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 -- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 msgr2=0x55dee01a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee01a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 -- 172.21.15.76:0/3535343540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0189b40 msgr2=0x55dee01a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:00:59.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0189b40 0x55dee01a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd189d9b640 1 -- 172.21.15.76:0/3535343540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee01a65f0 con 0x55dee01885d0 2024-09-19T08:00:59.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.095+0000 7fd18a59c640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0189b40 0x55dee01a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:00:59.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd189d9b640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee01a8580 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fd180005820 tx=0x7fd180005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e680c214048c145b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:00:59.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd171ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:00:59.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd171ffb640 1 -- 172.21.15.76:0/3535343540 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180051070 con 0x55dee01885d0 2024-09-19T08:00:59.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd171ffb640 1 -- 172.21.15.76:0/3535343540 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7fd18003a900 con 0x55dee01885d0 2024-09-19T08:00:59.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd18003ae50 con 0x55dee01885d0 2024-09-19T08:00:59.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd171ffb640 1 -- 172.21.15.76:0/3535343540 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd1800044e0 con 0x55dee01885d0 2024-09-19T08:00:59.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 10 client.17811 fetch_fsmap learned FSMap version 35 2024-09-19T08:00:59.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dee020d740 con 0x55dee01885d0 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd171ffb640 1 -- 172.21.15.76:0/3535343540 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd18003ae50 con 0x55dee01885d0 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd171ffb640 1 -- 172.21.15.76:0/3535343540 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd180068020 con 0x55dee01885d0 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 10 client.17811 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 10 client.17811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 20 client.17811 populate_metadata read hostname 'smithi076' 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee020ddf0 0x55dee02101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:00:59.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 4 client.17811 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.096+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dee00f5d70 con 0x55dee020ddf0 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.097+0000 7fd18a59c640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee020ddf0 0x55dee02101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.097+0000 7fd171ffb640 10 client.17811 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.097+0000 7fd18a59c640 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee020ddf0 0x55dee02101e0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7159d9fdbe87b9f0 server_cookie=9889cdda9c2eb8ab in_seq=0 out_seq=0 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.097+0000 7fd171ffb640 1 -- 172.21.15.76:0/3535343540 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dee00f5d70 con 0x55dee020ddf0 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.097+0000 7fd171ffb640 10 client.17811 handle_command_reply: tid=0 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.097+0000 7fd192e9e740 1 client.17811 shutdown 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 msgr2=0x55dee01a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee01a8580 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fd180005820 tx=0x7fd180005920 comp rx=0 tx=0).stop 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 shutdown_connections 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dee0193370 0x55dee01a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dee0189b40 0x55dee01a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55dee020ddf0 0x55dee02101e0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 --2- 172.21.15.76:0/3535343540 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55dee01885d0 0x55dee01a8580 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 >> 172.21.15.76:0/3535343540 conn(0x55dee0151310 msgr2=0x55dee0192030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd171ffb640 0 client.17811 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 shutdown_connections 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 1 -- 172.21.15.76:0/3535343540 wait complete. 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd192e9e740 20 client.17811 trim_cache size 0 max 16384 2024-09-19T08:00:59.129 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd1740a33b0 msgr2=0x7fd1740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd1740a33b0 0x7fd1740a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd1840ccf20 tx=0x7fd184090b00 comp rx=0 tx=0).stop 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 msgr2=0x7fd18c0fd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 0x7fd18c0fd840 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd18400b970 tx=0x7fd18400be30 comp rx=0 tx=0).stop 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 shutdown_connections 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fd1740a33b0 0x7fd1740a5870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd18c106a80 0x7fd18c0fd840 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd18c101420 0x7fd18c0fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 --2- 172.21.15.76:0/3875604441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd18c100a80 0x7fd18c0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:00:59.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.098+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 >> 172.21.15.76:0/3875604441 conn(0x7fd18c0fc7a0 msgr2=0x7fd18c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:00:59.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.099+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 shutdown_connections 2024-09-19T08:00:59.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:00:59.099+0000 7fd190ac5640 1 -- 172.21.15.76:0/3875604441 wait complete. 2024-09-19T08:01:00.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:00 smithi137 ceph-mon[35309]: pgmap v304: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:01:00.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:00 smithi076 ceph-mon[30930]: pgmap v304: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:01:00.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:00 smithi152 ceph-mon[35117]: pgmap v304: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:01:00.848 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:01:00.849 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:01:01.106 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 -- 172.21.15.76:0/2450692224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14102ef0 msgr2=0x7f4c1410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 --2- 172.21.15.76:0/2450692224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14102ef0 0x7f4c1410da40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009ca0 tx=0x7f4c0c02a950 comp rx=0 tx=0).stop 2024-09-19T08:01:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 -- 172.21.15.76:0/2450692224 shutdown_connections 2024-09-19T08:01:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 --2- 172.21.15.76:0/2450692224 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14102ef0 0x7f4c1410da40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 --2- 172.21.15.76:0/2450692224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14102570 0x7f4c141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 --2- 172.21.15.76:0/2450692224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c14100e20 0x7f4c14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 -- 172.21.15.76:0/2450692224 >> 172.21.15.76:0/2450692224 conn(0x7f4c140fc7d0 msgr2=0x7f4c140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 -- 172.21.15.76:0/2450692224 shutdown_connections 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 -- 172.21.15.76:0/2450692224 wait complete. 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.639+0000 7f4c19eac640 1 Processor -- start 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 -- start start 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 0x7f4c14198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14102570 0x7f4c14198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c14102ef0 0x7f4c1419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141110e0 con 0x7f4c14100e20 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14110f60 con 0x7f4c14102570 2024-09-19T08:01:01.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c19eac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14111260 con 0x7f4c14102ef0 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 0x7f4c14198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 0x7f4c14198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49034/0 (socket says 172.21.15.76:49034) 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 -- 172.21.15.76:0/145009651 learned_addr learned my addr 172.21.15.76:0/145009651 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14102570 0x7f4c14198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 -- 172.21.15.76:0/145009651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c14102ef0 msgr2=0x7f4c1419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c13fff640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c14102ef0 0x7f4c1419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c14102ef0 0x7f4c1419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 -- 172.21.15.76:0/145009651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14102570 msgr2=0x7f4c14198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14102570 0x7f4c14198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.640+0000 7f4c137fe640 1 -- 172.21.15.76:0/145009651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1419d520 con 0x7f4c14100e20 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.641+0000 7f4c137fe640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 0x7f4c14198570 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00b4a0 tx=0x7f4bfc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.641+0000 7f4c10ff9640 1 -- 172.21.15.76:0/145009651 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc014070 con 0x7f4c14100e20 2024-09-19T08:01:01.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.641+0000 7f4c10ff9640 1 -- 172.21.15.76:0/145009651 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4bfc010b10 con 0x7f4c14100e20 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.641+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1419d810 con 0x7f4c14100e20 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.641+0000 7f4c10ff9640 1 -- 172.21.15.76:0/145009651 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc017d60 con 0x7f4c14100e20 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.641+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c141a50f0 con 0x7f4c14100e20 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.643+0000 7f4c10ff9640 1 -- 172.21.15.76:0/145009651 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4bfc017070 con 0x7f4c14100e20 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.643+0000 7f4c1c285740 1 Processor -- start 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.643+0000 7f4c1c285740 1 -- start start 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d86f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d91800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d94130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c10ff9640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4c000a33b0 0x7f4c000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c1c285740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557383cec280 con 0x557383d91d40 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c1c285740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557383c93b10 con 0x557383d87480 2024-09-19T08:01:01.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c1c285740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557383ce8240 con 0x557383d86b60 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d94130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c13fff640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4c000a33b0 0x7f4c000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d94130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49036/0 (socket says 172.21.15.76:49036) 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 -- 172.21.15.76:0/3215082407 learned_addr learned my addr 172.21.15.76:0/3215082407 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c137fe640 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c10ff9640 1 -- 172.21.15.76:0/145009651 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f4bfc0cf180 con 0x7f4c14100e20 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c13fff640 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d86f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 -- 172.21.15.76:0/3215082407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 msgr2=0x557383d86f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d86f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 -- 172.21.15.76:0/3215082407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 msgr2=0x557383d91800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d91800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 -- 172.21.15.76:0/3215082407 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557383ca01f0 con 0x557383d91d40 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c13fff640 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d86f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d94130 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400cc40 tx=0x7f4c0400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3a18e76f8d6bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.644+0000 7f4c13fff640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4c000a33b0 0x7f4c000a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c030040 tx=0x7f4c0c005d80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c09ffb640 1 -- 172.21.15.76:0/3215082407 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04014070 con 0x557383d91d40 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c09ffb640 1 -- 172.21.15.76:0/3215082407 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4c040047a0 con 0x557383d91d40 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c09ffb640 1 -- 172.21.15.76:0/3215082407 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04010850 con 0x557383d91d40 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 -- 172.21.15.76:0/3215082407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 msgr2=0x557383d94130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d94130 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400cc40 tx=0x7f4c0400e720 comp rx=0 tx=0).stop 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 -- 172.21.15.76:0/3215082407 shutdown_connections 2024-09-19T08:01:01.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d94130 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d91800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3215082407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d86f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 -- 172.21.15.76:0/3215082407 >> 172.21.15.76:0/3215082407 conn(0x557383d830f0 msgr2=0x557383d834d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 -- 172.21.15.76:0/3215082407 shutdown_connections 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.645+0000 7f4c1c285740 1 -- 172.21.15.76:0/3215082407 wait complete. 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 -- start start 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 Processor -- start 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d8ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d8f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d8f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x557383d94910 con 0x557383d91d40 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557383ca6f10 con 0x557383d87480 2024-09-19T08:01:01.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557383d94a90 con 0x557383d86b60 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c1c285740 10 client.0 _ll_register_callbacks cb 0x557383c6fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d8f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d8f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49044/0 (socket says 172.21.15.76:49044) 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.646+0000 7f4c13fff640 1 -- 172.21.15.76:0/3202297593 learned_addr learned my addr 172.21.15.76:0/3202297593 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d8f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c137fe640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d8ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c13fff640 1 -- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 msgr2=0x557383d8ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c13fff640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d8ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c13fff640 1 -- 172.21.15.76:0/3202297593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 msgr2=0x557383d8f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c13fff640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d8f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c13fff640 1 -- 172.21.15.76:0/3202297593 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557383a5d6a0 con 0x557383d91d40 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c137fe640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d8ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:01.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c13fff640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d8f690 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c02f8b0 tx=0x7f4c0c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa29779f88370558 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/3202297593 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c034040 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/3202297593 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f4c0c003da0 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c040047a0 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/3202297593 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4c0c004040 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c1c285740 10 client.17823 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557383da0480 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.647+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/3202297593 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4c040047a0 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/3202297593 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4c0c03cb80 con 0x557383d91d40 2024-09-19T08:01:01.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c1c285740 10 client.17823 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c1c285740 10 client.17823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c1c285740 20 client.17823 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383da1940 0x557383da3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c1c285740 4 client.17823 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557383cf97f0 con 0x557383da1940 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c137fe640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383da1940 0x557383da3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4bf2ffd640 10 client.17823 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.648+0000 7f4c137fe640 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383da1940 0x557383da3db0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef1ba5d7c3df3fd7 server_cookie=8014e691380927d6 in_seq=0 out_seq=0 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/3202297593 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557383cf97f0 con 0x557383da1940 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4bf2ffd640 10 client.17823 handle_command_reply: tid=0 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 client.17823 shutdown 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 msgr2=0x557383d8f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d8f690 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c02f8b0 tx=0x7f4c0c0095c0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 shutdown_connections 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383da1940 0x557383da3db0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383d8f690 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d8f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 --2- 172.21.15.76:0/3202297593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d8ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4bf2ffd640 0 client.17823 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 >> 172.21.15.76:0/3202297593 conn(0x557383d830f0 msgr2=0x557383d88dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 shutdown_connections 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.649+0000 7f4c1c285740 1 -- 172.21.15.76:0/3202297593 wait complete. 2024-09-19T08:01:01.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.650+0000 7f4c1c285740 20 client.17823 trim_cache size 0 max 16384 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.667+0000 7f4c1c285740 1 Processor -- start 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.667+0000 7f4c1c285740 1 -- start start 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 0x557383d8e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d87480 0x557383da96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d91d40 0x557383da9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c1c285740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141b0390 con 0x557383d86b60 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c1c285740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141adc60 con 0x557383d91d40 2024-09-19T08:01:01.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c1c285740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141abad0 con 0x557383d87480 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 0x557383d8e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 0x557383d8e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49060/0 (socket says 172.21.15.76:49060) 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 -- 172.21.15.76:0/1853665140 learned_addr learned my addr 172.21.15.76:0/1853665140 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 -- 172.21.15.76:0/1853665140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d87480 msgr2=0x557383da96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d87480 0x557383da96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d87480 0x557383da96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 -- 172.21.15.76:0/1853665140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d91d40 msgr2=0x557383da9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d91d40 0x557383da9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 -- 172.21.15.76:0/1853665140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557383d94490 con 0x557383d86b60 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d87480 0x557383da96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c137fe640 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 0x557383d8e4f0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0cc9b0 tx=0x7f4bfc012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b948d545d5b807 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:01.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.668+0000 7f4c097fa640 1 -- 172.21.15.76:0/1853665140 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0a4150 con 0x557383d86b60 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c097fa640 1 -- 172.21.15.76:0/1853665140 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4bfc01c120 con 0x557383d86b60 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c097fa640 1 -- 172.21.15.76:0/1853665140 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0ccac0 con 0x557383d86b60 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 -- 172.21.15.76:0/1853665140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 msgr2=0x557383d8e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 0x557383d8e4f0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0cc9b0 tx=0x7f4bfc012040 comp rx=0 tx=0).stop 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 -- 172.21.15.76:0/1853665140 shutdown_connections 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d91d40 0x557383da9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d87480 0x557383da96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 --2- 172.21.15.76:0/1853665140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d86b60 0x557383d8e4f0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 -- 172.21.15.76:0/1853665140 >> 172.21.15.76:0/1853665140 conn(0x557383d830f0 msgr2=0x557383d90b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 -- 172.21.15.76:0/1853665140 shutdown_connections 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.669+0000 7f4c1c285740 1 -- 172.21.15.76:0/1853665140 wait complete. 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 -- start start 2024-09-19T08:01:01.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 Processor -- start 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d96360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383e09af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141ac120 con 0x557383d91d40 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141ad590 con 0x557383d87480 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141ac7f0 con 0x557383d86b60 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c1c285740 10 client.0 _ll_register_callbacks cb 0x7f4c0c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383e09af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383e09af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49072/0 (socket says 172.21.15.76:49072) 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c13fff640 1 -- 172.21.15.76:0/181645781 learned_addr learned my addr 172.21.15.76:0/181645781 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c137fe640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d96360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.670+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c13fff640 1 -- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 msgr2=0x557383d96360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c13fff640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d96360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c13fff640 1 -- 172.21.15.76:0/181645781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 msgr2=0x557383d968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c13fff640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c13fff640 1 -- 172.21.15.76:0/181645781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557383e0a130 con 0x557383d91d40 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c12ffd640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c13fff640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383e09af0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c005e30 tx=0x7f4c0c02fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ec7294e2fec4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/181645781 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c034070 con 0x557383d91d40 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/181645781 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7f4c0c0309b0 con 0x557383d91d40 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bfc01c120 con 0x557383d91d40 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/181645781 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4c0c02f430 con 0x557383d91d40 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c1c285740 10 client.17829 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:01.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557383e11490 con 0x557383d91d40 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/181645781 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4bfc01c120 con 0x557383d91d40 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/181645781 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4c0c05e070 con 0x557383d91d40 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c1c285740 10 client.17829 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c1c285740 10 client.17829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.671+0000 7f4c1c285740 20 client.17829 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.672+0000 7f4c1c285740 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383e11ba0 0x557383e13f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.672+0000 7f4c1c285740 4 client.17829 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.672+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557383cf3d00 con 0x557383e11ba0 2024-09-19T08:01:01.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.672+0000 7f4c137fe640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383e11ba0 0x557383e13f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.672+0000 7f4bf2ffd640 10 client.17829 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.672+0000 7f4c137fe640 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383e11ba0 0x557383e13f90 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e521cac9868d77ea server_cookie=c19231a143ab1295 in_seq=0 out_seq=0 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.673+0000 7f4bf2ffd640 1 -- 172.21.15.76:0/181645781 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557383cf3d00 con 0x557383e11ba0 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.673+0000 7f4bf2ffd640 10 client.17829 handle_command_reply: tid=0 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.673+0000 7f4c1c285740 1 client.17829 shutdown 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 msgr2=0x557383e09af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383e09af0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c005e30 tx=0x7f4c0c02fa60 comp rx=0 tx=0).stop 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 shutdown_connections 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x557383e11ba0 0x557383e13f90 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557383d91d40 0x557383e09af0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557383d87480 0x557383d968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 --2- 172.21.15.76:0/181645781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557383d86b60 0x557383d96360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 >> 172.21.15.76:0/181645781 conn(0x557383d830f0 msgr2=0x557383d81a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:01.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4bf2ffd640 0 client.17829 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:01.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 shutdown_connections 2024-09-19T08:01:01.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 1 -- 172.21.15.76:0/181645781 wait complete. 2024-09-19T08:01:01.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c1c285740 20 client.17829 trim_cache size 0 max 16384 2024-09-19T08:01:01.685 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:01.685 INFO:teuthology.orchestra.run.smithi076.stdout: "return_code": 0, 2024-09-19T08:01:01.686 INFO:teuthology.orchestra.run.smithi076.stdout: "scrub_tag": "003838b0-e6cd-492d-b425-e9cf9d3b8da0", 2024-09-19T08:01:01.686 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": "asynchronous" 2024-09-19T08:01:01.686 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:01.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4c000a33b0 msgr2=0x7f4c000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c19eac640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4c000a33b0 0x7f4c000a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c030040 tx=0x7f4c0c005d80 comp rx=0 tx=0).stop 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 msgr2=0x7f4c14198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.674+0000 7f4c19eac640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 0x7f4c14198570 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00b4a0 tx=0x7f4bfc00b960 comp rx=0 tx=0).stop 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 shutdown_connections 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f4c000a33b0 0x7f4c000a5870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c14102ef0 0x7f4c1419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c14102570 0x7f4c14198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 --2- 172.21.15.76:0/145009651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4c14100e20 0x7f4c14198570 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 >> 172.21.15.76:0/145009651 conn(0x7f4c140fc7d0 msgr2=0x7f4c1406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 shutdown_connections 2024-09-19T08:01:01.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:01.675+0000 7f4c19eac640 1 -- 172.21.15.76:0/145009651 wait complete. 2024-09-19T08:01:02.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:02 smithi137 ceph-mon[35309]: pgmap v305: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:02.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:02 smithi137 ceph-mon[35309]: scrub queued for path: / 2024-09-19T08:01:02.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:02 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T08:01:02.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:02 smithi137 ceph-mon[35309]: scrub summary: active paths [/] 2024-09-19T08:01:02.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:02 smithi137 ceph-mon[35309]: scrub summary: idle+waiting paths [/] 2024-09-19T08:01:02.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:02 smithi076 ceph-mon[30930]: pgmap v305: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:02.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:02 smithi076 ceph-mon[30930]: scrub queued for path: / 2024-09-19T08:01:02.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:02 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T08:01:02.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:02 smithi076 ceph-mon[30930]: scrub summary: active paths [/] 2024-09-19T08:01:02.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:02 smithi076 ceph-mon[30930]: scrub summary: idle+waiting paths [/] 2024-09-19T08:01:02.510 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:01:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:02 smithi152 ceph-mon[35117]: pgmap v305: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:02 smithi152 ceph-mon[35117]: scrub queued for path: / 2024-09-19T08:01:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:02 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T08:01:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:02 smithi152 ceph-mon[35117]: scrub summary: active paths [/] 2024-09-19T08:01:02.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:02 smithi152 ceph-mon[35117]: scrub summary: idle+waiting paths [/] 2024-09-19T08:01:02.761 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/4246092299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 msgr2=0x7ff0dc1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/4246092299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc1063d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009ca0 tx=0x7ff0d402a940 comp rx=0 tx=0).stop 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/4246092299 shutdown_connections 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/4246092299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc1063d0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/4246092299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0dc101450 0x7ff0dc105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/4246092299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc100b30 0x7ff0dc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.263+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/4246092299 >> 172.21.15.76:0/4246092299 conn(0x7ff0dc0fc7a0 msgr2=0x7ff0dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/4246092299 shutdown_connections 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/4246092299 wait complete. 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 Processor -- start 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 -- start start 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0dc100b30 0x7ff0dc1a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc101450 0x7ff0dc1a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc118780 con 0x7ff0dc105f40 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc118600 con 0x7ff0dc101450 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e3b8f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc118900 con 0x7ff0dc100b30 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e212c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.264+0000 7ff0e212c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc19e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49094/0 (socket says 172.21.15.76:49094) 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 -- 172.21.15.76:0/1445639870 learned_addr learned my addr 172.21.15.76:0/1445639870 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e192b640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0dc100b30 0x7ff0dc1a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e112a640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc101450 0x7ff0dc1a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 -- 172.21.15.76:0/1445639870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0dc100b30 msgr2=0x7ff0dc1a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0dc100b30 0x7ff0dc1a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 -- 172.21.15.76:0/1445639870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc101450 msgr2=0x7ff0dc1a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc101450 0x7ff0dc1a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 -- 172.21.15.76:0/1445639870 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc19f100 con 0x7ff0dc105f40 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e112a640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc101450 0x7ff0dc1a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e212c640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc19e9d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005cc0 tx=0x7ff0d402fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0d2ffd640 1 -- 172.21.15.76:0/1445639870 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4034040 con 0x7ff0dc105f40 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0d2ffd640 1 -- 172.21.15.76:0/1445639870 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0d402fe60 con 0x7ff0dc105f40 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc19f390 con 0x7ff0dc105f40 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0d2ffd640 1 -- 172.21.15.76:0/1445639870 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d403a690 con 0x7ff0dc105f40 2024-09-19T08:01:03.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.265+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc1ab6e0 con 0x7ff0dc105f40 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.267+0000 7ff0d2ffd640 1 -- 172.21.15.76:0/1445639870 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff0d4037020 con 0x7ff0dc105f40 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 Processor -- start 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 -- start start 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d14a0 0x5612276d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276dc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5612276372e0 con 0x5612276dc680 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5612275dece0 con 0x5612276d14a0 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5612276332a0 con 0x5612276d1dc0 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0d2ffd640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0c80a33b0 0x7ff0c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49102/0 (socket says 172.21.15.76:49102) 2024-09-19T08:01:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e112a640 1 -- 172.21.15.76:0/2344169049 learned_addr learned my addr 172.21.15.76:0/2344169049 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.268+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d14a0 0x5612276d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e212c640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0c80a33b0 0x7ff0c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e192b640 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0d2ffd640 1 -- 172.21.15.76:0/1445639870 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7ff0d40f0f90 con 0x7ff0dc105f40 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e112a640 1 -- 172.21.15.76:0/2344169049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 msgr2=0x5612276dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276dc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e112a640 1 -- 172.21.15.76:0/2344169049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d14a0 msgr2=0x5612276d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d14a0 0x5612276d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e112a640 1 -- 172.21.15.76:0/2344169049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612275c3440 con 0x5612276dc680 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276dea70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00cf70 tx=0x7ff0cc00c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6313c6f34287891d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0e212c640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0c80a33b0 0x7ff0c80a5870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40ee810 tx=0x7ff0d40c1040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0c7fff640 1 -- 172.21.15.76:0/2344169049 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00f040 con 0x5612276dc680 2024-09-19T08:01:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0c7fff640 1 -- 172.21.15.76:0/2344169049 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0cc01c070 con 0x5612276dc680 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.269+0000 7ff0c7fff640 1 -- 172.21.15.76:0/2344169049 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc016810 con 0x5612276dc680 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2344169049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 msgr2=0x5612276dea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276dea70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00cf70 tx=0x7ff0cc00c230 comp rx=0 tx=0).stop 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2344169049 shutdown_connections 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276dea70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276dc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2344169049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d14a0 0x5612276d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2344169049 >> 172.21.15.76:0/2344169049 conn(0x5612276cda30 msgr2=0x5612276cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2344169049 shutdown_connections 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2344169049 wait complete. 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 -- start start 2024-09-19T08:01:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.270+0000 7ff0e5f68740 1 Processor -- start 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d14a0 0x5612276dc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d1dc0 0x5612276d92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276d9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5612276df250 con 0x5612276dc680 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5612275f2050 con 0x5612276d1dc0 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5612276df3d0 con 0x5612276d14a0 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e5f68740 10 client.0 _ll_register_callbacks cb 0x561227632160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276d9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276d9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49110/0 (socket says 172.21.15.76:49110) 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 -- 172.21.15.76:0/2754048283 learned_addr learned my addr 172.21.15.76:0/2754048283 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e192b640 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d1dc0 0x5612276d92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 -- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d14a0 msgr2=0x5612276dc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d14a0 0x5612276dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 -- 172.21.15.76:0/2754048283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d1dc0 msgr2=0x5612276d92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d1dc0 0x5612276d92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 -- 172.21.15.76:0/2754048283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612273a83c0 con 0x5612276dc680 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0e112a640 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276d9830 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc015fa0 tx=0x7ff0cc016370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc700574eb2fd503 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.271+0000 7ff0c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0c57fa640 1 -- 172.21.15.76:0/2754048283 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc006c90 con 0x5612276dc680 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0c57fa640 1 -- 172.21.15.76:0/2754048283 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7ff0cc017410 con 0x5612276dc680 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0cc01c070 con 0x5612276dc680 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0c57fa640 1 -- 172.21.15.76:0/2754048283 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff0cc017610 con 0x5612276dc680 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 10 client.17841 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5612276eac70 con 0x5612276dc680 2024-09-19T08:01:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0c57fa640 1 -- 172.21.15.76:0/2754048283 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0cc01c070 con 0x5612276dc680 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0c57fa640 1 -- 172.21.15.76:0/2754048283 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff0cc02e020 con 0x5612276dc680 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 10 client.17841 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 10 client.17841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 20 client.17841 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5612276ebfc0 0x5612276ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 4 client.17841 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561227644850 con 0x5612276ebfc0 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.272+0000 7ff0e192b640 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5612276ebfc0 0x5612276ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.273+0000 7ff0e192b640 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5612276ebfc0 0x5612276ee3b0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e157dad318783c2 server_cookie=5e3507585e17d050 in_seq=0 out_seq=0 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.273+0000 7ff0c57fa640 10 client.17841 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0c57fa640 1 -- 172.21.15.76:0/2754048283 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561227644850 con 0x5612276ebfc0 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0c57fa640 10 client.17841 handle_command_reply: tid=0 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 client.17841 shutdown 2024-09-19T08:01:03.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 msgr2=0x5612276d9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276d9830 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc015fa0 tx=0x7ff0cc016370 comp rx=0 tx=0).stop 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 shutdown_connections 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x5612276ebfc0 0x5612276ee3b0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276dc680 0x5612276d9830 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276d1dc0 0x5612276d92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/2754048283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d14a0 0x5612276dc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 >> 172.21.15.76:0/2754048283 conn(0x5612276cda30 msgr2=0x5612276d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0c57fa640 0 client.17841 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 shutdown_connections 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 1 -- 172.21.15.76:0/2754048283 wait complete. 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.274+0000 7ff0e5f68740 20 client.17841 trim_cache size 0 max 16384 2024-09-19T08:01:03.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 Processor -- start 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 -- start start 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276f3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1b6b00 con 0x5612276d14a0 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1b43d0 con 0x5612276dc680 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1b2240 con 0x5612276d1dc0 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49118/0 (socket says 172.21.15.76:49118) 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 -- 172.21.15.76:0/4139609301 learned_addr learned my addr 172.21.15.76:0/4139609301 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 -- 172.21.15.76:0/4139609301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 msgr2=0x5612276f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 -- 172.21.15.76:0/4139609301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 msgr2=0x5612276f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.291+0000 7ff0e112a640 1 -- 172.21.15.76:0/4139609301 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612276d1bf0 con 0x5612276d14a0 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e112a640 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e84e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc016010 tx=0x7ff0cc00c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd9f313de65aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0c77fe640 1 -- 172.21.15.76:0/4139609301 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00c410 con 0x5612276d14a0 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0c77fe640 1 -- 172.21.15.76:0/4139609301 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0cc035020 con 0x5612276d14a0 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0c77fe640 1 -- 172.21.15.76:0/4139609301 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc02b2e0 con 0x5612276d14a0 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 -- 172.21.15.76:0/4139609301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 msgr2=0x5612276e84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e84e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc016010 tx=0x7ff0cc00c1a0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 -- 172.21.15.76:0/4139609301 shutdown_connections 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/4139609301 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e84e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 -- 172.21.15.76:0/4139609301 >> 172.21.15.76:0/4139609301 conn(0x5612276cda30 msgr2=0x5612276d48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:03.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 -- 172.21.15.76:0/4139609301 shutdown_connections 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.292+0000 7ff0e5f68740 1 -- 172.21.15.76:0/4139609301 wait complete. 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 -- start start 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 Processor -- start 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1b2890 con 0x5612276d14a0 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1b3d00 con 0x5612276dc680 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1b2f60 con 0x5612276d1dc0 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e5f68740 10 client.0 _ll_register_callbacks cb 0x7ff0cc00cbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49122/0 (socket says 172.21.15.76:49122) 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 -- 172.21.15.76:0/1407211068 learned_addr learned my addr 172.21.15.76:0/1407211068 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e192b640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": { 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: "003838b0-e6cd-492d-b425-e9cf9d3b8da0": { 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: "path": "/", 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: "tag": "003838b0-e6cd-492d-b425-e9cf9d3b8da0", 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: "options": "recursive,force" 2024-09-19T08:01:03.312 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:03.313 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:03.313 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:03.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 -- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 msgr2=0x5612276e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276e4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 -- 172.21.15.76:0/1407211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 msgr2=0x5612276dfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:03.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276dfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e112a640 1 -- 172.21.15.76:0/1407211068 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612276dc370 con 0x5612276d14a0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.293+0000 7ff0e192b640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276e4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e112a640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e47f0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7f3b8d644254e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0c57fa640 1 -- 172.21.15.76:0/1407211068 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00f040 con 0x5612276d14a0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0cc035020 con 0x5612276d14a0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0c57fa640 1 -- 172.21.15.76:0/1407211068 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8658+0+0 (secure 0 0 0) 0x7ff0cc030670 con 0x5612276d14a0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0c57fa640 1 -- 172.21.15.76:0/1407211068 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff0cc030870 con 0x5612276d14a0 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 10 client.17847 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:03.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561227756290 con 0x5612276d14a0 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0c57fa640 1 -- 172.21.15.76:0/1407211068 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0cc035020 con 0x5612276d14a0 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0c57fa640 1 -- 172.21.15.76:0/1407211068 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff0cc02e040 con 0x5612276d14a0 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 10 client.17847 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 10 client.17847 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 20 client.17847 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561227756890 0x561227758c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 4 client.17847 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.294+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56122763ed60 con 0x561227756890 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e192b640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561227756890 0x561227758c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0c57fa640 10 client.17847 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e192b640 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561227756890 0x561227758c80 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203513ccf87a02f2 server_cookie=74c47e3ecd687b3b in_seq=0 out_seq=0 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0c57fa640 1 -- 172.21.15.76:0/1407211068 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56122763ed60 con 0x561227756890 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0c57fa640 10 client.17847 handle_command_reply: tid=0 2024-09-19T08:01:03.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 client.17847 shutdown 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 msgr2=0x5612276e47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e47f0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 shutdown_connections 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5612276dc680 0x5612276dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612276d1dc0 0x5612276e4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x561227756890 0x561227758c80 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 --2- 172.21.15.76:0/1407211068 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5612276d14a0 0x5612276e47f0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0c57fa640 0 client.17847 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 >> 172.21.15.76:0/1407211068 conn(0x5612276cda30 msgr2=0x5612276dab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 shutdown_connections 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.295+0000 7ff0e5f68740 1 -- 172.21.15.76:0/1407211068 wait complete. 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e5f68740 20 client.17847 trim_cache size 0 max 16384 2024-09-19T08:01:03.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0c80a33b0 msgr2=0x7ff0c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0c80a33b0 0x7ff0c80a5870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40ee810 tx=0x7ff0d40c1040 comp rx=0 tx=0).stop 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 msgr2=0x7ff0dc19e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc19e9d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4005cc0 tx=0x7ff0d402fa70 comp rx=0 tx=0).stop 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 shutdown_connections 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7ff0c80a33b0 0x7ff0c80a5870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff0dc105f40 0x7ff0dc19e9d0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0dc101450 0x7ff0dc1a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 --2- 172.21.15.76:0/1445639870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0dc100b30 0x7ff0dc1a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 >> 172.21.15.76:0/1445639870 conn(0x7ff0dc0fc7a0 msgr2=0x7ff0dc1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 shutdown_connections 2024-09-19T08:01:03.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:03.296+0000 7ff0e3b8f640 1 -- 172.21.15.76:0/1445639870 wait complete. 2024-09-19T08:01:04.111 INFO:tasks.cephfs.filesystem:scrub status for tag:003838b0-e6cd-492d-b425-e9cf9d3b8da0 - {'path': '/', 'tag': '003838b0-e6cd-492d-b425-e9cf9d3b8da0', 'options': 'recursive,force'} 2024-09-19T08:01:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:04 smithi137 ceph-mon[35309]: pgmap v306: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:04.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:04 smithi137 ceph-mon[35309]: scrub summary: idle 2024-09-19T08:01:04.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:04 smithi076 ceph-mon[30930]: pgmap v306: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:04.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:04 smithi076 ceph-mon[30930]: scrub summary: idle 2024-09-19T08:01:04.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:04 smithi152 ceph-mon[35117]: pgmap v306: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:04.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:04 smithi152 ceph-mon[35117]: scrub summary: idle 2024-09-19T08:01:06.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:06 smithi137 ceph-mon[35309]: pgmap v307: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:01:06.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:06 smithi076 ceph-mon[30930]: pgmap v307: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:01:06.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:06 smithi152 ceph-mon[35117]: pgmap v307: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:01:08.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:08 smithi137 ceph-mon[35309]: pgmap v308: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:01:08.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:08 smithi076 ceph-mon[30930]: pgmap v308: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:01:08.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:08 smithi152 ceph-mon[35117]: pgmap v308: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:01:10.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:10 smithi137 ceph-mon[35309]: pgmap v309: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:01:10.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:10 smithi137 ceph-mon[35309]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:01:10.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:10 smithi076 ceph-mon[30930]: pgmap v309: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:01:10.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:10 smithi076 ceph-mon[30930]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:01:10.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:10 smithi152 ceph-mon[35117]: pgmap v309: 97 pgs: 97 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:01:10.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:10 smithi152 ceph-mon[35117]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:01:12.407 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:12 smithi137 ceph-mon[35309]: pgmap v311: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:01:13.038 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:12 smithi152 ceph-mon[35117]: pgmap v311: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:01:13.038 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:12 smithi076 ceph-mon[30930]: pgmap v311: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:01:14.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:14 smithi137 ceph-mon[35309]: pgmap v312: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:01:14.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:14 smithi076 ceph-mon[30930]: pgmap v312: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:01:14.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:14 smithi152 ceph-mon[35117]: pgmap v312: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 171 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:01:16.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:16 smithi137 ceph-mon[35309]: pgmap v313: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:16.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:16 smithi076 ceph-mon[30930]: pgmap v313: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:16.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:16 smithi152 ceph-mon[35117]: pgmap v313: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:18 smithi152 ceph-mon[35117]: pgmap v314: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:18 smithi152 ceph-mon[35117]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:01:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:18 smithi137 ceph-mon[35309]: pgmap v314: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:18 smithi137 ceph-mon[35309]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:01:18.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:18 smithi076 ceph-mon[30930]: pgmap v314: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:18.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:18 smithi076 ceph-mon[30930]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:01:20.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:20 smithi152 ceph-mon[35117]: pgmap v316: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-09-19T08:01:20.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:20 smithi137 ceph-mon[35309]: pgmap v316: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-09-19T08:01:20.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:20 smithi076 ceph-mon[30930]: pgmap v316: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-09-19T08:01:22.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:22 smithi152 ceph-mon[35117]: pgmap v317: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:22.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:22 smithi137 ceph-mon[35309]: pgmap v317: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:22.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:22 smithi076 ceph-mon[30930]: pgmap v317: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:22.901 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T08:01:23.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 -- 172.21.15.76:0/1989023363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550106220 msgr2=0x7f2550106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 --2- 172.21.15.76:0/1989023363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550106220 0x7f2550106600 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2540009cd0 tx=0x7f254002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 -- 172.21.15.76:0/1989023363 shutdown_connections 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 --2- 172.21.15.76:0/1989023363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2550100fd0 0x7f255010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 --2- 172.21.15.76:0/1989023363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2550100630 0x7f2550100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 --2- 172.21.15.76:0/1989023363 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550106220 0x7f2550106600 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 -- 172.21.15.76:0/1989023363 >> 172.21.15.76:0/1989023363 conn(0x7f2550075ef0 msgr2=0x7f2550076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 -- 172.21.15.76:0/1989023363 shutdown_connections 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.017+0000 7f2557aba640 1 -- 172.21.15.76:0/1989023363 wait complete. 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 Processor -- start 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 -- start start 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2550100630 0x7f25501973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 0x7f25501978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2550106220 0x7f255019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f25501106e0 con 0x7f2550100fd0 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2550110560 con 0x7f2550106220 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2557aba640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2550110860 con 0x7f2550100630 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 0x7f25501978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 0x7f25501978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55064/0 (socket says 172.21.15.76:55064) 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 -- 172.21.15.76:0/2270252751 learned_addr learned my addr 172.21.15.76:0/2270252751 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555856640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2550100630 0x7f25501973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 -- 172.21.15.76:0/2270252751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2550100630 msgr2=0x7f25501973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2550100630 0x7f25501973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 -- 172.21.15.76:0/2270252751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2550106220 msgr2=0x7f255019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2556057640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2550106220 0x7f255019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2550106220 0x7f255019bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.018+0000 7f2555055640 1 -- 172.21.15.76:0/2270252751 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255019c390 con 0x7f2550100fd0 2024-09-19T08:01:23.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.019+0000 7f2555055640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 0x7f25501978e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f254400c890 tx=0x7f254400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:23.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.019+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544004220 con 0x7f2550100fd0 2024-09-19T08:01:23.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.019+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25440043c0 con 0x7f2550100fd0 2024-09-19T08:01:23.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.019+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255019c680 con 0x7f2550100fd0 2024-09-19T08:01:23.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.019+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544004b10 con 0x7f2550100fd0 2024-09-19T08:01:23.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.019+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25501a3f10 con 0x7f2550100fd0 2024-09-19T08:01:23.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.020+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2550100a90 con 0x7f2550100fd0 2024-09-19T08:01:23.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.021+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f25440051b0 con 0x7f2550100fd0 2024-09-19T08:01:23.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.022+0000 7f254effd640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f25380a3460 0x7f25380a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.022+0000 7f2555856640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f25380a3460 0x7f25380a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.022+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f25440cfec0 con 0x7f2550100fd0 2024-09-19T08:01:23.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.022+0000 7f2555856640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f25380a3460 0x7f25380a5920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2540031040 tx=0x7f2540000f40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:23.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.025+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2544014030 con 0x7f2550100fd0 2024-09-19T08:01:23.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.212+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2550104eb0 con 0x7f25380a3460 2024-09-19T08:01:23.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.220+0000 7f254effd640 1 -- 172.21.15.76:0/2270252751 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f2550104eb0 con 0x7f25380a3460 2024-09-19T08:01:23.221 INFO:teuthology.orchestra.run.smithi076.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T07:51:21", "first": "2024-09-19T07:52:00", "last": "2024-09-19T08:01:00", "last_pruned": "2024-09-19T08:01:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f25380a3460 msgr2=0x7f25380a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f25380a3460 0x7f25380a5920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2540031040 tx=0x7f2540000f40 comp rx=0 tx=0).stop 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 msgr2=0x7f25501978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 0x7f25501978e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f254400c890 tx=0x7f254400cd50 comp rx=0 tx=0).stop 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 shutdown_connections 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f25380a3460 0x7f25380a5920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2550106220 0x7f255019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2550100fd0 0x7f25501978e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.222+0000 7f2557aba640 1 --2- 172.21.15.76:0/2270252751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2550100630 0x7f25501973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.223+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 >> 172.21.15.76:0/2270252751 conn(0x7f2550075ef0 msgr2=0x7f25501047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.223+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 shutdown_connections 2024-09-19T08:01:23.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.223+0000 7f2557aba640 1 -- 172.21.15.76:0/2270252751 wait complete. 2024-09-19T08:01:23.237 DEBUG:teuthology.orchestra.run.smithi076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T08:01:23.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 -- 172.21.15.76:0/413226610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb638101250 msgr2=0x7fb638107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/413226610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb638101250 0x7fb638107990 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb620009ca0 tx=0x7fb62002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 -- 172.21.15.76:0/413226610 shutdown_connections 2024-09-19T08:01:23.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/413226610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 0x7fb63810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/413226610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb638101250 0x7fb638107990 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/413226610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6381008a0 0x7fb638100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 -- 172.21.15.76:0/413226610 >> 172.21.15.76:0/413226610 conn(0x7fb638075ef0 msgr2=0x7fb638076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 -- 172.21.15.76:0/413226610 shutdown_connections 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.338+0000 7fb63d6a5640 1 -- 172.21.15.76:0/413226610 wait complete. 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 Processor -- start 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 -- start start 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 0x7fb638198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 0x7fb638198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63819ccd0 0x7fb63819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb638112080 con 0x7fb6381008a0 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb638111f00 con 0x7fb6381080f0 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb63d6a5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb638112200 con 0x7fb63819ccd0 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 0x7fb638198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 0x7fb638198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55084/0 (socket says 172.21.15.76:55084) 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 -- 172.21.15.76:0/595713462 learned_addr learned my addr 172.21.15.76:0/595713462 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb6367fc640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 0x7fb638198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb6377fe640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63819ccd0 0x7fb63819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 -- 172.21.15.76:0/595713462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63819ccd0 msgr2=0x7fb63819d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63819ccd0 0x7fb63819d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 -- 172.21.15.76:0/595713462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 msgr2=0x7fb638198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 0x7fb638198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb636ffd640 1 -- 172.21.15.76:0/595713462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63819d7c0 con 0x7fb6381008a0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.339+0000 7fb6367fc640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 0x7fb638198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.340+0000 7fb636ffd640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 0x7fb638198410 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb63000d950 tx=0x7fb63000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.340+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630017030 con 0x7fb6381008a0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.340+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb630004020 con 0x7fb6381008a0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.340+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63819dab0 con 0x7fb6381008a0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.340+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630004a00 con 0x7fb6381008a0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.340+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381a5240 con 0x7fb6381008a0 2024-09-19T08:01:23.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.341+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638100c80 con 0x7fb6381008a0 2024-09-19T08:01:23.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.342+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb6300041d0 con 0x7fb6381008a0 2024-09-19T08:01:23.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.343+0000 7fb62ffff640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6240a3460 0x7fb6240a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:23.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.343+0000 7fb6367fc640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6240a3460 0x7fb6240a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:23.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.343+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fb6300cf8c0 con 0x7fb6381008a0 2024-09-19T08:01:23.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.343+0000 7fb6367fc640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6240a3460 0x7fb6240a5920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6380fed10 tx=0x7fb6200093f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:23.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.347+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb63009c210 con 0x7fb6381008a0 2024-09-19T08:01:23.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.532+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 --> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb638101460 con 0x7fb6240a3460 2024-09-19T08:01:23.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.540+0000 7fb62ffff640 1 -- 172.21.15.76:0/595713462 <== mgr.15132 v2:172.21.15.76:6800/4082879407 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb638101460 con 0x7fb6240a3460 2024-09-19T08:01:23.540 INFO:teuthology.orchestra.run.smithi076.stdout:/ 1m 6m3h 2024-09-19T08:01:23.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6240a3460 msgr2=0x7fb6240a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6240a3460 0x7fb6240a5920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6380fed10 tx=0x7fb6200093f0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 msgr2=0x7fb638198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 0x7fb638198410 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb63000d950 tx=0x7fb63000de10 comp rx=0 tx=0).stop 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 shutdown_connections 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb6240a3460 0x7fb6240a5920 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63819ccd0 0x7fb63819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6381080f0 0x7fb638198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 --2- 172.21.15.76:0/595713462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb6381008a0 0x7fb638198410 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:23.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 >> 172.21.15.76:0/595713462 conn(0x7fb638075ef0 msgr2=0x7fb6380ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:23.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 shutdown_connections 2024-09-19T08:01:23.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:23.542+0000 7fb63d6a5640 1 -- 172.21.15.76:0/595713462 wait complete. 2024-09-19T08:01:23.554 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T08:01:23.566 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T08:01:24.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:24 smithi152 ceph-mon[35117]: pgmap v318: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:24.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:24 smithi152 ceph-mon[35117]: from='client.17853 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:24.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:24 smithi152 ceph-mon[35117]: from='client.17859 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:24.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:24 smithi137 ceph-mon[35309]: pgmap v318: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:24.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:24 smithi137 ceph-mon[35309]: from='client.17853 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:24.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:24 smithi137 ceph-mon[35309]: from='client.17859 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:24.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:24 smithi076 ceph-mon[30930]: pgmap v318: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:01:24.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:24 smithi076 ceph-mon[30930]: from='client.17853 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:24.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:24 smithi076 ceph-mon[30930]: from='client.17859 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:01:26.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:26 smithi152 ceph-mon[35117]: pgmap v319: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T08:01:26.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:26 smithi137 ceph-mon[35309]: pgmap v319: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T08:01:26.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:26 smithi076 ceph-mon[30930]: pgmap v319: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T08:01:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:28 smithi152 ceph-mon[35117]: pgmap v320: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T08:01:28.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:28 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:28.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:28 smithi137 ceph-mon[35309]: pgmap v320: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T08:01:28.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:28 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:28.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:28 smithi076 ceph-mon[30930]: pgmap v320: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T08:01:28.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:28 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:01:30.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: pgmap v321: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.562 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: Unable to set osd_memory_target on smithi137 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.563 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-19T08:01:30.564 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: Adjusting osd_memory_target on smithi076 to 176.0M 2024-09-19T08:01:30.564 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: Unable to set osd_memory_target on smithi152 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T08:01:30.564 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: Unable to set osd_memory_target on smithi076 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T08:01:30.564 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:01:30.564 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:01:30.564 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:30 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: pgmap v321: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T08:01:30.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: Unable to set osd_memory_target on smithi137 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: Adjusting osd_memory_target on smithi076 to 176.0M 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: Unable to set osd_memory_target on smithi152 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: Unable to set osd_memory_target on smithi076 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:01:30.656 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:01:30.657 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:30 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: pgmap v321: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: Unable to set osd_memory_target on smithi137 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.695 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi152 to 176.0M 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: Adjusting osd_memory_target on smithi076 to 176.0M 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: Unable to set osd_memory_target on smithi152 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: Unable to set osd_memory_target on smithi076 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:01:30.696 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:30 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' 2024-09-19T08:01:32.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:32 smithi152 ceph-mon[35117]: pgmap v322: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:01:32.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:32 smithi137 ceph-mon[35309]: pgmap v322: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:01:32.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:32 smithi076 ceph-mon[30930]: pgmap v322: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:01:34.113 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:01:34.370 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:34.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:34 smithi076 ceph-mon[30930]: pgmap v323: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:01:34.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:34 smithi152 ceph-mon[35117]: pgmap v323: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:01:34.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:34 smithi137 ceph-mon[35309]: pgmap v323: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 -- 172.21.15.76:0/3841191154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 msgr2=0x7fe18010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 --2- 172.21.15.76:0/3841191154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe18010d950 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe178009cd0 tx=0x7fe17802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 -- 172.21.15.76:0/3841191154 shutdown_connections 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 --2- 172.21.15.76:0/3841191154 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe18010d950 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 --2- 172.21.15.76:0/3841191154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 0x7fe180100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 --2- 172.21.15.76:0/3841191154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 0x7fe180106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 -- 172.21.15.76:0/3841191154 >> 172.21.15.76:0/3841191154 conn(0x7fe1800fc7a0 msgr2=0x7fe1800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 -- 172.21.15.76:0/3841191154 shutdown_connections 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.842+0000 7fe18484d640 1 -- 172.21.15.76:0/3841191154 wait complete. 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 Processor -- start 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 -- start start 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 0x7fe180198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe1801989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 0x7fe18019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe180110fa0 con 0x7fe180101420 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe180110e20 con 0x7fe180100a80 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.843+0000 7fe18484d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe180111120 con 0x7fe180106a80 2024-09-19T08:01:34.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe1801989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe1801989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49812/0 (socket says 172.21.15.76:49812) 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 -- 172.21.15.76:0/4192762082 learned_addr learned my addr 172.21.15.76:0/4192762082 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17e59c640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 0x7fe180198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 0x7fe18019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 -- 172.21.15.76:0/4192762082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 msgr2=0x7fe18019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 0x7fe18019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 -- 172.21.15.76:0/4192762082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 msgr2=0x7fe180198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 0x7fe180198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 -- 172.21.15.76:0/4192762082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18019d440 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 0x7fe18019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17e59c640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 0x7fe180198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe1801989d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe16800d950 tx=0x7fe16800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe1777fe640 1 -- 172.21.15.76:0/4192762082 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168017070 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe1777fe640 1 -- 172.21.15.76:0/4192762082 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe168009c30 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18019d730 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe1777fe640 1 -- 172.21.15.76:0/4192762082 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16800f740 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.844+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1801a5010 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.846+0000 7fe1777fe640 1 -- 172.21.15.76:0/4192762082 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe168010a80 con 0x7fe180101420 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 Processor -- start 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 -- start start 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae07632c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae0763d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae0763fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55ae075942e0 con 0x55ae076328b0 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ae0753bce0 con 0x55ae0763da90 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe186c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ae075902a0 con 0x55ae076331d0 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe17ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae07632c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe17ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae07632c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49822/0 (socket says 172.21.15.76:49822) 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe17ed9d640 1 -- 172.21.15.76:0/2094540135 learned_addr learned my addr 172.21.15.76:0/2094540135 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:34.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe1777fe640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe16c0a33b0 0x7fe16c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe17e59c640 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae0763d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe16c0a33b0 0x7fe16c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.847+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae0763fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe1777fe640 1 -- 172.21.15.76:0/4192762082 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fe1680cfab0 con 0x7fe180101420 2024-09-19T08:01:34.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 -- 172.21.15.76:0/2094540135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 msgr2=0x55ae0763d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae0763d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 -- 172.21.15.76:0/2094540135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 msgr2=0x55ae0763fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae0763fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 -- 172.21.15.76:0/2094540135 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae07520440 con 0x55ae076328b0 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae0763fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae07632c90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe178005e30 tx=0x7fe178031e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe4aac1537e34f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe16c0a33b0 0x7fe16c0a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe178009430 tx=0x7fe178048000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:34.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe174ff9640 1 -- 172.21.15.76:0/2094540135 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178004b40 con 0x55ae076328b0 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe174ff9640 1 -- 172.21.15.76:0/2094540135 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe178036040 con 0x55ae076328b0 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.848+0000 7fe174ff9640 1 -- 172.21.15.76:0/2094540135 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178030800 con 0x55ae076328b0 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 -- 172.21.15.76:0/2094540135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 msgr2=0x55ae07632c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae07632c90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe178005e30 tx=0x7fe178031e10 comp rx=0 tx=0).stop 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 -- 172.21.15.76:0/2094540135 shutdown_connections 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae0763fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae0763d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 --2- 172.21.15.76:0/2094540135 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae07632c90 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 -- 172.21.15.76:0/2094540135 >> 172.21.15.76:0/2094540135 conn(0x55ae0762ee40 msgr2=0x55ae0762f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 -- 172.21.15.76:0/2094540135 shutdown_connections 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 -- 172.21.15.76:0/2094540135 wait complete. 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 -- start start 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.849+0000 7fe186c26740 1 Processor -- start 2024-09-19T08:01:34.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae0763d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 0x55ae0763a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae0763da90 0x55ae0763ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55ae07640660 con 0x55ae076331d0 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ae0754f050 con 0x55ae076328b0 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ae076407e0 con 0x55ae0763da90 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 10 client.0 _ll_register_callbacks cb 0x55ae0758f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 0x55ae0763a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 0x55ae0763a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49836/0 (socket says 172.21.15.76:49836) 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 -- 172.21.15.76:0/2255229 learned_addr learned my addr 172.21.15.76:0/2255229 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17e59c640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae0763d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae0763da90 0x55ae0763ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 -- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae0763da90 msgr2=0x55ae0763ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae0763da90 0x55ae0763ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 -- 172.21.15.76:0/2255229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 msgr2=0x55ae0763d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae0763d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 -- 172.21.15.76:0/2255229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae073053c0 con 0x55ae076331d0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae0763da90 0x55ae0763ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17e59c640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae0763d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 0x55ae0763a6f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe168098160 tx=0x7fe168018460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b547f5d3b99b526c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe165ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe165ffb640 1 -- 172.21.15.76:0/2255229 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168020040 con 0x55ae076331d0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe165ffb640 1 -- 172.21.15.76:0/2255229 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fe1680a44e0 con 0x55ae076331d0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe178036040 con 0x55ae076331d0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe165ffb640 1 -- 172.21.15.76:0/2255229 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe168018270 con 0x55ae076331d0 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 10 client.17871 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:34.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.850+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ae0764c0c0 con 0x55ae076331d0 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe165ffb640 1 -- 172.21.15.76:0/2255229 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe178036040 con 0x55ae076331d0 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe165ffb640 1 -- 172.21.15.76:0/2255229 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe168094050 con 0x55ae076331d0 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe186c26740 10 client.17871 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe186c26740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe186c26740 20 client.17871 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe186c26740 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae0764d580 0x55ae0764f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe186c26740 4 client.17871 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae075a1850 con 0x55ae0764d580 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.851+0000 7fe17e59c640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae0764d580 0x55ae0764f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe165ffb640 10 client.17871 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe17e59c640 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae0764d580 0x55ae0764f9d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a090f0e89551ed3 server_cookie=a87074ccbc492294 in_seq=0 out_seq=0 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe165ffb640 1 -- 172.21.15.76:0/2255229 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae075a1850 con 0x55ae0764d580 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe165ffb640 10 client.17871 handle_command_reply: tid=0 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 client.17871 shutdown 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 msgr2=0x55ae0763a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 0x55ae0763a6f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe168098160 tx=0x7fe168018460 comp rx=0 tx=0).stop 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 shutdown_connections 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae0763da90 0x55ae0763ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae0764d580 0x55ae0764f9d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076331d0 0x55ae0763a6f0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 --2- 172.21.15.76:0/2255229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae0763d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe165ffb640 0 client.17871 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.852+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 >> 172.21.15.76:0/2255229 conn(0x55ae0762ee40 msgr2=0x55ae07629b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.853+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 shutdown_connections 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.853+0000 7fe186c26740 1 -- 172.21.15.76:0/2255229 wait complete. 2024-09-19T08:01:34.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.853+0000 7fe186c26740 20 client.17871 trim_cache size 0 max 16384 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 Processor -- start 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 -- start start 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae076498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07638fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 0x55ae076552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801ae1c0 con 0x55ae0763da90 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801aba90 con 0x55ae076328b0 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe186c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801a9900 con 0x55ae076331d0 2024-09-19T08:01:34.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 0x55ae076552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 0x55ae076552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49842/0 (socket says 172.21.15.76:49842) 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 -- 172.21.15.76:0/1077041759 learned_addr learned my addr 172.21.15.76:0/1077041759 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17e59c640 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae076498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 -- 172.21.15.76:0/1077041759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 msgr2=0x55ae07638fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07638fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 -- 172.21.15.76:0/1077041759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 msgr2=0x55ae076498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae076498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.870+0000 7fe17ed9d640 1 -- 172.21.15.76:0/1077041759 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae076396a0 con 0x55ae0763da90 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.871+0000 7fe17ed9d640 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 0x55ae076552a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fe1780315c0 tx=0x7fe17802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe4640f573cb399 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:34.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.871+0000 7fe167fff640 1 -- 172.21.15.76:0/1077041759 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1780319c0 con 0x55ae0763da90 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.871+0000 7fe167fff640 1 -- 172.21.15.76:0/1077041759 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe178036030 con 0x55ae0763da90 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.871+0000 7fe167fff640 1 -- 172.21.15.76:0/1077041759 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178030dd0 con 0x55ae0763da90 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- 172.21.15.76:0/1077041759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 msgr2=0x55ae076552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 0x55ae076552a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fe1780315c0 tx=0x7fe17802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- 172.21.15.76:0/1077041759 shutdown_connections 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae0763da90 0x55ae076552a0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07638fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- 172.21.15.76:0/1077041759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae076328b0 0x55ae076498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- 172.21.15.76:0/1077041759 >> 172.21.15.76:0/1077041759 conn(0x55ae0762ee40 msgr2=0x55ae0763c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- 172.21.15.76:0/1077041759 shutdown_connections 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- 172.21.15.76:0/1077041759 wait complete. 2024-09-19T08:01:34.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- start start 2024-09-19T08:01:34.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 Processor -- start 2024-09-19T08:01:34.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae076417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07641ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae07642220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801a9f50 con 0x55ae076328b0 2024-09-19T08:01:34.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801ab3c0 con 0x55ae0763da90 2024-09-19T08:01:34.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1801aa620 con 0x55ae076331d0 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe186c26740 10 client.0 _ll_register_callbacks cb 0x7fe16809b840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae076417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae076417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49856/0 (socket says 172.21.15.76:49856) 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.872+0000 7fe17e59c640 1 -- 172.21.15.76:0/694431623 learned_addr learned my addr 172.21.15.76:0/694431623 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07641ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17e59c640 1 -- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 msgr2=0x55ae07641ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17e59c640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07641ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17e59c640 1 -- 172.21.15.76:0/694431623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 msgr2=0x55ae07642220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17e59c640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae07642220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17e59c640 1 -- 172.21.15.76:0/694431623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae07633000 con 0x55ae076328b0 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07641ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:34.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe17e59c640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae076417a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe170005fd0 tx=0x7fe170012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8e79b67d7855b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe165ffb640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe165ffb640 1 -- 172.21.15.76:0/694431623 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17001f020 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe165ffb640 1 -- 172.21.15.76:0/694431623 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fe170004440 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe178036030 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe165ffb640 1 -- 172.21.15.76:0/694431623 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe17002a050 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe186c26740 10 client.17877 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ae076b8400 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe165ffb640 1 -- 172.21.15.76:0/694431623 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe178036030 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.873+0000 7fe165ffb640 1 -- 172.21.15.76:0/694431623 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe17001b6c0 con 0x55ae076328b0 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 10 client.17877 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 10 client.17877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:34.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 20 client.17877 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae076b8b50 0x55ae076baf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 4 client.17877 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae0759bd60 con 0x55ae076b8b50 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae076b8b50 0x55ae076baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe17dd9b640 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae076b8b50 0x55ae076baf70 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=498e9e263e287b08 server_cookie=4620a692faaeae06 in_seq=0 out_seq=0 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe165ffb640 10 client.17877 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe165ffb640 1 -- 172.21.15.76:0/694431623 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ae0759bd60 con 0x55ae076b8b50 2024-09-19T08:01:34.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe165ffb640 10 client.17877 handle_command_reply: tid=0 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 1 client.17877 shutdown 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 msgr2=0x55ae076417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.874+0000 7fe186c26740 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae076417a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe170005fd0 tx=0x7fe170012820 comp rx=0 tx=0).stop 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 shutdown_connections 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ae0763da90 0x55ae07642220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ae076331d0 0x55ae07641ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55ae076b8b50 0x55ae076baf70 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 --2- 172.21.15.76:0/694431623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ae076328b0 0x55ae076417a0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe165ffb640 0 client.17877 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:34.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 >> 172.21.15.76:0/694431623 conn(0x55ae0762ee40 msgr2=0x55ae07635c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:34.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 shutdown_connections 2024-09-19T08:01:34.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 1 -- 172.21.15.76:0/694431623 wait complete. 2024-09-19T08:01:34.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe186c26740 20 client.17877 trim_cache size 0 max 16384 2024-09-19T08:01:34.886 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:34.886 INFO:teuthology.orchestra.run.smithi076.stdout: "status": "no active scrubs running", 2024-09-19T08:01:34.887 INFO:teuthology.orchestra.run.smithi076.stdout: "scrubs": {} 2024-09-19T08:01:34.887 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:34.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe16c0a33b0 msgr2=0x7fe16c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe16c0a33b0 0x7fe16c0a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe178009430 tx=0x7fe178048000 comp rx=0 tx=0).stop 2024-09-19T08:01:34.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 msgr2=0x7fe1801989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:34.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe1801989d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe16800d950 tx=0x7fe16800de10 comp rx=0 tx=0).stop 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 shutdown_connections 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe16c0a33b0 0x7fe16c0a5870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe180106a80 0x7fe18019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe180101420 0x7fe1801989d0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 --2- 172.21.15.76:0/4192762082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe180100a80 0x7fe180198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 >> 172.21.15.76:0/4192762082 conn(0x7fe1800fc7a0 msgr2=0x7fe180104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 shutdown_connections 2024-09-19T08:01:34.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:34.875+0000 7fe18484d640 1 -- 172.21.15.76:0/4192762082 wait complete. 2024-09-19T08:01:35.638 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:01:35.639 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:01:35.887 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:36.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 -- 172.21.15.76:0/999133377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c8101f80 msgr2=0x7f03c810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:36.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 --2- 172.21.15.76:0/999133377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c8101f80 0x7f03c810d9b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009ca0 tx=0x7f03c002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 -- 172.21.15.76:0/999133377 shutdown_connections 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 --2- 172.21.15.76:0/999133377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c8101f80 0x7f03c810d9b0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 --2- 172.21.15.76:0/999133377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c81015e0 0x7f03c8101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 --2- 172.21.15.76:0/999133377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 0x7f03c81070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.325+0000 7f03cf926640 1 -- 172.21.15.76:0/999133377 >> 172.21.15.76:0/999133377 conn(0x7f03c80fba90 msgr2=0x7f03c80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 -- 172.21.15.76:0/999133377 shutdown_connections 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 -- 172.21.15.76:0/999133377 wait complete. 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 Processor -- start 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 -- start start 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 0x7f03c8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c8101f80 0x7f03c8198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 0x7f03c819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:36.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f03c8111130 con 0x7f03c81015e0 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03c8110fb0 con 0x7f03c8101f80 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cf926640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81112b0 con 0x7f03c8106d00 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cd6c2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 0x7f03c8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cd6c2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 0x7f03c8198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49876/0 (socket says 172.21.15.76:49876) 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.326+0000 7f03cd6c2640 1 -- 172.21.15.76:0/1428983060 learned_addr learned my addr 172.21.15.76:0/1428983060 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03ccec1640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c8101f80 0x7f03c8198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cdec3640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 0x7f03c819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cd6c2640 1 -- 172.21.15.76:0/1428983060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 msgr2=0x7f03c819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cd6c2640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 0x7f03c819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cd6c2640 1 -- 172.21.15.76:0/1428983060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c8101f80 msgr2=0x7f03c8198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cd6c2640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c8101f80 0x7f03c8198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cd6c2640 1 -- 172.21.15.76:0/1428983060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c819d620 con 0x7f03c81015e0 2024-09-19T08:01:36.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03ccec1640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c8101f80 0x7f03c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cdec3640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 0x7f03c819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cd6c2640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 0x7f03c8198670 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f03b800b4a0 tx=0x7f03b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8014070 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03b8010b10 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c819d910 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8017d60 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.327+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c81a51f0 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.328+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c8101a40 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.329+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f03b8017070 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.330+0000 7f03c67fc640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03b00a33b0 0x7f03b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.330+0000 7f03ccec1640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03b00a33b0 0x7f03b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.330+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f03b80cf540 con 0x7f03c81015e0 2024-09-19T08:01:36.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.330+0000 7f03ccec1640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03b00a33b0 0x7f03b00a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006fd0 tx=0x7f03bc008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:36.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.333+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03b809bfa0 con 0x7f03c81015e0 2024-09-19T08:01:36.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.532+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03c81999d0 con 0x7f03c81015e0 2024-09-19T08:01:36.534 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:36 smithi076 ceph-mon[30930]: pgmap v324: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:01:36.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.533+0000 7f03c67fc640 1 -- 172.21.15.76:0/1428983060 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f03b809b8a0 con 0x7f03c81015e0 2024-09-19T08:01:36.535 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:01:36.535 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T08:01:36.535 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T08:01:36.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03b00a33b0 msgr2=0x7f03b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:36.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03b00a33b0 0x7f03b00a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006fd0 tx=0x7f03bc008040 comp rx=0 tx=0).stop 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 msgr2=0x7f03c8198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 0x7f03c8198670 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f03b800b4a0 tx=0x7f03b800b960 comp rx=0 tx=0).stop 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 shutdown_connections 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f03b00a33b0 0x7f03b00a5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03c8106d00 0x7f03c819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03c8101f80 0x7f03c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 --2- 172.21.15.76:0/1428983060 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f03c81015e0 0x7f03c8198670 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 >> 172.21.15.76:0/1428983060 conn(0x7f03c80fba90 msgr2=0x7f03c81048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 shutdown_connections 2024-09-19T08:01:36.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:36.535+0000 7f03cf926640 1 -- 172.21.15.76:0/1428983060 wait complete. 2024-09-19T08:01:36.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:36 smithi152 ceph-mon[35117]: pgmap v324: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:01:36.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:36 smithi137 ceph-mon[35309]: pgmap v324: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:01:37.253 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:01:37.500 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:37.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:37 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1428983060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:01:37.611 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:37 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1428983060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:01:37.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:37 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1428983060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:01:37.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/3431997033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c106a80 msgr2=0x7f2a9c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:37.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/3431997033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c106a80 0x7f2a9c106e60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009930 tx=0x7f2a8c02a420 comp rx=0 tx=0).stop 2024-09-19T08:01:37.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/3431997033 shutdown_connections 2024-09-19T08:01:37.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/3431997033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a9c101420 0x7f2a9c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/3431997033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a9c100a80 0x7f2a9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/3431997033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c106a80 0x7f2a9c106e60 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/3431997033 >> 172.21.15.76:0/3431997033 conn(0x7f2a9c0fc7a0 msgr2=0x7f2a9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:37.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/3431997033 shutdown_connections 2024-09-19T08:01:37.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.927+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/3431997033 wait complete. 2024-09-19T08:01:37.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 Processor -- start 2024-09-19T08:01:37.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 -- start start 2024-09-19T08:01:37.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a9c100a80 0x7f2a9c0fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 0x7f2a9c0fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a9c106a80 0x7f2a9c0fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c111000 con 0x7f2a9c101420 2024-09-19T08:01:37.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c110e80 con 0x7f2a9c100a80 2024-09-19T08:01:37.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2aa1e1a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c111180 con 0x7f2a9c106a80 2024-09-19T08:01:37.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2a93fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 0x7f2a9c0fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2a93fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 0x7f2a9c0fd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49902/0 (socket says 172.21.15.76:49902) 2024-09-19T08:01:37.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.928+0000 7f2a93fff640 1 -- 172.21.15.76:0/1247053515 learned_addr learned my addr 172.21.15.76:0/1247053515 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:37.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a9c106a80 0x7f2a9c0fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a9c100a80 0x7f2a9c0fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a93fff640 1 -- 172.21.15.76:0/1247053515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a9c106a80 msgr2=0x7f2a9c0fd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:37.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a93fff640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a9c106a80 0x7f2a9c0fd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a93fff640 1 -- 172.21.15.76:0/1247053515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a9c100a80 msgr2=0x7f2a9c0fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:37.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a93fff640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a9c100a80 0x7f2a9c0fcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a93fff640 1 -- 172.21.15.76:0/1247053515 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c1a6ab0 con 0x7f2a9c101420 2024-09-19T08:01:37.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a93fff640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 0x7f2a9c0fd290 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b4a0 tx=0x7f2a8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:37.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a997fa640 1 -- 172.21.15.76:0/1247053515 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84014070 con 0x7f2a9c101420 2024-09-19T08:01:37.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a997fa640 1 -- 172.21.15.76:0/1247053515 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a84010b10 con 0x7f2a9c101420 2024-09-19T08:01:37.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c1a6da0 con 0x7f2a9c101420 2024-09-19T08:01:37.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2a997fa640 1 -- 172.21.15.76:0/1247053515 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84017d60 con 0x7f2a9c101420 2024-09-19T08:01:37.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.929+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c1a7250 con 0x7f2a9c101420 2024-09-19T08:01:37.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a997fa640 1 -- 172.21.15.76:0/1247053515 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2a84017070 con 0x7f2a9c101420 2024-09-19T08:01:37.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 Processor -- start 2024-09-19T08:01:37.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 -- start start 2024-09-19T08:01:37.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 0x556e6b8f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8fd370 0x556e6b8ff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a997fa640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a880a33b0 0x7f2a880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556e6b8582f0 con 0x556e6b8f3b40 2024-09-19T08:01:37.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556e6b7ffcf0 con 0x556e6b8fd370 2024-09-19T08:01:37.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556e6b8542b0 con 0x556e6b8f25d0 2024-09-19T08:01:37.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 0x556e6b8f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 0x556e6b8f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49910/0 (socket says 172.21.15.76:49910) 2024-09-19T08:01:37.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a9bfff640 1 -- 172.21.15.76:0/3758421403 learned_addr learned my addr 172.21.15.76:0/3758421403 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:37.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a997fa640 1 -- 172.21.15.76:0/1247053515 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f2a840cef60 con 0x7f2a9c101420 2024-09-19T08:01:37.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.932+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a880a33b0 0x7f2a880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a93fff640 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8fd370 0x556e6b8ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 -- 172.21.15.76:0/3758421403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 msgr2=0x556e6b8f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 -- 172.21.15.76:0/3758421403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8fd370 msgr2=0x556e6b8ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8fd370 0x556e6b8ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 -- 172.21.15.76:0/3758421403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6b7e43a0 con 0x556e6b8f3b40 2024-09-19T08:01:37.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a93fff640 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8fd370 0x556e6b8ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:37.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 0x556e6b8f2090 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2a94012a70 tx=0x7f2a94012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dc51cc278bbf69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:37.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a880a33b0 0x7f2a880a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a94010800 tx=0x7f2a9401d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:37.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a91ffb640 1 -- 172.21.15.76:0/3758421403 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a940124b0 con 0x556e6b8f3b40 2024-09-19T08:01:37.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a91ffb640 1 -- 172.21.15.76:0/3758421403 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a94010d10 con 0x556e6b8f3b40 2024-09-19T08:01:37.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.933+0000 7f2a91ffb640 1 -- 172.21.15.76:0/3758421403 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94005730 con 0x556e6b8f3b40 2024-09-19T08:01:37.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 -- 172.21.15.76:0/3758421403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 msgr2=0x556e6b8f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:37.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 0x556e6b8f2090 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2a94012a70 tx=0x7f2a94012f30 comp rx=0 tx=0).stop 2024-09-19T08:01:37.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 -- 172.21.15.76:0/3758421403 shutdown_connections 2024-09-19T08:01:37.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8fd370 0x556e6b8ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/3758421403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f3b40 0x556e6b8f2090 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 -- 172.21.15.76:0/3758421403 >> 172.21.15.76:0/3758421403 conn(0x556e6b8bb310 msgr2=0x556e6b8eec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:37.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 -- 172.21.15.76:0/3758421403 shutdown_connections 2024-09-19T08:01:37.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 -- 172.21.15.76:0/3758421403 wait complete. 2024-09-19T08:01:37.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.934+0000 7f2aa41f3740 1 -- start start 2024-09-19T08:01:37.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 Processor -- start 2024-09-19T08:01:37.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 0x556e6b8fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8fd370 0x556e6b8fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x556e6b900010 con 0x556e6b8f25d0 2024-09-19T08:01:37.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556e6b813060 con 0x556e6b8f3b40 2024-09-19T08:01:37.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556e6b900190 con 0x556e6b8fd370 2024-09-19T08:01:37.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2aa41f3740 10 client.0 _ll_register_callbacks cb 0x556e6b5668c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:37.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 0x556e6b8fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 0x556e6b8fcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49918/0 (socket says 172.21.15.76:49918) 2024-09-19T08:01:37.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 -- 172.21.15.76:0/4014262338 learned_addr learned my addr 172.21.15.76:0/4014262338 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:37.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8fd370 0x556e6b8fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a93fff640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 -- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8fd370 msgr2=0x556e6b8fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8fd370 0x556e6b8fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 -- 172.21.15.76:0/4014262338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 msgr2=0x556e6b8fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 -- 172.21.15.76:0/4014262338 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6b5c93c0 con 0x556e6b8f25d0 2024-09-19T08:01:37.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 0x556e6b8fcd50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c000c00 tx=0x7f2a8c0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783d98c7c6fe4565 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:37.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.935+0000 7f2a7affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:37.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2a7affd640 1 -- 172.21.15.76:0/4014262338 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c035040 con 0x556e6b8f25d0 2024-09-19T08:01:37.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2a7affd640 1 -- 172.21.15.76:0/4014262338 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f2a8c004240 con 0x556e6b8f25d0 2024-09-19T08:01:37.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a94010d10 con 0x556e6b8f25d0 2024-09-19T08:01:37.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2a7affd640 1 -- 172.21.15.76:0/4014262338 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a8c004440 con 0x556e6b8f25d0 2024-09-19T08:01:37.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 10 client.17895 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:37.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556e6b90ba90 con 0x556e6b8f25d0 2024-09-19T08:01:37.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2a7affd640 1 -- 172.21.15.76:0/4014262338 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a94010d10 con 0x556e6b8f25d0 2024-09-19T08:01:37.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2a7affd640 1 -- 172.21.15.76:0/4014262338 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2a8c0035f0 con 0x556e6b8f25d0 2024-09-19T08:01:37.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 10 client.17895 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:37.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 10 client.17895 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:01:37.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 20 client.17895 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:37.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b90f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 4 client.17895 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:01:37.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.936+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e6b865860 con 0x556e6b90cf50 2024-09-19T08:01:37.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.937+0000 7f2a93fff640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b90f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.937+0000 7f2a93fff640 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b90f340 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b118642cac575c9 server_cookie=e4de0117c2c09e2 in_seq=0 out_seq=0 2024-09-19T08:01:37.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.937+0000 7f2a7affd640 10 client.17895 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:01:37.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2a7affd640 1 -- 172.21.15.76:0/4014262338 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e6b865860 con 0x556e6b90cf50 2024-09-19T08:01:37.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2a7affd640 10 client.17895 handle_command_reply: tid=0 2024-09-19T08:01:37.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 client.17895 shutdown 2024-09-19T08:01:37.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 msgr2=0x556e6b8fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:37.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 0x556e6b8fcd50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c000c00 tx=0x7f2a8c0319b0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 shutdown_connections 2024-09-19T08:01:37.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b90f340 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8fd370 0x556e6b8fa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2a7affd640 0 client.17895 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:01:37.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/4014262338 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8f25d0 0x556e6b8fcd50 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 >> 172.21.15.76:0/4014262338 conn(0x556e6b8bb310 msgr2=0x556e6b8f4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:37.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 shutdown_connections 2024-09-19T08:01:37.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 1 -- 172.21.15.76:0/4014262338 wait complete. 2024-09-19T08:01:37.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.938+0000 7f2aa41f3740 20 client.17895 trim_cache size 0 max 16384 2024-09-19T08:01:37.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 Processor -- start 2024-09-19T08:01:37.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 -- start start 2024-09-19T08:01:37.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b8f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1b26d0 con 0x556e6b8fd370 2024-09-19T08:01:37.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1affa0 con 0x556e6b8f3b40 2024-09-19T08:01:37.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.951+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1ade10 con 0x556e6b8f25d0 2024-09-19T08:01:37.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b8f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b8f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49930/0 (socket says 172.21.15.76:49930) 2024-09-19T08:01:37.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 -- 172.21.15.76:0/2604676911 learned_addr learned my addr 172.21.15.76:0/2604676911 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:37.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a93fff640 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 -- 172.21.15.76:0/2604676911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 msgr2=0x556e6b8f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 -- 172.21.15.76:0/2604676911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 msgr2=0x556e6b8edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 -- 172.21.15.76:0/2604676911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e6b8ef730 con 0x556e6b8fd370 2024-09-19T08:01:37.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a93fff640 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:37.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b8f5120 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2a94010f50 tx=0x7f2a94010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33815798933713b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:37.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a917fa640 1 -- 172.21.15.76:0/2604676911 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94033070 con 0x556e6b8fd370 2024-09-19T08:01:37.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a917fa640 1 -- 172.21.15.76:0/2604676911 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a940125b0 con 0x556e6b8fd370 2024-09-19T08:01:37.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.952+0000 7f2a917fa640 1 -- 172.21.15.76:0/2604676911 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9402e8d0 con 0x556e6b8fd370 2024-09-19T08:01:37.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 -- 172.21.15.76:0/2604676911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 msgr2=0x556e6b8f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:37.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b8f5120 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2a94010f50 tx=0x7f2a94010f80 comp rx=0 tx=0).stop 2024-09-19T08:01:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 -- 172.21.15.76:0/2604676911 shutdown_connections 2024-09-19T08:01:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b8f5120 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b8edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/2604676911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b8f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 -- 172.21.15.76:0/2604676911 >> 172.21.15.76:0/2604676911 conn(0x556e6b8bb310 msgr2=0x556e6b8ed500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:37.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 -- 172.21.15.76:0/2604676911 shutdown_connections 2024-09-19T08:01:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 -- 172.21.15.76:0/2604676911 wait complete. 2024-09-19T08:01:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.953+0000 7f2aa41f3740 1 -- start start 2024-09-19T08:01:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 Processor -- start 2024-09-19T08:01:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b905b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b900e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b9013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1ae460 con 0x556e6b8fd370 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1af8d0 con 0x556e6b8f3b40 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c1aeb30 con 0x556e6b8f25d0 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2aa41f3740 10 client.0 _ll_register_callbacks cb 0x7f2a8c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b9013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b9013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49938/0 (socket says 172.21.15.76:49938) 2024-09-19T08:01:37.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 -- 172.21.15.76:0/35405471 learned_addr learned my addr 172.21.15.76:0/35405471 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:37.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b905b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a93fff640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b900e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:37.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 -- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 msgr2=0x556e6b905b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b905b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 -- 172.21.15.76:0/35405471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 msgr2=0x556e6b900e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:37.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b900e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:37.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9bfff640 1 -- 172.21.15.76:0/35405471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6b901bf0 con 0x556e6b8fd370 2024-09-19T08:01:37.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b905b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:37.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.954+0000 7f2a93fff640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b900e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:37.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a9bfff640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b9013c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2a94031040 tx=0x7f2a94012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485342df834e596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:37.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a7affd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:37.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a7affd640 1 -- 172.21.15.76:0/35405471 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94033040 con 0x556e6b8fd370 2024-09-19T08:01:37.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a7affd640 1 -- 172.21.15.76:0/35405471 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f2a9400cd00 con 0x556e6b8fd370 2024-09-19T08:01:37.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a940125b0 con 0x556e6b8fd370 2024-09-19T08:01:37.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a7affd640 1 -- 172.21.15.76:0/35405471 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a9402e570 con 0x556e6b8fd370 2024-09-19T08:01:37.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 10 client.17901 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556e6b977b20 con 0x556e6b8fd370 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a7affd640 1 -- 172.21.15.76:0/35405471 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a940125b0 con 0x556e6b8fd370 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a7affd640 1 -- 172.21.15.76:0/35405471 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2a94036030 con 0x556e6b8fd370 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 10 client.17901 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 10 client.17901 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 20 client.17901 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:37.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b97a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:38.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 4 client.17901 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:01:38.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 --> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e6b85fd70 con 0x556e6b90cf50 2024-09-19T08:01:38.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.955+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b97a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:38.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2a9b7fe640 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b97a0a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b94eb902d970cf23 server_cookie=6a3bf5f36432681a in_seq=0 out_seq=0 2024-09-19T08:01:38.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2a7affd640 10 client.17901 ms_handle_connect on v2:172.21.15.152:6836/3136720511 2024-09-19T08:01:38.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2a7affd640 1 -- 172.21.15.76:0/35405471 <== mds.2 v2:172.21.15.152:6836/3136720511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e6b85fd70 con 0x556e6b90cf50 2024-09-19T08:01:38.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2a7affd640 10 client.17901 handle_command_reply: tid=0 2024-09-19T08:01:38.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 client.17901 shutdown 2024-09-19T08:01:38.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 msgr2=0x556e6b9013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:38.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b9013c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2a94031040 tx=0x7f2a94012f30 comp rx=0 tx=0).stop 2024-09-19T08:01:38.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 shutdown_connections 2024-09-19T08:01:38.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:6836/3136720511,v1:172.21.15.152:6837/3136720511] conn(0x556e6b90cf50 0x556e6b97a0a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556e6b8fd370 0x556e6b9013c0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556e6b8f3b40 0x556e6b900e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2a7affd640 0 client.17901 ms_handle_reset on v2:172.21.15.152:6836/3136720511 2024-09-19T08:01:38.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 --2- 172.21.15.76:0/35405471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556e6b8f25d0 0x556e6b905b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 >> 172.21.15.76:0/35405471 conn(0x556e6b8bb310 msgr2=0x556e6b8edd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:38.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 shutdown_connections 2024-09-19T08:01:38.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.956+0000 7f2aa41f3740 1 -- 172.21.15.76:0/35405471 wait complete. 2024-09-19T08:01:38.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa41f3740 20 client.17901 trim_cache size 0 max 16384 2024-09-19T08:01:38.003 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:01:38.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a880a33b0 msgr2=0x7f2a880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:38.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a880a33b0 0x7f2a880a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a94010800 tx=0x7f2a9401d000 comp rx=0 tx=0).stop 2024-09-19T08:01:38.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 msgr2=0x7f2a9c0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:38.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 0x7f2a9c0fd290 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b4a0 tx=0x7f2a8400b960 comp rx=0 tx=0).stop 2024-09-19T08:01:38.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 shutdown_connections 2024-09-19T08:01:38.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f2a880a33b0 0x7f2a880a5870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a9c106a80 0x7f2a9c0fd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2a9c101420 0x7f2a9c0fd290 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 --2- 172.21.15.76:0/1247053515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a9c100a80 0x7f2a9c0fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:38.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 >> 172.21.15.76:0/1247053515 conn(0x7f2a9c0fc7a0 msgr2=0x7f2a9c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:38.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 shutdown_connections 2024-09-19T08:01:38.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:37.957+0000 7f2aa1e1a640 1 -- 172.21.15.76:0/1247053515 wait complete. 2024-09-19T08:01:38.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:38 smithi152 ceph-mon[35117]: pgmap v325: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:38.618 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:38 smithi076 ceph-mon[30930]: pgmap v325: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:38.643 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:01:38.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:38 smithi137 ceph-mon[35309]: pgmap v325: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:38.889 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:39.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 -- 172.21.15.76:0/3865941990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 msgr2=0x7fb8c010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/3865941990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c010d960 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009900 tx=0x7fb8b802a410 comp rx=0 tx=0).stop 2024-09-19T08:01:39.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 -- 172.21.15.76:0/3865941990 shutdown_connections 2024-09-19T08:01:39.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/3865941990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c010d960 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/3865941990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 0x7fb8c01056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/3865941990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 0x7fb8c0101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 -- 172.21.15.76:0/3865941990 >> 172.21.15.76:0/3865941990 conn(0x7fb8c0077230 msgr2=0x7fb8c00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 -- 172.21.15.76:0/3865941990 shutdown_connections 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 -- 172.21.15.76:0/3865941990 wait complete. 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 Processor -- start 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.370+0000 7fb8c7a27640 1 -- start start 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c7a27640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 0x7fb8c0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c7a27640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 0x7fb8c01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c7a27640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c01a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c7a27640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0111020 con 0x7fb8c0105de0 2024-09-19T08:01:39.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c7a27640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0110ea0 con 0x7fb8c0101470 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c7a27640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01111a0 con 0x7fb8c0101e20 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c01a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c01a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49960/0 (socket says 172.21.15.76:49960) 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 -- 172.21.15.76:0/1179532468 learned_addr learned my addr 172.21.15.76:0/1179532468 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 0x7fb8c0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 0x7fb8c01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 -- 172.21.15.76:0/1179532468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 msgr2=0x7fb8c01999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 0x7fb8c01999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 -- 172.21.15.76:0/1179532468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 msgr2=0x7fb8c0199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 0x7fb8c0199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 -- 172.21.15.76:0/1179532468 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c01a4a30 con 0x7fb8c0105de0 2024-09-19T08:01:39.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 0x7fb8c0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 0x7fb8c01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8c5fc4640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c01a44f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009230 tx=0x7fb8b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.371+0000 7fb8be7fc640 1 -- 172.21.15.76:0/1179532468 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803f030 con 0x7fb8c0105de0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.372+0000 7fb8be7fc640 1 -- 172.21.15.76:0/1179532468 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8b8003d00 con 0x7fb8c0105de0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.372+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c01a4c00 con 0x7fb8c0105de0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.372+0000 7fb8be7fc640 1 -- 172.21.15.76:0/1179532468 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8035070 con 0x7fb8c0105de0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.372+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c01a5050 con 0x7fb8c0105de0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8be7fc640 1 -- 172.21.15.76:0/1179532468 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb8b8042030 con 0x7fb8c0105de0 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 Processor -- start 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 -- start start 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 0x55a0841f9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a0841f9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a084204370 0x55a084206760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a08415f2f0 con 0x55a0841fab40 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a084106cf0 con 0x55a0841f95d0 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.374+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a08415b2b0 con 0x55a084204370 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 0x55a0841f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 0x55a0841f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49966/0 (socket says 172.21.15.76:49966) 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2692311167 learned_addr learned my addr 172.21.15.76:0/2692311167 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8be7fc640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8a80a33b0 0x7fb8a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a0841f9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c5fc4640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8a80a33b0 0x7fb8a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a084204370 0x55a084206760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2692311167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a084204370 msgr2=0x55a084206760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a084204370 0x55a084206760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2692311167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 msgr2=0x55a0841f9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a0841f9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2692311167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0840eb3a0 con 0x55a0841fab40 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8be7fc640 1 -- 172.21.15.76:0/1179532468 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fb8b80f0380 con 0x7fb8c0105de0 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 0x55a0841f9090 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4006ee0 tx=0x7fb8b400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae8a287726e14c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8a77fe640 1 -- 172.21.15.76:0/2692311167 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400f040 con 0x55a0841fab40 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8a77fe640 1 -- 172.21.15.76:0/2692311167 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8b401d070 con 0x55a0841fab40 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.375+0000 7fb8a77fe640 1 -- 172.21.15.76:0/2692311167 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4013960 con 0x55a0841fab40 2024-09-19T08:01:39.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2692311167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 msgr2=0x55a0841f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c5fc4640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8a80a33b0 0x7fb8a80a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80edaf0 tx=0x7fb8b8009260 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 0x55a0841f9090 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4006ee0 tx=0x7fb8b400a410 comp rx=0 tx=0).stop 2024-09-19T08:01:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2692311167 shutdown_connections 2024-09-19T08:01:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a084204370 0x55a084206760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a0841f9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2692311167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841fab40 0x55a0841f9090 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2692311167 >> 172.21.15.76:0/2692311167 conn(0x55a0841c2310 msgr2=0x55a0841f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2692311167 shutdown_connections 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2692311167 wait complete. 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.376+0000 7fb8c9e00740 1 -- start start 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 Processor -- start 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084203c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a084200f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 0x55a084201480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55a084207010 con 0x55a084204370 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a08411a060 con 0x55a0841f95d0 2024-09-19T08:01:39.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a084207190 con 0x55a0841fab40 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c9e00740 10 client.0 _ll_register_callbacks cb 0x55a083e6d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 0x55a084201480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 0x55a084201480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49976/0 (socket says 172.21.15.76:49976) 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/3661491436 learned_addr learned my addr 172.21.15.76:0/3661491436 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a084200f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084203c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/3661491436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 msgr2=0x55a084200f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a084200f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 msgr2=0x55a084203c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084203c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.377+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/3661491436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a083ed03c0 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 0x55a084201480 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400a3e0 tx=0x7fb8b4004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee8881d4ce0cf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/3661491436 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4028070 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/3661491436 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fb8b4018ce0 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b401d070 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/3661491436 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb8b4034050 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 10 client.17913 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a084212a30 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/3661491436 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8b401d070 con 0x55a084204370 2024-09-19T08:01:39.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/3661491436 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb8b40249b0 con 0x55a084204370 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 10 client.17913 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 10 client.17913 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 20 client.17913 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084213de0 0x55a0842161d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 4 client.17913 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.378+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a08416c860 con 0x55a084213de0 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.379+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084213de0 0x55a0842161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.379+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084213de0 0x55a0842161d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcd9f768209ecc9d server_cookie=5d132fd3390673b5 in_seq=0 out_seq=0 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.379+0000 7fb8a4ff9640 10 client.17913 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/3661491436 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a08416c860 con 0x55a084213de0 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8a4ff9640 10 client.17913 handle_command_reply: tid=0 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 client.17913 shutdown 2024-09-19T08:01:39.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 msgr2=0x55a084201480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 0x55a084201480 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400a3e0 tx=0x7fb8b4004660 comp rx=0 tx=0).stop 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 shutdown_connections 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084213de0 0x55a0842161d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a084204370 0x55a084201480 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8a4ff9640 0 client.17913 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a084200f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/3661491436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084203c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 >> 172.21.15.76:0/3661491436 conn(0x55a0841c2310 msgr2=0x55a0841fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 shutdown_connections 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 1 -- 172.21.15.76:0/3661491436 wait complete. 2024-09-19T08:01:39.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.380+0000 7fb8c9e00740 20 client.17913 trim_cache size 0 max 16384 2024-09-19T08:01:39.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 Processor -- start 2024-09-19T08:01:39.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 -- start start 2024-09-19T08:01:39.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841c2310 0x55a084210310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 0x55a0841fc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841fab40 0x55a08421b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01ae330 con 0x55a0841f95d0 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01abc00 con 0x55a0841fab40 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01a9a70 con 0x55a0841c2310 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c57c3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 0x55a0841fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c57c3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 0x55a0841fc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49984/0 (socket says 172.21.15.76:49984) 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.393+0000 7fb8c57c3640 1 -- 172.21.15.76:0/1984055048 learned_addr learned my addr 172.21.15.76:0/1984055048 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841c2310 0x55a084210310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841fab40 0x55a08421b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c57c3640 1 -- 172.21.15.76:0/1984055048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841c2310 msgr2=0x55a084210310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841c2310 0x55a084210310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c57c3640 1 -- 172.21.15.76:0/1984055048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841fab40 msgr2=0x55a08421b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841fab40 0x55a08421b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c57c3640 1 -- 172.21.15.76:0/1984055048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0841fc120 con 0x55a0841f95d0 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841c2310 0x55a084210310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 0x55a0841fc310 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x55a0842007d0 tx=0x7fb8b00098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae07ce464cdc73e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8a6ffd640 1 -- 172.21.15.76:0/1984055048 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000a6c0 con 0x55a0841f95d0 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8a6ffd640 1 -- 172.21.15.76:0/1984055048 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8b0022030 con 0x55a0841f95d0 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.394+0000 7fb8a6ffd640 1 -- 172.21.15.76:0/1984055048 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0018cf0 con 0x55a0841f95d0 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 -- 172.21.15.76:0/1984055048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 msgr2=0x55a0841fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 0x55a0841fc310 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x55a0842007d0 tx=0x7fb8b00098d0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 -- 172.21.15.76:0/1984055048 shutdown_connections 2024-09-19T08:01:39.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841fab40 0x55a08421b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841f95d0 0x55a0841fc310 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/1984055048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841c2310 0x55a084210310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 -- 172.21.15.76:0/1984055048 >> 172.21.15.76:0/1984055048 conn(0x55a0842015e0 msgr2=0x55a084200030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 -- 172.21.15.76:0/1984055048 shutdown_connections 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 -- 172.21.15.76:0/1984055048 wait complete. 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 -- start start 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.395+0000 7fb8c9e00740 1 Processor -- start 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 0x55a08420cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084207f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a0842084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01aa0c0 con 0x55a0841c2310 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01ab530 con 0x55a0841f95d0 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01aa790 con 0x55a0841fab40 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 10 client.0 _ll_register_callbacks cb 0x7fb8b0009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 0x55a08420cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 0x55a08420cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49992/0 (socket says 172.21.15.76:49992) 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2714122045 learned_addr learned my addr 172.21.15.76:0/2714122045 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2714122045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 msgr2=0x55a0842084f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a0842084f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 msgr2=0x55a084207f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084207f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 -- 172.21.15.76:0/2714122045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a084208d20 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c4fc2640 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 0x55a08420cc60 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4018f30 tx=0x7fb8b400a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a6f8b2338aa6be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/2714122045 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4028070 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/2714122045 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fb8b4006ba0 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.396+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b0022030 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/2714122045 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb8b4018ae0 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 10 client.17919 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a08427e930 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/2714122045 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8b0022030 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/2714122045 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb8b40218c0 con 0x55a0841c2310 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 10 client.17919 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 10 client.17919 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T08:01:39.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 20 client.17919 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084204370 0x55a084281000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 4 client.17919 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 --> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a084166d70 con 0x55a084204370 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.397+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084204370 0x55a084281000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c57c3640 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084204370 0x55a084281000 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=40bf6aa7aae9d3ee server_cookie=515970f548a9a182 in_seq=0 out_seq=0 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8a4ff9640 10 client.17919 ms_handle_connect on v2:172.21.15.137:6838/1413757795 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8a4ff9640 1 -- 172.21.15.76:0/2714122045 <== mds.1 v2:172.21.15.137:6838/1413757795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a084166d70 con 0x55a084204370 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8a4ff9640 10 client.17919 handle_command_reply: tid=0 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 client.17919 shutdown 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 msgr2=0x55a08420cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 0x55a08420cc60 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4018f30 tx=0x7fb8b400a370 comp rx=0 tx=0).stop 2024-09-19T08:01:39.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 shutdown_connections 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:6838/1413757795,v1:172.21.15.137:6839/1413757795] conn(0x55a084204370 0x55a084281000 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0841fab40 0x55a0842084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0841f95d0 0x55a084207f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8a4ff9640 0 client.17919 ms_handle_reset on v2:172.21.15.137:6838/1413757795 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 --2- 172.21.15.76:0/2714122045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0841c2310 0x55a08420cc60 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 >> 172.21.15.76:0/2714122045 conn(0x55a0842015e0 msgr2=0x55a0842027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 shutdown_connections 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 1 -- 172.21.15.76:0/2714122045 wait complete. 2024-09-19T08:01:39.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.398+0000 7fb8c9e00740 20 client.17919 trim_cache size 0 max 16384 2024-09-19T08:01:39.414 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:01:39.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8a80a33b0 msgr2=0x7fb8a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8a80a33b0 0x7fb8a80a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80edaf0 tx=0x7fb8b8009260 comp rx=0 tx=0).stop 2024-09-19T08:01:39.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 msgr2=0x7fb8c01a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:39.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c01a44f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009230 tx=0x7fb8b80042f0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 shutdown_connections 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fb8a80a33b0 0x7fb8a80a5870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb8c0105de0 0x7fb8c01a44f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8c0101e20 0x7fb8c01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 --2- 172.21.15.76:0/1179532468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c0101470 0x7fb8c0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 >> 172.21.15.76:0/1179532468 conn(0x7fb8c0077230 msgr2=0x7fb8c0104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 shutdown_connections 2024-09-19T08:01:39.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:39.399+0000 7fb8c7a27640 1 -- 172.21.15.76:0/1179532468 wait complete. 2024-09-19T08:01:40.186 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:01:40.437 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:40.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:40 smithi076 ceph-mon[30930]: pgmap v326: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:01:40.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:40 smithi152 ceph-mon[35117]: pgmap v326: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:01:40.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:40 smithi137 ceph-mon[35309]: pgmap v326: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 -- 172.21.15.76:0/3926714043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac0100e30 msgr2=0x7fdac0104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 --2- 172.21.15.76:0/3926714043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac0100e30 0x7fdac0104e80 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009900 tx=0x7fdab402a410 comp rx=0 tx=0).stop 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 -- 172.21.15.76:0/3926714043 shutdown_connections 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 --2- 172.21.15.76:0/3926714043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac01055b0 0x7fdac010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 --2- 172.21.15.76:0/3926714043 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac0100e30 0x7fdac0104e80 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 --2- 172.21.15.76:0/3926714043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac0100480 0x7fdac0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 -- 172.21.15.76:0/3926714043 >> 172.21.15.76:0/3926714043 conn(0x7fdac0077210 msgr2=0x7fdac00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 -- 172.21.15.76:0/3926714043 shutdown_connections 2024-09-19T08:01:40.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.905+0000 7fdac5933640 1 -- 172.21.15.76:0/3926714043 wait complete. 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 Processor -- start 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 -- start start 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac0100480 0x7fdac01a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac0100e30 0x7fdac01a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 0x7fdac019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdac0110790 con 0x7fdac01055b0 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdac0110610 con 0x7fdac0100e30 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdac5933640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdac0110910 con 0x7fdac0100480 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 0x7fdac019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdabeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac0100480 0x7fdac01a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 0x7fdac019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49996/0 (socket says 172.21.15.76:49996) 2024-09-19T08:01:40.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.906+0000 7fdabf7fe640 1 -- 172.21.15.76:0/3305173633 learned_addr learned my addr 172.21.15.76:0/3305173633 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac0100e30 0x7fdac01a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabf7fe640 1 -- 172.21.15.76:0/3305173633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac0100480 msgr2=0x7fdac01a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabf7fe640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac0100480 0x7fdac01a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabf7fe640 1 -- 172.21.15.76:0/3305173633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac0100e30 msgr2=0x7fdac01a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabf7fe640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac0100e30 0x7fdac01a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabf7fe640 1 -- 172.21.15.76:0/3305173633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac019ad50 con 0x7fdac01055b0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdabf7fe640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 0x7fdac019a620 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009fd0 tx=0x7fdab800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdac4931640 1 -- 172.21.15.76:0/3305173633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8011830 con 0x7fdac01055b0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdac4931640 1 -- 172.21.15.76:0/3305173633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdab8016070 con 0x7fdac01055b0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac019b040 con 0x7fdac01055b0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdac4931640 1 -- 172.21.15.76:0/3305173633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab800f2e0 con 0x7fdac01055b0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.907+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac01a7330 con 0x7fdac01055b0 2024-09-19T08:01:40.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac4931640 1 -- 172.21.15.76:0/3305173633 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fdab801b460 con 0x7fdac01055b0 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 Processor -- start 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 -- start start 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559668611b40 0x559668610090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668610a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x55966861d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5596685762f0 con 0x55966861b370 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55966851dcf0 con 0x559668611b40 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.910+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5596685722b0 con 0x5596686105d0 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x55966861d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x55966861d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50006/0 (socket says 172.21.15.76:50006) 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 -- 172.21.15.76:0/894073611 learned_addr learned my addr 172.21.15.76:0/894073611 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559668611b40 0x559668610090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabeffd640 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668610a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdac4931640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdaa80a33b0 0x7fdaa80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 -- 172.21.15.76:0/894073611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 msgr2=0x559668610a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668610a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 -- 172.21.15.76:0/894073611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559668611b40 msgr2=0x559668610090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559668611b40 0x559668610090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 -- 172.21.15.76:0/894073611 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596685023a0 con 0x55966861b370 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabf7fe640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdaa80a33b0 0x7fdaa80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdac4931640 1 -- 172.21.15.76:0/3305173633 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fdab80cf310 con 0x7fdac01055b0 2024-09-19T08:01:40.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x55966861d760 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fdab402a930 tx=0x7fdab40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0699a7a88971fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdaa5ffb640 1 -- 172.21.15.76:0/894073611 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4035040 con 0x55966861b370 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdabf7fe640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdaa80a33b0 0x7fdaa80a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdab80ccb90 tx=0x7fdab8015f80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdaa5ffb640 1 -- 172.21.15.76:0/894073611 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdab40035f0 con 0x55966861b370 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.911+0000 7fdaa5ffb640 1 -- 172.21.15.76:0/894073611 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab403d6c0 con 0x55966861b370 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 -- 172.21.15.76:0/894073611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 msgr2=0x55966861d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x55966861d760 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fdab402a930 tx=0x7fdab40056d0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 -- 172.21.15.76:0/894073611 shutdown_connections 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x55966861d760 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668610a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/894073611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559668611b40 0x559668610090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 -- 172.21.15.76:0/894073611 >> 172.21.15.76:0/894073611 conn(0x5596685d9310 msgr2=0x55966860cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 -- 172.21.15.76:0/894073611 shutdown_connections 2024-09-19T08:01:40.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 -- 172.21.15.76:0/894073611 wait complete. 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.912+0000 7fdac7d0c740 1 -- start start 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 Processor -- start 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596686105d0 0x55966861ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668618090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x5596686187d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55966861e010 con 0x55966861b370 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559668531060 con 0x5596686105d0 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55966861e190 con 0x559668611b40 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdac7d0c740 10 client.0 _ll_register_callbacks cb 0x5596682848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x5596686187d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x5596686187d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50010/0 (socket says 172.21.15.76:50010) 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 -- 172.21.15.76:0/2421728464 learned_addr learned my addr 172.21.15.76:0/2421728464 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:40.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabeffd640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668618090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596686105d0 0x55966861ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 -- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 msgr2=0x559668618090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668618090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 -- 172.21.15.76:0/2421728464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596686105d0 msgr2=0x55966861ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596686105d0 0x55966861ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.913+0000 7fdabe7fc640 1 -- 172.21.15.76:0/2421728464 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596682e73c0 con 0x55966861b370 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x5596686187d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005d00 tx=0x7fdab4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b5ada6aa62c8af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fda9effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fda9effd640 1 -- 172.21.15.76:0/2421728464 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4035070 con 0x55966861b370 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdab40035f0 con 0x55966861b370 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fda9effd640 1 -- 172.21.15.76:0/2421728464 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fdab4003bb0 con 0x55966861b370 2024-09-19T08:01:40.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fda9effd640 1 -- 172.21.15.76:0/2421728464 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdab4003db0 con 0x55966861b370 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 10 client.17931 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559668629b40 con 0x55966861b370 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fda9effd640 1 -- 172.21.15.76:0/2421728464 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdab40035f0 con 0x55966861b370 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fda9effd640 1 -- 172.21.15.76:0/2421728464 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdab403a040 con 0x55966861b370 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 10 client.17931 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 10 client.17931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 20 client.17931 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x55966862d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 4 client.17931 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.914+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559668583860 con 0x55966862ae90 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.915+0000 7fdabeffd640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x55966862d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.915+0000 7fda9effd640 10 client.17931 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.915+0000 7fdabeffd640 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x55966862d280 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2d1b89d8256bc6 server_cookie=b196e9db8f4df10 in_seq=0 out_seq=0 2024-09-19T08:01:40.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fda9effd640 1 -- 172.21.15.76:0/2421728464 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559668583860 con 0x55966862ae90 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fda9effd640 10 client.17931 handle_command_reply: tid=0 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 client.17931 shutdown 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 msgr2=0x5596686187d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x5596686187d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005d00 tx=0x7fdab4005c90 comp rx=0 tx=0).stop 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 shutdown_connections 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x55966862d280 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fda9effd640 0 client.17931 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55966861b370 0x5596686187d0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668618090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2421728464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5596686105d0 0x55966861ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 >> 172.21.15.76:0/2421728464 conn(0x5596685d9310 msgr2=0x559668612960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 shutdown_connections 2024-09-19T08:01:40.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2421728464 wait complete. 2024-09-19T08:01:40.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.916+0000 7fdac7d0c740 20 client.17931 trim_cache size 0 max 16384 2024-09-19T08:01:40.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 Processor -- start 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 -- start start 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 0x559668627430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668617090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x5596686302a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdac01b2770 con 0x5596686105d0 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdac01b0040 con 0x55966861b370 2024-09-19T08:01:40.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdac01adeb0 con 0x559668611b40 2024-09-19T08:01:40.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 0x559668627430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 0x559668627430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50024/0 (socket says 172.21.15.76:50024) 2024-09-19T08:01:40.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 -- 172.21.15.76:0/616717880 learned_addr learned my addr 172.21.15.76:0/616717880 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 -- 172.21.15.76:0/616717880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 msgr2=0x559668617090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668617090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 -- 172.21.15.76:0/616717880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 msgr2=0x5596686302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x5596686302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.929+0000 7fdabe7fc640 1 -- 172.21.15.76:0/616717880 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55966860dd60 con 0x5596686105d0 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 0x559668627430 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fdab40315e0 tx=0x7fdab4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662617c6852f23e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdaa57fa640 1 -- 172.21.15.76:0/616717880 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4035070 con 0x5596686105d0 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdaa57fa640 1 -- 172.21.15.76:0/616717880 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdab40035f0 con 0x5596686105d0 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdaa57fa640 1 -- 172.21.15.76:0/616717880 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4003c10 con 0x5596686105d0 2024-09-19T08:01:40.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 -- 172.21.15.76:0/616717880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 msgr2=0x559668627430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 0x559668627430 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fdab40315e0 tx=0x7fdab4009780 comp rx=0 tx=0).stop 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 -- 172.21.15.76:0/616717880 shutdown_connections 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x5596686302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559668611b40 0x559668617090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/616717880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5596686105d0 0x559668627430 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 -- 172.21.15.76:0/616717880 >> 172.21.15.76:0/616717880 conn(0x5596685d9310 msgr2=0x559668616980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 -- 172.21.15.76:0/616717880 shutdown_connections 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.930+0000 7fdac7d0c740 1 -- 172.21.15.76:0/616717880 wait complete. 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 -- start start 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 Processor -- start 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668630790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 0x55966862db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x55966862e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdac01ae500 con 0x559668611b40 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdac01af970 con 0x55966861b370 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdac01aebd0 con 0x5596686105d0 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdac7d0c740 10 client.0 _ll_register_callbacks cb 0x7fdab4032d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdabeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 0x55966862db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdabeffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 0x55966862db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50030/0 (socket says 172.21.15.76:50030) 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.931+0000 7fdabeffd640 1 -- 172.21.15.76:0/2855831307 learned_addr learned my addr 172.21.15.76:0/2855831307 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668630790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x55966862e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabeffd640 1 -- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 msgr2=0x559668630790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabeffd640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668630790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabeffd640 1 -- 172.21.15.76:0/2855831307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 msgr2=0x55966862e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabeffd640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x55966862e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabeffd640 1 -- 172.21.15.76:0/2855831307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55966862e680 con 0x559668611b40 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdabeffd640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 0x55966862db80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x559668617920 tx=0x7fdab0014b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f24367bc860a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fda9effd640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fda9effd640 1 -- 172.21.15.76:0/2855831307 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab00133c0 con 0x559668611b40 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fda9effd640 1 -- 172.21.15.76:0/2855831307 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fdab0012b00 con 0x559668611b40 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdab40035f0 con 0x559668611b40 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fda9effd640 1 -- 172.21.15.76:0/2855831307 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdab0012d00 con 0x559668611b40 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdac7d0c740 10 client.17937 fetch_fsmap learned FSMap version 35 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5596686955f0 con 0x559668611b40 2024-09-19T08:01:40.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.932+0000 7fda9effd640 1 -- 172.21.15.76:0/2855831307 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdab40035f0 con 0x559668611b40 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fda9effd640 1 -- 172.21.15.76:0/2855831307 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdab000f040 con 0x559668611b40 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 10 client.17937 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 10 client.17937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 20 client.17937 populate_metadata read hostname 'smithi076' 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x559668697e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 4 client.17937 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 --> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55966857dd70 con 0x55966862ae90 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x559668697e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdabe7fc640 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x559668697e10 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c235b9dba1ab430 server_cookie=5a35ec3aab79dd30 in_seq=0 out_seq=0 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fda9effd640 10 client.17937 ms_handle_connect on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fda9effd640 1 -- 172.21.15.76:0/2855831307 <== mds.0 v2:172.21.15.152:6838/1843787894 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55966857dd70 con 0x55966862ae90 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fda9effd640 10 client.17937 handle_command_reply: tid=0 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.933+0000 7fdac7d0c740 1 client.17937 shutdown 2024-09-19T08:01:40.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 msgr2=0x55966862db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 0x55966862db80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x559668617920 tx=0x7fdab0014b60 comp rx=0 tx=0).stop 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 shutdown_connections 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55966861b370 0x55966862e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:6838/1843787894,v1:172.21.15.152:6839/1843787894] conn(0x55966862ae90 0x559668697e10 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559668611b40 0x55966862db80 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 --2- 172.21.15.76:0/2855831307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5596686105d0 0x559668630790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 >> 172.21.15.76:0/2855831307 conn(0x5596685d9310 msgr2=0x5596686198f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fda9effd640 0 client.17937 ms_handle_reset on v2:172.21.15.152:6838/1843787894 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 shutdown_connections 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 1 -- 172.21.15.76:0/2855831307 wait complete. 2024-09-19T08:01:40.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac7d0c740 20 client.17937 trim_cache size 0 max 16384 2024-09-19T08:01:40.941 INFO:teuthology.orchestra.run.smithi076.stdout:[] 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdaa80a33b0 msgr2=0x7fdaa80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdaa80a33b0 0x7fdaa80a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdab80ccb90 tx=0x7fdab8015f80 comp rx=0 tx=0).stop 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 msgr2=0x7fdac019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 0x7fdac019a620 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009fd0 tx=0x7fdab800b8e0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 shutdown_connections 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fdaa80a33b0 0x7fdaa80a5870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdac01055b0 0x7fdac019a620 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac0100e30 0x7fdac01a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 --2- 172.21.15.76:0/3305173633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac0100480 0x7fdac01a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:40.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.934+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 >> 172.21.15.76:0/3305173633 conn(0x7fdac0077210 msgr2=0x7fdac010bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:40.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.935+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 shutdown_connections 2024-09-19T08:01:40.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:40.935+0000 7fdac5933640 1 -- 172.21.15.76:0/3305173633 wait complete. 2024-09-19T08:01:41.752 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T08:01:41.753 INFO:tasks.fwd_scrub:done joining 2024-09-19T08:01:41.753 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T08:01:41.763 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 -- 172.21.15.76:0/4217833109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 msgr2=0x7f767810ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 --2- 172.21.15.76:0/4217833109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f767810ba70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f766c009900 tx=0x7f766c02a480 comp rx=0 tx=0).stop 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 -- 172.21.15.76:0/4217833109 shutdown_connections 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 --2- 172.21.15.76:0/4217833109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767810c090 0x7f767810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 --2- 172.21.15.76:0/4217833109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f767810ba70 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 --2- 172.21.15.76:0/4217833109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 0x7f7678103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 -- 172.21.15.76:0/4217833109 >> 172.21.15.76:0/4217833109 conn(0x7f76780fc6c0 msgr2=0x7f76780feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:41.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 -- 172.21.15.76:0/4217833109 shutdown_connections 2024-09-19T08:01:41.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 -- 172.21.15.76:0/4217833109 wait complete. 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 Processor -- start 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.868+0000 7f76807a6640 1 -- start start 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 0x7f76781985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f7678198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767810c090 0x7f767819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7678112030 con 0x7f7678103590 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7678111eb0 con 0x7f7678102c70 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76781121b0 con 0x7f767810c090 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f7678198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f7678198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50042/0 (socket says 172.21.15.76:50042) 2024-09-19T08:01:41.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 -- 172.21.15.76:0/3821689944 learned_addr learned my addr 172.21.15.76:0/3821689944 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767e542640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 0x7f76781985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 -- 172.21.15.76:0/3821689944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767810c090 msgr2=0x7f767819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767810c090 0x7f767819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 -- 172.21.15.76:0/3821689944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 msgr2=0x7f76781985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 0x7f76781985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 -- 172.21.15.76:0/3821689944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767819d5d0 con 0x7f7678103590 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767e542640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 0x7f76781985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f767dd41640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f7678198b20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f766c006010 tx=0x7f766c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c03f030 con 0x7f7678103590 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f766c003d00 con 0x7f7678103590 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767819d860 con 0x7f7678103590 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c035070 con 0x7f7678103590 2024-09-19T08:01:41.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.869+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76781a5150 con 0x7f7678103590 2024-09-19T08:01:41.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.870+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7678103050 con 0x7f7678103590 2024-09-19T08:01:41.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.872+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f766c042030 con 0x7f7678103590 2024-09-19T08:01:41.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.873+0000 7f76777fe640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76600a33c0 0x7f76600a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:41.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.873+0000 7f767e542640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76600a33c0 0x7f76600a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:41.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.873+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f766c0f0520 con 0x7f7678103590 2024-09-19T08:01:41.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.873+0000 7f767e542640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76600a33c0 0x7f76600a5880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76680058c0 tx=0x7f7668005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:41.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:41.876+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f766c0bce70 con 0x7f7678103590 2024-09-19T08:01:42.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.044+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7678107090 con 0x7f7678103590 2024-09-19T08:01:42.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.046+0000 7f76777fe640 1 -- 172.21.15.76:0/3821689944 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+23440 (secure 0 0 0) 0x7f766c0bc770 con 0x7f7678103590 2024-09-19T08:01:42.046 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:01:42.046 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":95,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T08:01:17.025401+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1524312740":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3175575583":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1359391390":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/2768770565":"2024-09-20T07:51:12.773685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:01:42.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76600a33c0 msgr2=0x7f76600a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76600a33c0 0x7f76600a5880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76680058c0 tx=0x7f7668005850 comp rx=0 tx=0).stop 2024-09-19T08:01:42.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 msgr2=0x7f7678198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f7678198b20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f766c006010 tx=0x7f766c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 shutdown_connections 2024-09-19T08:01:42.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f76600a33c0 0x7f76600a5880 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767810c090 0x7f767819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7678103590 0x7f7678198b20 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 --2- 172.21.15.76:0/3821689944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7678102c70 0x7f76781985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 >> 172.21.15.76:0/3821689944 conn(0x7f76780fc6c0 msgr2=0x7f76780fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 shutdown_connections 2024-09-19T08:01:42.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.048+0000 7f76807a6640 1 -- 172.21.15.76:0/3821689944 wait complete. 2024-09-19T08:01:42.059 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:44:46.792310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:49:23.884114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:49:26.359069+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:01:42.060 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 -- 172.21.15.76:0/1395606448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594100980 msgr2=0x7f0594100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 --2- 172.21.15.76:0/1395606448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594100980 0x7f0594100de0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0588009930 tx=0x7f058802a420 comp rx=0 tx=0).stop 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 -- 172.21.15.76:0/1395606448 shutdown_connections 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 --2- 172.21.15.76:0/1395606448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0594101320 0x7f059410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 --2- 172.21.15.76:0/1395606448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594100980 0x7f0594100de0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 --2- 172.21.15.76:0/1395606448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 0x7f0594106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 -- 172.21.15.76:0/1395606448 >> 172.21.15.76:0/1395606448 conn(0x7f05940779d0 msgr2=0x7f05940fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 -- 172.21.15.76:0/1395606448 shutdown_connections 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 -- 172.21.15.76:0/1395606448 wait complete. 2024-09-19T08:01:42.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 Processor -- start 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.163+0000 7f0599647640 1 -- start start 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0594100980 0x7f05941992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 0x7f0594199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 0x7f05941a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0594110eb0 con 0x7f0594101320 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0594110d30 con 0x7f0594106990 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0594111030 con 0x7f0594100980 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 0x7f0594199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 0x7f0594199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50060/0 (socket says 172.21.15.76:50060) 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 -- 172.21.15.76:0/2668146792 learned_addr learned my addr 172.21.15.76:0/2668146792 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05937fe640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 0x7f05941a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0592ffd640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0594100980 0x7f05941992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 -- 172.21.15.76:0/2668146792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0594100980 msgr2=0x7f05941992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0594100980 0x7f05941992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 -- 172.21.15.76:0/2668146792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 msgr2=0x7f05941a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 0x7f05941a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 -- 172.21.15.76:0/2668146792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05941a4880 con 0x7f0594101320 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05937fe640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 0x7f05941a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f05927fc640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 0x7f0594199800 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0588009230 tx=0x7f0588004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058803f030 con 0x7f0594101320 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05941a4a50 con 0x7f0594101320 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0588003af0 con 0x7f0594101320 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588035070 con 0x7f0594101320 2024-09-19T08:01:42.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.164+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05941a4eb0 con 0x7f0594101320 2024-09-19T08:01:42.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.165+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0594100de0 con 0x7f0594101320 2024-09-19T08:01:42.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.167+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0588042030 con 0x7f0594101320 2024-09-19T08:01:42.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.167+0000 7f057bfff640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f057c0a33c0 0x7f057c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.167+0000 7f0592ffd640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f057c0a33c0 0x7f057c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.167+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f05880f0690 con 0x7f0594101320 2024-09-19T08:01:42.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.168+0000 7f0592ffd640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f057c0a33c0 0x7f057c0a5880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0584005fd0 tx=0x7f0584008230 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:42.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.171+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05880bd040 con 0x7f0594101320 2024-09-19T08:01:42.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.337+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05941a5170 con 0x7f0594101320 2024-09-19T08:01:42.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.337+0000 7f057bfff640 1 -- 172.21.15.76:0/2668146792 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f05880bc940 con 0x7f0594101320 2024-09-19T08:01:42.337 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-09-19T08:01:42.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f057c0a33c0 msgr2=0x7f057c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f057c0a33c0 0x7f057c0a5880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0584005fd0 tx=0x7f0584008230 comp rx=0 tx=0).stop 2024-09-19T08:01:42.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 msgr2=0x7f0594199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 0x7f0594199800 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0588009230 tx=0x7f0588004270 comp rx=0 tx=0).stop 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 shutdown_connections 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f057c0a33c0 0x7f057c0a5880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0594106990 0x7f05941a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0594101320 0x7f0594199800 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 --2- 172.21.15.76:0/2668146792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0594100980 0x7f05941992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 >> 172.21.15.76:0/2668146792 conn(0x7f05940779d0 msgr2=0x7f0594103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 shutdown_connections 2024-09-19T08:01:42.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.339+0000 7f0599647640 1 -- 172.21.15.76:0/2668146792 wait complete. 2024-09-19T08:01:42.349 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:42 smithi076 ceph-mon[30930]: pgmap v327: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:42.349 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:42 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3821689944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:01:42.350 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:01:42.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 -- 172.21.15.76:0/911934957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 msgr2=0x7fa290106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 --2- 172.21.15.76:0/911934957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa290106d70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa280009cd0 tx=0x7fa28002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 -- 172.21.15.76:0/911934957 shutdown_connections 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 --2- 172.21.15.76:0/911934957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa290101320 0x7fa29010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 --2- 172.21.15.76:0/911934957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa290100980 0x7fa290100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 --2- 172.21.15.76:0/911934957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa290106d70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 -- 172.21.15.76:0/911934957 >> 172.21.15.76:0/911934957 conn(0x7fa2900779d0 msgr2=0x7fa2900fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 -- 172.21.15.76:0/911934957 shutdown_connections 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.453+0000 7fa2955b7640 1 -- 172.21.15.76:0/911934957 wait complete. 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 Processor -- start 2024-09-19T08:01:42.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 -- start start 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa290100980 0x7fa290198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa290101320 0x7fa290198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa29019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa290111fa0 con 0x7fa290106990 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa290111e20 con 0x7fa290100980 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa2955b7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa290112120 con 0x7fa290101320 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.454+0000 7fa28f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa29019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa29019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50088/0 (socket says 172.21.15.76:50088) 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 -- 172.21.15.76:0/3159521479 learned_addr learned my addr 172.21.15.76:0/3159521479 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28e7fc640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa290101320 0x7fa290198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28effd640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa290100980 0x7fa290198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 -- 172.21.15.76:0/3159521479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa290101320 msgr2=0x7fa290198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa290101320 0x7fa290198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 -- 172.21.15.76:0/3159521479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa290100980 msgr2=0x7fa290198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa290100980 0x7fa290198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 -- 172.21.15.76:0/3159521479 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29019d500 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa28f7fe640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa29019cdd0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d750 tx=0x7fa28800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288017070 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa288005520 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29019d7f0 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288004e00 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.455+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2901a5080 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.456+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa290100de0 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.457+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa288004fa0 con 0x7fa290106990 2024-09-19T08:01:42.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.458+0000 7fa277fff640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa2780a33c0 0x7fa2780a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.458+0000 7fa28effd640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa2780a33c0 0x7fa2780a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.458+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fa2880cf730 con 0x7fa290106990 2024-09-19T08:01:42.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.458+0000 7fa28effd640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa2780a33c0 0x7fa2780a5880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa280006010 tx=0x7fa280000f40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:42.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.462+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa28809c080 con 0x7fa290106990 2024-09-19T08:01:42.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:42 smithi152 ceph-mon[35117]: pgmap v327: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:42.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:42 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3821689944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:01:42.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.630+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa290108960 con 0x7fa290106990 2024-09-19T08:01:42.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.631+0000 7fa277fff640 1 -- 172.21.15.76:0/3159521479 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7fa28809b980 con 0x7fa290106990 2024-09-19T08:01:42.631 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa2780a33c0 msgr2=0x7fa2780a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa2780a33c0 0x7fa2780a5880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa280006010 tx=0x7fa280000f40 comp rx=0 tx=0).stop 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 msgr2=0x7fa29019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa29019cdd0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d750 tx=0x7fa28800dc10 comp rx=0 tx=0).stop 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 shutdown_connections 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa2780a33c0 0x7fa2780a5880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa290106990 0x7fa29019cdd0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa290101320 0x7fa290198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 --2- 172.21.15.76:0/3159521479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa290100980 0x7fa290198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 >> 172.21.15.76:0/3159521479 conn(0x7fa2900779d0 msgr2=0x7fa2901039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 shutdown_connections 2024-09-19T08:01:42.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.633+0000 7fa2955b7640 1 -- 172.21.15.76:0/3159521479 wait complete. 2024-09-19T08:01:42.644 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:01:42.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:42 smithi137 ceph-mon[35309]: pgmap v327: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:42.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:42 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3821689944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:01:42.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 -- 172.21.15.76:0/2380331583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae68101350 msgr2=0x7fae6810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/2380331583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae68101350 0x7fae6810d880 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fae60009cd0 tx=0x7fae6002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 -- 172.21.15.76:0/2380331583 shutdown_connections 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/2380331583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae68101350 0x7fae6810d880 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/2380331583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae681009b0 0x7fae68100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/2380331583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae681069c0 0x7fae68106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 -- 172.21.15.76:0/2380331583 >> 172.21.15.76:0/2380331583 conn(0x7fae680fc690 msgr2=0x7fae680feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 -- 172.21.15.76:0/2380331583 shutdown_connections 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.747+0000 7fae6d1bd640 1 -- 172.21.15.76:0/2380331583 wait complete. 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.748+0000 7fae6d1bd640 1 Processor -- start 2024-09-19T08:01:42.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.748+0000 7fae6d1bd640 1 -- start start 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 0x7fae681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae68101350 0x7fae68198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae681069c0 0x7fae6819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fae68110f20 con 0x7fae681009b0 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fae68110da0 con 0x7fae681069c0 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fae681110a0 con 0x7fae68101350 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 0x7fae681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 0x7fae681984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50108/0 (socket says 172.21.15.76:50108) 2024-09-19T08:01:42.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 -- 172.21.15.76:0/413428902 learned_addr learned my addr 172.21.15.76:0/413428902 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6759e640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae681069c0 0x7fae6819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6659c640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae68101350 0x7fae68198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 -- 172.21.15.76:0/413428902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae68101350 msgr2=0x7fae68198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae68101350 0x7fae68198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 -- 172.21.15.76:0/413428902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae681069c0 msgr2=0x7fae6819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae681069c0 0x7fae6819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 -- 172.21.15.76:0/413428902 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6819d4e0 con 0x7fae681009b0 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae66d9d640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 0x7fae681984f0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fae5800d770 tx=0x7fae5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58017070 con 0x7fae681009b0 2024-09-19T08:01:42.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae58005520 con 0x7fae681009b0 2024-09-19T08:01:42.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6819d7d0 con 0x7fae681009b0 2024-09-19T08:01:42.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58010460 con 0x7fae681009b0 2024-09-19T08:01:42.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.749+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae681a5060 con 0x7fae681009b0 2024-09-19T08:01:42.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.750+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae68100e10 con 0x7fae681009b0 2024-09-19T08:01:42.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.751+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fae58004ea0 con 0x7fae681009b0 2024-09-19T08:01:42.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.752+0000 7fae4ffff640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae500a33c0 0x7fae500a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:42.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.752+0000 7fae6659c640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae500a33c0 0x7fae500a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:42.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.752+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fae580cf800 con 0x7fae681009b0 2024-09-19T08:01:42.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.753+0000 7fae6659c640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae500a33c0 0x7fae500a5880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fae5c005fd0 tx=0x7fae5c005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:42.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.756+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae5809c150 con 0x7fae681009b0 2024-09-19T08:01:42.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.925+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fae681a5320 con 0x7fae681009b0 2024-09-19T08:01:42.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.926+0000 7fae4ffff640 1 -- 172.21.15.76:0/413428902 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fae5809ba50 con 0x7fae681009b0 2024-09-19T08:01:42.926 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-09-19T08:01:42.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae500a33c0 msgr2=0x7fae500a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae500a33c0 0x7fae500a5880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fae5c005fd0 tx=0x7fae5c005850 comp rx=0 tx=0).stop 2024-09-19T08:01:42.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 msgr2=0x7fae681984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:42.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 0x7fae681984f0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fae5800d770 tx=0x7fae5800dc30 comp rx=0 tx=0).stop 2024-09-19T08:01:42.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 shutdown_connections 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fae500a33c0 0x7fae500a5880 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae681069c0 0x7fae6819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae68101350 0x7fae68198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 --2- 172.21.15.76:0/413428902 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fae681009b0 0x7fae681984f0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 >> 172.21.15.76:0/413428902 conn(0x7fae680fc690 msgr2=0x7fae68104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 shutdown_connections 2024-09-19T08:01:42.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:42.928+0000 7fae6d1bd640 1 -- 172.21.15.76:0/413428902 wait complete. 2024-09-19T08:01:42.939 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T08:01:43.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 -- 172.21.15.76:0/2347546956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6781069a0 msgr2=0x7fe678106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:43.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/2347546956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6781069a0 0x7fe678106d80 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fe668009930 tx=0x7fe66802a420 comp rx=0 tx=0).stop 2024-09-19T08:01:43.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 -- 172.21.15.76:0/2347546956 shutdown_connections 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/2347546956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe678101330 0x7fe67810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/2347546956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 0x7fe678100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/2347546956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe6781069a0 0x7fe678106d80 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 -- 172.21.15.76:0/2347546956 >> 172.21.15.76:0/2347546956 conn(0x7fe6780fc6d0 msgr2=0x7fe6780feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 -- 172.21.15.76:0/2347546956 shutdown_connections 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 -- 172.21.15.76:0/2347546956 wait complete. 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.039+0000 7fe67d2dd640 1 Processor -- start 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 -- start start 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 0x7fe6781984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 0x7fe678198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:43.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6781069a0 0x7fe67819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe678111ff0 con 0x7fe678101330 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe678111e70 con 0x7fe678100990 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe67d2dd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe678112170 con 0x7fe6781069a0 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 0x7fe678198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 0x7fe678198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50120/0 (socket says 172.21.15.76:50120) 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 -- 172.21.15.76:0/3794844639 learned_addr learned my addr 172.21.15.76:0/3794844639 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe676ffd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 0x7fe6781984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 -- 172.21.15.76:0/3794844639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6781069a0 msgr2=0x7fe67819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6781069a0 0x7fe67819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 -- 172.21.15.76:0/3794844639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 msgr2=0x7fe6781984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 0x7fe6781984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 -- 172.21.15.76:0/3794844639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67819d4d0 con 0x7fe678101330 2024-09-19T08:01:43.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe676ffd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 0x7fe6781984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.040+0000 7fe6767fc640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 0x7fe678198a20 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00d950 tx=0x7fe66c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.041+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c017030 con 0x7fe678101330 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.041+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67819d7c0 con 0x7fe678101330 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.041+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe66c004020 con 0x7fe678101330 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.041+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c004a00 con 0x7fe678101330 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.041+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6781a5050 con 0x7fe678101330 2024-09-19T08:01:43.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.041+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678100df0 con 0x7fe678101330 2024-09-19T08:01:43.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.043+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe66c0041d0 con 0x7fe678101330 2024-09-19T08:01:43.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.043+0000 7fe65ffff640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe6600a33c0 0x7fe6600a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:01:43.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.044+0000 7fe676ffd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe6600a33c0 0x7fe6600a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:01:43.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.044+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fe66c0cfed0 con 0x7fe678101330 2024-09-19T08:01:43.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.044+0000 7fe676ffd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe6600a33c0 0x7fe6600a5880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe668000c00 tx=0x7fe668005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:01:43.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.047+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe66c00e350 con 0x7fe678101330 2024-09-19T08:01:43.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.258+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe678199830 con 0x7fe678101330 2024-09-19T08:01:43.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.266+0000 7fe65ffff640 1 -- 172.21.15.76:0/3794844639 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+742867 (secure 0 0 0) 0x7fe678199830 con 0x7fe678101330 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: "epoch": 26, 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: "active_gid": 15132, 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: "active_name": "x", 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: "active_addrs": { 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:43.281 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:6800", 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 4082879407 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:6801", 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 4082879407 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "active_addr": "172.21.15.76:6801/4082879407", 2024-09-19T08:01:43.282 INFO:teuthology.orchestra.run.smithi076.stdout: "active_change": "2024-09-19T07:51:12.773878+0000", 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "available": true, 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "standbys": [ 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "gid": 24731, 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "z", 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "available_modules": [ 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "alerts", 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.283 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.284 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.285 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.286 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.287 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.288 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.289 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_destination": { 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_destination", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.290 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_from_name": { 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_from_name", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.291 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "Ceph", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email From: name", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_host": { 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_host", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.292 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP server", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_password": { 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_password", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.293 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Password to authenticate with", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_port": { 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_port", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.294 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "465", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP port", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_sender": { 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_sender", 2024-09-19T08:01:43.295 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.296 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_ssl": { 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_ssl", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.297 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_user": { 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_user", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "User to authenticate as", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.298 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "balancer", 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "active": { 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "active", 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.299 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_time": { 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_time", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.300 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0000", 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_weekday": { 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_weekday", 2024-09-19T08:01:43.301 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_max_iterations": { 2024-09-19T08:01:43.302 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "25", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "250", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_metrics": { 2024-09-19T08:01:43.303 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_metrics", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.304 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_step": { 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_step", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.5", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0.001", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "0.999", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.305 INFO:teuthology.orchestra.run.smithi076.stdout: "end_time": { 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_time", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2359", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.306 INFO:teuthology.orchestra.run.smithi076.stdout: "end_weekday": { 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_weekday", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.307 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.308 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.309 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.310 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.311 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.312 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "min_score": { 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_score", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.313 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.314 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.314 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:01:43.314 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.314 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.314 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "upmap", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "crush-compat", 2024-09-19T08:01:43.315 INFO:teuthology.orchestra.run.smithi076.stdout: "none", 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "read", 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap", 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap-read" 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Balancer mode", 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_ids": { 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_ids", 2024-09-19T08:01:43.316 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.317 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.318 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_deviation": { 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_deviation", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.319 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_optimizations": { 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.320 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm", 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_down_multiplier": { 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_down_multiplier", 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.321 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_refresh_rate": { 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_refresh_rate", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.322 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "20", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_starting_port": { 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_starting_port", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.323 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4721", 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_ptrace": { 2024-09-19T08:01:43.324 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_ptrace", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.325 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_interval": { 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_interval", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.7", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.327 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm_log_destination": { 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm_log_destination", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "file", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "file,syslog", 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: "syslog" 2024-09-19T08:01:43.328 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "cgroups_split": { 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cgroups_split", 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.329 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "config_checks_enabled": { 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_checks_enabled", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.330 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "config_dashboard": { 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_dashboard", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.331 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_alertmanager": { 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_alertmanager", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.332 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_base": { 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_base", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.333 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_elasticsearch": { 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.334 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "elasticsearch container image", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_grafana": { 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_grafana", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.335 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_haproxy": { 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_haproxy", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.336 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "HAproxy container image", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_agent": { 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.337 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_collector": { 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.338 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_query": { 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.339 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger query container image", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_keepalived": { 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_keepalived", 2024-09-19T08:01:43.340 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Keepalived container image", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_loki": { 2024-09-19T08:01:43.341 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_loki", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Loki container image", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.342 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_node_exporter": { 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_node_exporter", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.343 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_nvmeof": { 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_nvmeof", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Nvme-of container image", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.344 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_prometheus": { 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_prometheus", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_promtail": { 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_promtail", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Promtail container image", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_samba": { 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_samba", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.347 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_snmp_gateway": { 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.348 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "container_init": { 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_init", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:01:43.349 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "daemon_cache_timeout": { 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.350 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "900", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.351 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "default_registry": { 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_registry", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io", 2024-09-19T08:01:43.352 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "device_cache_timeout": { 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_cache_timeout", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1800", 2024-09-19T08:01:43.353 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "device_enhanced_scan": { 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_enhanced_scan", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.354 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "facts_cache_timeout": { 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "facts_cache_timeout", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.355 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "grafana_dashboards_path": { 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.356 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "host_check_interval": { 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "host_check_interval", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.357 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "hw_monitoring": { 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hw_monitoring", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.358 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "inventory_list_all": { 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "inventory_list_all", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.359 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.360 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.361 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "log_refresh_metadata": { 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_refresh_metadata", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:01:43.362 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.363 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.364 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.365 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.366 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.367 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.368 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "*", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "max_count_per_host": { 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_count_per_host", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.369 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "max_osd_draining_count": { 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_osd_draining_count", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.370 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "migration_current": { 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "migration_current", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.371 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "internal - do not modify", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.372 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "root", 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm-package", 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "root" 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "oob_default_addr": { 2024-09-19T08:01:43.373 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "oob_default_addr", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "169.254.1.1", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "prometheus_alerts_path": { 2024-09-19T08:01:43.374 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.375 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_insecure": { 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_insecure", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_password": { 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_password", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.377 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_url": { 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_url", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.378 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_username": { 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_username", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.379 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "secure_monitoring_stack": { 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:01:43.380 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "service_discovery_port": { 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "service_discovery_port", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8765", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:01:43.381 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "ssh_config_file": { 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssh_config_file", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.382 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "use_agent": { 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_agent", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.383 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "use_repo_digest": { 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_repo_digest", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.384 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_failed_host_check": { 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.385 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_daemons": { 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.386 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_hosts": { 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.387 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crash", 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.388 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.389 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.390 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.391 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.392 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.393 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "retain_interval": { 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retain_interval", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "31536000", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:01:43.394 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_recent_interval": { 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_recent_interval", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1209600", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:01:43.395 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dashboard", 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.396 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.397 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:01:43.398 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:01:43.399 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:01:43.400 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:01:43.401 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.404 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.405 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.406 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.407 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.408 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.409 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.410 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.411 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.412 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_URL": { 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.413 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.414 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.417 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.418 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.419 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.420 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.422 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.423 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.424 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.425 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.426 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.427 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.428 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.429 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.430 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.431 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8", 2024-09-19T08:01:43.432 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "45", 2024-09-19T08:01:43.433 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.434 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:43.435 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.436 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.437 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.438 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.439 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.440 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "cross_origin_url": { 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cross_origin_url", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.441 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "crt_file": { 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crt_file", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.442 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "debug": { 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "debug", 2024-09-19T08:01:43.443 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "jwt_token_ttl": { 2024-09-19T08:01:43.444 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "jwt_token_ttl", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "28800", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.445 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.446 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.447 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.448 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.449 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "motd": { 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "motd", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "The message of the day", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8080", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.456 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl_server_port": { 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl_server_port", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8443", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.457 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "redirect", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.458 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect" 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-09-19T08:01:43.459 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "url_prefix": { 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url_prefix", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.460 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-09-19T08:01:43.461 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_monitoring": { 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_monitoring", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "monitor device health metrics", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.462 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.463 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.464 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.465 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.466 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.467 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "mark_out_threshold": { 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mark_out_threshold", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2419200", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.468 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_name": { 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_name", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "device_health_metrics", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.469 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "retention_period": { 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retention_period", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15552000", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.470 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_frequency": { 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_frequency", 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-09-19T08:01:43.471 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "self_heal": { 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "self_heal", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.472 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.473 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_threshold": { 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_threshold", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.474 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7257600", 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "diskprediction_local", 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.475 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.476 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.477 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.481 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.481 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.481 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.482 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.483 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.484 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.485 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.485 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.485 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.485 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.485 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.549 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "predict_interval": { 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predict_interval", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.550 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "predictor_model": { 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predictor_model", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "prophetstor", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.551 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.552 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "influx", 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": false, 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:01:43.553 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "batch_size": { 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "batch_size", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5000", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.554 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "database": { 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "database", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "ceph", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.555 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": { 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hostname", 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.556 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "30", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "5", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.557 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.558 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.559 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.560 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.561 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.562 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "password": { 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "password", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.563 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "port": { 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "port", 2024-09-19T08:01:43.564 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8086", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server port", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-09-19T08:01:43.565 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "false", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "threads": { 2024-09-19T08:01:43.566 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threads", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "32", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "username": { 2024-09-19T08:01:43.567 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "username", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.568 INFO:teuthology.orchestra.run.smithi076.stdout: "verify_ssl": { 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "verify_ssl", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "true", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.569 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "insights", 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.570 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.571 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.572 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.573 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.574 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.575 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "iostat", 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.576 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.577 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.578 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.579 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.580 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.581 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "k8sevents", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_event_retention_days": { 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.582 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "config_check_secs": { 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_check_secs", 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.583 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "10", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.584 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.585 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.586 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.587 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.589 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "localpool", 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.590 INFO:teuthology.orchestra.run.smithi076.stdout: "failure_domain": { 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "failure_domain", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "host", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.591 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.592 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.593 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.594 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.595 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.596 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.597 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.597 INFO:teuthology.orchestra.run.smithi076.stdout: "min_size": { 2024-09-19T08:01:43.597 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_size", 2024-09-19T08:01:43.597 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.597 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.597 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "num_rep": { 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "num_rep", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.598 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3", 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_num": { 2024-09-19T08:01:43.599 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_num", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "128", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "prefix": { 2024-09-19T08:01:43.600 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prefix", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.601 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "subtree": { 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "subtree", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "rack", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:01:43.602 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mds_autoscaler", 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.603 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.604 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.605 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.606 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.607 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.608 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirroring", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.609 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.610 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.611 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.612 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.612 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.612 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.612 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.612 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.612 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.613 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.614 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.614 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.614 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.614 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.614 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.615 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.616 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.617 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "nfs", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.618 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.619 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.620 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.621 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.622 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.623 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "fail_fs": { 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "fail_fs", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.624 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.625 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.626 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.627 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.628 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.629 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator": { 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.630 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "rook", 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "test_orchestrator" 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Orchestrator backend", 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_perf_query", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.632 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.633 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.634 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.635 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.636 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_support", 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.637 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.638 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.639 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.640 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.641 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.642 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_autoscaler", 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.643 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.644 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.645 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.646 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.647 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.648 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.649 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "threshold": { 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threshold", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.650 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1.0", 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "scaling threshold", 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "progress", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_pg_recovery_event": { 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.652 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.653 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.654 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.656 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.657 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.658 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "max_completed_events": { 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_completed_events", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.659 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "50", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:43.660 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.661 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "cache": { 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cache", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.662 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "exclude_perf_counters": { 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "exclude_perf_counters", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.663 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.664 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.665 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.666 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.667 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.668 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.669 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools": { 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools", 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.670 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.671 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "300", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_interval": { 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_interval", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.672 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15.0", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.673 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:43.674 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "9283", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "stale_cache_strategy": { 2024-09-19T08:01:43.675 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stale_cache_strategy", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "log", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.676 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "default", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "default", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "error" 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.677 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-09-19T08:01:43.678 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.679 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.680 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.681 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.686 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.687 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.688 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_snap_create": { 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:01:43.689 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.690 INFO:teuthology.orchestra.run.smithi076.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.691 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "trash_purge_schedule": { 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "trash_purge_schedule", 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.692 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "restful", 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.693 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_auth": { 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_auth", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.694 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.695 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.696 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.696 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.696 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.696 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.697 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.698 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.699 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.700 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.701 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.702 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.703 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:43.704 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.705 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rgw", 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.706 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.707 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.708 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.709 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.710 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.712 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.713 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.714 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.716 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rook", 2024-09-19T08:01:43.716 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.716 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.716 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.716 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.717 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.718 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.719 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.720 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.721 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "storage_class": { 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "storage_class", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "local", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:01:43.722 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "selftest", 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.723 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.724 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.725 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.726 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.727 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "roption1": { 2024-09-19T08:01:43.728 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption1", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.729 INFO:teuthology.orchestra.run.smithi076.stdout: "roption2": { 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption2", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "xyz", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.730 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption1": { 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption1", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.731 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption2": { 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption2", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.732 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption3": { 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption3", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.733 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption4": { 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption4", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.734 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption5": { 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption5", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.735 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption6": { 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption6", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.736 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption7": { 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption7", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "42", 2024-09-19T08:01:43.737 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "testkey": { 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testkey", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.738 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "testlkey": { 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testlkey", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.739 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "testnewline": { 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testnewline", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.740 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.741 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_m_granularity": { 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_m_granularity", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.742 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "dump_on_update": { 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dump_on_update", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.743 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.744 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.745 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.746 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.747 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.748 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stats", 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.749 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.750 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.751 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.752 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.753 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.754 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "status", 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.755 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.756 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.757 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.758 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.759 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telegraf", 2024-09-19T08:01:43.760 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "address": { 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "address", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.761 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.762 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.763 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.764 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.765 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.766 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.767 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telemetry", 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.768 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_basic": { 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_basic", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.769 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_crash": { 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_crash", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.770 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_device": { 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_device", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.771 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_ident": { 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_ident", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.772 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_perf": { 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_perf", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.773 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "contact": { 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "contact", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.774 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "description": { 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "description", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.775 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "device_url": { 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_url", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.776 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "24", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "8", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.778 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "last_opt_revision": { 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "last_opt_revision", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.779 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard": { 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.780 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard_description": { 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard_description", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.781 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.782 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.783 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.784 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.785 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.786 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "organization": { 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "organization", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.787 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "proxy": { 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "proxy", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.788 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "url": { 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url", 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.789 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.790 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "test_orchestrator", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.791 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.792 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.793 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.794 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.795 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.796 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.797 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.798 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.799 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.801 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_clones": { 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_clones", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:01:43.802 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "periodic_async_work": { 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "periodic_async_work", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Periodically check for async work", 2024-09-19T08:01:43.803 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_delay": { 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:01:43.804 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.805 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix", 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "discovery_interval": { 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "discovery_interval", 2024-09-19T08:01:43.806 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "100", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "identifier": { 2024-09-19T08:01:43.807 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "identifier", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:43.808 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.810 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.811 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.812 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.813 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.814 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_host": { 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_host", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.815 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_port": { 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_port", 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.816 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10051", 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_sender": { 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_sender", 2024-09-19T08:01:43.817 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.818 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "gid": 24734, 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "y", 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "available_modules": [ 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "alerts", 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:43.819 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.820 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.821 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.822 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.823 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_destination": { 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_destination", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_from_name": { 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_from_name", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "Ceph", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email From: name", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_host": { 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_host", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP server", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.828 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_password": { 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_password", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Password to authenticate with", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.829 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_port": { 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_port", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "465", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP port", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.830 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_sender": { 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_sender", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:01:43.831 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_ssl": { 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_ssl", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:01:43.832 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_user": { 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_user", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.833 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "User to authenticate as", 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "balancer", 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "active": { 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "active", 2024-09-19T08:01:43.834 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_time": { 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_time", 2024-09-19T08:01:43.835 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0000", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_weekday": { 2024-09-19T08:01:43.836 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_weekday", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:01:43.837 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:01:43.840 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.840 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_max_iterations": { 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "25", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "250", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.841 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_metrics": { 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_metrics", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:01:43.842 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_step": { 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_step", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.5", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0.001", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "0.999", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:01:43.843 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "end_time": { 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_time", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2359", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:01:43.844 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "end_weekday": { 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_weekday", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:01:43.845 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.846 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.847 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.848 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.849 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.850 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "min_score": { 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_score", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.851 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "upmap", 2024-09-19T08:01:43.852 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "crush-compat", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "none", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "read", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap-read" 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Balancer mode", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.853 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_ids": { 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_ids", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_deviation": { 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_deviation", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_optimizations": { 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.857 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm", 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_down_multiplier": { 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_down_multiplier", 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.858 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_refresh_rate": { 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_refresh_rate", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.859 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "20", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_starting_port": { 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_starting_port", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.860 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4721", 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_ptrace": { 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_ptrace", 2024-09-19T08:01:43.861 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_interval": { 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_interval", 2024-09-19T08:01:43.862 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:01:43.863 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.7", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.864 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm_log_destination": { 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm_log_destination", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "file", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "file,syslog", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "syslog" 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:01:43.865 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "cgroups_split": { 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cgroups_split", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:01:43.866 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "config_checks_enabled": { 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_checks_enabled", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:01:43.867 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "config_dashboard": { 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_dashboard", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.868 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_alertmanager": { 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_alertmanager", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.869 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_base": { 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_base", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.870 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_elasticsearch": { 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.871 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "elasticsearch container image", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_grafana": { 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_grafana", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.872 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_haproxy": { 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_haproxy", 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.873 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "HAproxy container image", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_agent": { 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.874 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_collector": { 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.875 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_query": { 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.876 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger query container image", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_keepalived": { 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_keepalived", 2024-09-19T08:01:43.877 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Keepalived container image", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_loki": { 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_loki", 2024-09-19T08:01:43.878 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Loki container image", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_node_exporter": { 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_node_exporter", 2024-09-19T08:01:43.879 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_nvmeof": { 2024-09-19T08:01:43.880 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_nvmeof", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Nvme-of container image", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_prometheus": { 2024-09-19T08:01:43.881 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_prometheus", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_promtail": { 2024-09-19T08:01:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_promtail", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Promtail container image", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.883 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_samba": { 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_samba", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.884 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_snmp_gateway": { 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.885 INFO:teuthology.orchestra.run.smithi076.stdout: "container_init": { 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_init", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "daemon_cache_timeout": { 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.887 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "900", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.888 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "default_registry": { 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_registry", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.889 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "device_cache_timeout": { 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_cache_timeout", 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1800", 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.890 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "device_enhanced_scan": { 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_enhanced_scan", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.891 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "facts_cache_timeout": { 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "facts_cache_timeout", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.892 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "grafana_dashboards_path": { 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:01:43.893 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "host_check_interval": { 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "host_check_interval", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:43.894 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "hw_monitoring": { 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hw_monitoring", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.895 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "inventory_list_all": { 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "inventory_list_all", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.896 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.897 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "log_refresh_metadata": { 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_refresh_metadata", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.899 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.900 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.901 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.902 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.903 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:01:43.904 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "*", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "max_count_per_host": { 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_count_per_host", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.905 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "max_osd_draining_count": { 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_osd_draining_count", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.906 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "migration_current": { 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "migration_current", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.907 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "internal - do not modify", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.908 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "root", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm-package", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "root" 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.909 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "oob_default_addr": { 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "oob_default_addr", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "169.254.1.1", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.910 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "prometheus_alerts_path": { 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.911 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_insecure": { 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_insecure", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.912 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_password": { 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_password", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.913 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_url": { 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_url", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.914 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_username": { 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_username", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.915 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "secure_monitoring_stack": { 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.916 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "service_discovery_port": { 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "service_discovery_port", 2024-09-19T08:01:43.917 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8765", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "ssh_config_file": { 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssh_config_file", 2024-09-19T08:01:43.918 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "use_agent": { 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_agent", 2024-09-19T08:01:43.919 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "use_repo_digest": { 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_repo_digest", 2024-09-19T08:01:43.920 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_failed_host_check": { 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:01:43.921 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_daemons": { 2024-09-19T08:01:43.922 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_hosts": { 2024-09-19T08:01:43.923 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.924 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crash", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.925 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.927 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.928 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.929 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "retain_interval": { 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retain_interval", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.930 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "31536000", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_recent_interval": { 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_recent_interval", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:43.931 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1209600", 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.932 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dashboard", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.933 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.934 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.935 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.936 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.937 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.938 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.939 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.940 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.941 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.942 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.943 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.944 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.945 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.946 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.947 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.948 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_URL": { 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.949 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.950 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.951 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:01:43.952 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:01:43.953 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:01:43.954 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.955 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.956 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.957 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.958 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.959 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.960 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.961 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.962 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.963 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.964 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.965 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.966 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.967 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.968 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "45", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.969 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.970 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.971 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.972 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.973 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.974 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.975 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:43.976 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "cross_origin_url": { 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cross_origin_url", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.977 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "crt_file": { 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crt_file", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.978 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "debug": { 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "debug", 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.979 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "jwt_token_ttl": { 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "jwt_token_ttl", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.980 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "28800", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.981 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.982 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.983 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.984 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.985 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.986 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "motd": { 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "motd", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.987 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "The message of the day", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.988 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.989 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.990 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8080", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.991 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl_server_port": { 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl_server_port", 2024-09-19T08:01:43.992 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8443", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-09-19T08:01:43.993 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "redirect", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect" 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.994 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.995 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "url_prefix": { 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url_prefix", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.996 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_monitoring": { 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_monitoring", 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.997 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "monitor device health metrics", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:43.998 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:43.999 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.000 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.001 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.002 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "mark_out_threshold": { 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mark_out_threshold", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.003 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2419200", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_name": { 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_name", 2024-09-19T08:01:44.004 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "device_health_metrics", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "retention_period": { 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retention_period", 2024-09-19T08:01:44.005 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15552000", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_frequency": { 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_frequency", 2024-09-19T08:01:44.006 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "self_heal": { 2024-09-19T08:01:44.007 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "self_heal", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.008 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.009 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_threshold": { 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_threshold", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7257600", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.010 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "diskprediction_local", 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.011 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.012 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.013 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.014 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.015 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "predict_interval": { 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predict_interval", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.016 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "predictor_model": { 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predictor_model", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.017 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "prophetstor", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.018 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "influx", 2024-09-19T08:01:44.019 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": false, 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "batch_size": { 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "batch_size", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5000", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "database": { 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "database", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "ceph", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.021 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": { 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hostname", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.022 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "30", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "5", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.023 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.024 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.025 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.026 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.027 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.028 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "password": { 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "password", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.029 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "port": { 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "port", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8086", 2024-09-19T08:01:44.030 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server port", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "false", 2024-09-19T08:01:44.031 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "threads": { 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threads", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.032 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "32", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "username": { 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "username", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.033 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "verify_ssl": { 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "verify_ssl", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.034 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "true", 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.035 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "insights", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.036 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.037 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.038 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.039 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.040 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "iostat", 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.041 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.042 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.043 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.044 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.045 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.046 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "k8sevents", 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_event_retention_days": { 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.047 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "config_check_secs": { 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_check_secs", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.048 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "10", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.049 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.050 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.051 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.052 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.053 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.054 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "localpool", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "failure_domain": { 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "failure_domain", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "host", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.055 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.056 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.057 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.058 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.059 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.060 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "min_size": { 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_size", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.061 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "num_rep": { 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "num_rep", 2024-09-19T08:01:44.062 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.063 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_num": { 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_num", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "128", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.064 INFO:teuthology.orchestra.run.smithi076.stdout: "prefix": { 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prefix", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.065 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "subtree": { 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "subtree", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "rack", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.066 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mds_autoscaler", 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.067 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.068 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.069 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.070 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.071 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.072 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirroring", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.073 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.074 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.075 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.076 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.077 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "nfs", 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.078 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.079 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.080 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.081 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.082 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.083 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "fail_fs": { 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "fail_fs", 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.084 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.085 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.086 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.087 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.088 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.089 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator": { 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-09-19T08:01:44.090 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "rook", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "test_orchestrator" 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Orchestrator backend", 2024-09-19T08:01:44.091 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_perf_query", 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.092 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.093 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.094 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.095 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.096 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.097 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_support", 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.098 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.099 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.100 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.101 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.102 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_autoscaler", 2024-09-19T08:01:44.103 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.104 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.105 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.106 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.107 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.108 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.109 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "threshold": { 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threshold", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1.0", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.110 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "scaling threshold", 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "progress", 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_pg_recovery_event": { 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:01:44.111 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-09-19T08:01:44.112 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.113 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.114 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.115 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.116 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.117 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.118 INFO:teuthology.orchestra.run.smithi076.stdout: "max_completed_events": { 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_completed_events", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "50", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.119 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.120 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus", 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "cache": { 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cache", 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.121 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "exclude_perf_counters": { 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "exclude_perf_counters", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.122 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.123 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.124 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.125 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.126 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.127 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.128 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools": { 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "300", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_interval": { 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_interval", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15.0", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.131 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.132 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "9283", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:01:44.133 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "stale_cache_strategy": { 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stale_cache_strategy", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "log", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.134 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "default", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.135 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "default", 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "error" 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.136 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-09-19T08:01:44.137 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.138 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.139 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.140 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.141 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.142 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_snap_create": { 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.143 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.144 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "trash_purge_schedule": { 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "trash_purge_schedule", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.145 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "restful", 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_auth": { 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_auth", 2024-09-19T08:01:44.146 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-09-19T08:01:44.147 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.148 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.149 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.150 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.151 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.152 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.155 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rgw", 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.156 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.157 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.158 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.159 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.160 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.161 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.162 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rook", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.163 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.164 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.165 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.166 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.167 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "storage_class": { 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "storage_class", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "local", 2024-09-19T08:01:44.168 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "selftest", 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.169 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.170 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.171 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.172 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.173 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.174 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "roption1": { 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption1", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.175 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "roption2": { 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption2", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "xyz", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.176 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption1": { 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption1", 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.177 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption2": { 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption2", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.178 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption3": { 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption3", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.179 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption4": { 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption4", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.180 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption5": { 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption5", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.181 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption6": { 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption6", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.182 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption7": { 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption7", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.183 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "42", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "testkey": { 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testkey", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.184 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "testlkey": { 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testlkey", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.185 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "testnewline": { 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testnewline", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.186 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.187 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_m_granularity": { 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_m_granularity", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "dump_on_update": { 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dump_on_update", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.190 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.191 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.192 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.193 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.194 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stats", 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.195 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.196 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.197 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.198 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.199 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.200 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "status", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.201 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.202 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.203 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.204 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.205 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telegraf", 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.206 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "address": { 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "address", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.207 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.208 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.209 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.210 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.211 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.212 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.213 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telemetry", 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_basic": { 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_basic", 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.214 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_crash": { 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_crash", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.215 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_device": { 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_device", 2024-09-19T08:01:44.216 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_ident": { 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_ident", 2024-09-19T08:01:44.217 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_perf": { 2024-09-19T08:01:44.218 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_perf", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.219 INFO:teuthology.orchestra.run.smithi076.stdout: "contact": { 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "contact", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.220 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "description": { 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "description", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.221 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "device_url": { 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_url", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.222 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.223 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "24", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "8", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.224 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "last_opt_revision": { 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "last_opt_revision", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.225 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard": { 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.226 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard_description": { 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard_description", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.227 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.228 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.229 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.230 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.231 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.232 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "organization": { 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "organization", 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "proxy": { 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "proxy", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.234 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "url": { 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.235 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "test_orchestrator", 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.236 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.237 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.238 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.239 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.240 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.241 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.242 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.243 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.244 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.245 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.246 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_clones": { 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_clones", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.247 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "periodic_async_work": { 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "periodic_async_work", 2024-09-19T08:01:44.248 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Periodically check for async work", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_delay": { 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:01:44.249 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:01:44.250 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "discovery_interval": { 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "discovery_interval", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "100", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "identifier": { 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "identifier", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_host": { 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_host", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_port": { 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_port", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10051", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_sender": { 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_sender", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:01:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: "modules": [ 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "dashboard", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "iostat", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "nfs", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "restful", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "snap_schedule" 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "available_modules": [ 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "alerts", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.265 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.266 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.267 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.268 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.269 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.270 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_destination": { 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_destination", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.271 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_from_name": { 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_from_name", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "Ceph", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Email From: name", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.272 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_host": { 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_host", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP server", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.273 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_password": { 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_password", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Password to authenticate with", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.274 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_port": { 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_port", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "465", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP port", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.275 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_sender": { 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_sender", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.276 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_ssl": { 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_ssl", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.277 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "smtp_user": { 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "smtp_user", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "User to authenticate as", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.278 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "balancer", 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "active": { 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "active", 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.279 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_time": { 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_time", 2024-09-19T08:01:44.280 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0000", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "begin_weekday": { 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "begin_weekday", 2024-09-19T08:01:44.281 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_max_iterations": { 2024-09-19T08:01:44.282 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "25", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "250", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_metrics": { 2024-09-19T08:01:44.283 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_metrics", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.284 INFO:teuthology.orchestra.run.smithi076.stdout: "crush_compat_step": { 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crush_compat_step", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.5", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0.001", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "0.999", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.285 INFO:teuthology.orchestra.run.smithi076.stdout: "end_time": { 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_time", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2359", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.286 INFO:teuthology.orchestra.run.smithi076.stdout: "end_weekday": { 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "end_weekday", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "0", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "6", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.287 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.288 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.289 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.290 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.291 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.292 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: "min_score": { 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_score", 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.293 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:44.295 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.295 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.295 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "upmap", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.296 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "crush-compat", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "none", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "read", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap-read" 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Balancer mode", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.297 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_ids": { 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_ids", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.298 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.299 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_deviation": { 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_deviation", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.300 INFO:teuthology.orchestra.run.smithi076.stdout: "upmap_max_optimizations": { 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.301 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm", 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_down_multiplier": { 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_down_multiplier", 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-09-19T08:01:44.302 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_refresh_rate": { 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_refresh_rate", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.303 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "20", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "agent_starting_port": { 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "agent_starting_port", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.304 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4721", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_ptrace": { 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_ptrace", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.305 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_interval": { 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_interval", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.306 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.307 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0.7", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm_log_destination": { 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cephadm_log_destination", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.308 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "file", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "file,syslog", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "syslog" 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "cgroups_split": { 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cgroups_split", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.310 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "config_checks_enabled": { 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_checks_enabled", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.311 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "config_dashboard": { 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_dashboard", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.312 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_alertmanager": { 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_alertmanager", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.313 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_base": { 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_base", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.314 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_elasticsearch": { 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "elasticsearch container image", 2024-09-19T08:01:44.315 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_grafana": { 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_grafana", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.316 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_haproxy": { 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_haproxy", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.317 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "HAproxy container image", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_agent": { 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.318 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_collector": { 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.319 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_jaeger_query": { 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.320 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Jaeger query container image", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_keepalived": { 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_keepalived", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.321 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Keepalived container image", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_loki": { 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_loki", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.322 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Loki container image", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_node_exporter": { 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_node_exporter", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.323 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_nvmeof": { 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_nvmeof", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.324 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Nvme-of container image", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_prometheus": { 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_prometheus", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:01:44.325 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Prometheus container image", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_promtail": { 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_promtail", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:01:44.326 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Promtail container image", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_samba": { 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_samba", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.327 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "container_image_snmp_gateway": { 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.328 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "container_init": { 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "container_init", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.329 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "daemon_cache_timeout": { 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.330 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:01:44.331 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "900", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "default_registry": { 2024-09-19T08:01:44.332 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "default_registry", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "docker.io", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "device_cache_timeout": { 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_cache_timeout", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1800", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "device_enhanced_scan": { 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_enhanced_scan", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "facts_cache_timeout": { 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "facts_cache_timeout", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.336 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "grafana_dashboards_path": { 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.337 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "host_check_interval": { 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "host_check_interval", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.338 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "hw_monitoring": { 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hw_monitoring", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.339 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "inventory_list_all": { 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "inventory_list_all", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:01:44.340 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.341 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "log_refresh_metadata": { 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_refresh_metadata", 2024-09-19T08:01:44.342 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.343 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.344 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.345 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.346 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.347 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.348 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "*", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "max_count_per_host": { 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_count_per_host", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.349 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "max_osd_draining_count": { 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_osd_draining_count", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.350 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "migration_current": { 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "migration_current", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.351 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "internal - do not modify", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "mode": { 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mode", 2024-09-19T08:01:44.352 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "root", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm-package", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "root" 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "oob_default_addr": { 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "oob_default_addr", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "169.254.1.1", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.354 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "prometheus_alerts_path": { 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.355 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_insecure": { 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_insecure", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.356 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_password": { 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_password", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.357 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_url": { 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_url", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:01:44.358 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "registry_username": { 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "registry_username", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.359 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "secure_monitoring_stack": { 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.360 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "service_discovery_port": { 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "service_discovery_port", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8765", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.361 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "ssh_config_file": { 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssh_config_file", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.362 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "use_agent": { 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_agent", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.363 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "use_repo_digest": { 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "use_repo_digest", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.364 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_failed_host_check": { 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.365 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_daemons": { 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.366 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_on_stray_hosts": { 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.367 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.368 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crash", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.369 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.370 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.371 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.372 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.373 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "retain_interval": { 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retain_interval", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "31536000", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.374 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_recent_interval": { 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_recent_interval", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1209600", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.375 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dashboard", 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:01:44.376 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:01:44.377 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.378 INFO:teuthology.orchestra.run.smithi076.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.381 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.382 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.383 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.384 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.385 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.386 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.387 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.388 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.389 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.390 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.391 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.392 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_URL": { 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.393 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.394 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.395 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.396 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.397 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.398 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.399 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.400 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.401 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.402 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.403 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.404 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.405 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.406 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:01:44.407 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:01:44.408 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.409 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.410 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.411 INFO:teuthology.orchestra.run.smithi076.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "45", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.413 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.414 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "admin", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.415 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.416 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.417 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.418 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.419 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.420 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "cross_origin_url": { 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cross_origin_url", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.421 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "crt_file": { 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "crt_file", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.422 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "debug": { 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "debug", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:01:44.423 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "jwt_token_ttl": { 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "jwt_token_ttl", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "28800", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.424 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.425 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.426 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.427 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.428 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.429 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.430 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "motd": { 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "motd", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.431 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "The message of the day", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.432 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-09-19T08:01:44.433 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8080", 2024-09-19T08:01:44.434 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.435 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl_server_port": { 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl_server_port", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.436 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8443", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.437 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "redirect", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "redirect" 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-09-19T08:01:44.438 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "url_prefix": { 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url_prefix", 2024-09-19T08:01:44.439 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_monitoring": { 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_monitoring", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.441 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "monitor device health metrics", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.442 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.443 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.445 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.446 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "mark_out_threshold": { 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mark_out_threshold", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.447 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "2419200", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "pool_name": { 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pool_name", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.448 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "device_health_metrics", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "retention_period": { 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "retention_period", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.449 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15552000", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_frequency": { 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_frequency", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.450 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "self_heal": { 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "self_heal", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.451 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.452 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "warn_threshold": { 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "warn_threshold", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.453 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7257600", 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "diskprediction_local", 2024-09-19T08:01:44.454 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.455 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.456 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.457 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.458 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.459 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "predict_interval": { 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predict_interval", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "86400", 2024-09-19T08:01:44.460 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "predictor_model": { 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "predictor_model", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "prophetstor", 2024-09-19T08:01:44.461 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "600", 2024-09-19T08:01:44.462 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "influx", 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": false, 2024-09-19T08:01:44.463 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "batch_size": { 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "batch_size", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5000", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.464 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "database": { 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "database", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "ceph", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.465 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": { 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "hostname", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:01:44.466 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "30", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "5", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:01:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.468 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.469 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.470 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.471 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.472 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "password": { 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "password", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.473 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "port": { 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "port", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "8086", 2024-09-19T08:01:44.474 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "InfluxDB server port", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "ssl": { 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ssl", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "false", 2024-09-19T08:01:44.475 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "threads": { 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threads", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.476 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "32", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "username": { 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "username", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.477 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "verify_ssl": { 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "verify_ssl", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.478 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "true", 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.479 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "insights", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.480 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.481 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.482 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.483 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.484 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "iostat", 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.485 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.486 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.487 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.488 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.489 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.490 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "k8sevents", 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_event_retention_days": { 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.491 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "7", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "config_check_secs": { 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "config_check_secs", 2024-09-19T08:01:44.492 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "10", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.493 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.494 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.495 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.496 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.497 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.498 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "localpool", 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "failure_domain": { 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "failure_domain", 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.499 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "host", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.500 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.501 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.502 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.503 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.504 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.505 INFO:teuthology.orchestra.run.smithi076.stdout: "min_size": { 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "min_size", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.506 INFO:teuthology.orchestra.run.smithi076.stdout: "num_rep": { 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "num_rep", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.507 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_num": { 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_num", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "128", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.508 INFO:teuthology.orchestra.run.smithi076.stdout: "prefix": { 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prefix", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.509 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "subtree": { 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "subtree", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "rack", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.510 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mds_autoscaler", 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.511 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.512 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.513 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.514 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.515 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.516 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirroring", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.517 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.518 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.519 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.520 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.521 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "nfs", 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.522 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.523 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.524 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.525 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.526 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.527 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "fail_fs": { 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "fail_fs", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.528 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.529 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.530 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.531 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.532 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.533 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator": { 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "orchestrator", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.534 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "cephadm", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "rook", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "test_orchestrator" 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Orchestrator backend", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.535 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_perf_query", 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.536 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.537 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.538 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.539 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.540 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "osd_support", 2024-09-19T08:01:44.541 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.542 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.543 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.544 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.545 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.546 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "pg_autoscaler", 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.547 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.548 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.549 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.550 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.551 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.552 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.553 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "threshold": { 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "threshold", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "3.0", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1.0", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "scaling threshold", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.554 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "progress", 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_pg_recovery_event": { 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.555 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.556 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.557 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.558 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.559 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.560 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.561 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "max_completed_events": { 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_completed_events", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.562 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "50", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "sleep_interval": { 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "sleep_interval", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.563 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "prometheus", 2024-09-19T08:01:44.564 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "cache": { 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "cache", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.565 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "exclude_perf_counters": { 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "exclude_perf_counters", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.566 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.567 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.568 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.569 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.570 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.571 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools": { 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.572 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "300", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.573 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "scrape_interval": { 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "scrape_interval", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15.0", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.574 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "::", 2024-09-19T08:01:44.575 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "9283", 2024-09-19T08:01:44.576 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "stale_cache_strategy": { 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stale_cache_strategy", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.577 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "log", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_behaviour": { 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_behaviour", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.578 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "default", 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "default", 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "error" 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "standby_error_status_code": { 2024-09-19T08:01:44.579 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "standby_error_status_code", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "500", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "400", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "599", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.580 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.581 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.582 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.584 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.585 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_snap_create": { 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.586 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.587 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "trash_purge_schedule": { 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "trash_purge_schedule", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.588 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.589 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "restful", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "enable_auth": { 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enable_auth", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.590 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "key_file": { 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "key_file", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.591 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.592 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.593 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.594 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.595 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.596 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "server_addr": { 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_addr", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.597 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "server_port": { 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "server_port", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.598 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rgw", 2024-09-19T08:01:44.599 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.600 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.601 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.602 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.603 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.604 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.605 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "5", 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rook", 2024-09-19T08:01:44.606 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.607 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.608 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.609 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.610 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.611 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "storage_class": { 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "storage_class", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "local", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.612 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "selftest", 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.613 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.614 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.615 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.616 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.617 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.618 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "roption1": { 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption1", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.619 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "roption2": { 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "roption2", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "xyz", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.620 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption1": { 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption1", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.621 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption2": { 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption2", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.622 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption3": { 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption3", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "float", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.623 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption4": { 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption4", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.624 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption5": { 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption5", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.625 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption6": { 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption6", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.626 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "rwoption7": { 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rwoption7", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.627 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "1", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "42", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "testkey": { 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testkey", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.628 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "testlkey": { 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testlkey", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.629 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "testnewline": { 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "testnewline", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.630 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.631 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "allow_m_granularity": { 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "allow_m_granularity", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.632 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "dump_on_update": { 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "dump_on_update", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.633 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.634 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.635 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.636 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.637 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.638 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "stats", 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.639 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.640 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.642 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.643 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.644 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "status", 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.645 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.646 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.647 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.648 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.649 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.650 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telegraf", 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "address": { 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "address", 2024-09-19T08:01:44.651 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.652 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "15", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.653 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.654 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.655 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.656 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.657 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.658 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "telemetry", 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_basic": { 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_basic", 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_crash": { 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_crash", 2024-09-19T08:01:44.660 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_device": { 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_device", 2024-09-19T08:01:44.661 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_ident": { 2024-09-19T08:01:44.662 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_ident", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "channel_perf": { 2024-09-19T08:01:44.663 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "channel_perf", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.664 INFO:teuthology.orchestra.run.smithi076.stdout: "contact": { 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "contact", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.665 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "description": { 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "description", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "device_url": { 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "device_url", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "enabled": { 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "enabled", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.668 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "24", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "8", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.669 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "last_opt_revision": { 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "last_opt_revision", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "1", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.670 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard": { 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.671 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "leaderboard_description": { 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "leaderboard_description", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.672 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.673 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.674 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.676 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.677 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "organization": { 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "organization", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.678 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "proxy": { 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "proxy", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.679 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "url": { 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "url", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.680 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.681 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "test_orchestrator", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.682 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.683 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.684 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.685 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.686 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.687 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.688 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.689 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.690 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.691 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.692 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "max_concurrent_clones": { 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "max_concurrent_clones", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "4", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.693 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "periodic_async_work": { 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "periodic_async_work", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.694 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Periodically check for async work", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_delay": { 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "0", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.695 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "True", 2024-09-19T08:01:44.696 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix", 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "can_run": true, 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "error_string": "", 2024-09-19T08:01:44.697 INFO:teuthology.orchestra.run.smithi076.stdout: "module_options": { 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "discovery_interval": { 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "discovery_interval", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "uint", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "100", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.698 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "identifier": { 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "identifier", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "interval": { 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "interval", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "secs", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "60", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.700 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "log_level": { 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_level", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.701 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster": { 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.702 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.703 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.703 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_cluster_level": { 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_cluster_level", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.704 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "info", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [ 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "critical", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "debug", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "error", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "info", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "warning" 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.705 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "log_to_file": { 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "log_to_file", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "bool", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 1, 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "False", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.706 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_host": { 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_host", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.707 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_port": { 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_port", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "int", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "10051", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.708 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "zabbix_sender": { 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "zabbix_sender", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "str", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "level": "advanced", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "flags": 0, 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "min": "", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "max": "", 2024-09-19T08:01:44.709 INFO:teuthology.orchestra.run.smithi076.stdout: "enum_allowed": [], 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "desc": "", 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "long_desc": "", 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "tags": [], 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "see_also": [] 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "services": { 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "dashboard": "https://172.21.15.76:8443/" 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "always_on_modules": { 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "octopus": [ 2024-09-19T08:01:44.710 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "pacific": [ 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-09-19T08:01:44.711 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "quincy": [ 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-09-19T08:01:44.712 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "reef": [ 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-09-19T08:01:44.713 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: ], 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "squid": [ 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "balancer", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "crash", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "devicehealth", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "orchestrator", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "pg_autoscaler", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "progress", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "rbd_support", 2024-09-19T08:01:44.714 INFO:teuthology.orchestra.run.smithi076.stdout: "status", 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "telemetry", 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "volumes" 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "last_failure_osd_epoch": 85, 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "active_clients": [ 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "devicehealth", 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 145888506 2024-09-19T08:01:44.715 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "libcephsqlite", 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 377008946 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.716 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "rbd_support", 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3471734984 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:44.717 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 4143893224 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "snap_schedule", 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 550195765 2024-09-19T08:01:44.718 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: "name": "volumes", 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: "addrvec": [ 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v2", 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2089051 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.719 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:44.720 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-19T08:01:44.720 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:44.721 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:43 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2668146792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.721 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:43 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3159521479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.721 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:43 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/413428902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:43 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/3794844639' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:44 smithi137 ceph-mon[35309]: pgmap v328: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:43 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2668146792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:43 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3159521479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:43 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/413428902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:43 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/3794844639' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:01:44.722 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:44 smithi152 ceph-mon[35117]: pgmap v328: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe6600a33c0 msgr2=0x7fe6600a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe6600a33c0 0x7fe6600a5880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe668000c00 tx=0x7fe668005a20 comp rx=0 tx=0).stop 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 msgr2=0x7fe678198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 0x7fe678198a20 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00d950 tx=0x7fe66c00de10 comp rx=0 tx=0).stop 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 shutdown_connections 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fe6600a33c0 0x7fe6600a5880 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6781069a0 0x7fe67819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe678101330 0x7fe678198a20 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 --2- 172.21.15.76:0/3794844639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe678100990 0x7fe6781984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 >> 172.21.15.76:0/3794844639 conn(0x7fe6780fc6d0 msgr2=0x7fe6780fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:01:44.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 shutdown_connections 2024-09-19T08:01:44.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:01:43.272+0000 7fe67d2dd640 1 -- 172.21.15.76:0/3794844639 wait complete. 2024-09-19T08:01:44.784 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T08:01:44.784 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T08:01:44.784 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:43 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2668146792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.785 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:43 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3159521479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.785 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:43 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/413428902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:01:44.785 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:43 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/3794844639' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:01:44.785 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:44 smithi076 ceph-mon[30930]: pgmap v328: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:45.044 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:45.576 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 213, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 202, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 1584112, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 124064, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.038741294, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.013164137, 2024-09-19T08:01:45.577 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.037282169, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 201, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.010632279, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000052896 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:45.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 1584112, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 6, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 157, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 3344, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 184960, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.014129217, 2024-09-19T08:01:45.579 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.008466999, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.003716940, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 155, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.017773156, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000114665 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:45.580 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 184960 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 0, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 2, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 0, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-09-19T08:01:45.581 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.000354110, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000283496, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:45.582 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:45.583 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:45.584 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:45.585 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:45.586 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 30, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-09-19T08:01:45.587 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:45.588 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 215, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 1554071, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 215, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 215, 2024-09-19T08:01:45.589 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 1554071, 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:45.590 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:46.259 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T08:01:46.260 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T08:01:46.260 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T08:01:46.260 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T08:01:46.260 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T08:01:46.260 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T08:01:46.260 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T08:01:46.260 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T08:01:46.261 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T08:01:46.507 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:46.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:46 smithi152 ceph-mon[35117]: pgmap v329: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:01:46.627 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:46 smithi076 ceph-mon[30930]: pgmap v329: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:01:46.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:46 smithi137 ceph-mon[35309]: pgmap v329: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:01:47.045 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:47.045 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:47.045 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 218, 2024-09-19T08:01:47.045 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 207, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 1585472, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 127264, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.040495497, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.013750837, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.038344437, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 206, 2024-09-19T08:01:47.046 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.011359883, 2024-09-19T08:01:47.047 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000055145 2024-09-19T08:01:47.047 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.047 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:47.047 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:47.047 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:47.047 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:47.048 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.048 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 1585472, 2024-09-19T08:01:47.048 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-19T08:01:47.048 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.048 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 159, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 185216, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.012688637, 2024-09-19T08:01:47.049 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.008459143, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.002270953, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 156, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.012371126, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000079302 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:01:47.050 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 185216 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 4, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 4, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 3024, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 448, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.002213109, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000042419, 2024-09-19T08:01:47.051 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.002172005, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 3, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.003904383, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.001301461 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T08:01:47.052 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:47.053 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:47.054 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:47.055 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148995, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 31, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-09-19T08:01:47.056 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-09-19T08:01:47.057 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 220, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 1554721, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 220, 2024-09-19T08:01:47.058 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 220, 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 1554721, 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:47.059 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:47.700 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T08:01:47.700 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T08:01:47.700 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T08:01:47.700 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T08:01:47.700 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T08:01:47.701 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T08:01:47.701 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T08:01:47.701 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T08:01:47.701 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T08:01:47.953 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:48.413 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:48 smithi076 ceph-mon[30930]: pgmap v330: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 0, 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 2, 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 0, 2024-09-19T08:01:48.514 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.001150999, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000172205, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:48.515 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 219, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 206, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 1587680, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 125792, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-09-19T08:01:48.516 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.041687819, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.014465276, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.039874090, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 206, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.015294792, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000074246 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.517 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 1587680, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 125792 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 156, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 184688, 2024-09-19T08:01:48.518 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.011900853, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.008218341, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.001732496, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 153, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.011625778, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000075985 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:48.519 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 184688 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-09-19T08:01:48.520 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:48.521 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:48.522 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-09-19T08:01:48.523 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148955, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 30, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:48.524 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-09-19T08:01:48.525 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 217, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 1554331, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 217, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 217, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 1554331, 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-09-19T08:01:48.526 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:48.527 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:48.527 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:48.527 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:48.527 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:48.527 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:48.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:48 smithi152 ceph-mon[35117]: pgmap v330: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:48.655 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:48 smithi137 ceph-mon[35309]: pgmap v330: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:49.214 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T08:01:49.215 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T08:01:49.215 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T08:01:49.215 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T08:01:49.215 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T08:01:49.215 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T08:01:49.216 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T08:01:49.216 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T08:01:49.216 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T08:01:49.463 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:01:49.983 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-19T08:01:49.983 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:49.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 224, 2024-09-19T08:01:49.983 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 211, 2024-09-19T08:01:49.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 1589040, 2024-09-19T08:01:49.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 128992, 2024-09-19T08:01:49.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 4, 2024-09-19T08:01:49.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 0, 2024-09-19T08:01:49.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.043119417, 2024-09-19T08:01:49.984 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.015088889, 2024-09-19T08:01:49.985 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.040148296, 2024-09-19T08:01:49.985 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:49.985 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:49.985 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 211, 2024-09-19T08:01:49.985 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.015724458, 2024-09-19T08:01:49.986 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000074523 2024-09-19T08:01:49.986 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.986 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:49.986 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:49.986 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:49.986 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:49.987 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.987 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 1589040, 2024-09-19T08:01:49.987 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 128992 2024-09-19T08:01:49.987 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.987 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:49.987 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 2, 2024-09-19T08:01:49.988 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 161, 2024-09-19T08:01:49.988 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:01:49.988 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 185568, 2024-09-19T08:01:49.988 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:49.988 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:49.988 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.013385477, 2024-09-19T08:01:49.989 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.009497777, 2024-09-19T08:01:49.989 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.001685666, 2024-09-19T08:01:49.989 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:49.989 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:49.989 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 158, 2024-09-19T08:01:49.989 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.016328702, 2024-09-19T08:01:49.990 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000103346 2024-09-19T08:01:49.990 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.990 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:49.990 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:49.990 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:49.990 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 185568 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_messages": 0, 2024-09-19T08:01:49.991 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages": 2, 2024-09-19T08:01:49.992 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:01:49.992 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_bytes": 0, 2024-09-19T08:01:49.992 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_created_connections": 2, 2024-09-19T08:01:49.992 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_active_connections": 1, 2024-09-19T08:01:49.992 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_total_time": 0.000360882, 2024-09-19T08:01:49.992 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:01:49.993 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_recv_time": 0.000279769, 2024-09-19T08:01:49.993 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:49.993 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:49.993 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:49.993 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:49.993 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:49.994 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.994 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:49.994 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:49.994 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:49.994 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:49.995 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.995 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:49.995 INFO:teuthology.orchestra.run.smithi076.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:49.995 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.995 INFO:teuthology.orchestra.run.smithi076.stdout: "cct": { 2024-09-19T08:01:49.995 INFO:teuthology.orchestra.run.smithi076.stdout: "total_workers": 0, 2024-09-19T08:01:49.996 INFO:teuthology.orchestra.run.smithi076.stdout: "unhealthy_workers": 0 2024-09-19T08:01:49.996 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:49.996 INFO:teuthology.orchestra.run.smithi076.stdout: "mempool": { 2024-09-19T08:01:49.996 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:49.996 INFO:teuthology.orchestra.run.smithi076.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:49.996 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:49.997 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:49.997 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:49.997 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:49.997 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:49.997 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:49.997 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:49.998 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:49.998 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:49.998 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:49.998 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:49.998 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:49.998 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:49.999 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:49.999 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:49.999 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:49.999 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:49.999 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:49.999 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:50.000 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:50.000 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:50.000 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:50.000 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:50.000 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:50.000 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:50.001 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:50.001 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:50.001 INFO:teuthology.orchestra.run.smithi076.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:50.001 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:50.001 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_items": 0, 2024-09-19T08:01:50.001 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:50.002 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:50.002 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:50.002 INFO:teuthology.orchestra.run.smithi076.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:50.002 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_bytes": 148994, 2024-09-19T08:01:50.002 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_anon_items": 31, 2024-09-19T08:01:50.002 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:50.003 INFO:teuthology.orchestra.run.smithi076.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:50.003 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_bytes": 0, 2024-09-19T08:01:50.003 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_items": 0, 2024-09-19T08:01:50.003 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:50.003 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:50.003 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:50.004 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:50.004 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_bytes": 0, 2024-09-19T08:01:50.004 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_items": 0, 2024-09-19T08:01:50.004 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:50.004 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:50.004 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:50.005 INFO:teuthology.orchestra.run.smithi076.stdout: "pgmap_items": 0, 2024-09-19T08:01:50.005 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_bytes": 928, 2024-09-19T08:01:50.005 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_co_items": 2, 2024-09-19T08:01:50.005 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:50.005 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_1_items": 0, 2024-09-19T08:01:50.005 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:50.006 INFO:teuthology.orchestra.run.smithi076.stdout: "unittest_2_items": 0 2024-09-19T08:01:50.006 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-19T08:01:50.006 INFO:teuthology.orchestra.run.smithi076.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:50.006 INFO:teuthology.orchestra.run.smithi076.stdout: "val": 0, 2024-09-19T08:01:50.006 INFO:teuthology.orchestra.run.smithi076.stdout: "max": 104857600, 2024-09-19T08:01:50.006 INFO:teuthology.orchestra.run.smithi076.stdout: "get_started": 0, 2024-09-19T08:01:50.007 INFO:teuthology.orchestra.run.smithi076.stdout: "get": 222, 2024-09-19T08:01:50.007 INFO:teuthology.orchestra.run.smithi076.stdout: "get_sum": 1554981, 2024-09-19T08:01:50.007 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:50.007 INFO:teuthology.orchestra.run.smithi076.stdout: "get_or_fail_success": 222, 2024-09-19T08:01:50.007 INFO:teuthology.orchestra.run.smithi076.stdout: "take": 0, 2024-09-19T08:01:50.007 INFO:teuthology.orchestra.run.smithi076.stdout: "take_sum": 0, 2024-09-19T08:01:50.008 INFO:teuthology.orchestra.run.smithi076.stdout: "put": 222, 2024-09-19T08:01:50.008 INFO:teuthology.orchestra.run.smithi076.stdout: "put_sum": 1554981, 2024-09-19T08:01:50.008 INFO:teuthology.orchestra.run.smithi076.stdout: "wait": { 2024-09-19T08:01:50.008 INFO:teuthology.orchestra.run.smithi076.stdout: "avgcount": 0, 2024-09-19T08:01:50.008 INFO:teuthology.orchestra.run.smithi076.stdout: "sum": 0.000000000, 2024-09-19T08:01:50.008 INFO:teuthology.orchestra.run.smithi076.stdout: "avgtime": 0.000000000 2024-09-19T08:01:50.009 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:50.009 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-19T08:01:50.009 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-19T08:01:50.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:50 smithi152 ceph-mon[35117]: pgmap v331: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:01:50.620 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:50 smithi076 ceph-mon[30930]: pgmap v331: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T08:01:50.649 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T08:01:50.649 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T08:01:50.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T08:01:50.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:50 smithi137 ceph-mon[35309]: pgmap v331: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:01:50.910 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:01:51.372 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 15489, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 11976, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 9152334, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 14673100, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 10, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.765435426, 2024-09-19T08:01:51.373 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.318254609, 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.506338257, 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.054720542, 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 11975, 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.514853819, 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000042994 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.374 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 23961, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.003168328, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000132 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 11164, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 21228, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 5799019, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 15126180, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 55, 2024-09-19T08:01:51.375 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.816108460, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.391088841, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.727855345, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.045274097, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 21227, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.167156710, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000054984 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 23551, 2024-09-19T08:01:51.376 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.003553469, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000150 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 5407088, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 9891344 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 1421, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 1603, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 686682, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 7127763, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 17, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-09-19T08:01:51.377 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.149579484, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.063334468, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.035297248, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.039890130, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1600, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.121079087, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000075674 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 62, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000010849, 2024-09-19T08:01:51.378 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000174 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 4784, 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 451360 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-19T08:01:51.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.380 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-09-19T08:01:51.380 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-19T08:01:51.380 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-19T08:01:51.380 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 877, 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 6.640477318, 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.007571809 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4378, 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.026948967, 2024-09-19T08:01:51.381 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000234570 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 4543, 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 4533, 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4533, 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 9.901153968, 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002184238 2024-09-19T08:01:51.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 10, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 8, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 29, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 2, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-09-19T08:01:51.383 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 3600, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 0, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 1, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 3599, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 3599, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 1657, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 2, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 2, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 3, 2024-09-19T08:01:51.384 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 6980, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 5641, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 8, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 869, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 1000, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 1, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 8, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 504, 2024-09-19T08:01:51.385 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 8, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 2679, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 1058, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 6, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 1058, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 58, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:01:51.386 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 58, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 1000, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 846, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 4338, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 4834, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 3844, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 45, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 3281 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 108, 2024-09-19T08:01:51.387 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 2301, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 1577, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 1355, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 188, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 135, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 2954, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 2819, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:01:51.388 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 4, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 21, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 8, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 2, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-09-19T08:01:51.389 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 12886, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 12886, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 18, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 18, 2024-09-19T08:01:51.390 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 3, 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 37026625, 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-09-19T08:01:51.391 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 249, 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 5.023613449, 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.020175154 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-09-19T08:01:51.392 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1771, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 5435, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 3664, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 194, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 853, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 659, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 3600, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 8076, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 4476, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 2, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 2961, 2024-09-19T08:01:51.393 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 2959, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 89940, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 223520 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 5884, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 92, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 4543, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 29, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 473, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1060, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.796339846, 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001694660 2024-09-19T08:01:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4, 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000844846, 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000211211 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.395 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 356, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.130483502, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000366526 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.396 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1, 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000117603, 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000117603 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-09-19T08:01:51.397 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.398 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.399 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.399 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-09-19T08:01:51.399 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.400 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.401 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 158, 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.113966369, 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000721306 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.402 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-09-19T08:01:51.403 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.403 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.403 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.403 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-09-19T08:01:51.403 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.404 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.404 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.404 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-09-19T08:01:51.404 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.404 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 135, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2.179683518, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.016145803 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.406 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.407 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.408 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2819, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 5.679718284, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002014798 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 2, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 5, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 3, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 2, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 2735, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 1367, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 600, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.410 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:51.411 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:51.412 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 1453340, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 2202, 2024-09-19T08:01:51.413 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 8608, 2024-09-19T08:01:51.414 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 189, 2024-09-19T08:01:51.415 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:51.415 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:51.415 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:51.415 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-19T08:01:51.415 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 7132923, 2024-09-19T08:01:51.415 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 115544, 2024-09-19T08:01:51.416 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:51.416 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-19T08:01:51.416 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:51.416 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-19T08:01:51.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.416 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-09-19T08:01:51.417 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-09-19T08:01:51.417 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-09-19T08:01:51.417 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 4342, 2024-09-19T08:01:51.417 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 33829600, 2024-09-19T08:01:51.417 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 32, 2024-09-19T08:01:51.417 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 4342, 2024-09-19T08:01:51.418 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-09-19T08:01:51.418 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4342, 2024-09-19T08:01:51.418 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 18.338679801, 2024-09-19T08:01:51.418 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.004223555 2024-09-19T08:01:51.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.418 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4342, 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 4428 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 4342, 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 1111, 2024-09-19T08:01:51.419 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 3231, 2024-09-19T08:01:51.420 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-09-19T08:01:51.420 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-09-19T08:01:51.420 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 0, 2024-09-19T08:01:51.420 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 10, 2024-09-19T08:01:51.420 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 45, 2024-09-19T08:01:51.420 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 294, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 31, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 2, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 2838, 2024-09-19T08:01:51.421 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 1058, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 20, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-09-19T08:01:51.422 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:01:51.423 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-09-19T08:01:51.424 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-09-19T08:01:51.424 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-09-19T08:01:51.424 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-09-19T08:01:51.424 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-09-19T08:01:51.424 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-09-19T08:01:51.424 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-09-19T08:01:51.425 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-09-19T08:01:51.426 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-09-19T08:01:51.426 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-09-19T08:01:51.426 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-09-19T08:01:51.426 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 95, 2024-09-19T08:01:51.426 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-09-19T08:01:51.426 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 13, 2024-09-19T08:01:51.427 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 12, 2024-09-19T08:01:51.427 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 12, 2024-09-19T08:01:51.427 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-09-19T08:01:51.427 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-09-19T08:01:51.427 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 98, 2024-09-19T08:01:51.427 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 16, 2024-09-19T08:01:51.428 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 16 2024-09-19T08:01:51.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.428 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-09-19T08:01:51.428 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-09-19T08:01:51.428 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: "osd-slow-ops": { 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 25 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.429 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 10, 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 2819, 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 2819, 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-09-19T08:01:51.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 28070, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 12630252, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 28070, 2024-09-19T08:01:51.431 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 28070, 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 12630252, 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.432 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.433 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-09-19T08:01:51.433 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:51.433 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-19T08:01:51.433 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:51.433 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 4342, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 34124383, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 4342, 2024-09-19T08:01:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 34124383, 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-09-19T08:01:51.435 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 4342, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 4342, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 4342, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 4342, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.436 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 2819, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 294911, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 2819, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 45, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 294911, 2024-09-19T08:01:51.437 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x557b511ca960": { 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 12886, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 32832321, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 12886, 2024-09-19T08:01:51.438 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 249, 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 32832321, 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:51.439 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-19T08:01:52.388 INFO:tasks.check_counter:Daemon mds.b mds.exported=8 2024-09-19T08:01:52.388 INFO:tasks.check_counter:Daemon mds.b mds.imported=8 2024-09-19T08:01:52.388 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=108 2024-09-19T08:01:52.389 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=2301 2024-09-19T08:01:52.389 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T08:01:52.389 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:01:52.389 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:01:52.389 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T08:01:52.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T08:01:52.560 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:52 smithi152 ceph-mon[35117]: pgmap v332: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:52.616 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:52 smithi137 ceph-mon[35309]: pgmap v332: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:52.683 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:01:52.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:52 smithi076 ceph-mon[30930]: pgmap v332: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 0, 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 2, 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 0, 2024-09-19T08:01:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 0, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.001070715, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.000211679, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 6, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 161, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 3344, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 185664, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.013246035, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.007243438, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.003428752, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 159, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.023322035, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000146679 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 185664 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 219, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 208, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1585744, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 127904, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 2, 2024-09-19T08:01:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 1, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.041853418, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.014128012, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.043085835, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 207, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.014145982, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000068338 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1585744, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 0, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 29, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 928, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 2, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 221, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1554851, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 221, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 221, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1554851, 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:53.217 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-19T08:01:53.972 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-19T08:01:53.973 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-19T08:01:53.973 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-19T08:01:53.973 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-19T08:01:53.973 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-19T08:01:53.973 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-19T08:01:53.973 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-19T08:01:53.973 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T08:01:53.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T08:01:54.221 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:01:54.614 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:54 smithi137 ceph-mon[35309]: pgmap v333: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:54.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:54 smithi076 ceph-mon[30930]: pgmap v333: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:54.716 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 1470, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 1472, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 16499916, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 467467, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 7, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.138452846, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.050393751, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.038738385, 2024-09-19T08:01:54.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.037067698, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1470, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.056517088, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000038446 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 972, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 946, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 14423978, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 359536, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 4, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.105195007, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.029690610, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.064536461, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.021677057, 2024-09-19T08:01:54.719 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 946, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.038946798, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000041169 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1661888, 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 130832 2024-09-19T08:01:54.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 12, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 169, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 4198312, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 444508, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 7, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.014643880, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.007054473, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.005426664, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000204889, 2024-09-19T08:01:54.721 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 166, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.017600171, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000106025 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:01:54.722 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 441328 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3696, 2024-09-19T08:01:54.723 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.088383169, 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000023913 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-09-19T08:01:54.724 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-09-19T08:01:54.725 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 6546, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 0, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 6546, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 0, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 6546, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 0, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 0, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 0, 2024-09-19T08:01:54.726 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 1, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 0, 2024-09-19T08:01:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:01:54.728 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 0, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 0 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-09-19T08:01:54.729 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:01:54.730 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-09-19T08:01:54.731 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 12886, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 18, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 3, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-09-19T08:01:54.732 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 37026625, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 37024537, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 12886 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1896, 2024-09-19T08:01:54.733 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 4887, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 2991, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 186, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 221, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 35, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 6546, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 7075, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 529, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 0, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 0, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 0, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 65672, 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 215328 2024-09-19T08:01:54.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.735 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.736 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.737 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.738 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.740 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.741 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.743 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.744 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.745 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.746 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 2, 2024-09-19T08:01:54.747 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 5, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 3, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 4, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 3290, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:54.748 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:54.749 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 289227, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 2086, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:54.751 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 8608, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 189, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 9365123, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 116760, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-19T08:01:54.752 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 2199, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 21, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 3, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 2199, 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-09-19T08:01:54.753 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2199, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1.391975585, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000633003 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2199, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2200 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 2199, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 2199, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 0, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-09-19T08:01:54.754 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 1419, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 778, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-09-19T08:01:54.755 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 1, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-09-19T08:01:54.756 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-09-19T08:01:54.757 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 95, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 13, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 8, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 8, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 0, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 2, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 0 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 0, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:01:54.758 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "osd-slow-ops": { 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 0, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 0, 2024-09-19T08:01:54.759 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 0, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 2450, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 34885994, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 2450, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 2450, 2024-09-19T08:01:54.760 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 34885994, 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-19T08:01:54.761 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 2199, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 32839252, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 2199, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 32839252, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 2199, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 2199, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 2199, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 2199, 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:54.763 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:54.764 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x55a65f356b40": { 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-19T08:01:54.765 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:54.766 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-19T08:01:54.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:54 smithi152 ceph-mon[35117]: pgmap v333: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:01:55.553 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:01:55.553 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T08:01:55.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T08:01:55.800 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:01:56.325 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-19T08:01:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 226, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 213, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1589584, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 130272, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 0, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.043971039, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.014473562, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.042988271, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 213, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.016564930, 2024-09-19T08:01:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000077769 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1589584, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 130272 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 2, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 162, 2024-09-19T08:01:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 185744, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.010869366, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.007450216, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.001178990, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 159, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.016408420, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000103197 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 185744 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 0, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 2, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 0, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 2, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 1, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.000323393, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.000253167, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 0, 2024-09-19T08:01:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 29, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-19T08:01:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 928, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 2, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 224, 2024-09-19T08:01:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1555241, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 224, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 224, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1555241, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-19T08:01:56.338 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-19T08:01:56.637 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:56 smithi137 ceph-mon[35309]: pgmap v334: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:01:56.694 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:56 smithi076 ceph-mon[30930]: pgmap v334: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:01:56.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:56 smithi152 ceph-mon[35117]: pgmap v334: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:01:57.041 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T08:01:57.041 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T08:01:57.041 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-19T08:01:57.041 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-19T08:01:57.042 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T08:01:57.042 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T08:01:57.042 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T08:01:57.042 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T08:01:57.042 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T08:01:57.303 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:01:57.843 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-19T08:01:57.843 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:57.843 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 12510, 2024-09-19T08:01:57.843 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 9927, 2024-09-19T08:01:57.843 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 8057437, 2024-09-19T08:01:57.843 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 7886144, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 49, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.646448754, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.296184801, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.413235201, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.017327620, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 9927, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.296435280, 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000029861 2024-09-19T08:01:57.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 21129, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.002988707, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000141 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3740, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 7984, 2024-09-19T08:01:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1352563, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 8776750, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 18, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.318717363, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.157863500, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.172906289, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.020989103, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7980, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.346639674, 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000043438 2024-09-19T08:01:57.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 8152, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.001362619, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000167 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1147840, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 4284464 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 2158, 2024-09-19T08:01:57.847 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 2531, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2362068, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 3126355, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 12, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.161178913, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.063930545, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.105323713, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.013597796, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2530, 2024-09-19T08:01:57.848 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.096140419, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000038000 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2905, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000461802, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000158 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1669568, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 456656 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-19T08:01:57.849 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 563, 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.498196579, 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002661095 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.850 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1949, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.282811035, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000145105 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 2115, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 2107, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2107, 2024-09-19T08:01:57.851 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.887464110, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001370414 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 8, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 11, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 1223, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 0, 2024-09-19T08:01:57.852 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 1, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 1222, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 1222, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 2766, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 1, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 1, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 3, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 5299, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 3509, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 8, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 856, 2024-09-19T08:01:57.853 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 37, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 1807, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 37, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 2832, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2024-09-19T08:01:57.854 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 234, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 6, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 234, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 1508, 2024-09-19T08:01:57.855 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 780, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 551, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 18, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 2105 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 58, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 2256, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 1549, 2024-09-19T08:01:57.856 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 1313, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 87, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 56, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 1346, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 1290, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-19T08:01:57.857 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 4, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 26, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 37, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 4634, 2024-09-19T08:01:57.858 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 4634, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 8, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 8, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-19T08:01:57.859 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 14964861, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 258, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.821245453, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003183121 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 642, 2024-09-19T08:01:57.860 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 3305, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 2663, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 77, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 819, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 742, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 1223, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 5279, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 4056, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 1, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 1378, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 1377, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 73400, 2024-09-19T08:01:57.861 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 223520 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 3499, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 90, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 2115, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 13, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 979, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.862 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 669, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.184615083, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000275956 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.864 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000109334, 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000109334 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-19T08:01:57.865 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-19T08:01:57.866 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.867 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-19T08:01:57.868 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 91, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.072827577, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000800303 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.870 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 56, 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.831598159, 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.014849967 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.872 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.873 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.874 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-19T08:01:57.875 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1290, 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.798313957, 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001394041 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.876 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-19T08:01:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-09-19T08:01:57.878 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2024-09-19T08:01:57.878 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2024-09-19T08:01:57.878 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-09-19T08:01:57.878 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-19T08:01:57.878 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 1282, 2024-09-19T08:01:57.878 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 1282, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 619, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:57.879 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:57.880 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:57.882 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 745162, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 882, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:57.883 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8608, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 189, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 2543899, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 35957, 2024-09-19T08:01:57.884 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 1702, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 10941296, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 33, 2024-09-19T08:01:57.885 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 1702, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1702, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.393949538, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002581638 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1702, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1748 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 1702, 2024-09-19T08:01:57.886 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 37, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 1665, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 37, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 295, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 26, 2024-09-19T08:01:57.887 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 1304, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-19T08:01:57.888 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-19T08:01:57.889 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-19T08:01:57.890 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 95, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 13, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 44, 2024-09-19T08:01:57.891 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 12 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-19T08:01:57.892 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 30 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 10, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 1290, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 1290, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:57.893 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 18404, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 9961859, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 18404, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 18404, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 9961859, 2024-09-19T08:01:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:01:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1702, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 11072546, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1702, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 11072546, 2024-09-19T08:01:57.896 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:57.897 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1702, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 1702, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1702, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1702, 2024-09-19T08:01:57.898 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1290, 2024-09-19T08:01:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 131250, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1290, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 37, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 131250, 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:57.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55b6d8764960": { 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 4634, 2024-09-19T08:01:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 10770557, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 4634, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 258, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 10770557, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.902 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:57.903 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-19T08:01:58.458 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:01:58 smithi152 ceph-mon[35117]: pgmap v335: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:58.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:01:58 smithi137 ceph-mon[35309]: pgmap v335: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:58.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:01:58 smithi076 ceph-mon[30930]: pgmap v335: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds.exported=37 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds.imported=37 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=58 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2256 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:01:58.795 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:01:58.795 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T08:01:58.795 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T08:01:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:01:59.694 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-19T08:01:59.694 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1135, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1137, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 42294423, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 360940, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 8, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.138590710, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.037139176, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.052314344, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.037074814, 2024-09-19T08:01:59.695 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1135, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.055031751, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000048486 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.696 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1243, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1220, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 49170005, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 447346, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.141674248, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.042212580, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.084776152, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.023550996, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1219, 2024-09-19T08:01:59.697 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.062949834, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000051640 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1659568, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 131824 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:01:59.698 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 339, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 495, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 25252185, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 549321, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 8, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.052961432, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.017255511, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.022241320, 2024-09-19T08:01:59.699 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.009212871, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 493, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.030988857, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000062857 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:01:59.700 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 443744 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4025, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.109522563, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000027210 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.701 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 0, 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 0, 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-19T08:01:59.702 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 17460, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 0, 2024-09-19T08:01:59.703 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 17460, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 17460, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 2, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:01:59.704 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 234, 2024-09-19T08:01:59.705 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 6, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:01:59.706 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 0 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:01:59.707 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 0, 2024-09-19T08:01:59.708 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 44413, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-19T08:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 0, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 60, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 5, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 118557168, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 118557056, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 44413 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 4761, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 17000, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 12239, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 478, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 788, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 310, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 17460, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 23539, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 6079, 2024-09-19T08:01:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 85248, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 215328 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 0, 2024-09-19T08:01:59.712 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-19T08:01:59.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-19T08:01:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.716 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-19T08:01:59.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.716 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.717 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-19T08:01:59.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.718 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.721 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.722 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-19T08:01:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:01:59.727 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 2, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 5, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 3, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 4, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 0, 2024-09-19T08:01:59.728 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 3257, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:01:59.729 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:01:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 419442, 2024-09-19T08:01:59.731 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 5178, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8608, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 189, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-19T08:01:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 24313246, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 304312, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 2459, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 26, 2024-09-19T08:01:59.733 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 4, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 2459, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2459, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.693980450, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000688889 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2459, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2460 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 2459, 2024-09-19T08:01:59.734 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 2459, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 1568, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 888, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-09-19T08:01:59.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 2, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-19T08:01:59.736 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-19T08:01:59.737 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 95, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 13, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 10, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 10, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 0, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 2, 2024-09-19T08:01:59.738 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 0 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 0, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:01:59.739 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 2713, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 116456581, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:59.740 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 2713, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2713, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 116456581, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:01:59.741 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 2459, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 114366415, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2459, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 114366415, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.742 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 2459, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 2459, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2459, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2459, 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:59.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:01:59.744 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x560da1d14b40": { 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:01:59.745 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:01:59.746 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-19T08:02:00.498 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T08:02:00.499 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T08:02:00.499 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T08:02:00.499 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T08:02:00.499 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-19T08:02:00.499 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:02:00.499 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:02:00.499 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T08:02:00.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T08:02:00.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:00 smithi137 ceph-mon[35309]: pgmap v336: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:02:00.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:00 smithi076 ceph-mon[30930]: pgmap v336: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:02:00.758 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:02:00.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:00 smithi152 ceph-mon[35117]: pgmap v336: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T08:02:01.285 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-19T08:02:01.285 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:02:01.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 13526, 2024-09-19T08:02:01.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 16686, 2024-09-19T08:02:01.285 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 4432660, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 67140973, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 176, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 1.052968400, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.475433802, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.464304970, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.131376165, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 16687, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.208151752, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000072400 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.286 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 21016, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.003481175, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000165 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 42528, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 1136 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 51402, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 91591, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 19717411, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 83366270, 2024-09-19T08:02:01.287 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 15, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 3.354485944, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.587878309, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 4.843806410, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.215062898, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 91588, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.633015948, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000028748 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:02:01.288 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 114305, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.020380568, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000178 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 17142176, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 44831776 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 13213, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 15208, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 6170102, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 24172785, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 21, 2024-09-19T08:02:01.289 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 8, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 1.032854062, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.471769773, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.544991351, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.119249385, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 15205, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.620131401, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000040784 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 22183, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.003411233, 2024-09-19T08:02:01.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000153 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 2008432, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 261392 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2866, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 28.914053149, 2024-09-19T08:02:01.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.010088643 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 10970, 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.598043102, 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000145673 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 21922, 2024-09-19T08:02:01.292 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 21763, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 21763, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 59.873200099, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002751146 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 159, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 41, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 183, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 19, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 1, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 10192, 2024-09-19T08:02:01.293 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 203, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 8902, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 1087, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 9901, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 6222, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 2, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 2, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 4, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 25323, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 24661, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 2, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 115, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-19T08:02:01.294 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 45, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 5511, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 45, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 2311, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 261, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 234, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 6, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 261, 2024-09-19T08:02:01.295 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 168, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 22, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 146, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 93, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 68, 2024-09-19T08:02:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 7207, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 22487, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 20726, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 13191, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 2509, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 9310 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.297 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 1389, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 309, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 185, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 231, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 2624, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 370, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 7461, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 7091, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-19T08:02:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 4, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 3623, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 22, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 45, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 21, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.299 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 44420, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 44420, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 60, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 60, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 5, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-19T08:02:01.300 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 118560366, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5017, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 486.427750466, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.096955900 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 4633, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 17412, 2024-09-19T08:02:01.301 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 12779, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 491, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 943, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 452, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 10192, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 24086, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 13894, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 2, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 14282, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 14280, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 128464, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 231712 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-19T08:02:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 25542, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 1088, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 21922, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 71, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 2424, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 10088, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 35.697696726, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003538629 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 143, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.048337636, 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000338025 2024-09-19T08:02:01.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2572, 2024-09-19T08:02:01.304 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.832647464, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000323735 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-19T08:02:01.305 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.306 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.307 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.307 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-19T08:02:01.307 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 11, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.002569535, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000233594 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 623, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.439156447, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000704906 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.308 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 11, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.141858140, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.194714376 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000212035, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000212035 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-19T08:02:01.309 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 837, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.255416889, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001499900 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.002721120, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001360560 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.310 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 426, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 6.722030490, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.015779414 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.021362959, 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004272591 2024-09-19T08:02:01.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.835471955, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.417735977 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.312 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.313 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.018264704, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002609243 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7035, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11.855453999, 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001685210 2024-09-19T08:02:01.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 2, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 5, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 3, 2024-09-19T08:02:01.315 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 2, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 148, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 74, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 623, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:02:01.316 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:02:01.317 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-19T08:02:01.318 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 3350923, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 5422, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-19T08:02:01.319 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8608, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 189, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 19216520, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 305278, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-19T08:02:01.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 13524, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 119467278, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 37, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 13524, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13524, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 65.439250076, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004838749 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.321 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13524, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 13892 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 13524, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 414, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 13110, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 11, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 90, 2024-09-19T08:02:01.322 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 5085, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 56, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 19, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 7664, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 283, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 22, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-19T08:02:01.323 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-19T08:02:01.324 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 95, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-19T08:02:01.325 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 13, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 511, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 82, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 69 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.326 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 3628 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 20, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 10, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 7123, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 7091, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:02:01.327 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 78137, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 20958370, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 78137, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 78137, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 20958370, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 13524, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 120225173, 2024-09-19T08:02:01.329 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 13524, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 120225173, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:02:01.330 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 13524, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 13524, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 13524, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 13524, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:01.331 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 7091, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 758551, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 7091, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 68, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 758551, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.332 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55a182d78960": { 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 84, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 44420, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 114366062, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 44420, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 5017, 2024-09-19T08:02:01.333 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 114365978, 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:01.334 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds.exported=45 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds.imported=45 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1389 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=309 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-09-19T08:02:02.105 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-09-19T08:02:02.105 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T08:02:02.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T08:02:02.356 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:02:02.403 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:02 smithi137 ceph-mon[35309]: pgmap v337: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:02:02.629 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:02 smithi152 ceph-mon[35117]: pgmap v337: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:02:02.693 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:02 smithi076 ceph-mon[30930]: pgmap v337: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 256, 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 233, 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1661602, 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 135188, 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2024-09-19T08:02:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 1, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.045909836, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.015618127, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.044184237, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.000020552, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 232, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.013752039, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000059276 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:02:02.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1660768, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 134864 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 656, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 818, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 4355690, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 651801, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 7, 2024-09-19T08:02:02.907 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.077393059, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.028853730, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.018438934, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.022239712, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 815, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.043312500, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000053144 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 443824 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1523, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1524, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 7032529, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 483866, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.153354213, 2024-09-19T08:02:02.909 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.046013200, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.046031208, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.047675546, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1523, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.067681118, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000044439 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:02:02.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3666, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.100880101, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000027517 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.911 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 0, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 0, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.912 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 2508, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 2508, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 0, 2024-09-19T08:02:02.913 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 2508, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 1, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-19T08:02:02.914 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:02:02.915 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 0, 2024-09-19T08:02:02.916 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 0 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 0, 2024-09-19T08:02:02.917 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-19T08:02:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 4634, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-19T08:02:02.919 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 8, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 14964861, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 14962773, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 4634 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.920 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 635, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 2784, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 2149, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 70, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 149, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 79, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 2508, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 4406, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 1898, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 0, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 0, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 57820, 2024-09-19T08:02:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 215328 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 0, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 0, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 0, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 0, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 0, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-19T08:02:02.922 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-19T08:02:02.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.925 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.926 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-19T08:02:02.927 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.931 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2024-09-19T08:02:02.934 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 2, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 3262, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:02:02.935 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:02:02.936 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:02:02.937 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 223498, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 739, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:02:02.938 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8608, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 189, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 3381603, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 36428, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-19T08:02:02.939 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 2175, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 21, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 3, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 2175, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2175, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.763979607, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000811025 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-19T08:02:02.940 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2175, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2176 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 2175, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 2175, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 1399, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 774, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-19T08:02:02.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-19T08:02:02.942 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-19T08:02:02.943 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 95, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 13, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 6, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 6, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 0, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 2, 2024-09-19T08:02:02.944 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 0 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 0, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:02:02.945 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 2432, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 12815127, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 2432, 2024-09-19T08:02:02.946 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2432, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 12815127, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-19T08:02:02.947 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 2175, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 10771081, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2175, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 10771081, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.948 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 2175, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 2175, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2175, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2175, 2024-09-19T08:02:02.949 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:02.950 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x556136cd0b40": { 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-19T08:02:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-19T08:02:02.952 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.953 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-19T08:02:02.953 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:02:03.736 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:02:03.736 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T08:02:03.747 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T08:02:03.747 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T08:02:03.748 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:02:03.769 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-19T08:02:03.769 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:02:03.829 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:02:04.124 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:04.565 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:04 smithi076 ceph-mon[30930]: pgmap v338: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:02:04.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:04 smithi137 ceph-mon[35309]: pgmap v338: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:02:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 -- 172.21.15.76:0/910905048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134100a80 msgr2=0x7f8134100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 --2- 172.21.15.76:0/910905048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134100a80 0x7f8134100ee0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f8128009930 tx=0x7f812802a420 comp rx=0 tx=0).stop 2024-09-19T08:02:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 -- 172.21.15.76:0/910905048 shutdown_connections 2024-09-19T08:02:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 --2- 172.21.15.76:0/910905048 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 0x7f813410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 --2- 172.21.15.76:0/910905048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134100a80 0x7f8134100ee0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 --2- 172.21.15.76:0/910905048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8134106a80 0x7f8134106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 -- 172.21.15.76:0/910905048 >> 172.21.15.76:0/910905048 conn(0x7f81340fc7a0 msgr2=0x7f81340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 -- 172.21.15.76:0/910905048 shutdown_connections 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 -- 172.21.15.76:0/910905048 wait complete. 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 Processor -- start 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.646+0000 7f8138d2c640 1 -- start start 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8134100a80 0x7f81341993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 0x7f8134199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 0x7f81341a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8134110fa0 con 0x7f8134106a80 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8134110e20 con 0x7f8134101420 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8134111120 con 0x7f8134100a80 2024-09-19T08:02:04.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 0x7f81341a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 0x7f81341a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50300/0 (socket says 172.21.15.76:50300) 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 -- 172.21.15.76:0/1513219415 learned_addr learned my addr 172.21.15.76:0/1513219415 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f813259c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8134100a80 0x7f81341993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8131d9b640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 0x7f8134199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 -- 172.21.15.76:0/1513219415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8134100a80 msgr2=0x7f81341993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8134100a80 0x7f81341993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 -- 172.21.15.76:0/1513219415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 msgr2=0x7f8134199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 0x7f8134199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 -- 172.21.15.76:0/1513219415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81341a49b0 con 0x7f8134106a80 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8131d9b640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 0x7f8134199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8132d9d640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 0x7f81341a4470 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c970 tx=0x7f812c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c007bb0 con 0x7f8134106a80 2024-09-19T08:02:04.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81341a4b80 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f812c007d50 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.647+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c00f450 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.648+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341a5090 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.648+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8134100ee0 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.650+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f812c005020 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.650+0000 7f81237fe640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f811c0a33b0 0x7f811c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.650+0000 7f813259c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f811c0a33b0 0x7f811c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.650+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f812c0cfb00 con 0x7f8134106a80 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.651+0000 7f813259c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f811c0a33b0 0x7f811c0a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8124005fd0 tx=0x7f8124009680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:04.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.654+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f812c014030 con 0x7f8134106a80 2024-09-19T08:02:04.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:04 smithi152 ceph-mon[35117]: pgmap v338: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:02:04.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.831+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f813402d7c0 con 0x7f8134106a80 2024-09-19T08:02:04.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.832+0000 7f81237fe640 1 -- 172.21.15.76:0/1513219415 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v95) ==== 81+0+945 (secure 0 0 0) 0x7f812c09c450 con 0x7f8134106a80 2024-09-19T08:02:04.832 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/1377496784 2024-09-20T07:51:12.773685+0000 2024-09-19T08:02:04.832 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/1377496784 2024-09-20T07:51:12.773685+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/2265753650 2024-09-20T07:42:09.273307+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/2265753650 2024-09-20T07:42:09.273307+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2035316692 2024-09-20T07:42:32.492367+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1524312740 2024-09-20T07:51:12.773685+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3080154999 2024-09-20T07:42:09.273307+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1478676464 2024-09-20T07:42:09.273307+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6801/1863850030 2024-09-20T07:42:32.492367+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3431326120 2024-09-20T07:42:32.492367+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/3175575583 2024-09-20T07:51:12.773685+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:6800/1863850030 2024-09-20T07:42:32.492367+0000 2024-09-19T08:02:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/921925698 2024-09-20T07:42:09.273307+0000 2024-09-19T08:02:04.834 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2956537166 2024-09-20T07:42:32.492367+0000 2024-09-19T08:02:04.834 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/1359391390 2024-09-20T07:51:12.773685+0000 2024-09-19T08:02:04.834 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76:0/2768770565 2024-09-20T07:51:12.773685+0000 2024-09-19T08:02:04.834 INFO:teuthology.orchestra.run.smithi076.stderr:listed 16 entries 2024-09-19T08:02:04.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f811c0a33b0 msgr2=0x7f811c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:04.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f811c0a33b0 0x7f811c0a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8124005fd0 tx=0x7f8124009680 comp rx=0 tx=0).stop 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 msgr2=0x7f81341a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 0x7f81341a4470 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c970 tx=0x7f812c00ce30 comp rx=0 tx=0).stop 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 shutdown_connections 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f811c0a33b0 0x7f811c0a5870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8134106a80 0x7f81341a4470 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8134101420 0x7f8134199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 --2- 172.21.15.76:0/1513219415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8134100a80 0x7f81341993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 >> 172.21.15.76:0/1513219415 conn(0x7f81340fc7a0 msgr2=0x7f81340fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 shutdown_connections 2024-09-19T08:02:04.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:04.834+0000 7f8138d2c640 1 -- 172.21.15.76:0/1513219415 wait complete. 2024-09-19T08:02:05.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:05 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1513219415' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:02:05.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T08:02:05.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:02:05.474 DEBUG:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T08:02:05.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T08:02:05.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:02:05.563 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:02:05.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:02:05.602 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-09-19T08:02:05.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:05 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1513219415' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:02:05.658 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:02:05.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:02:05.658 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:02:05.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:02:05.725 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link delete ceph-brx 2024-09-19T08:02:05.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:05 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1513219415' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:02:05.825 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T08:02:05.836 INFO:tasks.cephadm:Teardown begin 2024-09-19T08:02:05.836 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:02:05.836 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:02:06.086 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:06.527 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:06 smithi076 ceph-mon[30930]: pgmap v339: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:02:06.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1748563548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70106a80 msgr2=0x7f8f70106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1748563548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70106a80 0x7f8f70106e60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009930 tx=0x7f8f6002a420 comp rx=0 tx=0).stop 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1748563548 shutdown_connections 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1748563548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f70101420 0x7f8f7010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1748563548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f70100a80 0x7f8f70100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1748563548 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70106a80 0x7f8f70106e60 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1748563548 >> 172.21.15.76:0/1748563548 conn(0x7f8f700fc7a0 msgr2=0x7f8f700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1748563548 shutdown_connections 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.608+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1748563548 wait complete. 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 Processor -- start 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 -- start start 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 0x7f8f701a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f70101420 0x7f8f701a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f70106a80 0x7f8f7019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70110fe0 con 0x7f8f70100a80 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70110e60 con 0x7f8f70101420 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f75a8b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70111160 con 0x7f8f70106a80 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 0x7f8f701a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 0x7f8f701a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50310/0 (socket says 172.21.15.76:50310) 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 -- 172.21.15.76:0/1044870924 learned_addr learned my addr 172.21.15.76:0/1044870924 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6effd640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f70101420 0x7f8f701a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6ffff640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f70106a80 0x7f8f7019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 -- 172.21.15.76:0/1044870924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f70106a80 msgr2=0x7f8f7019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f70106a80 0x7f8f7019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 -- 172.21.15.76:0/1044870924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f70101420 msgr2=0x7f8f701a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f70101420 0x7f8f701a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.609+0000 7f8f6f7fe640 1 -- 172.21.15.76:0/1044870924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7019ad10 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.610+0000 7f8f6f7fe640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 0x7f8f701a0420 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009a50 tx=0x7f8f60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.610+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6003f030 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.610+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7019afa0 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.610+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f60003af0 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.610+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60035070 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.610+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f701a72f0 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.611+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f70100ee0 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.612+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8f60042030 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.613+0000 7f8f6cff9640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f580a33b0 0x7f8f580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.613+0000 7f8f6effd640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f580a33b0 0x7f8f580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.613+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7f8f600f0ad0 con 0x7f8f70100a80 2024-09-19T08:02:06.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.613+0000 7f8f6effd640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f580a33b0 0x7f8f580a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f7010bf60 tx=0x7f8f64009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:06.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.616+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f600bd3c0 con 0x7f8f70100a80 2024-09-19T08:02:06.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:06 smithi137 ceph-mon[35309]: pgmap v339: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:02:06.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:06 smithi152 ceph-mon[35117]: pgmap v339: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:02:06.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.816+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f701a74c0 con 0x7f8f70100a80 2024-09-19T08:02:06.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.816+0000 7f8f6cff9640 1 -- 172.21.15.76:0/1044870924 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7f8f600bccc0 con 0x7f8f70100a80 2024-09-19T08:02:06.817 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:02:06.817 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T08:02:06.817 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f580a33b0 msgr2=0x7f8f580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f580a33b0 0x7f8f580a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f7010bf60 tx=0x7f8f64009110 comp rx=0 tx=0).stop 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 msgr2=0x7f8f701a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 0x7f8f701a0420 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009a50 tx=0x7f8f60004270 comp rx=0 tx=0).stop 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 shutdown_connections 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8f580a33b0 0x7f8f580a5870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f70106a80 0x7f8f7019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f70101420 0x7f8f701a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 --2- 172.21.15.76:0/1044870924 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f70100a80 0x7f8f701a0420 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:06.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 >> 172.21.15.76:0/1044870924 conn(0x7f8f700fc7a0 msgr2=0x7f8f7006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:06.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 shutdown_connections 2024-09-19T08:02:06.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:06.820+0000 7f8f75a8b640 1 -- 172.21.15.76:0/1044870924 wait complete. 2024-09-19T08:02:07.524 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:07 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1044870924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:02:07.553 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:02:07.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:07 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1044870924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:02:07.801 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:07.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:07 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1044870924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:02:08.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 -- 172.21.15.76:0/1650078986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0101de0 msgr2=0x7fa6e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1650078986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0101de0 0x7fa6e01021c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009900 tx=0x7fa6d002a410 comp rx=0 tx=0).stop 2024-09-19T08:02:08.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 -- 172.21.15.76:0/1650078986 shutdown_connections 2024-09-19T08:02:08.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1650078986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0106f10 0x7fa6e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1650078986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0102790 0x7fa6e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1650078986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0101de0 0x7fa6e01021c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 -- 172.21.15.76:0/1650078986 >> 172.21.15.76:0/1650078986 conn(0x7fa6e00fd8c0 msgr2=0x7fa6e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 -- 172.21.15.76:0/1650078986 shutdown_connections 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.374+0000 7fa6e7691640 1 -- 172.21.15.76:0/1650078986 wait complete. 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 Processor -- start 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 -- start start 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0101de0 0x7fa6e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 0x7fa6e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0106f10 0x7fa6e0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0112150 con 0x7fa6e0102790 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0111fd0 con 0x7fa6e0101de0 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e7691640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e01122d0 con 0x7fa6e0106f10 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 0x7fa6e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 0x7fa6e0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50330/0 (socket says 172.21.15.76:50330) 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 -- 172.21.15.76:0/1137530446 learned_addr learned my addr 172.21.15.76:0/1137530446 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e542d640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0101de0 0x7fa6e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e5c2e640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0106f10 0x7fa6e0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 -- 172.21.15.76:0/1137530446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0106f10 msgr2=0x7fa6e0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0106f10 0x7fa6e0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 -- 172.21.15.76:0/1137530446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0101de0 msgr2=0x7fa6e00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0101de0 0x7fa6e00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e4c2c640 1 -- 172.21.15.76:0/1137530446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e01a6b30 con 0x7fa6e0102790 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e542d640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0101de0 0x7fa6e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.375+0000 7fa6e5c2e640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0106f10 0x7fa6e0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.376+0000 7fa6e4c2c640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 0x7fa6e0074a30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00b4a0 tx=0x7fa6dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.376+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc014070 con 0x7fa6e0102790 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.376+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e01a6e20 con 0x7fa6e0102790 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.376+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa6dc010b10 con 0x7fa6e0102790 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.376+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc017d60 con 0x7fa6e0102790 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.376+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01a7280 con 0x7fa6e0102790 2024-09-19T08:02:08.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.377+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e0102240 con 0x7fa6e0102790 2024-09-19T08:02:08.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.378+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa6dc017070 con 0x7fa6e0102790 2024-09-19T08:02:08.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.378+0000 7fa6d67fc640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6cc0a33b0 0x7fa6cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:08.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.379+0000 7fa6e542d640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6cc0a33b0 0x7fa6cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:08.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.379+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8658+0+0 (secure 0 0 0) 0x7fa6dc0cf0f0 con 0x7fa6e0102790 2024-09-19T08:02:08.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.379+0000 7fa6e542d640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6cc0a33b0 0x7fa6cc0a5870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000c00 tx=0x7fa6d0032d60 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:08.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.383+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6dc09bb50 con 0x7fa6e0102790 2024-09-19T08:02:08.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.584+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6e0075a20 con 0x7fa6e0102790 2024-09-19T08:02:08.586 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:08 smithi076 ceph-mon[30930]: pgmap v340: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:02:08.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.585+0000 7fa6d67fc640 1 -- 172.21.15.76:0/1137530446 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11915 (secure 0 0 0) 0x7fa6dc09b450 con 0x7fa6e0102790 2024-09-19T08:02:08.586 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:02:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":35,"btime":"2024-09-19T07:57:54:091113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/1242982400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":1242982400},{"type":"v1","addr":"172.21.15.76:6835","nonce":1242982400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/3127929213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":3127929213},{"type":"v1","addr":"172.21.15.76:6837","nonce":3127929213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/654330768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":654330768},{"type":"v1","addr":"172.21.15.76:6839","nonce":654330768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6841/57923082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6840","nonce":57923082},{"type":"v1","addr":"172.21.15.76:6841","nonce":57923082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/4027949156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":4027949156},{"type":"v1","addr":"172.21.15.137:6833","nonce":4027949156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24395,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/1108325659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1108325659},{"type":"v1","addr":"172.21.15.137:6835","nonce":1108325659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:49:28.218932+0000","modified":"2024-09-19T07:57:53.983944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24478,"mds_1":24458,"mds_2":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/4080590897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4080590897},{"type":"v1","addr":"172.21.15.152:6833","nonce":4080590897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6837/1714762912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1714762912},{"type":"v1","addr":"172.21.15.137:6837","nonce":1714762912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/266318645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":266318645},{"type":"v1","addr":"172.21.15.152:6835","nonce":266318645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6837/3136720511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3136720511},{"type":"v1","addr":"172.21.15.152:6837","nonce":3136720511}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6839/1413757795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":1413757795},{"type":"v1","addr":"172.21.15.137:6839","nonce":1413757795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6839/1843787894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":1843787894},{"type":"v1","addr":"172.21.15.152:6839","nonce":1843787894}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24478,"qdb_cluster":[24478,24458,24457]},"id":1}]} 2024-09-19T08:02:08.587 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 35 2024-09-19T08:02:08.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6cc0a33b0 msgr2=0x7fa6cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6cc0a33b0 0x7fa6cc0a5870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000c00 tx=0x7fa6d0032d60 comp rx=0 tx=0).stop 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 msgr2=0x7fa6e0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 0x7fa6e0074a30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00b4a0 tx=0x7fa6dc00b960 comp rx=0 tx=0).stop 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 shutdown_connections 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7fa6cc0a33b0 0x7fa6cc0a5870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6e0106f10 0x7fa6e0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa6e0102790 0x7fa6e0074a30 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 --2- 172.21.15.76:0/1137530446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6e0101de0 0x7fa6e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 >> 172.21.15.76:0/1137530446 conn(0x7fa6e00fd8c0 msgr2=0x7fa6e00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 shutdown_connections 2024-09-19T08:02:08.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:08.587+0000 7fa6e7691640 1 -- 172.21.15.76:0/1137530446 wait complete. 2024-09-19T08:02:08.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:08 smithi137 ceph-mon[35309]: pgmap v340: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:02:08.810 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:08 smithi152 ceph-mon[35117]: pgmap v340: 97 pgs: 97 active+clean; 153 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:02:09.241 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:02:09.504 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:09.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:09 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1137530446' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:02:09.625 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:09 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1137530446' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:02:09.653 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:09 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1137530446' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:02:10.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 -- 172.21.15.76:0/2777195801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc101de0 msgr2=0x7f96dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:10.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 --2- 172.21.15.76:0/2777195801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc101de0 0x7f96dc1021c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009900 tx=0x7f96d002a410 comp rx=0 tx=0).stop 2024-09-19T08:02:10.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 -- 172.21.15.76:0/2777195801 shutdown_connections 2024-09-19T08:02:10.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 --2- 172.21.15.76:0/2777195801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 0x7f96dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 --2- 172.21.15.76:0/2777195801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc102790 0x7f96dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 --2- 172.21.15.76:0/2777195801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc101de0 0x7f96dc1021c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 -- 172.21.15.76:0/2777195801 >> 172.21.15.76:0/2777195801 conn(0x7f96dc0fd8c0 msgr2=0x7f96dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 -- 172.21.15.76:0/2777195801 shutdown_connections 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.017+0000 7f96e327a640 1 -- 172.21.15.76:0/2777195801 wait complete. 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 Processor -- start 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 -- start start 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc101de0 0x7f96dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 0x7f96dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 0x7f96dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc1120d0 con 0x7f96dc102790 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc111f50 con 0x7f96dc101de0 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e327a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc112250 con 0x7f96dc106f10 2024-09-19T08:02:10.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 0x7f96dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 0x7f96dc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50344/0 (socket says 172.21.15.76:50344) 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 -- 172.21.15.76:0/933777161 learned_addr learned my addr 172.21.15.76:0/933777161 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e1016640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc101de0 0x7f96dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e1817640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 0x7f96dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 -- 172.21.15.76:0/933777161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 msgr2=0x7f96dc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 0x7f96dc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 -- 172.21.15.76:0/933777161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc101de0 msgr2=0x7f96dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc101de0 0x7f96dc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 -- 172.21.15.76:0/933777161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc1a69d0 con 0x7f96dc102790 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e1817640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 0x7f96dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e1016640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc101de0 0x7f96dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:02:10.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.018+0000 7f96e0815640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 0x7f96dc074a30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f96d800d950 tx=0x7f96d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.019+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8017030 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.019+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc1a6cc0 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.019+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f96d8004020 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.019+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8004a00 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.019+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc1a71a0 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.020+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc1021c0 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.021+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f96d80041d0 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.022+0000 7f96ce7fc640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96c80a33b0 0x7f96c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.022+0000 7f96e1016640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96c80a33b0 0x7f96c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.022+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8702+0+0 (secure 0 0 0) 0x7f96d80cf890 con 0x7f96dc102790 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.022+0000 7f96e1016640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96c80a33b0 0x7f96c80a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f96d0005ab0 tx=0x7f96d0005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:10.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.026+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96d809c1c0 con 0x7f96dc102790 2024-09-19T08:02:10.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.194+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96dc109b60 con 0x7f96dc102790 2024-09-19T08:02:10.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.196+0000 7f96ce7fc640 1 -- 172.21.15.76:0/933777161 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+23507 (secure 0 0 0) 0x7f96d809bac0 con 0x7f96dc102790 2024-09-19T08:02:10.197 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-19T08:02:10.197 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":96,"fsid":"6aad871c-765a-11ef-bceb-c7b262605968","created":"2024-09-19T07:41:37.923757+0000","modified":"2024-09-19T08:02:09.342576+0000","last_up_change":"2024-09-19T07:48:36.091904+0000","last_in_change":"2024-09-19T07:48:11.856572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:44:46.792310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:49:23.884114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:49:26.359069+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbcd7216-2e99-403b-b350-f556959ce4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6803","nonce":3678505020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6805","nonce":3678505020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6809","nonce":3678505020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":3678505020},{"type":"v1","addr":"172.21.15.76:6807","nonce":3678505020}]},"public_addr":"172.21.15.76:6803/3678505020","cluster_addr":"172.21.15.76:6805/3678505020","heartbeat_back_addr":"172.21.15.76:6809/3678505020","heartbeat_front_addr":"172.21.15.76:6807/3678505020","state":["exists","up"]},{"osd":1,"uuid":"b6e0be59-8380-49cd-a4af-bd63b01ea789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6801","nonce":943192386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6803","nonce":943192386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6807","nonce":943192386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":943192386},{"type":"v1","addr":"172.21.15.137:6805","nonce":943192386}]},"public_addr":"172.21.15.137:6801/943192386","cluster_addr":"172.21.15.137:6803/943192386","heartbeat_back_addr":"172.21.15.137:6807/943192386","heartbeat_front_addr":"172.21.15.137:6805/943192386","state":["exists","up"]},{"osd":2,"uuid":"d9a747d3-c188-4867-979e-0bda4e6c30c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6801","nonce":3696302179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6803","nonce":3696302179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6807","nonce":3696302179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3696302179},{"type":"v1","addr":"172.21.15.152:6805","nonce":3696302179}]},"public_addr":"172.21.15.152:6801/3696302179","cluster_addr":"172.21.15.152:6803/3696302179","heartbeat_back_addr":"172.21.15.152:6807/3696302179","heartbeat_front_addr":"172.21.15.152:6805/3696302179","state":["exists","up"]},{"osd":3,"uuid":"a6ebdf0e-f8b8-473b-919a-2f129822ad89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6811","nonce":1561520625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6813","nonce":1561520625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6817","nonce":1561520625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":1561520625},{"type":"v1","addr":"172.21.15.76:6815","nonce":1561520625}]},"public_addr":"172.21.15.76:6811/1561520625","cluster_addr":"172.21.15.76:6813/1561520625","heartbeat_back_addr":"172.21.15.76:6817/1561520625","heartbeat_front_addr":"172.21.15.76:6815/1561520625","state":["exists","up"]},{"osd":4,"uuid":"d3915b62-fdff-42fc-a586-f5ec5d2aba91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6809","nonce":2368598531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6811","nonce":2368598531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6815","nonce":2368598531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2368598531},{"type":"v1","addr":"172.21.15.137:6813","nonce":2368598531}]},"public_addr":"172.21.15.137:6809/2368598531","cluster_addr":"172.21.15.137:6811/2368598531","heartbeat_back_addr":"172.21.15.137:6815/2368598531","heartbeat_front_addr":"172.21.15.137:6813/2368598531","state":["exists","up"]},{"osd":5,"uuid":"dd332d73-a236-4f57-81a1-c971286b9034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6809","nonce":1589616787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6811","nonce":1589616787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6815","nonce":1589616787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1589616787},{"type":"v1","addr":"172.21.15.152:6813","nonce":1589616787}]},"public_addr":"172.21.15.152:6809/1589616787","cluster_addr":"172.21.15.152:6811/1589616787","heartbeat_back_addr":"172.21.15.152:6815/1589616787","heartbeat_front_addr":"172.21.15.152:6813/1589616787","state":["exists","up"]},{"osd":6,"uuid":"a799bfc9-78c1-4d99-b9f5-4a80371e957e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6819","nonce":3902035917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6821","nonce":3902035917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6825","nonce":3902035917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":3902035917},{"type":"v1","addr":"172.21.15.76:6823","nonce":3902035917}]},"public_addr":"172.21.15.76:6819/3902035917","cluster_addr":"172.21.15.76:6821/3902035917","heartbeat_back_addr":"172.21.15.76:6825/3902035917","heartbeat_front_addr":"172.21.15.76:6823/3902035917","state":["exists","up"]},{"osd":7,"uuid":"2f89e262-1002-4e2c-b312-aead48b74d7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6817","nonce":3569961551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6819","nonce":3569961551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6823","nonce":3569961551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":3569961551},{"type":"v1","addr":"172.21.15.137:6821","nonce":3569961551}]},"public_addr":"172.21.15.137:6817/3569961551","cluster_addr":"172.21.15.137:6819/3569961551","heartbeat_back_addr":"172.21.15.137:6823/3569961551","heartbeat_front_addr":"172.21.15.137:6821/3569961551","state":["exists","up"]},{"osd":8,"uuid":"799b54bb-4284-41b5-8cc1-d139b9dae6d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6817","nonce":2407728016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6819","nonce":2407728016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6823","nonce":2407728016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2407728016},{"type":"v1","addr":"172.21.15.152:6821","nonce":2407728016}]},"public_addr":"172.21.15.152:6817/2407728016","cluster_addr":"172.21.15.152:6819/2407728016","heartbeat_back_addr":"172.21.15.152:6823/2407728016","heartbeat_front_addr":"172.21.15.152:6821/2407728016","state":["exists","up"]},{"osd":9,"uuid":"156eab9f-4c2f-4ff4-b26b-f9100ca01236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6827","nonce":356414316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6829","nonce":356414316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6833","nonce":356414316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":356414316},{"type":"v1","addr":"172.21.15.76:6831","nonce":356414316}]},"public_addr":"172.21.15.76:6827/356414316","cluster_addr":"172.21.15.76:6829/356414316","heartbeat_back_addr":"172.21.15.76:6833/356414316","heartbeat_front_addr":"172.21.15.76:6831/356414316","state":["exists","up"]},{"osd":10,"uuid":"167970e0-dbe5-4fed-91bd-df956725da30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6825","nonce":3618747545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6827","nonce":3618747545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6831","nonce":3618747545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3618747545},{"type":"v1","addr":"172.21.15.137:6829","nonce":3618747545}]},"public_addr":"172.21.15.137:6825/3618747545","cluster_addr":"172.21.15.137:6827/3618747545","heartbeat_back_addr":"172.21.15.137:6831/3618747545","heartbeat_front_addr":"172.21.15.137:6829/3618747545","state":["exists","up"]},{"osd":11,"uuid":"09775c03-0d7f-4443-99af-1ccf1bb95342","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6825","nonce":4215098574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6827","nonce":4215098574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6831","nonce":4215098574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":4215098574},{"type":"v1","addr":"172.21.15.152:6829","nonce":4215098574}]},"public_addr":"172.21.15.152:6825/4215098574","cluster_addr":"172.21.15.152:6827/4215098574","heartbeat_back_addr":"172.21.15.152:6831/4215098574","heartbeat_front_addr":"172.21.15.152:6829/4215098574","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:43:53.345852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:17.276935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:44:43.470840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:09.216774+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:45:35.078942+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:00.659409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:26.139248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:46:51.463662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:17.024162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:47:42.079772+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:07.812192+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:48:34.102698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.76:6801/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1377496784":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/2265753650":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2035316692":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1524312740":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/3080154999":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/1478676464":"2024-09-20T07:42:09.273307+0000","172.21.15.76:6801/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3431326120":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/3175575583":"2024-09-20T07:51:12.773685+0000","172.21.15.76:6800/1863850030":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/921925698":"2024-09-20T07:42:09.273307+0000","172.21.15.76:0/2956537166":"2024-09-20T07:42:32.492367+0000","172.21.15.76:0/1359391390":"2024-09-20T07:51:12.773685+0000","172.21.15.76:0/2768770565":"2024-09-20T07:51:12.773685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:02:10.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96c80a33b0 msgr2=0x7f96c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:10.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96c80a33b0 0x7f96c80a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f96d0005ab0 tx=0x7f96d0005a20 comp rx=0 tx=0).stop 2024-09-19T08:02:10.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 msgr2=0x7f96dc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:10.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 0x7f96dc074a30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f96d800d950 tx=0x7f96d800de10 comp rx=0 tx=0).stop 2024-09-19T08:02:10.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 shutdown_connections 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f96c80a33b0 0x7f96c80a5870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc106f10 0x7f96dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f96dc102790 0x7f96dc074a30 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 --2- 172.21.15.76:0/933777161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96dc101de0 0x7f96dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 >> 172.21.15.76:0/933777161 conn(0x7f96dc0fd8c0 msgr2=0x7f96dc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 shutdown_connections 2024-09-19T08:02:10.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:10.198+0000 7f96e327a640 1 -- 172.21.15.76:0/933777161 wait complete. 2024-09-19T08:02:10.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:10 smithi137 ceph-mon[35309]: pgmap v341: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T08:02:10.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:10 smithi137 ceph-mon[35309]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T08:02:10.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:10 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/933777161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:02:10.654 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:10 smithi076 ceph-mon[30930]: pgmap v341: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T08:02:10.655 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:10 smithi076 ceph-mon[30930]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T08:02:10.655 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:10 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/933777161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:02:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:10 smithi152 ceph-mon[35117]: pgmap v341: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T08:02:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:10 smithi152 ceph-mon[35117]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T08:02:10.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:10 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/933777161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:02:10.924 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T08:02:11.173 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:11.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 -- 172.21.15.76:0/1677087125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c100b30 msgr2=0x7f461c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 --2- 172.21.15.76:0/1677087125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c100b30 0x7f461c100f10 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f4618009900 tx=0x7f461802a470 comp rx=0 tx=0).stop 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 -- 172.21.15.76:0/1677087125 shutdown_connections 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 --2- 172.21.15.76:0/1677087125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c105f40 0x7f461c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 --2- 172.21.15.76:0/1677087125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f461c101450 0x7f461c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 --2- 172.21.15.76:0/1677087125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c100b30 0x7f461c100f10 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 -- 172.21.15.76:0/1677087125 >> 172.21.15.76:0/1677087125 conn(0x7f461c0fc7a0 msgr2=0x7f461c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 -- 172.21.15.76:0/1677087125 shutdown_connections 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.651+0000 7f46235f5640 1 -- 172.21.15.76:0/1677087125 wait complete. 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 Processor -- start 2024-09-19T08:02:11.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 -- start start 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c100b30 0x7f461c1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f461c101450 0x7f461c1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 0x7f461c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f461c118700 con 0x7f461c105f40 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f461c118580 con 0x7f461c101450 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f46235f5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f461c118880 con 0x7f461c100b30 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 0x7f461c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 0x7f461c19e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50364/0 (socket says 172.21.15.76:50364) 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 -- 172.21.15.76:0/1887023403 learned_addr learned my addr 172.21.15.76:0/1887023403 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4620b90640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f461c101450 0x7f461c1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 -- 172.21.15.76:0/1887023403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c100b30 msgr2=0x7f461c1a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:11.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c100b30 0x7f461c1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 -- 172.21.15.76:0/1887023403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f461c101450 msgr2=0x7f461c1a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f461c101450 0x7f461c1a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.652+0000 7f4621b92640 1 -- 172.21.15.76:0/1887023403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c19f040 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.653+0000 7f4621b92640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 0x7f461c19e910 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f461400cce0 tx=0x7f461400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.653+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461400f450 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.653+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f461400faf0 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.653+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614018cc0 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.653+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c19f330 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.653+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c1ab620 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.654+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c105920 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.655+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f461400f5f0 con 0x7f461c105f40 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.656+0000 7f46127fc640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46080a33b0 0x7f46080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.656+0000 7f4621391640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46080a33b0 0x7f46080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:11.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.656+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8702+0+0 (secure 0 0 0) 0x7f46140d0380 con 0x7f461c105f40 2024-09-19T08:02:11.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.656+0000 7f4621391640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46080a33b0 0x7f46080a5870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f46180096c0 tx=0x7f4618000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:11.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.661+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4614014030 con 0x7f461c105f40 2024-09-19T08:02:11.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.861+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f461c1ab900 con 0x7f461c105f40 2024-09-19T08:02:11.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.863+0000 7f46127fc640 1 -- 172.21.15.76:0/1887023403 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7f461409ccb0 con 0x7f461c105f40 2024-09-19T08:02:11.863 INFO:teuthology.orchestra.run.smithi076.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:02:11.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46080a33b0 msgr2=0x7f46080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:11.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46080a33b0 0x7f46080a5870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f46180096c0 tx=0x7f4618000bc0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 msgr2=0x7f461c19e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:11.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 0x7f461c19e910 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f461400cce0 tx=0x7f461400a620 comp rx=0 tx=0).stop 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 shutdown_connections 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f46080a33b0 0x7f46080a5870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f461c105f40 0x7f461c19e910 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f461c101450 0x7f461c1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 --2- 172.21.15.76:0/1887023403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c100b30 0x7f461c1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 >> 172.21.15.76:0/1887023403 conn(0x7f461c0fc7a0 msgr2=0x7f461c1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 shutdown_connections 2024-09-19T08:02:11.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:11.866+0000 7f46235f5640 1 -- 172.21.15.76:0/1887023403 wait complete. 2024-09-19T08:02:12.177 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a[30926]: 2024-09-19T08:02:11.862+0000 7f0687abe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:02:12.314 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:12.314 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:12.314 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-mds[65634]: -- 172.21.15.152:0/3257141676 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564aad385c20 con 0x564aad363000 2024-09-19T08:02:12.314 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: starting mds.i at 2024-09-19T08:02:12.315 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c[65328]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:12.315 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c[65328]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:12.315 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-mds[65332]: -- 172.21.15.152:0/2566126566 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633eefa3c20 con 0x5633eef80800 2024-09-19T08:02:12.315 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c[65328]: starting mds.c at 2024-09-19T08:02:12.315 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f[65028]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:12.315 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f[65028]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:12.316 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-mds[65032]: -- 172.21.15.152:0/2749435662 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635dd77b860 con 0x5635dd758800 2024-09-19T08:02:12.316 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f[65028]: starting mds.f at 2024-09-19T08:02:12.316 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l[64726]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:12.316 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l[64726]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:12.316 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-mds[64730]: -- 172.21.15.152:0/4155989754 <== mon.0 v2:172.21.15.76:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ef0ae3860 con 0x559ef0ac1400 2024-09-19T08:02:12.316 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:02:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l[64726]: starting mds.l at 2024-09-19T08:02:12.353 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h[65035]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:12.353 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h[65035]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:12.353 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-mds[65039]: -- 172.21.15.137:0/173405866 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593b19b9860 con 0x5593b1996800 2024-09-19T08:02:12.353 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h[65035]: starting mds.h at 2024-09-19T08:02:12.354 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b[65349]: ignoring --setuser ceph since I am not root 2024-09-19T08:02:12.354 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b[65349]: ignoring --setgroup ceph since I am not root 2024-09-19T08:02:12.354 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-mds[65353]: -- 172.21.15.137:0/252166743 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ecb0390680 con 0x55ecb0365000 2024-09-19T08:02:12.354 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-mds[65353]: -- 172.21.15.137:0/252166743 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ecb0387860 con 0x55ecb0365000 2024-09-19T08:02:12.354 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:02:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b[65349]: starting mds.b at 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: pgmap v343: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1887023403' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/1887023403' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T08:02:12.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:12 smithi076 ceph-mon[30930]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T08:02:12.566 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: pgmap v343: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1887023403' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/1887023403' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T08:02:12.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:12 smithi137 ceph-mon[35309]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: pgmap v343: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1887023403' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/1887023403' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T08:02:12.811 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:12 smithi152 ceph-mon[35117]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T08:02:12.816 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 -- 172.21.15.76:0/2938483538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c1082a0 msgr2=0x7f8f0c10ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 --2- 172.21.15.76:0/2938483538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c1082a0 0x7f8f0c10ec10 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009cd0 tx=0x7f8f0402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 -- 172.21.15.76:0/2938483538 shutdown_connections 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 --2- 172.21.15.76:0/2938483538 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c1082a0 0x7f8f0c10ec10 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 --2- 172.21.15.76:0/2938483538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f0c103720 0x7f8f0c107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 --2- 172.21.15.76:0/2938483538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0c102d70 0x7f8f0c103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 -- 172.21.15.76:0/2938483538 >> 172.21.15.76:0/2938483538 conn(0x7f8f0c0fc7d0 msgr2=0x7f8f0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 -- 172.21.15.76:0/2938483538 shutdown_connections 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 -- 172.21.15.76:0/2938483538 wait complete. 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 Processor -- start 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.264+0000 7f8f12111640 1 -- start start 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f12111640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0c102d70 0x7f8f0c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f12111640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 0x7f8f0c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f12111640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f0c1082a0 0x7f8f0c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f12111640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c112240 con 0x7f8f0c103720 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f12111640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c1120c0 con 0x7f8f0c102d70 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f12111640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c1123c0 con 0x7f8f0c1082a0 2024-09-19T08:02:13.284 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 0x7f8f0c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 0x7f8f0c198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50370/0 (socket says 172.21.15.76:50370) 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 -- 172.21.15.76:0/394348052 learned_addr learned my addr 172.21.15.76:0/394348052 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f0bfff640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f0c1082a0 0x7f8f0c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f0b7fe640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0c102d70 0x7f8f0c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 -- 172.21.15.76:0/394348052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f0c1082a0 msgr2=0x7f8f0c19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f0c1082a0 0x7f8f0c19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 -- 172.21.15.76:0/394348052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0c102d70 msgr2=0x7f8f0c1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0c102d70 0x7f8f0c1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.265+0000 7f8f02ffd640 1 -- 172.21.15.76:0/394348052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c19d590 con 0x7f8f0c103720 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.266+0000 7f8f02ffd640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 0x7f8f0c198b20 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c8c0 tx=0x7f8ef400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.266+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4007bb0 con 0x7f8f0c103720 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.266+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ef4007d50 con 0x7f8f0c103720 2024-09-19T08:02:13.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.266+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c19d880 con 0x7f8f0c103720 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.266+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4018830 con 0x7f8f0c103720 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.266+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c1a5160 con 0x7f8f0c103720 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.267+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c103150 con 0x7f8f0c103720 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.268+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8ef400f450 con 0x7f8f0c103720 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.269+0000 7f8f097fa640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8ef80a3430 0x7f8ef80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.269+0000 7f8f0b7fe640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8ef80a3430 0x7f8ef80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.269+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8916+0+0 (secure 0 0 0) 0x7f8ef40cfec0 con 0x7f8f0c103720 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.269+0000 7f8f0b7fe640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8ef80a3430 0x7f8ef80a58f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009990 tx=0x7f8efc009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:13.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.273+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ef4014030 con 0x7f8f0c103720 2024-09-19T08:02:13.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.475+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8f0c1a53c0 con 0x7f8f0c103720 2024-09-19T08:02:13.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.870+0000 7f8f097fa640 1 -- 172.21.15.76:0/394348052 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f8ef409c710 con 0x7f8f0c103720 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.872+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8ef80a3430 msgr2=0x7f8ef80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.872+0000 7f8f12111640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8ef80a3430 0x7f8ef80a58f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009990 tx=0x7f8efc009110 comp rx=0 tx=0).stop 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.872+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 msgr2=0x7f8f0c198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.872+0000 7f8f12111640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 0x7f8f0c198b20 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c8c0 tx=0x7f8ef400ccc0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 shutdown_connections 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8ef80a3430 0x7f8ef80a58f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f0c1082a0 0x7f8f0c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8f0c103720 0x7f8f0c198b20 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 --2- 172.21.15.76:0/394348052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0c102d70 0x7f8f0c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:13.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 >> 172.21.15.76:0/394348052 conn(0x7f8f0c0fc7d0 msgr2=0x7f8f0c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:13.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 shutdown_connections 2024-09-19T08:02:13.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:13.873+0000 7f8f12111640 1 -- 172.21.15.76:0/394348052 wait complete. 2024-09-19T08:02:14.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6832/3628652205,v1:172.21.15.152:6833/3628652205] up:boot 2024-09-19T08:02:14.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6834/3979699736,v1:172.21.15.152:6835/3979699736] up:boot 2024-09-19T08:02:14.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6836/3297104491,v1:172.21.15.137:6838/3297104491] up:boot 2024-09-19T08:02:14.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.137:6837/2111580694,v1:172.21.15.137:6839/2111580694] up:boot 2024-09-19T08:02:14.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6836/3757233021,v1:172.21.15.152:6837/3757233021] up:boot 2024-09-19T08:02:14.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: mds.? [v2:172.21.15.152:6838/419149940,v1:172.21.15.152:6839/419149940] up:boot 2024-09-19T08:02:14.155 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T08:02:14.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:02:14.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:02:14.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:02:14.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:02:14.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:02:14.156 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:02:14.157 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: pgmap v345: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T08:02:14.157 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:13 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/394348052' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:02:14.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6832/3628652205,v1:172.21.15.152:6833/3628652205] up:boot 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6834/3979699736,v1:172.21.15.152:6835/3979699736] up:boot 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6836/3297104491,v1:172.21.15.137:6838/3297104491] up:boot 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.137:6837/2111580694,v1:172.21.15.137:6839/2111580694] up:boot 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6836/3757233021,v1:172.21.15.152:6837/3757233021] up:boot 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: mds.? [v2:172.21.15.152:6838/419149940,v1:172.21.15.152:6839/419149940] up:boot 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:02:14.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: pgmap v345: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T08:02:14.195 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:13 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/394348052' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6832/3628652205,v1:172.21.15.152:6833/3628652205] up:boot 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6834/3979699736,v1:172.21.15.152:6835/3979699736] up:boot 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6836/3297104491,v1:172.21.15.137:6838/3297104491] up:boot 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.137:6837/2111580694,v1:172.21.15.137:6839/2111580694] up:boot 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6836/3757233021,v1:172.21.15.152:6837/3757233021] up:boot 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: mds.? [v2:172.21.15.152:6838/419149940,v1:172.21.15.152:6839/419149940] up:boot 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:02:14.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:02:14.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:02:14.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:02:14.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='mgr.15132 172.21.15.76:0/2353879690' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:02:14.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: pgmap v345: 97 pgs: 97 active+clean; 153 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-19T08:02:14.312 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:13 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/394348052' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:02:14.661 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:02:14.908 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:14.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:14 smithi076 ceph-mon[30930]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:02:14.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:14 smithi076 ceph-mon[30930]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:02:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:14 smithi076 ceph-mon[30930]: Cluster is now healthy 2024-09-19T08:02:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:14 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/394348052' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:02:14.944 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:14 smithi076 ceph-mon[30930]: fsmap 12 up:standby 2024-09-19T08:02:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:14 smithi137 ceph-mon[35309]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:02:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:14 smithi137 ceph-mon[35309]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:02:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:14 smithi137 ceph-mon[35309]: Cluster is now healthy 2024-09-19T08:02:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:14 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/394348052' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:02:15.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:14 smithi137 ceph-mon[35309]: fsmap 12 up:standby 2024-09-19T08:02:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:14 smithi152 ceph-mon[35117]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:02:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:14 smithi152 ceph-mon[35117]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:02:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:14 smithi152 ceph-mon[35117]: Cluster is now healthy 2024-09-19T08:02:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:14 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/394348052' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:02:15.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:14 smithi152 ceph-mon[35117]: fsmap 12 up:standby 2024-09-19T08:02:15.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 -- 172.21.15.76:0/717142513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 msgr2=0x7f8b3810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:15.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 --2- 172.21.15.76:0/717142513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3810ea90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009ca0 tx=0x7f8b3002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 -- 172.21.15.76:0/717142513 shutdown_connections 2024-09-19T08:02:15.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 --2- 172.21.15.76:0/717142513 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3810ea90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 --2- 172.21.15.76:0/717142513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b38102790 0x7f8b381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 --2- 172.21.15.76:0/717142513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b38101de0 0x7f8b381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 -- 172.21.15.76:0/717142513 >> 172.21.15.76:0/717142513 conn(0x7f8b380fd8c0 msgr2=0x7f8b380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 -- 172.21.15.76:0/717142513 shutdown_connections 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.418+0000 7f8b3daad640 1 -- 172.21.15.76:0/717142513 wait complete. 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 Processor -- start 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 -- start start 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b38101de0 0x7f8b38198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b38102790 0x7f8b38198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381120d0 con 0x7f8b38106f10 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38111f50 con 0x7f8b38101de0 2024-09-19T08:02:15.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b3daad640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38112250 con 0x7f8b38102790 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b37fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b37fff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60914/0 (socket says 172.21.15.76:60914) 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b37fff640 1 -- 172.21.15.76:0/2279529995 learned_addr learned my addr 172.21.15.76:0/2279529995 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b377fe640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b38101de0 0x7f8b38198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.419+0000 7f8b36ffd640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b38102790 0x7f8b38198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b37fff640 1 -- 172.21.15.76:0/2279529995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b38102790 msgr2=0x7f8b38198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b37fff640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b38102790 0x7f8b38198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b37fff640 1 -- 172.21.15.76:0/2279529995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b38101de0 msgr2=0x7f8b38198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b37fff640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b38101de0 0x7f8b38198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b37fff640 1 -- 172.21.15.76:0/2279529995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3819d4c0 con 0x7f8b38106f10 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b37fff640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3819cde0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8b30006010 tx=0x7f8b300319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:15.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3002fa20 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3819d750 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b3002fbc0 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3003a730 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.420+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b381a5090 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.421+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b381021c0 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.422+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8b300305c0 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.423+0000 7f8b34ff9640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8b240a33b0 0x7f8b240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.423+0000 7f8b377fe640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8b240a33b0 0x7f8b240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.423+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8916+0+0 (secure 0 0 0) 0x7f8b300f12d0 con 0x7f8b38106f10 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.423+0000 7f8b377fe640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8b240a33b0 0x7f8b240a5870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009990 tx=0x7f8b28009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:15.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.427+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b300bdcc0 con 0x7f8b38106f10 2024-09-19T08:02:15.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.595+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8b3810a150 con 0x7f8b38106f10 2024-09-19T08:02:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.878+0000 7f8b34ff9640 1 -- 172.21.15.76:0/2279529995 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) ==== 181+0+0 (secure 0 0 0) 0x7f8b300bd5c0 con 0x7f8b38106f10 2024-09-19T08:02:15.878 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:02:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8b240a33b0 msgr2=0x7f8b240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8b240a33b0 0x7f8b240a5870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009990 tx=0x7f8b28009110 comp rx=0 tx=0).stop 2024-09-19T08:02:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 msgr2=0x7f8b3819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3819cde0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8b30006010 tx=0x7f8b300319f0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 shutdown_connections 2024-09-19T08:02:15.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7f8b240a33b0 0x7f8b240a5870 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8b38106f10 0x7f8b3819cde0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b38102790 0x7f8b38198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 --2- 172.21.15.76:0/2279529995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b38101de0 0x7f8b38198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.882+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 >> 172.21.15.76:0/2279529995 conn(0x7f8b380fd8c0 msgr2=0x7f8b380febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.883+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 shutdown_connections 2024-09-19T08:02:15.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:15.883+0000 7f8b3daad640 1 -- 172.21.15.76:0/2279529995 wait complete. 2024-09-19T08:02:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:15 smithi137 ceph-mon[35309]: pgmap v346: 97 pgs: 97 active+clean; 153 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T08:02:16.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:15 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2279529995' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:02:16.193 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:15 smithi076 ceph-mon[30930]: pgmap v346: 97 pgs: 97 active+clean; 153 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T08:02:16.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:15 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2279529995' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:02:16.212 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:15 smithi152 ceph-mon[35117]: pgmap v346: 97 pgs: 97 active+clean; 153 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T08:02:16.212 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:15 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2279529995' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:02:16.700 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6aad871c-765a-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:02:16.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:16 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2279529995' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:02:16.943 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:16 smithi076 ceph-mon[30930]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T08:02:16.951 INFO:teuthology.orchestra.run.smithi076.stderr:Inferring config /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:02:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:16 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2279529995' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:02:17.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:16 smithi137 ceph-mon[35309]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T08:02:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:16 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2279529995' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:02:17.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:16 smithi152 ceph-mon[35117]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T08:02:17.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 -- 172.21.15.76:0/247977426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 msgr2=0x7feaf010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:17.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 --2- 172.21.15.76:0/247977426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf010bb50 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7feae4009900 tx=0x7feae402a480 comp rx=0 tx=0).stop 2024-09-19T08:02:17.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 -- 172.21.15.76:0/247977426 shutdown_connections 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 --2- 172.21.15.76:0/247977426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf010c170 0x7feaf010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 --2- 172.21.15.76:0/247977426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf010bb50 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 --2- 172.21.15.76:0/247977426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf0102d40 0x7feaf0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 -- 172.21.15.76:0/247977426 >> 172.21.15.76:0/247977426 conn(0x7feaf00fc7a0 msgr2=0x7feaf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 -- 172.21.15.76:0/247977426 shutdown_connections 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 -- 172.21.15.76:0/247977426 wait complete. 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 Processor -- start 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.455+0000 7feaf7b63640 1 -- start start 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf0102d40 0x7feaf01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf010c170 0x7feaf0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:17.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0112090 con 0x7feaf0103660 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0111f10 con 0x7feaf010c170 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0112210 con 0x7feaf0102d40 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf0100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60936/0 (socket says 172.21.15.76:60936) 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 -- 172.21.15.76:0/2715764817 learned_addr learned my addr 172.21.15.76:0/2715764817 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf58ff640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf0102d40 0x7feaf01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf6100640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf010c170 0x7feaf0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 -- 172.21.15.76:0/2715764817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf0102d40 msgr2=0x7feaf01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf0102d40 0x7feaf01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 -- 172.21.15.76:0/2715764817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf010c170 msgr2=0x7feaf0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf010c170 0x7feaf0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 -- 172.21.15.76:0/2715764817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf01a69d0 con 0x7feaf0103660 2024-09-19T08:02:17.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf6100640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf010c170 0x7feaf0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf50fe640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf0100ee0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7feae4006010 tx=0x7feae40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae403f030 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf01a6c60 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feae4003d00 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4035070 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.456+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf01a7190 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.457+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf0103120 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.459+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7feae4042030 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.459+0000 7feae2ffd640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feadc0a33b0 0x7feadc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.459+0000 7feaf58ff640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feadc0a33b0 0x7feadc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.459+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8304+0+0 (secure 0 0 0) 0x7feae40f0260 con 0x7feaf0103660 2024-09-19T08:02:17.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.460+0000 7feaf58ff640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feadc0a33b0 0x7feadc0a5870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feaec0058c0 tx=0x7feaec00a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:02:17.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.462+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feae40bcd20 con 0x7feaf0103660 2024-09-19T08:02:17.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:17.630+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7feaf002d7c0 con 0x7feaf0103660 2024-09-19T08:02:18.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.047+0000 7feae2ffd640 1 -- 172.21.15.76:0/2715764817 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7feae40bc620 con 0x7feaf0103660 2024-09-19T08:02:18.050 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data' removed 2024-09-19T08:02:18.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feadc0a33b0 msgr2=0x7feadc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:18.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feadc0a33b0 0x7feadc0a5870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feaec0058c0 tx=0x7feaec00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 msgr2=0x7feaf0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:02:18.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf0100ee0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7feae4006010 tx=0x7feae40042f0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 shutdown_connections 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:6800/4082879407,v1:172.21.15.76:6801/4082879407] conn(0x7feadc0a33b0 0x7feadc0a5870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feaf010c170 0x7feaf0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feaf0103660 0x7feaf0100ee0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 --2- 172.21.15.76:0/2715764817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf0102d40 0x7feaf01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 >> 172.21.15.76:0/2715764817 conn(0x7feaf00fc7a0 msgr2=0x7feaf00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:02:18.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 shutdown_connections 2024-09-19T08:02:18.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-19T08:02:18.051+0000 7feaf7b63640 1 -- 172.21.15.76:0/2715764817 wait complete. 2024-09-19T08:02:18.310 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:18 smithi152 ceph-mon[35117]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:02:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:18 smithi152 ceph-mon[35117]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T08:02:18.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:18 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2715764817' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:02:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:18 smithi137 ceph-mon[35309]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:02:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:18 smithi137 ceph-mon[35309]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T08:02:18.404 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:18 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2715764817' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:02:18.416 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:18 smithi076 ceph-mon[30930]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:02:18.416 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:18 smithi076 ceph-mon[30930]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T08:02:18.416 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:18 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2715764817' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:02:18.795 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:18.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:18.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:02:18.889 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T08:02:18.890 DEBUG:teuthology.orchestra.run.smithi076:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:02:18.905 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:02:18.923 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:02:18.947 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T08:02:18.947 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T08:02:18.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:02:19.055 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:18 smithi076 systemd[1]: Stopping Ceph mon.a for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:19 smithi137 ceph-mon[35309]: from='client.? 172.21.15.76:0/2715764817' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:02:19.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:19 smithi137 ceph-mon[35309]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T08:02:19.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:19 smithi152 ceph-mon[35117]: from='client.? 172.21.15.76:0/2715764817' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:02:19.311 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:19 smithi152 ceph-mon[35117]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T08:02:19.443 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:19 smithi076 ceph-mon[30930]: from='client.? 172.21.15.76:0/2715764817' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:02:19.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:19 smithi076 ceph-mon[30930]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T08:02:19.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a[30926]: 2024-09-19T08:02:19.247+0000 7f068d2c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:19.444 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a[30926]: 2024-09-19T08:02:19.247+0000 7f068d2c9640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T08:02:19.924 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:19 smithi076 podman[112369]: 2024-09-19 08:02:19.503084816 +0000 UTC m=+0.372039242 container died b15b079e9d65889fb05dfdbb6992f2caff8f41b8b9e40d8a9d19a36139576515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T08:02:20.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:20 smithi076 podman[112369]: 2024-09-19 08:02:20.057236489 +0000 UTC m=+0.926190906 container cleanup b15b079e9d65889fb05dfdbb6992f2caff8f41b8b9e40d8a9d19a36139576515 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:02:20.194 INFO:journalctl@ceph.mon.a.smithi076.stdout:Sep 19 08:02:20 smithi076 bash[112369]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:02:20.493 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T08:02:20.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:20.556 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T08:02:20.556 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T08:02:20.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.b 2024-09-19T08:02:20.867 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:20 smithi137 systemd[1]: Stopping Ceph mon.b for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:21.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-b[35305]: 2024-09-19T08:02:20.867+0000 7f5c30def640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:21.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-b[35305]: 2024-09-19T08:02:20.867+0000 7f5c30def640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:02:21.154 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:21 smithi137 podman[70548]: 2024-09-19 08:02:21.081667706 +0000 UTC m=+0.325570868 container died 6e749eac1ee6a14a960dd56d396dfd80c5deff9c41986358ed92bd950ba9ab16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-b, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T08:02:21.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:21 smithi137 podman[70548]: 2024-09-19 08:02:21.454433717 +0000 UTC m=+0.698336881 container cleanup 6e749eac1ee6a14a960dd56d396dfd80c5deff9c41986358ed92bd950ba9ab16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:02:21.654 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 19 08:02:21 smithi137 bash[70548]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-b 2024-09-19T08:02:21.885 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T08:02:21.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:21.931 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T08:02:21.932 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T08:02:21.932 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.c 2024-09-19T08:02:22.264 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:21 smithi152 systemd[1]: Stopping Ceph mon.c for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c[35113]: 2024-09-19T08:02:22.263+0000 7f9782a6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c[35113]: 2024-09-19T08:02:22.263+0000 7f9782a6b640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:02:22.561 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:22 smithi152 podman[71110]: 2024-09-19 08:02:22.438404614 +0000 UTC m=+0.310753425 container died f8f909920519e88eebbaed3422f0adfd7263d4a76966254ca8684b474c22619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T08:02:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:22 smithi152 podman[71110]: 2024-09-19 08:02:22.882153849 +0000 UTC m=+0.754502659 container cleanup f8f909920519e88eebbaed3422f0adfd7263d4a76966254ca8684b474c22619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T08:02:23.061 INFO:journalctl@ceph.mon.c.smithi152.stdout:Sep 19 08:02:22 smithi152 bash[71110]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mon-c 2024-09-19T08:02:23.311 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T08:02:23.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:23.358 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T08:02:23.358 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T08:02:23.358 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:02:23.645 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 08:02:23 smithi076 systemd[1]: Stopping Ceph mgr.x for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:23.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 08:02:23 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T08:02:23.645+0000 7fd674078640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:23.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 08:02:23 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x[31156]: 2024-09-19T08:02:23.645+0000 7fd674078640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T08:02:23.944 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 08:02:23 smithi076 podman[112494]: 2024-09-19 08:02:23.676480891 +0000 UTC m=+0.126893812 container died 908fb35e2429bd190e9d54643230c8dd46a0cbf6c327d709d27c20f1e756669c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:02:24.407 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 08:02:24 smithi076 podman[112494]: 2024-09-19 08:02:24.171945011 +0000 UTC m=+0.622357926 container cleanup 908fb35e2429bd190e9d54643230c8dd46a0cbf6c327d709d27c20f1e756669c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:02:24.407 INFO:journalctl@ceph.mgr.x.smithi076.stdout:Sep 19 08:02:24 smithi076 bash[112494]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-x 2024-09-19T08:02:24.544 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T08:02:24.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:24.579 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T08:02:24.580 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T08:02:24.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.y 2024-09-19T08:02:24.903 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:24 smithi137 systemd[1]: Stopping Ceph mgr.y for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:25.153 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:24 smithi137 podman[70669]: 2024-09-19 08:02:24.903711655 +0000 UTC m=+0.126792742 container died d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:02:25.541 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 podman[70669]: 2024-09-19 08:02:25.32331087 +0000 UTC m=+0.546391949 container cleanup d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T08:02:25.541 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 bash[70669]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y 2024-09-19T08:02:25.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T08:02:25.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 podman[70681]: 2024-09-19 08:02:25.541569215 +0000 UTC m=+0.639564314 container remove d279e1f75a21f689371290abccc754d56c0c920e2f141b46fcc34ac52d096a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:02:25.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T08:02:25.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-19T08:02:25.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 systemd[1]: Stopped Ceph mgr.y for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T08:02:25.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 19 08:02:25 smithi137 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.y.service: Consumed 11.419s CPU time. 2024-09-19T08:02:25.826 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:25.827 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T08:02:25.827 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T08:02:25.827 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.z 2024-09-19T08:02:26.177 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 08:02:25 smithi152 systemd[1]: Stopping Ceph mgr.z for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:26.488 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 08:02:26 smithi152 podman[71231]: 2024-09-19 08:02:26.174354768 +0000 UTC m=+0.146667288 container died 521a32d8bae87f7dfbf9cee6f1815dd7c9ab4e04a4949b22ee5d907a52912432 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:02:26.810 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 08:02:26 smithi152 podman[71231]: 2024-09-19 08:02:26.588040252 +0000 UTC m=+0.560352765 container cleanup 521a32d8bae87f7dfbf9cee6f1815dd7c9ab4e04a4949b22ee5d907a52912432 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:02:26.811 INFO:journalctl@ceph.mgr.z.smithi152.stdout:Sep 19 08:02:26 smithi152 bash[71231]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mgr-z 2024-09-19T08:02:27.010 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T08:02:27.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:27.045 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T08:02:27.045 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T08:02:27.045 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.0 2024-09-19T08:02:27.360 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:27 smithi076 systemd[1]: Stopping Ceph osd.0 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:27.694 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0[45091]: 2024-09-19T08:02:27.359+0000 7f3239d1c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:27.694 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0[45091]: 2024-09-19T08:02:27.359+0000 7f3239d1c640 -1 osd.0 100 *** Got signal Terminated *** 2024-09-19T08:02:27.694 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0[45091]: 2024-09-19T08:02:27.359+0000 7f3239d1c640 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:02:33.120 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:32 smithi076 podman[112616]: 2024-09-19 08:02:32.818443518 +0000 UTC m=+5.579949637 container stop 4613b48cc2f9e15ae147d60b7eeee622eddf6b20757cfd127da81ce5c26e270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:02:33.120 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:32 smithi076 podman[112616]: 2024-09-19 08:02:32.844094176 +0000 UTC m=+5.605600318 container died 4613b48cc2f9e15ae147d60b7eeee622eddf6b20757cfd127da81ce5c26e270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T08:02:33.437 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:33 smithi076 podman[112616]: 2024-09-19 08:02:33.210971513 +0000 UTC m=+5.972477629 container cleanup 4613b48cc2f9e15ae147d60b7eeee622eddf6b20757cfd127da81ce5c26e270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T08:02:33.437 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:33 smithi076 bash[112616]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0 2024-09-19T08:02:33.693 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:33 smithi076 podman[112633]: 2024-09-19 08:02:33.437657458 +0000 UTC m=+0.611039707 container remove 4613b48cc2f9e15ae147d60b7eeee622eddf6b20757cfd127da81ce5c26e270a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:02:34.028 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:33 smithi076 podman[112723]: 2024-09-19 08:02:33.787025552 +0000 UTC m=+0.016049530 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:02:34.028 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:33 smithi076 podman[112723]: 2024-09-19 08:02:33.90527451 +0000 UTC m=+0.134298476 container create 7f07656035df7f1897bbe540144be0dab2d2ed50b51bcc7c2edea465f4f35252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T08:02:34.337 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:34 smithi076 podman[112723]: 2024-09-19 08:02:34.149591346 +0000 UTC m=+0.378615312 container init 7f07656035df7f1897bbe540144be0dab2d2ed50b51bcc7c2edea465f4f35252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:02:34.338 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:34 smithi076 podman[112723]: 2024-09-19 08:02:34.153147984 +0000 UTC m=+0.382171953 container start 7f07656035df7f1897bbe540144be0dab2d2ed50b51bcc7c2edea465f4f35252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:02:34.338 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:34 smithi076 podman[112723]: 2024-09-19 08:02:34.233062154 +0000 UTC m=+0.462086150 container attach 7f07656035df7f1897bbe540144be0dab2d2ed50b51bcc7c2edea465f4f35252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T08:02:34.694 INFO:journalctl@ceph.osd.0.smithi076.stdout:Sep 19 08:02:34 smithi076 podman[112723]: 2024-09-19 08:02:34.338563466 +0000 UTC m=+0.567587435 container died 7f07656035df7f1897bbe540144be0dab2d2ed50b51bcc7c2edea465f4f35252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T08:02:35.020 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T08:02:35.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:35.060 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T08:02:35.060 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T08:02:35.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.1 2024-09-19T08:02:35.403 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:35 smithi137 systemd[1]: Stopping Ceph osd.1 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:36.154 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1[39765]: 2024-09-19T08:02:35.668+0000 7f59d386d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:36.154 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1[39765]: 2024-09-19T08:02:35.668+0000 7f59d386d640 -1 osd.1 100 *** Got signal Terminated *** 2024-09-19T08:02:36.154 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1[39765]: 2024-09-19T08:02:35.668+0000 7f59d386d640 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:02:41.460 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:41 smithi137 podman[70793]: 2024-09-19 08:02:41.197417449 +0000 UTC m=+5.944799853 container died 58250fad7216ce95dc262879d8e94c44edc490b8377229e98b4e5fa5bcbad9da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T08:02:41.861 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:41 smithi137 podman[70793]: 2024-09-19 08:02:41.552103901 +0000 UTC m=+6.299486304 container cleanup 58250fad7216ce95dc262879d8e94c44edc490b8377229e98b4e5fa5bcbad9da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:02:41.862 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:41 smithi137 bash[70793]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1 2024-09-19T08:02:42.153 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:41 smithi137 podman[70808]: 2024-09-19 08:02:41.86221337 +0000 UTC m=+0.660191981 container remove 58250fad7216ce95dc262879d8e94c44edc490b8377229e98b4e5fa5bcbad9da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:02:42.498 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:42 smithi137 podman[70893]: 2024-09-19 08:02:42.121059784 +0000 UTC m=+0.015904000 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:02:42.498 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:42 smithi137 podman[70893]: 2024-09-19 08:02:42.246709303 +0000 UTC m=+0.141553514 container create 057df7b8d57b59c3e5bfaeb479d056e375dada076922d8f59e68ed002dd94685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T08:02:42.498 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:42 smithi137 podman[70893]: 2024-09-19 08:02:42.499072985 +0000 UTC m=+0.393917192 container init 057df7b8d57b59c3e5bfaeb479d056e375dada076922d8f59e68ed002dd94685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:02:42.904 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:42 smithi137 podman[70893]: 2024-09-19 08:02:42.502731406 +0000 UTC m=+0.397575612 container start 057df7b8d57b59c3e5bfaeb479d056e375dada076922d8f59e68ed002dd94685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:02:42.904 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:42 smithi137 podman[70893]: 2024-09-19 08:02:42.59911354 +0000 UTC m=+0.493957766 container attach 057df7b8d57b59c3e5bfaeb479d056e375dada076922d8f59e68ed002dd94685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T08:02:42.904 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 19 08:02:42 smithi137 podman[70893]: 2024-09-19 08:02:42.69558506 +0000 UTC m=+0.590429283 container died 057df7b8d57b59c3e5bfaeb479d056e375dada076922d8f59e68ed002dd94685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T08:02:43.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T08:02:43.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:43.412 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T08:02:43.412 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T08:02:43.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.2 2024-09-19T08:02:43.768 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:43 smithi152 systemd[1]: Stopping Ceph osd.2 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:44.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2[40101]: 2024-09-19T08:02:43.767+0000 7fa802826640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:44.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2[40101]: 2024-09-19T08:02:43.767+0000 7fa802826640 -1 osd.2 100 *** Got signal Terminated *** 2024-09-19T08:02:44.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2[40101]: 2024-09-19T08:02:43.767+0000 7fa802826640 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:02:49.561 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:49 smithi152 podman[71358]: 2024-09-19 08:02:49.288235043 +0000 UTC m=+5.680254989 container died 6009e2c85a5809816856f8b27142d26bd5679e486b86e58af37c3821c99e8609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T08:02:49.960 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:49 smithi152 podman[71358]: 2024-09-19 08:02:49.678127683 +0000 UTC m=+6.070147630 container cleanup 6009e2c85a5809816856f8b27142d26bd5679e486b86e58af37c3821c99e8609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:02:49.960 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:49 smithi152 bash[71358]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2 2024-09-19T08:02:50.310 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:49 smithi152 podman[71373]: 2024-09-19 08:02:49.963028272 +0000 UTC m=+0.677458988 container remove 6009e2c85a5809816856f8b27142d26bd5679e486b86e58af37c3821c99e8609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T08:02:50.608 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:50 smithi152 podman[71466]: 2024-09-19 08:02:50.228520097 +0000 UTC m=+0.018194369 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:02:50.608 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:50 smithi152 podman[71466]: 2024-09-19 08:02:50.355492504 +0000 UTC m=+0.145166764 container create 72f69e31a6e1dc9bacbd555c4351cb4481a1df02de82e312c889063dc2250878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:02:51.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:50 smithi152 podman[71466]: 2024-09-19 08:02:50.608307844 +0000 UTC m=+0.397982123 container init 72f69e31a6e1dc9bacbd555c4351cb4481a1df02de82e312c889063dc2250878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T08:02:51.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:50 smithi152 podman[71466]: 2024-09-19 08:02:50.612508788 +0000 UTC m=+0.402183049 container start 72f69e31a6e1dc9bacbd555c4351cb4481a1df02de82e312c889063dc2250878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:02:51.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:50 smithi152 podman[71466]: 2024-09-19 08:02:50.726572586 +0000 UTC m=+0.516246862 container attach 72f69e31a6e1dc9bacbd555c4351cb4481a1df02de82e312c889063dc2250878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T08:02:51.061 INFO:journalctl@ceph.osd.2.smithi152.stdout:Sep 19 08:02:50 smithi152 podman[71466]: 2024-09-19 08:02:50.807548961 +0000 UTC m=+0.597223222 container died 72f69e31a6e1dc9bacbd555c4351cb4481a1df02de82e312c889063dc2250878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T08:02:51.552 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T08:02:51.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:51.593 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T08:02:51.593 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T08:02:51.593 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.3 2024-09-19T08:02:51.915 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:51 smithi076 systemd[1]: Stopping Ceph osd.3 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:02:52.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:51 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:51.915+0000 7f1ab5427640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:02:52.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:51 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:51.915+0000 7f1ab5427640 -1 osd.3 100 *** Got signal Terminated *** 2024-09-19T08:02:52.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:51 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:51.915+0000 7f1ab5427640 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:02:53.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:53 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:53.422+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:54.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:53.676+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:02:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:53.767+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:02:54.193 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:53 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:53.756+0000 7f1aada35640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.482211+0000 front 2024-09-19T08:02:29.482225+0000 (oldest deadline 2024-09-19T08:02:52.982473+0000) 2024-09-19T08:02:54.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:54.397+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:55.060 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:54.675+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:02:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:54.816+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:02:55.193 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:54 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:54.749+0000 7f1aada35640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.482211+0000 front 2024-09-19T08:02:29.482225+0000 (oldest deadline 2024-09-19T08:02:52.982473+0000) 2024-09-19T08:02:55.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:55 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:55.427+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:55.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:02:55 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:02:55.622+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:02:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:55.770+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:02:56.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:55.634+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:02:56.193 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:55 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:55.747+0000 7f1aada35640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.482211+0000 front 2024-09-19T08:02:29.482225+0000 (oldest deadline 2024-09-19T08:02:52.982473+0000) 2024-09-19T08:02:56.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:02:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:02:56.574+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:02:56.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:56.378+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:57.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:56.667+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:02:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:56.727+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:02:57.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:56 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3[51952]: 2024-09-19T08:02:56.750+0000 7f1aada35640 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.482211+0000 front 2024-09-19T08:02:29.482225+0000 (oldest deadline 2024-09-19T08:02:52.982473+0000) 2024-09-19T08:02:57.613 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:57.347+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:57.613 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:57 smithi076 podman[112826]: 2024-09-19 08:02:57.39259742 +0000 UTC m=+5.608041217 container died fc156a72790ef1448ad039cf6559f9125fbf8a656fda5fcf3e7f0337aa914ff8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True) 2024-09-19T08:02:57.873 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:02:57 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:02:57.612+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:02:57.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:02:57 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:02:57.509+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:02:58.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:57.667+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:02:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:57.680+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:02:58.150 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:57 smithi076 podman[112826]: 2024-09-19 08:02:57.874334967 +0000 UTC m=+6.089778749 container cleanup fc156a72790ef1448ad039cf6559f9125fbf8a656fda5fcf3e7f0337aa914ff8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:02:58.150 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:57 smithi076 bash[112826]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3 2024-09-19T08:02:58.443 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112842]: 2024-09-19 08:02:58.151023316 +0000 UTC m=+0.755529130 container remove fc156a72790ef1448ad039cf6559f9125fbf8a656fda5fcf3e7f0337aa914ff8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T08:02:58.444 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:58 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:58.305+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:58.779 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:02:58 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:02:58.637+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:02:58.779 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112930]: 2024-09-19 08:02:58.3943845 +0000 UTC m=+0.016193322 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:02:58.779 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112930]: 2024-09-19 08:02:58.502010201 +0000 UTC m=+0.123819009 container create 58328bc4db3ae42117cdc3d03fac1eb443755cc032a0488b5053f5b6bbb1a577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T08:02:58.779 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112930]: 2024-09-19 08:02:58.779722085 +0000 UTC m=+0.401530910 container init 58328bc4db3ae42117cdc3d03fac1eb443755cc032a0488b5053f5b6bbb1a577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:02:58.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:02:58 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:02:58.508+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:02:59.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:58.678+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:02:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:58.689+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:02:59.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112930]: 2024-09-19 08:02:58.783039994 +0000 UTC m=+0.404848803 container start 58328bc4db3ae42117cdc3d03fac1eb443755cc032a0488b5053f5b6bbb1a577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:02:59.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112930]: 2024-09-19 08:02:58.879916194 +0000 UTC m=+0.501725017 container attach 58328bc4db3ae42117cdc3d03fac1eb443755cc032a0488b5053f5b6bbb1a577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-19T08:02:59.194 INFO:journalctl@ceph.osd.3.smithi076.stdout:Sep 19 08:02:58 smithi076 podman[112930]: 2024-09-19 08:02:58.970399063 +0000 UTC m=+0.592207877 container died 58328bc4db3ae42117cdc3d03fac1eb443755cc032a0488b5053f5b6bbb1a577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:02:59.636 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:02:59 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:02:59.267+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:02:59.707 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T08:02:59.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:02:59.745 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T08:02:59.745 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T08:02:59.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.4 2024-09-19T08:02:59.773 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:02:59 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:02:59.486+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:02:59.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:02:59 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:02:59.636+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:00.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:02:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:02:59.710+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:00.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:02:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:02:59.643+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:00.105 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:02:59 smithi137 systemd[1]: Stopping Ceph osd.4 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:00.404 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:00 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T08:03:00.104+0000 7fcf867a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:00.404 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:00 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T08:03:00.104+0000 7fcf867a2640 -1 osd.4 100 *** Got signal Terminated *** 2024-09-19T08:03:00.404 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:00 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T08:03:00.104+0000 7fcf867a2640 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:00.661 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:00.228+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:00.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:00 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:00.478+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:00.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:00 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:00.662+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:01.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:00 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:00.748+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:01.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:00 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:00.653+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:01.631 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:01 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:01.201+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:01.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:01 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:01.461+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:01.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:01 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:01.631+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:02.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:01 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:01.753+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:02.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:01 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:01.699+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:02.589 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:02 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:02.206+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:02.589 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:02 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:02.206+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:02.653 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:02 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:02.403+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:02.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:02 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:02.458+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:02.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:02 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:02.589+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:03.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:02 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:02.681+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:03.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:02 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:02.726+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:03.569 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:03 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:03.247+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:03.569 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:03 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:03.247+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:03.904 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:03 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:03.423+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:03.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:03 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:03.423+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:03.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:03 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:03.423+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:03.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:03 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:03.569+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:03.944 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:03 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:03.569+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:04.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:03 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:03.710+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:04.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:03 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:03.711+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:04.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:03 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:03.711+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:04.654 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:04 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4[46636]: 2024-09-19T08:03:04.342+0000 7fcf7edb0640 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:38.843411+0000 front 2024-09-19T08:02:38.843427+0000 (oldest deadline 2024-09-19T08:03:04.143577+0000) 2024-09-19T08:03:04.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:04 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:04.465+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:04.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:04 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:04.461+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:04.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:04 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:04.461+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:04.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:04.293+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:04.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:04.293+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:04.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:04.534+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:04.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:04 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:04.534+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:05.060 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:04 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:04.682+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:05.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:04 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:04.682+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:05.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:04 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:04.716+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:05.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:04 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:04.716+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:05.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:05.337+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:05.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:05.337+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:05.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:05.554+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:05.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:05 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:05.554+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:05.772 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:05 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:05.428+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:05.772 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:05 smithi137 podman[71007]: 2024-09-19 08:03:05.469888999 +0000 UTC m=+5.526690766 container died e5215e76a168f02489181adca61bd17a3b955c96ba3bca61474ccf39cd68b191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T08:03:05.773 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:05 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:05.461+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:05.773 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:05 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:05.461+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:06.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:05 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:05.735+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:06.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:05 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:05.735+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:06.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:05 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:05.735+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:06.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:05 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:05.647+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:06.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:05 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:05.647+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:06.106 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:05 smithi137 podman[71007]: 2024-09-19 08:03:05.855042631 +0000 UTC m=+5.911844408 container cleanup e5215e76a168f02489181adca61bd17a3b955c96ba3bca61474ccf39cd68b191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:03:06.106 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:05 smithi137 bash[71007]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4 2024-09-19T08:03:06.403 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71024]: 2024-09-19 08:03:06.106342243 +0000 UTC m=+0.631558995 container remove e5215e76a168f02489181adca61bd17a3b955c96ba3bca61474ccf39cd68b191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:03:06.678 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71114]: 2024-09-19 08:03:06.324528306 +0000 UTC m=+0.016000742 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:06.679 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71114]: 2024-09-19 08:03:06.424392611 +0000 UTC m=+0.115865036 container create bbf146bfa6864d081c802f14d8f9f09f0a4e0cbc0511ff22bb3c78db60e38adc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T08:03:06.679 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:06 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:06.425+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:06.679 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:06 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:06.423+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:06.679 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:06 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:06.423+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:06.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:06 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:06.367+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:06.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:06 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:06.367+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:06.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:06 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:06.505+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:06.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:06 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:06.505+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:07.060 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:06 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:06.735+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:07.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:06 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:06.735+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:07.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:06 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:06.696+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:07.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:06 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:06.688+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:07.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:06 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:06.688+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:07.154 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71114]: 2024-09-19 08:03:06.679059249 +0000 UTC m=+0.370531682 container init bbf146bfa6864d081c802f14d8f9f09f0a4e0cbc0511ff22bb3c78db60e38adc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T08:03:07.154 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71114]: 2024-09-19 08:03:06.682644832 +0000 UTC m=+0.374117257 container start bbf146bfa6864d081c802f14d8f9f09f0a4e0cbc0511ff22bb3c78db60e38adc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T08:03:07.154 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71114]: 2024-09-19 08:03:06.793528318 +0000 UTC m=+0.485000746 container attach bbf146bfa6864d081c802f14d8f9f09f0a4e0cbc0511ff22bb3c78db60e38adc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T08:03:07.154 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 19 08:03:06 smithi137 podman[71114]: 2024-09-19 08:03:06.872497351 +0000 UTC m=+0.563969781 container died bbf146bfa6864d081c802f14d8f9f09f0a4e0cbc0511ff22bb3c78db60e38adc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:03:07.471 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:07.382+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:07.472 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:07.406+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:07.472 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:07 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:07.406+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:07.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T08:03:07.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:07.584 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T08:03:07.584 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T08:03:07.584 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.5 2024-09-19T08:03:07.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:07.331+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:07.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:07.331+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:07.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:07.510+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:07.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:07 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:07.510+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:07.906 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:07.650+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:07.725+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:07.725+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:07 smithi152 systemd[1]: Stopping Ceph osd.5 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:07.698+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:07.698+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:07.906+0000 7fb9e8437640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:07.906+0000 7fb9e8437640 -1 osd.5 100 *** Got signal Terminated *** 2024-09-19T08:03:07.907 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:07 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:07.906+0000 7fb9e8437640 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:08.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:08.358+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:08.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:08.387+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:08.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:08 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:08.387+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:08.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:08.508+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:08.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:08.508+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:08.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:08.312+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:08.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:08.312+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:09.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:08.633+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:09.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:08.728+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:09.062 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:08.728+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:09.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:08.736+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:09.063 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:08 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:08.736+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:09.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:09 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:09.319+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:09.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:09 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:09.434+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:09.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:09 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:09.434+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:09.693 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:09.287+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:09.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:09.287+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:09.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:09.483+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:09.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:09 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:09.483+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:10.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:09.598+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:10.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:09.781+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:10.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:09.781+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:10.062 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:09.761+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:10.062 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:09 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:09.761+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:10.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:10.293+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:10.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:10.384+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:10.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:10.384+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:10.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:10 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:10.384+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:10.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:10.451+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:10.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:10.451+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:10.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:10.261+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:10.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:10.261+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:10.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:10 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:10.261+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:11.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:10.599+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:11.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:10.808+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:11.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:10.808+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:11.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:10.829+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:11.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:10.829+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:11.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:10 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:10.829+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:11.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:11.276+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:11.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:11.276+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:11.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:11.341+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:11.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:11.341+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:11.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:11 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:11.341+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:11.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:11.408+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:11.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:11.408+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:11.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:11.289+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:11.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:11.289+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:11.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:11 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:11.289+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:12.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:11.609+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:12.061 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:11.609+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:12.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:11.811+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:12.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:11.811+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:12.061 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:11.811+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:47.344943+0000 front 2024-09-19T08:02:47.345057+0000 (oldest deadline 2024-09-19T08:03:11.445120+0000) 2024-09-19T08:03:12.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:11.826+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:12.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:11.826+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:12.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:11 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:11.826+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:12.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:12 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:12.248+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:12.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:12 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:12.248+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:12.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:12 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:12.368+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:12.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:12 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:12.368+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:12.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:12 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:12.368+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:12.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:12.455+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:12.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:12.455+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:12.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:12.274+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:12.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:12.274+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:12.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:12 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:12.274+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:12.833 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:12.570+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:12.834 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:12.570+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:13.311 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:12.833+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:29.242743+0000 front 2024-09-19T08:02:29.242584+0000 (oldest deadline 2024-09-19T08:02:53.342650+0000) 2024-09-19T08:03:13.311 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:12.833+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.744237+0000 front 2024-09-19T08:02:39.744475+0000 (oldest deadline 2024-09-19T08:03:04.444142+0000) 2024-09-19T08:03:13.311 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5[46885]: 2024-09-19T08:03:12.833+0000 7fb9e4a4d640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:47.344943+0000 front 2024-09-19T08:02:47.345057+0000 (oldest deadline 2024-09-19T08:03:11.445120+0000) 2024-09-19T08:03:13.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:12.876+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:13.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:12.876+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:13.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:12 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:12.876+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:13.607 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:13 smithi152 podman[71570]: 2024-09-19 08:03:13.315157455 +0000 UTC m=+5.530355758 container died 59eec485f61fdbf687133ccac57f48d52394975380db8eea2ce43cf568f5bf47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T08:03:13.608 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:13 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:13.561+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:13.608 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:13 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:13.561+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:13.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:13 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:13.292+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:13.655 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:13 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:13.292+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:13.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:13 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:13.322+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:13.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:13 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:13.322+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:13.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:13 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:13.322+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:13.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:13.437+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:13.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:13.437+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:13.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:13.437+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:13.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:13.318+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:13.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:13.318+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:13.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:13.318+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:13.889 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:13 smithi152 podman[71570]: 2024-09-19 08:03:13.706155782 +0000 UTC m=+5.921354078 container cleanup 59eec485f61fdbf687133ccac57f48d52394975380db8eea2ce43cf568f5bf47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T08:03:13.890 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:13 smithi152 bash[71570]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5 2024-09-19T08:03:14.311 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71585]: 2024-09-19 08:03:14.024473807 +0000 UTC m=+0.710410847 container remove 59eec485f61fdbf687133ccac57f48d52394975380db8eea2ce43cf568f5bf47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T08:03:14.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:13 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:13.890+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:14.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:13 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:13.890+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:14.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:13 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:13.890+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:14.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:14 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:14.357+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:14.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:14 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:14.357+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:14.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:14 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:14.357+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:14.556 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:14 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:14.259+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:14.556 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:14 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:14.259+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:14.652 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:14 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:14.547+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:14.652 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:14 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:14.547+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:14.652 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71673]: 2024-09-19 08:03:14.254245319 +0000 UTC m=+0.015896284 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:14.652 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71673]: 2024-09-19 08:03:14.383560864 +0000 UTC m=+0.145211835 container create 4294a9f31490f37bec42ccd1b6d5ebf798981ec155bab84e3894f7aea3201200 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-19T08:03:14.652 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71673]: 2024-09-19 08:03:14.652657513 +0000 UTC m=+0.414308481 container init 4294a9f31490f37bec42ccd1b6d5ebf798981ec155bab84e3894f7aea3201200 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:03:14.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:14.453+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:14.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:14.453+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:14.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:14.453+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:14.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:14.269+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:14.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:14.269+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:14.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:14 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:14.269+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:14.930 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71673]: 2024-09-19 08:03:14.656070176 +0000 UTC m=+0.417721144 container start 4294a9f31490f37bec42ccd1b6d5ebf798981ec155bab84e3894f7aea3201200 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T08:03:14.930 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71673]: 2024-09-19 08:03:14.761042738 +0000 UTC m=+0.522693712 container attach 4294a9f31490f37bec42ccd1b6d5ebf798981ec155bab84e3894f7aea3201200 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:03:14.930 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 19 08:03:14 smithi152 podman[71673]: 2024-09-19 08:03:14.84751187 +0000 UTC m=+0.609162836 container died 4294a9f31490f37bec42ccd1b6d5ebf798981ec155bab84e3894f7aea3201200 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T08:03:15.221 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:14 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:14.930+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:15.222 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:14 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:14.930+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:15.222 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:14 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:14.930+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:15.551 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T08:03:15.573 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:15 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:15.250+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:15.573 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:15 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:15.250+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:15.574 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:15 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:15.374+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:15.574 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:15 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:15.374+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:15.574 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:15 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:15.374+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:15.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:15.595 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T08:03:15.595 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T08:03:15.595 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.6 2024-09-19T08:03:15.622 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:15.244+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:15.623 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:15.244+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:15.623 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:15.244+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:15.623 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:15.491+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:15.623 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:15.491+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:15.623 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:15.491+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:15.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:15 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:15.544+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:15.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:15 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:15.544+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:15.920 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 systemd[1]: Stopping Ceph osd.6 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:16.193 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:15.919+0000 7fc8a26e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:16.193 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:15.919+0000 7fc8a26e1640 -1 osd.6 100 *** Got signal Terminated *** 2024-09-19T08:03:16.193 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:15 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:15.919+0000 7fc8a26e1640 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:16.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:15 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:15.960+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:16.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:15 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:15.960+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:16.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:15 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:15.960+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:16.502 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:16 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:16.248+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:16.502 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:16 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:16.248+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:16.503 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:16 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:16.248+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:16.653 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:16 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:16.377+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:16.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:16 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:16.377+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:16.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:16 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:16.377+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:16.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:16 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:16.261+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:16.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:16 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:16.261+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:16.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:16 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:16.532+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:16.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:16 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:16.532+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:16.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:16 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:16.501+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:16.943 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:16 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:16.501+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:16.944 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:16 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:16.501+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:17.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:16 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:16.951+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:17.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:16 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:16.951+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:17.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:16 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:16.951+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:17.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:17 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:17.240+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:17.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:17 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:17.240+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:17.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:17 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:17.420+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:17.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:17 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:17.420+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:17.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:17 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:17.420+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:17.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:17.473+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:17.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:17.473+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:17.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:17.473+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:17.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:17.293+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:17.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:17.293+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:17.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:17.293+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:17.912 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:17.573+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:17.913 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:17.573+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:18.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:17.913+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:18.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:17.913+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:18.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:17 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:17.913+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:18.655 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:18.247+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:18.655 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:18.247+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:18.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:18.447+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:18.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:18.447+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:18.656 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:18 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:18.447+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:18.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:18.450+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:18.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:18.450+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:18.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:18.450+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:18.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:18.320+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:18.695 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:18.320+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:18.695 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:18.320+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:18.695 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:18 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:18.320+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.795968+0000 front 2024-09-19T08:02:56.795915+0000 (oldest deadline 2024-09-19T08:03:17.896011+0000) 2024-09-19T08:03:18.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:18 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:18.532+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:18.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:18 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:18.532+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:19.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:18 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:18.864+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:19.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:18 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:18.864+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:19.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:18 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:18.864+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:19.584 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:19 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:19.527+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:19.584 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:19 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:19.527+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:19.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:19 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:19.268+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:19.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:19 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:19.268+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:19.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:19 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:19.268+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:19.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:19 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:19.459+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:19.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:19 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:19.459+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:19.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:19 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:19.459+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:19.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:19.420+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:19.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:19.420+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:19.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:19.420+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:19.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:19.271+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:19.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:19.271+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:19.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:19.271+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:19.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:19 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:19.271+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.795968+0000 front 2024-09-19T08:02:56.795915+0000 (oldest deadline 2024-09-19T08:03:17.896011+0000) 2024-09-19T08:03:20.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:19 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:19.863+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:20.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:19 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:19.863+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:20.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:19 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:19.863+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:20.258+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:20.258+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:20.258+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:20.458+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:20.458+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:20.458+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:20.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:20 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:20.458+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:20.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:20.422+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:20.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:20.422+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:20.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:20.422+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:20.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:20.223+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:27.290588+0000 front 2024-09-19T08:02:27.290522+0000 (oldest deadline 2024-09-19T08:02:53.190546+0000) 2024-09-19T08:03:20.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:20.223+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.792120+0000 front 2024-09-19T08:02:37.792193+0000 (oldest deadline 2024-09-19T08:03:01.292063+0000) 2024-09-19T08:03:20.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:20.223+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.293852+0000 front 2024-09-19T08:02:48.293933+0000 (oldest deadline 2024-09-19T08:03:09.393761+0000) 2024-09-19T08:03:20.694 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:20 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6[58677]: 2024-09-19T08:03:20.223+0000 7fc89acef640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.795968+0000 front 2024-09-19T08:02:56.795915+0000 (oldest deadline 2024-09-19T08:03:17.896011+0000) 2024-09-19T08:03:20.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:20 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:20.511+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:20.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:20 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:20.511+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:21.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:20 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:20.865+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:21.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:20 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:20.865+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:21.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:20 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:20.865+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:21.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:21.261+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:21.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:21.261+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:21.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:21.261+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:21.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:21.491+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:21.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:21.491+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:21.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:21.491+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:21.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:21.491+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:21.746 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:21 smithi076 podman[113032]: 2024-09-19 08:03:21.47659499 +0000 UTC m=+5.683926949 container died 3de33611bd14498f8380665da069e9b8eb0536fe59f7054a4228827733d87ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:03:21.746 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:21 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:21.452+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:21.746 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:21 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:21.452+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:21.747 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:21 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:21.452+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:21.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:21 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:21.549+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:21.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:21 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:21.549+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:22.193 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:21 smithi076 podman[113032]: 2024-09-19 08:03:21.920693274 +0000 UTC m=+6.128025223 container cleanup 3de33611bd14498f8380665da069e9b8eb0536fe59f7054a4228827733d87ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:03:22.194 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:21 smithi076 bash[113032]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6 2024-09-19T08:03:22.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:21 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:21.848+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:22.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:21 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:21.848+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:22.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:21 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:21.848+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:22.534 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113047]: 2024-09-19 08:03:22.20583811 +0000 UTC m=+0.730202538 container remove 3de33611bd14498f8380665da069e9b8eb0536fe59f7054a4228827733d87ddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T08:03:22.534 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:22 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:22.436+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:22.534 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:22 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:22.436+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:22.534 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:22 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:22.436+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:22.286+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:22.286+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:22.286+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:22.477+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:22.477+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:22.477+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:22.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:22 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:22.477+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:22.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:22.510+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:22.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:22.510+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:22.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:22.510+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:22.867 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113137]: 2024-09-19 08:03:22.437169063 +0000 UTC m=+0.016049301 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:22.867 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113137]: 2024-09-19 08:03:22.548248391 +0000 UTC m=+0.127128621 container create fef3aa9cf42e10cb6cce79e7785d191b5a394f61fae219ceb9a8dec86d7bed5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:03:22.867 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113137]: 2024-09-19 08:03:22.767485025 +0000 UTC m=+0.346365266 container init fef3aa9cf42e10cb6cce79e7785d191b5a394f61fae219ceb9a8dec86d7bed5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T08:03:22.867 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113137]: 2024-09-19 08:03:22.77084195 +0000 UTC m=+0.349722181 container start fef3aa9cf42e10cb6cce79e7785d191b5a394f61fae219ceb9a8dec86d7bed5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T08:03:22.867 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113137]: 2024-09-19 08:03:22.867548862 +0000 UTC m=+0.446429105 container attach fef3aa9cf42e10cb6cce79e7785d191b5a394f61fae219ceb9a8dec86d7bed5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T08:03:23.194 INFO:journalctl@ceph.osd.6.smithi076.stdout:Sep 19 08:03:22 smithi076 podman[113137]: 2024-09-19 08:03:22.958974943 +0000 UTC m=+0.537855176 container died fef3aa9cf42e10cb6cce79e7785d191b5a394f61fae219ceb9a8dec86d7bed5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:03:23.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:22.821+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:23.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:22.821+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:23.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:22 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:22.821+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:23.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:23.294+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:23.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:23.294+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:23.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:23.294+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:23.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:23.518+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:23.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:23.518+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:23.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:23.518+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:23.655 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:23 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:23.518+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:23.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:23 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:23.397+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:23.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:23 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:23.397+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:23.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:23 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:23.397+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:23.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:23 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:23.397+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:23.719 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T08:03:23.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:23 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:23.535+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:23.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:23 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:23.535+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:23.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:23 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:23.535+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:23.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:23.815 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T08:03:23.815 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T08:03:23.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.7 2024-09-19T08:03:24.155 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:23 smithi137 systemd[1]: Stopping Ceph osd.7 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:24.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:23 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:23.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:24.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:23 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:23.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:24.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:23 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:23.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:24.570 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:24.232+0000 7f00e12a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:24.570 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:24.232+0000 7f00e12a9640 -1 osd.7 100 *** Got signal Terminated *** 2024-09-19T08:03:24.570 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:24.232+0000 7f00e12a9640 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:24.570 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:24.272+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:24.570 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:24.272+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:24.570 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:24.272+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:24.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:24 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:24.381+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:24.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:24 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:24.381+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:24.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:24 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:24.381+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:24.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:24 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:24.381+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:24.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:24 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:24.542+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:24.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:24 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:24.542+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:24.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:24 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:24.542+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:24.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:24.568+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:24.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:24.568+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:24.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:24.568+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:24.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:24 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:24.568+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:25.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:24 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:24.819+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:25.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:24 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:24.819+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:25.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:24 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:24.819+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:25.526 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:25.229+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:25.526 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:25.229+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:25.527 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:25.229+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:25.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:25 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:25.357+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:25.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:25 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:25.357+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:25.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:25 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:25.357+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:25.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:25 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:25.357+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:25.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:25 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:25.534+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:25.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:25 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:25.535+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:25.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:25 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:25.535+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:25.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:25.526+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:25.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:25.526+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:25.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:25.526+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:25.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:25.526+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:26.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:25 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:25.832+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:26.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:25 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:25.832+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:26.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:25 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:25.832+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:26.549 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:26.267+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:26.549 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:26.267+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:26.549 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:26.267+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:26.549 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:26.267+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:03.550885+0000 front 2024-09-19T08:03:03.550855+0000 (oldest deadline 2024-09-19T08:03:25.850995+0000) 2024-09-19T08:03:26.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:26 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:26.352+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:26.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:26 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:26.352+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:26.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:26 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:26.352+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:26.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:26 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:26.352+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:26.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:26 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:26.533+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:26.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:26 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:26.533+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:26.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:26 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:26.533+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:26.849 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:26.548+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:26.849 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:26.548+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:26.849 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:26.548+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:26.849 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:26 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:26.548+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:27.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:26 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:26.830+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:27.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:26 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:26.830+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:27.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:26 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:26.830+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:27.561 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:27.238+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:27.561 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:27.238+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:27.561 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:27.238+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:27.562 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:27.238+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:03.550885+0000 front 2024-09-19T08:03:03.550855+0000 (oldest deadline 2024-09-19T08:03:25.850995+0000) 2024-09-19T08:03:27.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:27.345+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:27.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:27.345+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:27.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:27.345+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:27.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:27.345+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:27.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:27 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:27.345+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:27.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:27.529+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:27.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:27.529+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:27.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:27.529+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:27.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:27.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:27.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:27.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:27.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:27.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:27.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:27.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:27.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:27.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:28.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:27.855+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:28.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:27.855+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:28.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:27 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:27.855+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:28.597 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:28.198+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:28.597 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:28.198+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:28.597 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:28.198+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:28.597 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:28.198+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:03.550885+0000 front 2024-09-19T08:03:03.550855+0000 (oldest deadline 2024-09-19T08:03:25.850995+0000) 2024-09-19T08:03:28.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:28.354+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:28.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:28.354+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:28.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:28.354+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:28.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:28.354+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:28.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:28 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:28.354+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:28.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:28.487+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:28.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:28.487+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:28.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:28.487+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:28.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:28.487+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:28.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:28.596+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:28.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:28.596+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:28.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:28.596+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:28.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:28.596+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:28.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:28 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:28.596+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:29.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:28.825+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:29.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:28.825+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:29.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:28 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:28.825+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:29.589 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:29.210+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.946455+0000 front 2024-09-19T08:02:37.946429+0000 (oldest deadline 2024-09-19T08:03:01.446613+0000) 2024-09-19T08:03:29.589 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:29.210+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.547986+0000 front 2024-09-19T08:02:45.548000+0000 (oldest deadline 2024-09-19T08:03:10.847923+0000) 2024-09-19T08:03:29.589 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:29.210+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:52.549073+0000 front 2024-09-19T08:02:52.549255+0000 (oldest deadline 2024-09-19T08:03:18.949686+0000) 2024-09-19T08:03:29.589 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7[53157]: 2024-09-19T08:03:29.210+0000 7f00dd8bf640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:03.550885+0000 front 2024-09-19T08:03:03.550855+0000 (oldest deadline 2024-09-19T08:03:25.850995+0000) 2024-09-19T08:03:29.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:29.323+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:29.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:29.323+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:29.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:29.323+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:29.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:29.323+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:29.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:29 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:29.323+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:29.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:29.466+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:29.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:29.466+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:29.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:29.466+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:29.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:29.466+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:29.904 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:29 smithi137 podman[71228]: 2024-09-19 08:03:29.679457992 +0000 UTC m=+5.654668724 container died 9a8fbfb4ed3d943d173dfd3b7b8106073a5a0de1cb43e253b1cbaf31d262b14b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T08:03:29.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:29.588+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:29.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:29.588+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:29.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:29.588+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:29.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:29.588+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:29.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:29 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:29.588+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:30.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:29.853+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:30.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:29.853+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:30.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:29 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:29.853+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:30.350 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 podman[71228]: 2024-09-19 08:03:30.082885869 +0000 UTC m=+6.058096600 container cleanup 9a8fbfb4ed3d943d173dfd3b7b8106073a5a0de1cb43e253b1cbaf31d262b14b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T08:03:30.350 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 bash[71228]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7 2024-09-19T08:03:30.654 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 podman[71243]: 2024-09-19 08:03:30.350789197 +0000 UTC m=+0.665785242 container remove 9a8fbfb4ed3d943d173dfd3b7b8106073a5a0de1cb43e253b1cbaf31d262b14b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:03:30.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:30.542+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:30.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:30.542+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:30.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:30.542+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:30.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:30.542+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:30.654 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:30 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:30.542+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:30.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:30.300+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:30.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:30.300+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:30.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:30.300+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:30.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:30.300+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:30.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:30 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:30.300+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:30.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:30.443+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:30.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:30.443+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:30.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:30.443+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:30.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:30.443+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:30.970 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 podman[71334]: 2024-09-19 08:03:30.600488107 +0000 UTC m=+0.015956799 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:30.970 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 podman[71334]: 2024-09-19 08:03:30.726734367 +0000 UTC m=+0.142203059 container create 45106b78c717ed71f2615de45e9dbe7b2c63206f3e63b0bc491c80444dd5d3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T08:03:30.970 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 podman[71334]: 2024-09-19 08:03:30.971063533 +0000 UTC m=+0.386532226 container init 45106b78c717ed71f2615de45e9dbe7b2c63206f3e63b0bc491c80444dd5d3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T08:03:31.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:30.893+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:31.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:30.893+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:31.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:30.893+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:31.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:30 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:30.893+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:31.404 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:30 smithi137 podman[71334]: 2024-09-19 08:03:30.974500292 +0000 UTC m=+0.389968985 container start 45106b78c717ed71f2615de45e9dbe7b2c63206f3e63b0bc491c80444dd5d3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T08:03:31.404 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:31 smithi137 podman[71334]: 2024-09-19 08:03:31.079398809 +0000 UTC m=+0.494867502 container attach 45106b78c717ed71f2615de45e9dbe7b2c63206f3e63b0bc491c80444dd5d3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:03:31.404 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 19 08:03:31 smithi137 podman[71334]: 2024-09-19 08:03:31.160472557 +0000 UTC m=+0.575941261 container died 45106b78c717ed71f2615de45e9dbe7b2c63206f3e63b0bc491c80444dd5d3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T08:03:31.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:31.346+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:31.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:31.346+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:31.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:31.346+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:31.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:31.346+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:31.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:31 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:31.346+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:31.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:31.440+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:31.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:31.440+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:31.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:31.440+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:31.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:31.440+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:31.874 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:31.569+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:31.874 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:31.569+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:31.874 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:31.569+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:31.875 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:31.569+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:31.875 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:31 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:31.569+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:31.903 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T08:03:31.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:31.941 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T08:03:31.942 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T08:03:31.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.8 2024-09-19T08:03:32.258 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:31 smithi152 systemd[1]: Stopping Ceph osd.8 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:32.258 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:31.927+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:32.258 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:31.927+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:32.258 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:31.927+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:32.259 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:31 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:31.927+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.257+0000 7ff965b1d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.257+0000 7ff965b1d640 -1 osd.8 100 *** Got signal Terminated *** 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.257+0000 7ff965b1d640 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.483+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.483+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.483+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:32.561 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:32.483+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:32.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:32 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:32.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:32.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:32 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:32.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:32.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:32 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:32.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:32.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:32 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:32.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:32.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:32 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:32.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:32.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:32.604+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:32.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:32.604+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:32.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:32.604+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:32.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:32.604+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:32.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:32.604+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:33.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:32.958+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:33.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:32.958+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:33.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:32.958+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:33.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:32 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:32.958+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:33.563 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:33.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:33.563 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:33.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:33.563 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:33.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:33.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:33.382+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:33.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:33.382+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:33.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:33.382+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:33.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:33.382+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:33.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:33 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:33.382+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:33.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:33.479+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:33.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:33.479+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:33.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:33.479+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:33.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:33.479+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:33.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:33.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:33.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:33 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:33.561+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:34.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:33.967+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:34.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:33.967+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:34.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:33.967+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:34.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:33 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:33.967+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:34.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:34 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:34.341+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:34.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:34 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:34.341+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:34.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:34 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:34.341+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:34.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:34 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:34.341+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:34.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:34 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:34.341+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:34.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:34 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:34.341+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:34.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:34.438+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:34.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:34.438+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:34.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:34.438+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:34.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:34.438+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:34.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:34.603+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:34.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:34.603+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:34.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:34.603+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:34.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:34.603+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:34.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:34.603+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:34.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:34 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:34.603+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:35.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:34.954+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:35.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:34.954+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:35.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:34.954+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:35.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:34.954+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:35.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:34 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:34.954+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:35.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:35 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:35.305+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:35.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:35 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:35.305+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:35.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:35 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:35.305+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:35.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:35 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:35.305+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:35.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:35 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:35.305+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:35.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:35 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:35.305+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:35.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:35.432+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:35.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:35.432+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:35.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:35.432+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:35.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:35.432+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:35.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:35 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:35.432+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:11.777033+0000 front 2024-09-19T08:03:11.776963+0000 (oldest deadline 2024-09-19T08:03:35.277086+0000) 2024-09-19T08:03:35.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:35.617+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:35.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:35.617+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:35.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:35.617+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:35.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:35.617+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:35.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:35.617+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:35.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:35 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:35.617+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:36.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:35.998+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:36.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:35.998+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:36.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:35.998+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:36.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:35.998+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:36.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:35.998+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:36.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:36 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:36.274+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:36.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:36 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:36.274+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:36.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:36 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:36.274+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:36.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:36 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:36.274+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:36.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:36 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:36.274+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:36.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:36 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:36.274+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:36.810 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:36.413+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:34.872693+0000 front 2024-09-19T08:02:34.872581+0000 (oldest deadline 2024-09-19T08:03:04.873107+0000) 2024-09-19T08:03:36.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:36.413+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:48.374147+0000 front 2024-09-19T08:02:48.374093+0000 (oldest deadline 2024-09-19T08:03:11.274288+0000) 2024-09-19T08:03:36.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:36.413+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.475747+0000 front 2024-09-19T08:02:56.475848+0000 (oldest deadline 2024-09-19T08:03:22.375658+0000) 2024-09-19T08:03:36.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:36.413+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.376303+0000 front 2024-09-19T08:03:02.376317+0000 (oldest deadline 2024-09-19T08:03:27.676182+0000) 2024-09-19T08:03:36.811 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8[53819]: 2024-09-19T08:03:36.413+0000 7ff962133640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:11.777033+0000 front 2024-09-19T08:03:11.776963+0000 (oldest deadline 2024-09-19T08:03:35.277086+0000) 2024-09-19T08:03:36.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:36 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:36.635+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:36.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:36 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:36.635+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:36.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:36 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:36.635+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:36.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:36 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:36.635+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:36.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:36 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:36.635+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:36.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:36 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:36.635+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:37.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:36.995+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:37.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:36.995+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:37.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:36.995+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:37.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:36.995+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:37.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:36 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:36.995+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:37.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:37 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:37.311+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:37.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:37 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:37.311+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:37.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:37 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:37.311+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:37.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:37 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:37.311+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:37.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:37 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:37.311+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:37.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:37 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:37.311+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:37.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:37 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:37.638+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:37.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:37 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:37.638+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:37.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:37 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:37.638+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:37.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:37 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:37.638+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:37.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:37 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:37.638+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:37.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:37 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:37.638+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:37.942 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:37 smithi152 podman[71785]: 2024-09-19 08:03:37.649378313 +0000 UTC m=+5.509948707 container died d362635c1bde9e83e087272dea28c2ce809503e642ea57e5064117fc02de6c8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T08:03:38.283 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 podman[71785]: 2024-09-19 08:03:38.041069702 +0000 UTC m=+5.901640096 container cleanup d362635c1bde9e83e087272dea28c2ce809503e642ea57e5064117fc02de6c8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T08:03:38.284 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 bash[71785]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8 2024-09-19T08:03:38.284 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:38.029+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:38.284 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:38.029+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:38.284 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:38.029+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:38.284 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:38.029+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:38.284 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:38.029+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:38.560 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 podman[71801]: 2024-09-19 08:03:38.283986662 +0000 UTC m=+0.630678344 container remove d362635c1bde9e83e087272dea28c2ce809503e642ea57e5064117fc02de6c8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T08:03:38.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:38 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:38.360+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:38.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:38 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:38.360+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:38.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:38 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:38.360+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:38.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:38 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:38.360+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:38.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:38 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:38.360+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:38.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:38 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:38.360+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:38.895 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 podman[71886]: 2024-09-19 08:03:38.519941451 +0000 UTC m=+0.016084787 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:38.895 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 podman[71886]: 2024-09-19 08:03:38.643143844 +0000 UTC m=+0.139287212 container create 5e9d789063d68de96fa75586e32349acaf0a2817067228b24cf45492073c89d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:03:38.895 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 podman[71886]: 2024-09-19 08:03:38.895651001 +0000 UTC m=+0.391794327 container init 5e9d789063d68de96fa75586e32349acaf0a2817067228b24cf45492073c89d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T08:03:38.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:38 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:38.652+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:38.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:38 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:38.652+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:38.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:38 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:38.652+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:38.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:38 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:38.652+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:38.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:38 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:38.652+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:38.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:38 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:38.652+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:38 smithi152 podman[71886]: 2024-09-19 08:03:38.899099368 +0000 UTC m=+0.395242691 container start 5e9d789063d68de96fa75586e32349acaf0a2817067228b24cf45492073c89d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:39 smithi152 podman[71886]: 2024-09-19 08:03:39.00409793 +0000 UTC m=+0.500241265 container attach 5e9d789063d68de96fa75586e32349acaf0a2817067228b24cf45492073c89d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.8.smithi152.stdout:Sep 19 08:03:39 smithi152 podman[71886]: 2024-09-19 08:03:39.088709699 +0000 UTC m=+0.584853033 container died 5e9d789063d68de96fa75586e32349acaf0a2817067228b24cf45492073c89d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.040+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.040+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.040+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:39.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.040+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:39.312 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.040+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:39.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:39.372+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:39.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:39.372+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:39.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:39.372+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:39.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:39.372+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:39.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:39.372+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:39.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:39.372+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:39.762 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T08:03:39.801 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:39.801 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T08:03:39.801 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T08:03:39.801 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.9 2024-09-19T08:03:39.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:39 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:39.625+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:39.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:39 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:39.625+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:39.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:39 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:39.625+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:39.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:39 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:39.625+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:39.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:39 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:39.625+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:39.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:39 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:39.625+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:40.116 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:39 smithi076 systemd[1]: Stopping Ceph osd.9 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:40.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.991+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:40.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.991+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:40.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.991+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:40.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.991+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:40.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:39 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:39.991+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:40.387 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.115+0000 7fab2a58d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:40.387 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.115+0000 7fab2a58d640 -1 osd.9 100 *** Got signal Terminated *** 2024-09-19T08:03:40.387 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.115+0000 7fab2a58d640 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:40.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.388+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:40.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.388+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:40.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.388+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:40.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.388+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:40.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.388+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:40.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:40 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:40.388+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:41.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:40 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:40.656+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:41.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:40 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:40.656+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:41.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:40 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:40.656+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:41.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:40 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:40.656+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:41.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:40 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:40.656+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:41.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:40 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:40.656+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:41.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:40 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:40.953+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:41.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:40 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:40.953+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:41.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:40 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:40.953+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:41.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:40 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:40.953+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:41.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:40 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:40.953+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:41.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:41.377+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:41.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:41.377+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:41.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:41.377+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:41.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:41.377+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:41.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:41.377+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:41.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:41 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:41.377+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:41.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:41 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:41.643+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:41.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:41 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:41.643+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:41.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:41 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:41.643+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:41.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:41 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:41.643+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:41.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:41 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:41.643+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:41.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:41 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:41.643+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:42.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:41.908+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:42.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:41.908+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:42.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:41.908+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:42.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:41.908+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:42.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:41.908+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:42.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:42 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:42.398+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:42.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:42 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:42.398+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:42.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:42 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:42.398+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:42.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:42 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:42.398+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:42.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:42 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:42.398+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:42.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:42 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:42.398+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:42.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:42.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:42.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:42.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:42.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:42.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:42.905 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:42 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:42.672+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:43.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:42.938+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:43.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:42.938+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:43.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:42.938+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:43.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:42.938+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:43.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:42.938+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:43.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:42 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:42.938+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:43.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:43.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:43.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:43.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:43.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:43.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:43.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:43.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:43.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:43.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:43.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:43 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:43.375+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:44.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:43 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:43.721+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:44.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:43.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:44.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:43.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:44.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:43.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:44.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:43.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:44.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:43.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:44.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:43 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:43.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:44.693 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:44 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:44.336+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.615128+0000 front 2024-09-19T08:02:30.615565+0000 (oldest deadline 2024-09-19T08:02:54.715310+0000) 2024-09-19T08:03:44.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:44 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:44.336+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.016489+0000 front 2024-09-19T08:02:37.016582+0000 (oldest deadline 2024-09-19T08:03:02.817141+0000) 2024-09-19T08:03:44.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:44 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:44.336+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.618743+0000 front 2024-09-19T08:02:45.618780+0000 (oldest deadline 2024-09-19T08:03:12.619271+0000) 2024-09-19T08:03:44.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:44 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:44.336+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:56.720123+0000 front 2024-09-19T08:02:56.720057+0000 (oldest deadline 2024-09-19T08:03:22.620219+0000) 2024-09-19T08:03:44.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:44 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:44.336+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:02.620920+0000 front 2024-09-19T08:03:02.621119+0000 (oldest deadline 2024-09-19T08:03:27.320746+0000) 2024-09-19T08:03:44.694 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:44 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9[65628]: 2024-09-19T08:03:44.336+0000 7fab22b9b640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.722139+0000 front 2024-09-19T08:03:10.722151+0000 (oldest deadline 2024-09-19T08:03:34.222224+0000) 2024-09-19T08:03:45.055 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:45.055 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:45.055 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:45.055 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:45.055 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:45.056 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:45.056 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:44 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:44.695+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:45.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:44 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:44.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:45.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:44 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:44.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:45.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:44 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:44.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:45.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:44 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:44.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:45.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:44 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:44.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:45.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:44 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:44.914+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:45.824 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:45 smithi076 podman[113242]: 2024-09-19 08:03:45.55867195 +0000 UTC m=+5.559469909 container died 2ba626e62d076afc7c239ab66452eea295b9267a7980ed8f88d4e025c534db1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:03:46.150 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:45 smithi076 podman[113242]: 2024-09-19 08:03:45.982524884 +0000 UTC m=+5.983322839 container cleanup 2ba626e62d076afc7c239ab66452eea295b9267a7980ed8f88d4e025c534db1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:03:46.150 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:45 smithi076 bash[113242]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9 2024-09-19T08:03:46.153 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:46.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:46.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:46.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:46.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:46.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:46.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:45 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:45.733+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:46.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:45.932+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:46.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:45.932+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:46.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:45.932+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:46.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:45.932+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:46.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:45.932+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:46.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:45.932+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:46.443 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113257]: 2024-09-19 08:03:46.150520468 +0000 UTC m=+0.590058658 container remove 2ba626e62d076afc7c239ab66452eea295b9267a7980ed8f88d4e025c534db1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:03:46.878 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113347]: 2024-09-19 08:03:46.452101705 +0000 UTC m=+0.016506246 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:46.878 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113347]: 2024-09-19 08:03:46.567936512 +0000 UTC m=+0.132341043 container create 2d02f012698ef1e24839d79bdf0978b86d936b1d4c8967278fa45194323149ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:03:46.878 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113347]: 2024-09-19 08:03:46.795426249 +0000 UTC m=+0.359830778 container init 2d02f012698ef1e24839d79bdf0978b86d936b1d4c8967278fa45194323149ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T08:03:46.878 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113347]: 2024-09-19 08:03:46.7987627 +0000 UTC m=+0.363167229 container start 2d02f012698ef1e24839d79bdf0978b86d936b1d4c8967278fa45194323149ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T08:03:46.879 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113347]: 2024-09-19 08:03:46.878942284 +0000 UTC m=+0.443346812 container attach 2d02f012698ef1e24839d79bdf0978b86d936b1d4c8967278fa45194323149ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:47.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:46 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:46.702+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:47.193 INFO:journalctl@ceph.osd.9.smithi076.stdout:Sep 19 08:03:46 smithi076 podman[113347]: 2024-09-19 08:03:46.984069894 +0000 UTC m=+0.548474426 container died 2d02f012698ef1e24839d79bdf0978b86d936b1d4c8967278fa45194323149ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T08:03:47.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:46.923+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:47.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:46.923+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:47.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:46.923+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:47.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:46.923+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:47.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:46.923+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:47.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:46 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:46.923+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:47.558 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T08:03:47.599 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:47.599 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T08:03:47.599 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T08:03:47.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.10 2024-09-19T08:03:47.902 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 systemd[1]: Stopping Ceph osd.10 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:47.902 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:47.902 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:47.902 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:47.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:47.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:47.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:47.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.668+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:47.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.901+0000 7fac07b4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:47.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.901+0000 7fac07b4a640 -1 osd.10 100 *** Got signal Terminated *** 2024-09-19T08:03:47.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:47 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:47.901+0000 7fac07b4a640 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:48.310 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:47 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:47.878+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:48.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:47 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:47.878+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:48.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:47 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:47.878+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:48.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:47 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:47.878+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:48.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:47 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:47.878+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:48.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:47 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:47.878+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:49.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:48 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:48.683+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:49.212 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:48 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:48.856+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:49.212 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:48 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:48.856+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:49.212 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:48 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:48.856+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:49.212 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:48 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:48.856+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:49.212 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:48 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:48.856+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:49.212 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:48 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:48.856+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:50.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:49 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:49.675+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:50.313 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:49.823+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:50.313 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:49.823+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:50.313 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:49.823+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:50.313 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:49.823+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:50.314 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:49.823+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:50.314 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:49.823+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:51.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:51.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:51.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:51.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:51.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:51.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:51.155 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:50 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:50.693+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:51.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:50 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:50.849+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:51.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:50 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:50.849+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:51.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:50 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:50.849+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:51.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:50 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:50.849+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:51.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:50 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:50.849+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:51.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:50 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:50.849+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:52.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:51 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:51.680+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:52.311 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:51 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:51.817+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:53.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:52 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:52.792+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:31.133681+0000 front 2024-09-19T08:02:31.133531+0000 (oldest deadline 2024-09-19T08:02:57.033448+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:39.934409+0000 front 2024-09-19T08:02:39.934442+0000 (oldest deadline 2024-09-19T08:03:02.834531+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:44.535191+0000 front 2024-09-19T08:02:44.535255+0000 (oldest deadline 2024-09-19T08:03:10.335974+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6814 osd.3 since back 2024-09-19T08:02:51.937809+0000 front 2024-09-19T08:02:51.937752+0000 (oldest deadline 2024-09-19T08:03:19.538071+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:03:00.539271+0000 front 2024-09-19T08:03:00.539295+0000 (oldest deadline 2024-09-19T08:03:26.939928+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:10.341491+0000 front 2024-09-19T08:03:10.341462+0000 (oldest deadline 2024-09-19T08:03:33.841179+0000) 2024-09-19T08:03:53.154 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:52 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10[59694]: 2024-09-19T08:03:52.663+0000 7fac04160640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.142199+0000 front 2024-09-19T08:03:19.142253+0000 (oldest deadline 2024-09-19T08:03:42.642034+0000) 2024-09-19T08:03:53.560 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:53 smithi137 podman[71460]: 2024-09-19 08:03:53.297877342 +0000 UTC m=+5.499586069 container died a8f6d408d032136f3eaff4359e165dc1f5069d87ff7057466de4c0d9ad953e59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T08:03:53.903 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:53 smithi137 podman[71460]: 2024-09-19 08:03:53.659832522 +0000 UTC m=+5.861541242 container cleanup a8f6d408d032136f3eaff4359e165dc1f5069d87ff7057466de4c0d9ad953e59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T08:03:53.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:53 smithi137 bash[71460]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10 2024-09-19T08:03:54.060 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:54.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:53 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:53.752+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:54.230 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:53 smithi137 podman[71478]: 2024-09-19 08:03:53.910825442 +0000 UTC m=+0.609135621 container remove a8f6d408d032136f3eaff4359e165dc1f5069d87ff7057466de4c0d9ad953e59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:03:54.554 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:54 smithi137 podman[71566]: 2024-09-19 08:03:54.133184612 +0000 UTC m=+0.015999507 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:03:54.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:54 smithi137 podman[71566]: 2024-09-19 08:03:54.244970459 +0000 UTC m=+0.127785357 container create 7d9342830f9d00346a4b5af1af5c49f3941ddaa7f7ebb04a5c33133328c624fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T08:03:54.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:54 smithi137 podman[71566]: 2024-09-19 08:03:54.47223813 +0000 UTC m=+0.355053025 container init 7d9342830f9d00346a4b5af1af5c49f3941ddaa7f7ebb04a5c33133328c624fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T08:03:54.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:54 smithi137 podman[71566]: 2024-09-19 08:03:54.475578725 +0000 UTC m=+0.358393630 container start 7d9342830f9d00346a4b5af1af5c49f3941ddaa7f7ebb04a5c33133328c624fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:03:54.555 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:54 smithi137 podman[71566]: 2024-09-19 08:03:54.555292432 +0000 UTC m=+0.438107345 container attach 7d9342830f9d00346a4b5af1af5c49f3941ddaa7f7ebb04a5c33133328c624fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:03:54.904 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 19 08:03:54 smithi137 podman[71566]: 2024-09-19 08:03:54.668747026 +0000 UTC m=+0.551561930 container died 7d9342830f9d00346a4b5af1af5c49f3941ddaa7f7ebb04a5c33133328c624fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:55.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:54 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:54.704+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:55.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T08:03:55.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:03:55.267 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T08:03:55.267 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T08:03:55.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.11 2024-09-19T08:03:55.561 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 systemd[1]: Stopping Ceph osd.11 for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:03:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.591+0000 7fd6c4933640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:03:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.591+0000 7fd6c4933640 -1 osd.11 100 *** Got signal Terminated *** 2024-09-19T08:03:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.591+0000 7fd6c4933640 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:03:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:56.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:56.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:56.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:56.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:56.062 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:55 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:55.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:57.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:56 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:56.642+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:58.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:57 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:57.662+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:03:59.061 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:58 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:58.693+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6820 osd.8 since back 2024-09-19T08:03:36.705370+0000 front 2024-09-19T08:03:36.705383+0000 (oldest deadline 2024-09-19T08:03:57.805431+0000) 2024-09-19T08:04:00.073 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6806 osd.0 since back 2024-09-19T08:02:30.794837+0000 front 2024-09-19T08:02:30.794864+0000 (oldest deadline 2024-09-19T08:02:53.095042+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-19T08:02:37.096714+0000 front 2024-09-19T08:02:37.096701+0000 (oldest deadline 2024-09-19T08:03:02.996646+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6804 osd.2 since back 2024-09-19T08:02:45.297659+0000 front 2024-09-19T08:02:45.297583+0000 (oldest deadline 2024-09-19T08:03:09.997642+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-19T08:02:59.399252+0000 front 2024-09-19T08:02:59.399211+0000 (oldest deadline 2024-09-19T08:03:29.999937+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6812 osd.5 since back 2024-09-19T08:03:12.701931+0000 front 2024-09-19T08:03:12.702004+0000 (oldest deadline 2024-09-19T08:03:34.402098+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.76:6822 osd.6 since back 2024-09-19T08:03:19.103311+0000 front 2024-09-19T08:03:19.103330+0000 (oldest deadline 2024-09-19T08:03:42.603336+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-19T08:03:27.904479+0000 front 2024-09-19T08:03:27.904493+0000 (oldest deadline 2024-09-19T08:03:51.404362+0000) 2024-09-19T08:04:00.074 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:03:59 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11[60363]: 2024-09-19T08:03:59.658+0000 7fd6bcf41640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.152:6820 osd.8 since back 2024-09-19T08:03:36.705370+0000 front 2024-09-19T08:03:36.705383+0000 (oldest deadline 2024-09-19T08:03:57.805431+0000) 2024-09-19T08:04:01.367 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:01 smithi152 podman[71999]: 2024-09-19 08:04:01.097429494 +0000 UTC m=+5.629857569 container died c1c5ba687de36f921bdc145ff77645bb9ed0582fe12cb3ad0bcae1318bc9fff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T08:04:01.717 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:01 smithi152 podman[71999]: 2024-09-19 08:04:01.467258508 +0000 UTC m=+5.999686625 container cleanup c1c5ba687de36f921bdc145ff77645bb9ed0582fe12cb3ad0bcae1318bc9fff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:04:01.718 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:01 smithi152 bash[71999]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11 2024-09-19T08:04:02.043 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:01 smithi152 podman[72014]: 2024-09-19 08:04:01.718295233 +0000 UTC m=+0.623285818 container remove c1c5ba687de36f921bdc145ff77645bb9ed0582fe12cb3ad0bcae1318bc9fff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:04:02.295 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:02 smithi152 podman[72101]: 2024-09-19 08:04:01.946729221 +0000 UTC m=+0.016544543 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:04:02.295 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:02 smithi152 podman[72101]: 2024-09-19 08:04:02.060649284 +0000 UTC m=+0.130464590 container create d7775d90edecf203d04645a2f5216c9fda6af28d509e15b7985a3263f49dad07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T08:04:02.296 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:02 smithi152 podman[72101]: 2024-09-19 08:04:02.296168967 +0000 UTC m=+0.365984271 container init d7775d90edecf203d04645a2f5216c9fda6af28d509e15b7985a3263f49dad07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T08:04:02.561 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:02 smithi152 podman[72101]: 2024-09-19 08:04:02.299355207 +0000 UTC m=+0.369170515 container start d7775d90edecf203d04645a2f5216c9fda6af28d509e15b7985a3263f49dad07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:04:02.561 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:02 smithi152 podman[72101]: 2024-09-19 08:04:02.379358579 +0000 UTC m=+0.449173902 container attach d7775d90edecf203d04645a2f5216c9fda6af28d509e15b7985a3263f49dad07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T08:04:02.561 INFO:journalctl@ceph.osd.11.smithi152.stdout:Sep 19 08:04:02 smithi152 podman[72101]: 2024-09-19 08:04:02.488512785 +0000 UTC m=+0.558328091 container died d7775d90edecf203d04645a2f5216c9fda6af28d509e15b7985a3263f49dad07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T08:04:03.130 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T08:04:03.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:03.169 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T08:04:03.170 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T08:04:03.170 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.a 2024-09-19T08:04:03.459 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 08:04:03 smithi076 systemd[1]: Stopping Ceph mds.a for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:03.943 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 08:04:03 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a[72534]: 2024-09-19T08:04:03.459+0000 7f7b32fd3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:03.944 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 08:04:03 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a[72534]: 2024-09-19T08:04:03.459+0000 7f7b32fd3640 -1 mds.a *** got signal Terminated *** 2024-09-19T08:04:07.193 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 08:04:06 smithi076 podman[113449]: 2024-09-19 08:04:06.932659225 +0000 UTC m=+3.573317856 container died dd7a2276da063ea75228cf2ea2d579688d6a80adacf4e2101df83f6f99b9a80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T08:04:07.542 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 08:04:07 smithi076 podman[113449]: 2024-09-19 08:04:07.292106006 +0000 UTC m=+3.932764631 container cleanup dd7a2276da063ea75228cf2ea2d579688d6a80adacf4e2101df83f6f99b9a80e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T08:04:07.542 INFO:journalctl@ceph.mds.a.smithi076.stdout:Sep 19 08:04:07 smithi076 bash[113449]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-a 2024-09-19T08:04:07.724 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T08:04:07.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:07.759 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T08:04:07.759 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T08:04:07.759 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.d 2024-09-19T08:04:08.087 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:07 smithi076 systemd[1]: Stopping Ceph mds.d for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:08.443 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d[71300]: 2024-09-19T08:04:08.087+0000 7f4f270a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:08.444 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:08 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d[71300]: 2024-09-19T08:04:08.087+0000 7f4f270a2640 -1 mds.d *** got signal Terminated *** 2024-09-19T08:04:12.193 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:11 smithi076 podman[113569]: 2024-09-19 08:04:11.887182386 +0000 UTC m=+3.899802412 container died 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T08:04:12.496 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:12 smithi076 podman[113569]: 2024-09-19 08:04:12.32101415 +0000 UTC m=+4.333634180 container cleanup 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T08:04:12.497 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:12 smithi076 bash[113569]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d 2024-09-19T08:04:12.725 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T08:04:12.747 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:12 smithi076 podman[113581]: 2024-09-19 08:04:12.497182259 +0000 UTC m=+0.608475947 container remove 3bfeb1ee1123f99e4868c30fb1f1c504fc0a1668d61ce3e4288aa35015a0bd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:04:12.747 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:12 smithi076 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-19T08:04:12.747 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:12 smithi076 systemd[1]: Stopped Ceph mds.d for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T08:04:12.747 INFO:journalctl@ceph.mds.d.smithi076.stdout:Sep 19 08:04:12 smithi076 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.048s CPU time. 2024-09-19T08:04:12.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:12.758 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T08:04:12.758 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T08:04:12.758 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.g 2024-09-19T08:04:13.082 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 08:04:12 smithi076 systemd[1]: Stopping Ceph mds.g for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:13.443 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 08:04:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-g[72185]: 2024-09-19T08:04:13.082+0000 7f365d8ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:13.443 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 08:04:13 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-g[72185]: 2024-09-19T08:04:13.082+0000 7f365d8ec640 -1 mds.g *** got signal Terminated *** 2024-09-19T08:04:16.674 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 08:04:16 smithi076 podman[113688]: 2024-09-19 08:04:16.402657558 +0000 UTC m=+3.429288398 container died cd8bc9220e935c2565b31ce7caa06cfc21eea629badc24897f011430f28d57f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T08:04:16.944 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 08:04:16 smithi076 podman[113688]: 2024-09-19 08:04:16.757942916 +0000 UTC m=+3.784573750 container cleanup cd8bc9220e935c2565b31ce7caa06cfc21eea629badc24897f011430f28d57f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:04:16.944 INFO:journalctl@ceph.mds.g.smithi076.stdout:Sep 19 08:04:16 smithi076 bash[113688]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-g 2024-09-19T08:04:17.194 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T08:04:17.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:17.226 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T08:04:17.226 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T08:04:17.226 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.j 2024-09-19T08:04:17.693 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:17 smithi076 systemd[1]: Stopping Ceph mds.j for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:17.694 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j[70903]: 2024-09-19T08:04:17.536+0000 7f668b2d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:17.694 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:17 smithi076 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j[70903]: 2024-09-19T08:04:17.536+0000 7f668b2d4640 -1 mds.j *** got signal Terminated *** 2024-09-19T08:04:20.443 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:20 smithi076 podman[113806]: 2024-09-19 08:04:20.185872975 +0000 UTC m=+2.745221082 container died fbf07994bb88e537c5caeee770e16f90141426b4d2e3554ccf6189e4662ef2d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T08:04:20.779 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:20 smithi076 podman[113806]: 2024-09-19 08:04:20.612049902 +0000 UTC m=+3.171398050 container cleanup fbf07994bb88e537c5caeee770e16f90141426b4d2e3554ccf6189e4662ef2d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:04:20.779 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:20 smithi076 bash[113806]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j 2024-09-19T08:04:21.028 DEBUG:teuthology.orchestra.run.smithi076:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T08:04:21.049 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:20 smithi076 podman[113818]: 2024-09-19 08:04:20.780019705 +0000 UTC m=+0.594224620 container remove fbf07994bb88e537c5caeee770e16f90141426b4d2e3554ccf6189e4662ef2d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T08:04:21.049 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:21 smithi076 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-19T08:04:21.049 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:21 smithi076 systemd[1]: Stopped Ceph mds.j for 6aad871c-765a-11ef-bceb-c7b262605968. 2024-09-19T08:04:21.049 INFO:journalctl@ceph.mds.j.smithi076.stdout:Sep 19 08:04:21 smithi076 systemd[1]: ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.j.service: Consumed 1.041s CPU time. 2024-09-19T08:04:21.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:21.059 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T08:04:21.060 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T08:04:21.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.b 2024-09-19T08:04:21.403 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:04:21 smithi137 systemd[1]: Stopping Ceph mds.b for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:21.904 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:04:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b[65349]: 2024-09-19T08:04:21.424+0000 7f05be25e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:21.904 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:04:21 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b[65349]: 2024-09-19T08:04:21.424+0000 7f05be25e640 -1 mds.b *** got signal Terminated *** 2024-09-19T08:04:24.250 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:04:23 smithi137 podman[71668]: 2024-09-19 08:04:23.934467738 +0000 UTC m=+2.684227389 container died 98e77d667f46910cd482f922ca2662bb0dea6a66071100bd3a3350ea7b15298b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T08:04:24.558 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:04:24 smithi137 podman[71668]: 2024-09-19 08:04:24.341110447 +0000 UTC m=+3.090870085 container cleanup 98e77d667f46910cd482f922ca2662bb0dea6a66071100bd3a3350ea7b15298b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:04:24.558 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 19 08:04:24 smithi137 bash[71668]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-b 2024-09-19T08:04:24.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T08:04:24.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:24.723 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T08:04:24.723 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T08:04:24.724 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.e 2024-09-19T08:04:25.154 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:24 smithi137 systemd[1]: Stopping Ceph mds.e for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:25.154 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e[64733]: 2024-09-19T08:04:25.053+0000 7f3dcd784640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:25.154 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:25 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e[64733]: 2024-09-19T08:04:25.053+0000 7f3dcd784640 -1 mds.e *** got signal Terminated *** 2024-09-19T08:04:26.904 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:26 smithi137 podman[71800]: 2024-09-19 08:04:26.629128284 +0000 UTC m=+1.680433756 container died c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T08:04:27.241 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:26 smithi137 podman[71800]: 2024-09-19 08:04:26.936433104 +0000 UTC m=+1.987738563 container cleanup c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T08:04:27.242 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:26 smithi137 bash[71800]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e 2024-09-19T08:04:27.242 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 19 08:04:27 smithi137 podman[71814]: 2024-09-19 08:04:27.12954087 +0000 UTC m=+0.498653079 container remove c777e08e6409373b6e92c95ed383b54ab604a14c19f5ae4209bc1b2585ea64bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T08:04:27.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T08:04:27.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:27.288 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T08:04:27.289 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T08:04:27.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.h 2024-09-19T08:04:27.615 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:27 smithi137 systemd[1]: Stopping Ceph mds.h for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:27.903 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h[65035]: 2024-09-19T08:04:27.614+0000 7f86c6607640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:27.904 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:27 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h[65035]: 2024-09-19T08:04:27.614+0000 7f86c6607640 -1 mds.h *** got signal Terminated *** 2024-09-19T08:04:31.904 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:31 smithi137 podman[71921]: 2024-09-19 08:04:31.620017086 +0000 UTC m=+4.111974097 container died 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True) 2024-09-19T08:04:32.265 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:32 smithi137 podman[71921]: 2024-09-19 08:04:32.047967179 +0000 UTC m=+4.539924213 container cleanup 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:04:32.265 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:32 smithi137 bash[71921]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h 2024-09-19T08:04:32.515 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 19 08:04:32 smithi137 podman[71935]: 2024-09-19 08:04:32.265787893 +0000 UTC m=+0.638735978 container remove 5ef98c5b07874377c437b50519bed840085481680946677dd2eb70b52a44d4da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T08:04:32.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T08:04:32.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:32.551 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T08:04:32.551 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T08:04:32.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.k 2024-09-19T08:04:32.876 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 08:04:32 smithi137 systemd[1]: Stopping Ceph mds.k for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:33.130 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 08:04:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k[64415]: 2024-09-19T08:04:32.876+0000 7f36f531c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:33.130 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 08:04:32 smithi137 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k[64415]: 2024-09-19T08:04:32.876+0000 7f36f531c640 -1 mds.k *** got signal Terminated *** 2024-09-19T08:04:37.154 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 08:04:36 smithi137 podman[72042]: 2024-09-19 08:04:36.891049348 +0000 UTC m=+4.124899314 container died 2c6a50bb65eeb168b7c687f9a08ee9f368a6b90c2435213ccc0f08ececd1831a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:04:37.527 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 08:04:37 smithi137 podman[72042]: 2024-09-19 08:04:37.284434275 +0000 UTC m=+4.518284241 container cleanup 2c6a50bb65eeb168b7c687f9a08ee9f368a6b90c2435213ccc0f08ececd1831a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:04:37.527 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 19 08:04:37 smithi137 bash[72042]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-k 2024-09-19T08:04:37.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T08:04:37.690 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:37.690 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T08:04:37.690 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T08:04:37.690 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.c 2024-09-19T08:04:38.060 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:04:37 smithi152 systemd[1]: Stopping Ceph mds.c for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:38.560 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:04:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c[65328]: 2024-09-19T08:04:38.091+0000 7fec365d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:38.561 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:04:38 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c[65328]: 2024-09-19T08:04:38.091+0000 7fec365d0640 -1 mds.c *** got signal Terminated *** 2024-09-19T08:04:40.298 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:04:39 smithi152 podman[72205]: 2024-09-19 08:04:39.938373157 +0000 UTC m=+2.032903664 container died 650a4bf9e60307ad4bfd36c6c248929f095f1c3ebea20505ad4b6722d7f22e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T08:04:40.560 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:04:40 smithi152 podman[72205]: 2024-09-19 08:04:40.380774586 +0000 UTC m=+2.475305093 container cleanup 650a4bf9e60307ad4bfd36c6c248929f095f1c3ebea20505ad4b6722d7f22e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T08:04:40.561 INFO:journalctl@ceph.mds.c.smithi152.stdout:Sep 19 08:04:40 smithi152 bash[72205]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-c 2024-09-19T08:04:40.784 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T08:04:40.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:40.821 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T08:04:40.821 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T08:04:40.821 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.f 2024-09-19T08:04:41.151 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:04:40 smithi152 systemd[1]: Stopping Ceph mds.f for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:41.560 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:04:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f[65028]: 2024-09-19T08:04:41.151+0000 7fdd71538640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:41.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:04:41 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f[65028]: 2024-09-19T08:04:41.151+0000 7fdd71538640 -1 mds.f *** got signal Terminated *** 2024-09-19T08:04:44.234 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:04:43 smithi152 podman[72335]: 2024-09-19 08:04:43.93641389 +0000 UTC m=+2.892952283 container died d14f998bad9fa215786ccfe8b81b146a40e5b839015fd34faca542f07338a2fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T08:04:44.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:04:44 smithi152 podman[72335]: 2024-09-19 08:04:44.33411763 +0000 UTC m=+3.290656012 container cleanup d14f998bad9fa215786ccfe8b81b146a40e5b839015fd34faca542f07338a2fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:04:44.561 INFO:journalctl@ceph.mds.f.smithi152.stdout:Sep 19 08:04:44 smithi152 bash[72335]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-f 2024-09-19T08:04:44.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T08:04:44.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:44.793 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T08:04:44.794 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T08:04:44.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.i 2024-09-19T08:04:45.121 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:04:44 smithi152 systemd[1]: Stopping Ceph mds.i for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:45.560 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:04:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: 2024-09-19T08:04:45.121+0000 7f28e3a3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:45.561 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:04:45 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i[65630]: 2024-09-19T08:04:45.121+0000 7f28e3a3f640 -1 mds.i *** got signal Terminated *** 2024-09-19T08:04:48.296 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:04:47 smithi152 podman[72457]: 2024-09-19 08:04:47.934000596 +0000 UTC m=+2.923865893 container died 7345404ec2922103f229f3f921858911095467fbe09fb40d896df7dba1501d63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T08:04:48.560 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:04:48 smithi152 podman[72457]: 2024-09-19 08:04:48.379201231 +0000 UTC m=+3.369066570 container cleanup 7345404ec2922103f229f3f921858911095467fbe09fb40d896df7dba1501d63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:04:48.561 INFO:journalctl@ceph.mds.i.smithi152.stdout:Sep 19 08:04:48 smithi152 bash[72457]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-i 2024-09-19T08:04:48.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T08:04:48.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:48.854 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T08:04:48.854 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T08:04:48.854 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.l 2024-09-19T08:04:49.060 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:04:48 smithi152 systemd[1]: Stopping Ceph mds.l for 6aad871c-765a-11ef-bceb-c7b262605968... 2024-09-19T08:04:49.560 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:04:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l[64726]: 2024-09-19T08:04:49.182+0000 7f19ed2ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:04:49.561 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:04:49 smithi152 ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l[64726]: 2024-09-19T08:04:49.182+0000 7f19ed2ce640 -1 mds.l *** got signal Terminated *** 2024-09-19T08:04:52.274 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:04:51 smithi152 podman[72581]: 2024-09-19 08:04:51.926836008 +0000 UTC m=+2.858367868 container died 8ce106d30132fbfd63c860c8dfd936c04d68081680711d91bcbc68bdcfb8c9b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T08:04:52.533 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:04:52 smithi152 podman[72581]: 2024-09-19 08:04:52.366170036 +0000 UTC m=+3.297701890 container cleanup 8ce106d30132fbfd63c860c8dfd936c04d68081680711d91bcbc68bdcfb8c9b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T08:04:52.533 INFO:journalctl@ceph.mds.l.smithi152.stdout:Sep 19 08:04:52 smithi152 bash[72581]: ceph-6aad871c-765a-11ef-bceb-c7b262605968-mds-l 2024-09-19T08:04:52.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6aad871c-765a-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T08:04:52.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:04:52.775 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T08:04:52.775 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:04:52.973 INFO:teuthology.orchestra.run.smithi076.stdout:Deleting cluster with fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T08:04:55.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:04:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T08:04:58.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:04:58.323 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T08:05:00.747 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:05:00.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:05:00.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:05:00.841 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T08:05:00.843 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi076/crash 2024-09-19T08:05:00.844 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:05:00.872 INFO:teuthology.orchestra.run.smithi076.stderr:tar: /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:05:00.872 INFO:teuthology.orchestra.run.smithi076.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:05:00.874 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi137/crash 2024-09-19T08:05:00.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:05:00.915 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:05:00.915 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:05:00.917 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi152/crash 2024-09-19T08:05:00.919 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:05:00.960 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/6aad871c-765a-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:05:00.960 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:05:00.961 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T08:05:00.961 DEBUG:teuthology.orchestra.run.smithi076:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T08:05:01.000 INFO:tasks.cephadm:Compressing logs... 2024-09-19T08:05:01.000 DEBUG:teuthology.orchestra.run.smithi076:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:05:01.042 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:05:01.045 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:05:01.067 INFO:teuthology.orchestra.run.smithi076.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T08:05:01.067 INFO:teuthology.orchestra.run.smithi076.stderr:: No such file or directory 2024-09-19T08:05:01.067 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T08:05:01.068 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:05:01.068 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:05:01.068 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T08:05:01.068 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:05:01.070 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T08:05:01.070 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T08:05:01.070 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.6% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:05:01.070 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T08:05:01.072 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:05:01.072 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2024-09-19T08:05:01.072 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:05:01.072 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T08:05:01.072 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T08:05:01.073 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:05:01.073 INFO:teuthology.orchestra.run.smithi076.stderr: 94.6% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T08:05:01.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:05:01.081 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T08:05:01.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T08:05:01.081 INFO:teuthology.orchestra.run.smithi152.stderr: 82.2% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:05:01.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T08:05:01.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:05:01.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T08:05:01.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:05:01.082 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:05:01.082 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T08:05:01.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T08:05:01.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:: No such file or directory 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:05:01.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr: 94.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.y.log: 82.2% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log: 87.4% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:05:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T08:05:01.090 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:05:01.090 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T08:05:01.090 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T08:05:01.090 INFO:teuthology.orchestra.run.smithi076.stderr: 94.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T08:05:01.090 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T08:05:01.091 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:05:01.091 INFO:teuthology.orchestra.run.smithi076.stderr: 94.7% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T08:05:01.091 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T08:05:01.091 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:05:01.091 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:05:01.091 INFO:teuthology.orchestra.run.smithi076.stderr: 94.7% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T08:05:01.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T08:05:01.092 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:05:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T08:05:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T08:05:01.097 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:05:01.098 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:05:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.9% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T08:05:01.108 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T08:05:01.122 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:05:01.143 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:05:01.322 INFO:teuthology.orchestra.run.smithi076.stderr: 90.2% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T08:05:01.508 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T08:05:01.533 INFO:teuthology.orchestra.run.smithi152.stderr: 94.8% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T08:05:01.550 INFO:teuthology.orchestra.run.smithi137.stderr: 91.8% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T08:05:01.925 INFO:teuthology.orchestra.run.smithi137.stderr: 95.4% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T08:05:02.293 INFO:teuthology.orchestra.run.smithi076.stderr: 90.4% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T08:05:04.000 INFO:teuthology.orchestra.run.smithi076.stderr: 92.2% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T08:05:04.403 INFO:teuthology.orchestra.run.smithi137.stderr: 91.6% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T08:05:04.678 INFO:teuthology.orchestra.run.smithi076.stderr: 91.8% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T08:05:04.896 INFO:teuthology.orchestra.run.smithi152.stderr: 95.4% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T08:05:05.071 INFO:teuthology.orchestra.run.smithi137.stderr: 92.0% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T08:05:05.180 INFO:teuthology.orchestra.run.smithi137.stderr: 92.1% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T08:05:05.291 INFO:teuthology.orchestra.run.smithi076.stderr: 92.0% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T08:05:05.698 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T08:05:05.699 INFO:teuthology.orchestra.run.smithi076.stderr: 91.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T08:05:05.701 INFO:teuthology.orchestra.run.smithi076.stderr: 2024-09-19T08:05:05.701 INFO:teuthology.orchestra.run.smithi076.stderr:real 0m4.646s 2024-09-19T08:05:05.702 INFO:teuthology.orchestra.run.smithi076.stderr:user 0m16.370s 2024-09-19T08:05:05.702 INFO:teuthology.orchestra.run.smithi076.stderr:sys 0m0.529s 2024-09-19T08:05:05.703 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T08:05:05.921 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T08:05:06.131 INFO:teuthology.orchestra.run.smithi152.stderr: 91.5% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T08:05:06.186 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T08:05:06.222 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T08:05:09.597 INFO:teuthology.orchestra.run.smithi137.stderr: 93.3% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T08:05:09.599 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-19T08:05:09.599 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m8.538s 2024-09-19T08:05:09.599 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m25.093s 2024-09-19T08:05:09.599 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.800s 2024-09-19T08:05:33.795 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/6aad871c-765a-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T08:05:33.797 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-19T08:05:33.797 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m32.737s 2024-09-19T08:05:33.797 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m59.877s 2024-09-19T08:05:33.797 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m1.819s 2024-09-19T08:05:33.797 INFO:tasks.cephadm:Archiving logs... 2024-09-19T08:05:33.798 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi076/log 2024-09-19T08:05:34.174 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:05:37.424 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi137/log 2024-09-19T08:05:37.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:05:41.150 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi152/log 2024-09-19T08:05:41.151 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:05:49.298 INFO:tasks.cephadm:Removing cluster... 2024-09-19T08:05:49.298 DEBUG:teuthology.orchestra.run.smithi076:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --force 2024-09-19T08:05:49.507 INFO:teuthology.orchestra.run.smithi076.stdout:Deleting cluster with fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T08:05:49.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --force 2024-09-19T08:05:49.990 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T08:05:50.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6aad871c-765a-11ef-bceb-c7b262605968 --force 2024-09-19T08:05:50.481 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 6aad871c-765a-11ef-bceb-c7b262605968 2024-09-19T08:05:50.799 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T08:05:50.799 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:05:50.817 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:05:50.835 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:05:50.851 INFO:tasks.cephadm:Teardown complete 2024-09-19T08:05:50.851 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T08:05:50.863 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T08:05:50.864 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:05:50.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:05:50.877 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:05:50.986 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T08:05:50.996 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T08:05:50.997 DEBUG:teuthology.orchestra.run.smithi076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:05:51.000 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:05:51.002 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:05:51.013 INFO:teuthology.orchestra.run.smithi076.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:05:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:05:51.016 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:05:51.017 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:05:51.018 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-09-19T08:05:51.018 INFO:teuthology.orchestra.run.smithi076.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +1254us[+1257us] +/- 42ms 2024-09-19T08:05:51.018 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -3122us[-3122us] +/- 62ms 2024-09-19T08:05:51.018 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +1402us[+1402us] +/- 61ms 2024-09-19T08:05:51.018 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:05:51.020 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:05:51.020 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-19T08:05:51.020 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv01.front.sepia.ceph.com 3 7 377 81 +1249us[+1250us] +/- 41ms 2024-09-19T08:05:51.020 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -3163us[-3163us] +/- 62ms 2024-09-19T08:05:51.020 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1378us[+1378us] +/- 61ms 2024-09-19T08:05:51.020 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:05:51.022 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:05:51.022 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-19T08:05:51.022 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 7 377 15 +1283us[+1264us] +/- 42ms 2024-09-19T08:05:51.022 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -3124us[-3143us] +/- 62ms 2024-09-19T08:05:51.022 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +1411us[+1392us] +/- 61ms 2024-09-19T08:05:51.022 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:05:51.022 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T08:05:51.032 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T08:05:51.033 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T08:05:51.054 DEBUG:teuthology.orchestra.run.smithi076:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:05:51.144 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:05:51.218 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:05:51.286 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:05:51.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:05:51.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:05:51.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:05:51.345 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:05:51.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:05:51.374 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T08:05:51.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T08:05:51.413 INFO:teuthology.task.internal:Duration was 1881.804436 seconds 2024-09-19T08:05:51.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T08:05:51.446 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T08:05:51.446 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:05:51.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:05:51.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:05:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:05:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:05:51.491 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:05:51.953 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T08:05:51.953 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi076.front.sepia.ceph.com 2024-09-19T08:05:51.954 DEBUG:teuthology.orchestra.run.smithi076:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:05:51.974 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-19T08:05:51.975 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:05:52.025 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-19T08:05:52.025 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:05:52.055 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T08:05:52.055 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:05:52.058 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:05:52.067 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:05:52.122 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T08:05:52.122 DEBUG:teuthology.orchestra.run.smithi076:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:05:52.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:05:52.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:05:53.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T08:05:53.330 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T08:05:53.331 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:05:53.355 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:05:53.386 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:05:53.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T08:05:53.429 DEBUG:teuthology.orchestra.run.smithi076:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:05:53.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:05:53.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:05:53.453 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = core 2024-09-19T08:05:53.459 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-19T08:05:53.484 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-19T08:05:53.797 DEBUG:teuthology.orchestra.run.smithi076:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:05:53.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:05:53.812 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:05:53.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:05:53.830 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:05:53.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:05:53.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T08:05:53.867 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T08:05:53.868 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi076 2024-09-19T08:05:53.868 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:05:53.937 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi137 2024-09-19T08:05:53.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:05:53.978 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911815/remote/smithi152 2024-09-19T08:05:53.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:05:54.019 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T08:05:54.019 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:05:54.022 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:05:54.024 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:05:54.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T08:05:54.085 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T08:05:54.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T08:05:54.104 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T08:05:54.104 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:05:54.107 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:05:54.109 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:05:54.119 INFO:teuthology.orchestra.run.smithi076.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:05 /home/ubuntu/cephtest 2024-09-19T08:05:54.125 INFO:teuthology.orchestra.run.smithi137.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:05 /home/ubuntu/cephtest 2024-09-19T08:05:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:05 /home/ubuntu/cephtest 2024-09-19T08:05:54.132 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T08:05:54.148 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T08:05:54.225 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1881.8044357299805 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T08:05:54.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:05:54.307 INFO:teuthology.run:pass